-- Logs begin at Wed 2022-11-02 11:29:32 UTC, end at Wed 2022-11-02 14:21:06 UTC. -- Nov 02 12:07:38.987557 n-d-855650-5 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 12:07:38.997325 n-d-855650-5 devstack@n-api.service[104816]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:07:38 2022] *** Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: nodename: n-d-855650-5 Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: machine: x86_64 Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: clock source: unix Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: pcre jit disabled Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: detected number of CPU cores: 4 Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: current working directory: / Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: your processes number limit is 47680 Nov 02 12:07:38.999368 n-d-855650-5 devstack@n-api.service[104816]: your memory page size is 4096 bytes Nov 02 12:07:39.000833 n-d-855650-5 devstack@n-api.service[104816]: detected max file descriptor number: 2048 Nov 02 12:07:39.000833 n-d-855650-5 devstack@n-api.service[104816]: lock engine: pthread robust mutexes Nov 02 12:07:39.000833 n-d-855650-5 devstack@n-api.service[104816]: thunder lock: enabled Nov 02 12:07:39.000833 n-d-855650-5 devstack@n-api.service[104816]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 12:07:39.000833 n-d-855650-5 devstack@n-api.service[104816]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:07:39.038377 n-d-855650-5 devstack@n-api.service[104816]: Python main interpreter initialized at 0x5597376859c0 Nov 02 12:07:39.038377 n-d-855650-5 devstack@n-api.service[104816]: python threads support enabled Nov 02 12:07:39.038377 n-d-855650-5 devstack@n-api.service[104816]: your server socket listen backlog is limited to 100 connections Nov 02 12:07:39.038377 n-d-855650-5 devstack@n-api.service[104816]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:07:39.038787 n-d-855650-5 devstack@n-api.service[104816]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:07:39.038787 n-d-855650-5 devstack@n-api.service[104816]: *** Operational MODE: preforking *** Nov 02 12:07:39.039053 n-d-855650-5 devstack@n-api.service[104816]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:07:39.039053 n-d-855650-5 devstack@n-api.service[104816]: spawned uWSGI master process (pid: 104816) Nov 02 12:07:39.039262 n-d-855650-5 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 12:07:39.040094 n-d-855650-5 devstack@n-api.service[104816]: spawned uWSGI worker 1 (pid: 104817, cores: 1) Nov 02 12:07:39.041462 n-d-855650-5 devstack@n-api.service[104816]: spawned uWSGI worker 2 (pid: 104818, cores: 1) Nov 02 12:07:39.041462 n-d-855650-5 devstack@n-api.service[104816]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:07:39.704712 n-d-855650-5 devstack@n-api.service[104817]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:07:39.706551 n-d-855650-5 devstack@n-api.service[104818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:07:40.782387 n-d-855650-5 devstack@n-api.service[104817]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:07:40.782387 n-d-855650-5 devstack@n-api.service[104817]: from cryptography.utils import int_from_bytes Nov 02 12:07:40.783014 n-d-855650-5 devstack@n-api.service[104817]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:07:40.783014 n-d-855650-5 devstack@n-api.service[104817]: from cryptography.utils import int_from_bytes Nov 02 12:07:40.786825 n-d-855650-5 devstack@n-api.service[104818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:07:40.786825 n-d-855650-5 devstack@n-api.service[104818]: from cryptography.utils import int_from_bytes Nov 02 12:07:40.787256 n-d-855650-5 devstack@n-api.service[104818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:07:40.787256 n-d-855650-5 devstack@n-api.service[104818]: from cryptography.utils import int_from_bytes Nov 02 12:07:43.332759 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:07:43.333359 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:07:43.333707 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:07:43.333900 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:07:43.334105 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:07:43.334537 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:07:43.334619 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:07:43.334697 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.334895 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.334990 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:07:43.335154 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.335265 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:07:43.335804 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:07:43.335885 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.335885 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.336018 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.336089 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.336167 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.336388 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.336487 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.336683 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.336806 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.336999 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.337098 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.337256 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.337355 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.337562 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.337670 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.337880 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-855650-5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.337991 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.338226 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.338325 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.338532 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.338645 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.338865 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.338963 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.339194 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-855650-5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.339286 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.339493 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.339589 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.339807 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.339899 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.340107 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.340203 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.340422 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.340608 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.340726 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.341761 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.341906 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342068 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342212 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342212 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342422 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342538 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342676 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342771 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342853 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.342932 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.343066 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.343155 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.343240 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.343378 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.343503 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.343592 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.343682 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.343896 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.344013 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.344232 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.344327 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-855650-5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.344584 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.344802 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.344897 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.344979 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.345185 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.345277 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-855650-5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.345530 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.345663 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.345886 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.346570 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.346570 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.346773 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.346854 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.346943 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.347029 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.347112 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.347198 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.347284 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.347395 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.347489 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.347706 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.347803 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.348017 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.348111 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.348330 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.348423 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.348630 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.348779 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.348931 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.349025 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.349239 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.349329 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.349554 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.349671 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.349849 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.349978 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.350178 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.350278 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.350422 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.350546 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.350724 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.350850 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.351039 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.351153 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.351354 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.351453 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.351668 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.351765 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.351915 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.352086 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.352170 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.352300 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.352459 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.352624 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.352769 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.352884 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.353066 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.353164 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.353367 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.353517 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.353672 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.353837 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.354099 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.354191 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.354281 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.354362 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.355092 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.355185 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.355398 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.355500 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.355699 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.355842 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.356003 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.356091 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.356311 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.356398 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.356624 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.356722 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.356925 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.357018 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.357241 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.357328 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.357558 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.357656 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.357862 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.357954 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.358191 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.358281 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.358524 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.358620 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.358817 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.358922 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.359123 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.359216 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.359434 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.359532 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.359753 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.359840 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.360055 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.360147 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.360356 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.360455 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.360659 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.360745 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.360967 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.361059 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.361271 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.361365 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.361579 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.361695 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.361824 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.361920 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.362138 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.362257 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.362440 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.362563 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.362752 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.362848 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.363052 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.363146 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.363357 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.363463 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.363658 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.363797 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.363941 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.364100 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.364230 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.364320 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.364526 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.364624 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.364826 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.364920 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.365162 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.365272 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.365425 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.365519 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.365747 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.365848 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.366045 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.366135 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.366348 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.366444 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.366649 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.366743 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.366950 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.367036 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.367280 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.367392 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.367560 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.367654 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.367860 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.367953 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.368169 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.368266 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.368469 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.368557 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.368770 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.368871 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.369075 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.369182 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.369369 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.369456 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.369667 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.369752 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.370005 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.370170 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.370845 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.370940 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.371146 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.371239 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.371458 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.371557 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.371761 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.371853 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.372061 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.372147 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.372373 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.372466 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.372669 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.372822 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.372967 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.373062 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.373278 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.373491 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.373584 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.373716 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.373867 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.374022 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.374188 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.374322 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.374487 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.374581 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.374789 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.374875 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.375088 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.375190 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.375387 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.375533 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.375670 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.375805 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.375950 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.376099 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.376258 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.376389 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.376565 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.376714 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.376855 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.376990 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.377157 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.377304 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.377456 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.377604 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.377763 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.377898 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.378091 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.378225 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.378396 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.378541 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.378711 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:07:43.378848 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.379046 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.379214 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.379368 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.379584 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.379719 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.379854 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.379988 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.380128 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.380271 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.380406 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.380564 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.380709 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.380880 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.381011 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.381190 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.381334 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.381496 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.381632 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.381800 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.381935 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.382136 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.382274 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.382448 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.382590 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.382770 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.382915 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.383083 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.383231 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.383395 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.383533 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.383705 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.383848 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.383992 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.384135 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.384308 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.384445 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.384622 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.384722 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.384932 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.385019 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.385236 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.385323 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.385560 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.385655 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.385927 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.386085 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.386264 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.386400 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.386585 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.386746 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.386903 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.387088 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.387211 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.387402 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.387521 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.387728 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.387816 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.388052 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.388138 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.388367 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.388470 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.388679 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.388767 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.388990 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.389084 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.389328 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.389429 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.389641 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.389729 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.389950 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.390092 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.390280 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.390379 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.390589 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.390676 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.390895 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.390982 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.391202 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.391301 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.391510 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.391597 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.391820 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.391908 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.392128 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.392224 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.392435 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.392528 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.392742 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.392829 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.393054 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.393142 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.393360 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.393455 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.393666 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.393760 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.393987 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.394131 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.394293 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.394381 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.394594 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.394692 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.394893 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.394982 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.395204 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.395330 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.395501 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.395601 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.395805 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.395900 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.396106 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.396193 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.396412 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.396527 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.396719 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.396814 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.397026 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.397113 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.397334 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.397496 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.397639 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.397725 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.397943 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.398108 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.398276 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.398386 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.398581 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.398675 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.398886 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.398982 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.399189 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.399285 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.399488 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.399577 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.399796 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.399885 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.400094 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.400182 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.400393 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.400478 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.400701 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.400795 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.401002 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.401090 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.401304 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.401412 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.401635 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.401729 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.401938 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.402100 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.402264 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.402352 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.402573 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.402666 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.402881 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.402974 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.403190 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.403276 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.403499 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.403593 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.403808 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.403894 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.404130 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.404216 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.404429 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.404526 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.404737 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.404824 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.405056 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.405141 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.405367 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.405464 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.405668 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.405756 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.405987 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.406079 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.406297 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.406431 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.406597 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.406684 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.406895 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.406991 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.407199 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.407287 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.407497 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.407587 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.407797 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.407889 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.408094 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.408187 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.408393 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.408479 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.408690 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.408775 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.408992 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.409086 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.409293 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.409391 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.409596 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.409685 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.409894 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.410006 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.410230 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.410322 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.410534 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.410630 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.410836 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.410923 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.411135 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.411234 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.411434 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.411531 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.411773 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.411872 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.412077 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.412164 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.412396 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.412490 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.412708 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.412798 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.413014 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.413100 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.413321 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.413417 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.413628 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.413715 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.413933 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.414111 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.414265 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.414360 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.414571 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.414665 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.414880 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.414976 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.415186 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.415275 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.415502 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.415587 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.415808 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.415904 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.416122 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.416210 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.416420 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.416540 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.416730 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.416827 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.417551 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.417647 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.417869 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.417958 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.418195 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.418282 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.418510 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.418608 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.418819 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.418905 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.419394 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.419493 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.419702 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.419800 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.420013 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.420107 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.420323 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.420419 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.420629 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.420726 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.420936 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.421022 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.421248 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.421379 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.421562 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.421664 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.421868 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.421996 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.422206 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.422313 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.422512 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.422608 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.422827 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.422925 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.423123 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.423220 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.423435 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.423521 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.423740 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.423826 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.424056 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.424144 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.424359 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.424447 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.424665 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.424754 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.424980 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.425071 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.425285 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.425372 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.425589 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.425676 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.425898 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.426059 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.426221 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.426378 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.426522 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.426692 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.426831 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.426997 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.427124 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.427314 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.427421 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.427619 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.427710 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.427924 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.428019 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.428231 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.428327 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.428544 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.428632 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.428853 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.428946 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.429160 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.429253 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.429463 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.429551 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.429774 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.429860 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.430103 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.430194 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.430415 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.430517 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.430710 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.430798 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.431009 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.431173 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.431310 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.431397 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.431624 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.431719 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.431926 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.432024 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.432226 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.432312 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.432523 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.432656 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.433373 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.433562 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.433690 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.433780 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.434017 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.434109 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.434324 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.434431 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.434624 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.434717 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.434925 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.435013 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.435239 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.435327 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.435553 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.435647 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.435852 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.435939 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.436165 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.436303 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.436478 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.436571 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.436789 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.436922 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.437093 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.437182 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.437402 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.437499 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.437711 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.437799 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.438040 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.438132 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.438350 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.438485 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.438659 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.438756 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.438967 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.439063 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.439275 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.439361 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.439581 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.439675 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.439882 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.439969 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.440195 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.440290 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.440510 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.440631 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.440814 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.441071 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.441160 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.441401 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.441489 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.441710 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.441797 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.442049 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.442138 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.442392 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.442617 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.442715 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.442955 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.443043 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.443271 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.443360 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.443593 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.443692 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.443945 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.444042 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.444264 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.444352 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.444568 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.444655 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.444877 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.444976 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.445186 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.445277 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.445489 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.445576 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.445790 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.445913 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.446114 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.446233 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.446423 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.446530 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.446716 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.446855 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.447023 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.447122 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.447306 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.447398 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.447609 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.447700 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.447920 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.448007 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.448243 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.448340 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.448546 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.448633 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.448845 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.448931 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.449146 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.449245 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.449458 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.449545 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.449758 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.449853 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.450082 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.450189 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.450384 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.450479 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.450703 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.450802 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.451012 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.451109 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.451316 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.451404 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.451619 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.451706 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.451921 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.452022 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.452260 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.452348 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.452558 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.452645 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.452876 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.452964 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.453177 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.453324 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.453476 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.453597 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.453772 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.453862 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.454101 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.454192 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.454406 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.454494 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.454702 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.454791 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.455007 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.455096 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.455311 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.455401 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.455618 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.455707 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.455919 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.456005 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.456216 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.456313 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.456519 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.456607 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.456817 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.456905 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.457128 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.457226 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.457434 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.457520 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.457729 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.457814 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.458048 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.458153 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.458354 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.458441 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.458656 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.458742 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.458954 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.459051 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.459254 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.459348 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.459560 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.459655 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.459860 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.459948 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.460163 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.460249 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.460468 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.460570 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.460771 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.461005 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.461214 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.461467 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.461705 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.461779 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.461859 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.462003 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.462136 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.462242 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.462433 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.462519 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.462626 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.462893 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.462985 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.463314 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.463400 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.463480 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.463557 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.463776 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.463914 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.464156 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.464320 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.464424 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.464615 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.464778 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.464911 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.465097 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.465256 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.465406 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.465492 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.465572 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.465651 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.465879 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.466002 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.466208 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.466307 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.466514 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.466602 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.466814 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.466910 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.467115 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.467225 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.467412 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.467507 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.467711 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.467808 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.468011 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.468099 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.468321 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.468417 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.468620 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.468756 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.468918 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.469005 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.469217 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.469311 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.469513 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.469609 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.469810 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.469906 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.470155 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.470244 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.470467 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.470563 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.470770 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.470857 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.471074 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.471160 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.471374 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.471464 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.471694 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.471781 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.472000 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.472096 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.472309 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.472399 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.472614 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.472729 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.472924 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.473021 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.473231 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.473321 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.473538 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.473626 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.473836 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.473949 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.474159 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.474259 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.474460 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.474548 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.474773 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.474869 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.475080 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.475175 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.475391 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.475478 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.475697 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.475794 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.476000 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.476089 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.476298 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.476385 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.476607 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.476729 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.476908 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.476997 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.477256 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.477343 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.477504 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.477605 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.477809 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.477906 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.478148 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.478238 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.478456 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.478544 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.478760 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.478885 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.479064 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.479151 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.479369 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.479963 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.480193 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.480280 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.480503 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.480591 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.480807 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.480895 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.481109 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.481204 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.481416 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.481503 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.481721 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.481810 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.482043 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.482136 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.482349 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.482450 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.482650 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.482738 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.482949 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.483036 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.483247 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.483343 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.483563 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.483674 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.483869 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.483990 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.484179 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.484362 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.484483 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.484593 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.484790 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.484879 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.485091 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.485180 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.485437 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.485560 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.485744 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.485839 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.486071 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.486162 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.486422 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.486511 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.486730 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.486825 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.487038 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.487126 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.487351 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.487439 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.487647 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.487733 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.487944 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.488041 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.488247 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.488343 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.488562 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.488658 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.488859 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.488984 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.489157 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.489244 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.489454 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.489551 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.489769 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.489858 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.490092 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.490184 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.490407 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.490509 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.490725 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.490818 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.491026 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.491115 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.491327 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.491431 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.491644 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.491792 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.491947 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.492100 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.492264 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.492407 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.492675 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.492763 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.492988 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.493083 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.493290 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.493400 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.493615 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.493712 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.493922 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.494096 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.494252 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.494341 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.494568 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.494666 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.494886 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.494974 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.495778 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.495883 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.496083 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.496240 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.496384 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.496479 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.496690 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.496777 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.497005 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.497104 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.497315 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.497411 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.497629 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.497725 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.497941 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.498096 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.498266 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.498354 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.498589 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.498696 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.498911 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.498998 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.499225 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.499321 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.499543 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.499641 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.499839 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.499953 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.500145 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.500272 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.500443 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.500580 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.500747 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.500898 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.501061 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.501219 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.501360 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.501521 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.501665 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.501822 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.501986 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.502157 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.502293 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.502460 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.502592 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.502762 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.502892 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.503081 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.503207 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.503383 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.503506 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.503690 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.503824 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.504000 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.504132 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.504309 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.504448 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.504611 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.504761 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.504914 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.505062 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.505235 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.505377 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.505540 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.505681 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.505859 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.505994 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.506195 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.506284 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.506517 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.506616 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.506837 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.506926 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.507143 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.507232 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.507462 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.507595 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.507776 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.507866 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.508078 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.508165 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.508380 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.508476 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.508682 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.508770 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.509019 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.509106 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.509322 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.509425 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.509628 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.509718 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.509941 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.510101 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.510291 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.510390 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.510590 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.510696 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.510915 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.511004 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.511221 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.511318 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.511522 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.511610 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.511820 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.511908 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.512117 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.512207 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.512424 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.512513 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.512720 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.512808 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.513018 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.513107 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.513314 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.513404 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.513631 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.513719 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.513931 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.514057 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.514271 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.514366 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.514578 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.514680 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.514875 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.514964 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.515174 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.515260 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.515468 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.515568 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.515784 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.515871 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.516090 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.516192 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.516408 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.516506 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.516714 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.516802 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.517019 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.517105 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.517326 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.517426 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.517631 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.517719 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.517944 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.518101 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.518277 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.518391 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.518589 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.518714 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.518897 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.518983 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.519206 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.519329 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.519513 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.519602 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.519826 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.519913 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.520135 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.520229 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.520448 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.520536 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.520763 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.520998 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.521095 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.521329 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.521451 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.521639 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.521741 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.521949 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.522077 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.522280 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.522370 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.522588 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.522684 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.522898 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.523133 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.523219 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.523463 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.523561 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.523776 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.523941 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.524089 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.524186 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.524404 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.524505 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.524715 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.524813 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.525027 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.525132 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.525335 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.525437 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.525645 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.525735 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.525957 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.526112 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.526285 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.526375 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.526620 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.526713 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.526961 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.527062 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.527271 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.527369 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.527574 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.527660 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.527886 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.527976 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.528198 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.528304 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.528506 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.528595 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.528814 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.528902 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.529121 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.529218 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.529429 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.529538 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.529736 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.529824 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.530067 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.530160 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.530375 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.530475 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.530684 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.530772 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.530992 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.531080 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.531298 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.531399 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.531608 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.531697 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.531919 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.532008 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.532230 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.532319 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.532537 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.532637 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.532843 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.532930 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.533150 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.533239 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.533460 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.533657 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.533782 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.533989 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.534154 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.534312 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.534474 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.534632 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.534789 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.534948 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.535102 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.535259 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.535418 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.535571 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.535892 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.535979 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.536194 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.536282 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.536493 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.536583 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.536797 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.536894 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.537102 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.537191 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.537401 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.537490 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.537717 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.537806 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.538062 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.538164 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.538363 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.538453 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.538679 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.538767 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.538983 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.539091 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.539289 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.539509 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.539629 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.539858 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.539960 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.540173 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.540265 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.540481 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.540569 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.540802 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.540890 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.541114 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.541203 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.541416 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.541651 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.541782 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.542580 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.542699 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.542840 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.542930 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.543163 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.543250 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.543473 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.543561 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.543773 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.543862 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.544343 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.544444 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.544676 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.544789 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.544956 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.545051 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.545254 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.545345 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.545563 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.545652 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.545862 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.545950 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.546196 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.546284 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.546502 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.546595 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.546802 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.546889 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.547103 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.547200 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.547404 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.547492 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.547703 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.547790 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.548003 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.548139 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.548305 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.548391 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.548606 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.548695 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.548913 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.549062 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.549213 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.549303 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.549517 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.549648 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.549816 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.549923 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.550144 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.550235 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.550448 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.550536 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.550749 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.550837 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.551057 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.551144 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.551360 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.551447 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.551663 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.551751 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.551961 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.552050 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.552272 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.552359 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.552576 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.552665 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.552892 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.552980 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.553192 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.553279 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.553548 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.553645 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.553803 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.553900 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.554126 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.554229 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.554443 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.554697 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.554817 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.555029 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.555132 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.555347 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.555448 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.555652 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.555740 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.555982 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.556080 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.556285 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.556374 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.556585 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.556814 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.556911 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.557150 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.557250 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.557474 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.557570 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.558372 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.558487 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.558701 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.558801 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.559010 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.559115 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.559319 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.559415 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.559622 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.559724 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.559929 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.560025 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.560234 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.560323 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.560541 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.560639 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.560845 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.560935 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.561154 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.561251 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.561458 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.561546 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.561766 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.561869 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.562093 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.562198 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.562402 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.562490 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.562710 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.562798 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.563017 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.563114 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.563326 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.563414 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.563635 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.563723 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.563944 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.564033 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.564248 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.564344 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.564551 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.564639 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.564864 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.564954 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.565166 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.565262 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.565476 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.565564 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.565794 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.565883 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.566124 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.566213 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.566427 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.566515 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.566733 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.567041 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.567159 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.567352 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.567506 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.567673 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.567818 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.567967 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.568128 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.568276 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.568402 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.568569 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.568807 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.568938 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.569248 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.569337 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.569560 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.569648 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.569873 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.569991 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.570218 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.570310 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.570531 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.570622 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.570855 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.570944 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.571177 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.571265 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.571481 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.571571 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.571781 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.571871 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.572082 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.572170 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.572389 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.572486 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.572735 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.572838 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.573040 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.573138 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.573367 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.573464 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.573667 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.573762 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.574008 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.574117 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.574292 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.574381 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.574599 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.574688 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.574899 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.574993 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.575200 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.575299 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.575500 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.575596 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.575795 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.575884 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.576093 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.576183 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.576393 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.576483 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.576690 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.576780 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.576989 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.577077 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.577286 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.577391 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.577591 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.577680 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.577894 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.578037 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.578228 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.578315 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.578540 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.578696 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.578835 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.578925 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.579134 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.579229 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.579436 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.579534 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.579742 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.579829 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.580045 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.580160 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.580344 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.580433 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.580643 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.580733 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.580945 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.581047 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.581244 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.581333 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.581565 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.581651 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.581879 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.582001 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.582215 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.582304 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.582522 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.582623 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.582884 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.582979 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.583142 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.583229 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.583450 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.583539 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.583757 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.583847 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.584062 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.584150 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.584367 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.584456 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.584671 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.584760 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.584993 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.585096 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.585303 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.585445 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.585605 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.585700 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.585913 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.586020 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.586249 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.586351 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.586562 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.586649 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.586871 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.586959 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.587177 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.587274 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.587503 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.587592 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.587807 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.587900 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.588112 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.588216 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.588419 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.588506 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.588726 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.588878 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.589059 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.589148 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.589369 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.589499 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.589674 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.589768 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.589995 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.590142 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.590309 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.590396 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.590615 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.590702 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.590924 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.591014 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.591233 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.591322 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.591540 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.591635 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.591846 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.591933 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.592156 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.592244 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.592469 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.592569 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.592783 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.592870 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.593106 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.593194 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.593426 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.593522 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.593734 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.593822 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.594063 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.594155 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.594365 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.594466 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.594604 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104817) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:07:43.594790 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.595048 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.595388 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.595712 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.596024 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.596334 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.596639 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:07:43.596878 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:07:43.749908 n-d-855650-5 devstack@n-api.service[104817]: INFO dbcounter [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Registered counter for database nova_api Nov 02 12:07:43.751997 n-d-855650-5 devstack@n-api.service[104818]: INFO dbcounter [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Registered counter for database nova_api Nov 02 12:07:43.772317 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_db.sqlalchemy.engines [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:07:43.776986 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:07:43.779820 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writer thread running {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:07:43.784393 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writer thread running {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:07:43.838248 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.context [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) {{(pid=104817) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:07:43.842042 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.842520 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.843582 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.context [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) {{(pid=104818) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:07:43.844117 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.844834 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.845276 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.847318 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.847488 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_concurrency.lockutils [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.847966 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_concurrency.lockutils [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.849302 n-d-855650-5 devstack@n-api.service[104817]: INFO dbcounter [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Registered counter for database nova_cell0 Nov 02 12:07:43.849560 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_concurrency.lockutils [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.850327 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_concurrency.lockutils [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.850775 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_concurrency.lockutils [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.852795 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_concurrency.lockutils [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.853508 n-d-855650-5 devstack@n-api.service[104817]: INFO dbcounter [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Registered counter for database nova_cell1 Nov 02 12:07:43.854889 n-d-855650-5 devstack@n-api.service[104818]: INFO dbcounter [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Registered counter for database nova_cell0 Nov 02 12:07:43.859210 n-d-855650-5 devstack@n-api.service[104818]: INFO dbcounter [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Registered counter for database nova_cell1 Nov 02 12:07:43.861003 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_db.sqlalchemy.engines [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:07:43.864297 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_db.sqlalchemy.engines [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:07:43.866328 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:07:43.868238 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writer thread running {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:07:43.871270 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:07:43.872219 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writer thread running {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:07:43.872851 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writer thread running {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:07:44.014932 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writer thread running {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:07:44.017298 n-d-855650-5 devstack@n-api.service[104817]: INFO dbcounter [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Registered counter for database nova_cell0 Nov 02 12:07:44.024392 n-d-855650-5 devstack@n-api.service[104818]: INFO dbcounter [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Registered counter for database nova_cell0 Nov 02 12:07:44.026667 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_db.sqlalchemy.engines [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104817) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:07:44.033411 n-d-855650-5 devstack@n-api.service[104818]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:07:44.033708 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writer thread running {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:07:44.038506 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writer thread running {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:07:44.378324 n-d-855650-5 devstack@n-api.service[104817]: WARNING keystonemiddleware.auth_token [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:07:44.380104 n-d-855650-5 devstack@n-api.service[104818]: WARNING keystonemiddleware.auth_token [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:07:44.385606 n-d-855650-5 devstack@n-api.service[104817]: WARNING keystonemiddleware.auth_token [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:07:44.387501 n-d-855650-5 devstack@n-api.service[104818]: WARNING keystonemiddleware.auth_token [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:07:44.728724 n-d-855650-5 devstack@n-api.service[104817]: WARNING keystonemiddleware.auth_token [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:07:44.733355 n-d-855650-5 devstack@n-api.service[104818]: WARNING keystonemiddleware.auth_token [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:07:44.735217 n-d-855650-5 devstack@n-api.service[104817]: WARNING keystonemiddleware.auth_token [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:07:44.739371 n-d-855650-5 devstack@n-api.service[104818]: WARNING keystonemiddleware.auth_token [None req-0ae915aa-b108-4610-80f0-31f7f3596677 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:07:44.741384 n-d-855650-5 devstack@n-api.service[104817]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597376859c0 pid: 104817 (default app) Nov 02 12:07:44.743534 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:44.744726 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001767 Nov 02 12:07:44.745148 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Wed Nov 2 12:07:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:44.745596 n-d-855650-5 devstack@n-api.service[104818]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597376859c0 pid: 104818 (default app) Nov 02 12:09:08.762115 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:08.763017 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Nov 02 12:09:08.763411 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:08.775551 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writing DB stats nova_api:SELECT=3 {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:08.776559 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writing DB stats nova_cell0:SELECT=3 {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:08.777569 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writing DB stats nova_cell1:SELECT=3 {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:08.778615 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:09.705352 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-c93a6e6d-d2c7-43a7-8adc-9870b5a70a8b admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:09.737942 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-c93a6e6d-d2c7-43a7-8adc-9870b5a70a8b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.967488 Nov 02 12:09:09.738826 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:09:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:12.432138 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:12.433185 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-0480e148-428e-44bd-9da1-f9f8c5f4ecac None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 02 12:09:12.434233 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:12.919619 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-ec729f31-3ae5-43be-b202-3184c7f03822 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:12.968277 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-ec729f31-3ae5-43be-b202-3184c7f03822 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.527676 Nov 02 12:09:12.968842 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:12.983527 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writing DB stats nova_api:SELECT=3 {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:12.984461 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writing DB stats nova_cell1:SELECT=3 {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:12.985444 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writing DB stats nova_cell0:SELECT=3 {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:12.986261 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:13.203872 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-d1b6e786-c0c8-4ed8-a65e-446c234c570a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:13.280112 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-d1b6e786-c0c8-4ed8-a65e-446c234c570a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302563 Nov 02 12:09:13.280699 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Nov 2 12:09:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:15.950630 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-ec729f31-3ae5-43be-b202-3184c7f03822 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:15.951535 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-ec729f31-3ae5-43be-b202-3184c7f03822 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Nov 02 12:09:15.952114 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:16.777830 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-4dd7a251-c5e7-4e89-878d-7050a9ed112d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:16.828524 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-4dd7a251-c5e7-4e89-878d-7050a9ed112d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.869835 Nov 02 12:09:16.843861 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-ef245a4d-4509-413c-be79-3803e3760a53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:16.852271 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:09:16.912848 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-ef245a4d-4509-413c-be79-3803e3760a53 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072663 Nov 02 12:09:16.920524 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Nov 2 12:09:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:19.756429 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-4dd7a251-c5e7-4e89-878d-7050a9ed112d admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:19.757616 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-4dd7a251-c5e7-4e89-878d-7050a9ed112d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Nov 02 12:09:19.758156 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:20.519320 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-15eee585-bada-48f5-aedb-106b92e0f979 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:20.539900 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-15eee585-bada-48f5-aedb-106b92e0f979 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.775054 Nov 02 12:09:20.542009 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:20.553411 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-402d22d8-022b-470c-ac30-6a8f734f50da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:20.583389 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-402d22d8-022b-470c-ac30-6a8f734f50da admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033714 Nov 02 12:09:20.584064 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Nov 2 12:09:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:23.241742 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-15eee585-bada-48f5-aedb-106b92e0f979 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:23.242782 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-15eee585-bada-48f5-aedb-106b92e0f979 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 02 12:09:23.243373 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:23.765402 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-e2cf95a7-53f8-44e2-b140-5b7bb78a4980 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "swap": 0}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:23.794399 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-e2cf95a7-53f8-44e2-b140-5b7bb78a4980 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.544363 Nov 02 12:09:23.797526 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:23.808976 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-130f1823-d86d-4b28-823d-54a99ff1eb7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:23.850627 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-130f1823-d86d-4b28-823d-54a99ff1eb7f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045532 Nov 02 12:09:23.851440 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Nov 2 12:09:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:26.636990 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-e2cf95a7-53f8-44e2-b140-5b7bb78a4980 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:26.638819 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-e2cf95a7-53f8-44e2-b140-5b7bb78a4980 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002351 Nov 02 12:09:26.639477 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:27.132031 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-f151f889-644d-457b-a55a-51d11f6e0276 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:27.155395 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-f151f889-644d-457b-a55a-51d11f6e0276 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509183 Nov 02 12:09:27.164979 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:27.176782 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-0ab55a1d-c598-48ad-8a61-5a543930761b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:27.239955 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-0ab55a1d-c598-48ad-8a61-5a543930761b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072875 Nov 02 12:09:27.255354 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Nov 2 12:09:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:29.900204 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-f151f889-644d-457b-a55a-51d11f6e0276 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:29.901257 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-f151f889-644d-457b-a55a-51d11f6e0276 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 02 12:09:29.904240 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:30.440917 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-30e3764c-2566-4039-906b-d53ef8aaadaf admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:30.471816 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-30e3764c-2566-4039-906b-d53ef8aaadaf admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.563335 Nov 02 12:09:30.472611 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:09:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:09:33.207615 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-f151f889-644d-457b-a55a-51d11f6e0276 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:33.209910 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-f151f889-644d-457b-a55a-51d11f6e0276 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002434 Nov 02 12:09:33.210584 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:33.718044 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-67bfd651-a4ce-41ca-a7cb-6ff680b09409 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "id": "1"}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:33.740848 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-67bfd651-a4ce-41ca-a7cb-6ff680b09409 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.523482 Nov 02 12:09:33.741399 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:33.754816 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-d4b25bd7-f452-4f24-8016-c1af38cb600e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:33.792901 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-d4b25bd7-f452-4f24-8016-c1af38cb600e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041946 Nov 02 12:09:33.793746 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Nov 2 12:09:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:36.769376 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-67bfd651-a4ce-41ca-a7cb-6ff680b09409 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:36.770916 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-67bfd651-a4ce-41ca-a7cb-6ff680b09409 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Nov 02 12:09:36.771534 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:37.333034 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-31fc3c00-f5d2-4893-846e-477cf5d3266b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:37.355378 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-31fc3c00-f5d2-4893-846e-477cf5d3266b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.576065 Nov 02 12:09:37.355939 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:37.368459 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-75c1bab9-0012-42bb-b62d-2da23dd03ac3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:37.395934 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-75c1bab9-0012-42bb-b62d-2da23dd03ac3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031337 Nov 02 12:09:37.396526 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Nov 2 12:09:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:40.048319 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-31fc3c00-f5d2-4893-846e-477cf5d3266b admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:40.049258 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-31fc3c00-f5d2-4893-846e-477cf5d3266b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 02 12:09:40.049659 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:40.450412 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-02915aa4-510a-4993-9456-64da079e4808 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:40.471863 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-02915aa4-510a-4993-9456-64da079e4808 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.415658 Nov 02 12:09:40.472424 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:40.485770 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-7276f129-34e4-4ef4-9024-10671d33196f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:40.492089 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:40.513177 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-7276f129-34e4-4ef4-9024-10671d33196f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031255 Nov 02 12:09:40.518009 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Nov 2 12:09:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:43.189353 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-02915aa4-510a-4993-9456-64da079e4808 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:43.189913 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-02915aa4-510a-4993-9456-64da079e4808 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 02 12:09:43.190528 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:43.668006 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-915bb540-e0d4-4da4-8a1d-df6ed25007db admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "name": "m1.large", "disk": 80, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:43.688496 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-915bb540-e0d4-4da4-8a1d-df6ed25007db admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491562 Nov 02 12:09:43.689050 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:43.701608 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-83108c01-c837-4248-9502-3891f5eebd24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:43.707151 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:43.733071 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-83108c01-c837-4248-9502-3891f5eebd24 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035336 Nov 02 12:09:43.734048 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Nov 2 12:09:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:46.442603 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-915bb540-e0d4-4da4-8a1d-df6ed25007db admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:46.443618 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-915bb540-e0d4-4da4-8a1d-df6ed25007db admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Nov 02 12:09:46.444188 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:09:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:46.977224 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-bb5af5e0-3f5d-48d7-932e-12e012480d32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "swap": 0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:47.000911 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-bb5af5e0-3f5d-48d7-932e-12e012480d32 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.550241 Nov 02 12:09:47.001793 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Nov 2 12:09:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:09:47.014613 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-d75fadc7-f31f-4a86-9615-3dbeb7900c7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:47.043384 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-d75fadc7-f31f-4a86-9615-3dbeb7900c7a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033351 Nov 02 12:09:47.044307 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Nov 2 12:09:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:09.160818 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-bb5af5e0-3f5d-48d7-932e-12e012480d32 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:09.161888 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-bb5af5e0-3f5d-48d7-932e-12e012480d32 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Nov 02 12:10:09.162333 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:10:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:09.174968 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:09.594514 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-6854e333-856f-457e-9348-3ef001650f94 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:09.613071 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-6854e333-856f-457e-9348-3ef001650f94 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.442873 Nov 02 12:10:09.613623 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:10:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:10:10.933344 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-bb5af5e0-3f5d-48d7-932e-12e012480d32 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:10.934955 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-bb5af5e0-3f5d-48d7-932e-12e012480d32 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Nov 02 12:10:10.935352 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:10:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:11.489665 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-577c360f-a692-47ca-b8ca-efa36d36d7d3 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:11.495049 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.wsgi [None req-577c360f-a692-47ca-b8ca-efa36d36d7d3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-577c360f-a692-47ca-b8ca-efa36d36d7d3 admin admin] Request method failure captured: Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: Accept: application/json Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: Accept-Encoding: gzip, deflate Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: Connection: keep-alive Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: Content-Length: 0 Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: Host: 10.222.0.45 Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: Openstack-Api-Version: compute 2.92 Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: Openstack-System-Scope: None Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: User-Agent: python-novaclient Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Auth-Token: gAAAAABjYl4idqfR57_XE5jgZrL_u3eEA93oEt-gvuicKoPIFdkfPPt3JunHS-Qz6jdAZcyEKLUQbGIGjKQMX4P1cZbbjgYqiIT4qHA8UCWwN8oL1ndFVMAR8o6whhd7bN-w6I1z6u2GM-V_LxxBV_cKa_rb1o_uDiMOLypOfR_9ROCfimP_rwU Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Domain-Id: None Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Domain-Name: None Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Identity-Status: Confirmed Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Is-Admin-Project: True Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Domain-Id: default Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Domain-Name: Default Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Name: admin Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Role: member,reader,admin Nov 02 12:10:11.498347 n-d-855650-5 devstack@n-api.service[104818]: X-Roles: member,reader,admin Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant: admin Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant-Name: admin Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-User: admin Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-User-Domain-Id: default Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-User-Domain-Name: Default Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-User-Id: c969f31d88d348b881c967fbc181256c Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: X-User-Name: admin Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: method: > Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: exception: Flavor 42 could not be found. Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: action_args: {'id': '42'} Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:11.500014 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:11.501027 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.502265 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-577c360f-a692-47ca-b8ca-efa36d36d7d3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:11.503435 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-577c360f-a692-47ca-b8ca-efa36d36d7d3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.416901 Nov 02 12:10:11.503435 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Nov 2 12:10:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:10:11.509431 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-8cb19e4a-5a83-4ef8-9c9d-727b7f8c89dd admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:11.514084 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:11.534478 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-8cb19e4a-5a83-4ef8-9c9d-727b7f8c89dd admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028487 Nov 02 12:10:11.535057 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Nov 2 12:10:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:10:11.553362 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-d3f4ff2b-261a-4e6d-90cc-075f277d893c admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:11.575983 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-d3f4ff2b-261a-4e6d-90cc-075f277d893c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027158 Nov 02 12:10:11.576581 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Nov 2 12:10:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:10:11.586461 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-c86eedeb-70eb-44d4-b0b3-a68c1e04fd81 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:11.593128 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.wsgi [None req-c86eedeb-70eb-44d4-b0b3-a68c1e04fd81 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-c86eedeb-70eb-44d4-b0b3-a68c1e04fd81 admin admin] Request method failure captured: Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: Accept: application/json Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: Accept-Encoding: gzip, deflate Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: Connection: keep-alive Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: Content-Length: 0 Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: Host: 10.222.0.45 Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: Openstack-Api-Version: compute 2.92 Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: Openstack-System-Scope: None Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: User-Agent: python-novaclient Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Auth-Token: gAAAAABjYl4idqfR57_XE5jgZrL_u3eEA93oEt-gvuicKoPIFdkfPPt3JunHS-Qz6jdAZcyEKLUQbGIGjKQMX4P1cZbbjgYqiIT4qHA8UCWwN8oL1ndFVMAR8o6whhd7bN-w6I1z6u2GM-V_LxxBV_cKa_rb1o_uDiMOLypOfR_9ROCfimP_rwU Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Domain-Id: None Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Domain-Name: None Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Identity-Status: Confirmed Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Is-Admin-Project: True Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Domain-Id: default Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Domain-Name: Default Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Name: admin Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Role: member,reader,admin Nov 02 12:10:11.596441 n-d-855650-5 devstack@n-api.service[104817]: X-Roles: member,reader,admin Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant: admin Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant-Name: admin Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-User: admin Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-User-Domain-Id: default Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-User-Domain-Name: Default Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-User-Id: c969f31d88d348b881c967fbc181256c Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: X-User-Name: admin Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: method: > Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: exception: Flavor 42 could not be found. Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: action_args: {'id': '42'} Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:11.598113 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:11.598973 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:11.600013 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-c86eedeb-70eb-44d4-b0b3-a68c1e04fd81 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:11.601001 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-c86eedeb-70eb-44d4-b0b3-a68c1e04fd81 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015075 Nov 02 12:10:11.601001 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Nov 2 12:10:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:10:12.823349 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-d3f4ff2b-261a-4e6d-90cc-075f277d893c admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:12.824948 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-d3f4ff2b-261a-4e6d-90cc-075f277d893c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 02 12:10:12.825341 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:10:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:13.367159 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-fdb867f2-d01b-42a2-a6a6-d61d9847b81d admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:13.372109 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.wsgi [None req-fdb867f2-d01b-42a2-a6a6-d61d9847b81d admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-fdb867f2-d01b-42a2-a6a6-d61d9847b81d admin admin] Request method failure captured: Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: Accept: application/json Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: Accept-Encoding: gzip, deflate Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: Connection: keep-alive Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: Content-Length: 0 Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: Host: 10.222.0.45 Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: Openstack-Api-Version: compute 2.92 Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: Openstack-System-Scope: None Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: User-Agent: python-novaclient Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Auth-Token: gAAAAABjYl4k80b-6BkxzdAuWCTYUJ2Ln0eP6tpeS3bn5NgAIl4q5ZU2HiaiI5DCfZ9uegAHo1NnD8R8ngsDZyQL9j5w1CuTjOf3uQ5LomE5M_fYdLis-liiuNiNrNXKHRosFjXi1bCZye2HNvig4s57uYoKVoItr0QycwpNip7BP55Vdalp5lQ Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Domain-Id: None Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Domain-Name: None Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Identity-Status: Confirmed Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Is-Admin-Project: True Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Domain-Id: default Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Domain-Name: Default Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Name: admin Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Role: member,reader,admin Nov 02 12:10:13.373613 n-d-855650-5 devstack@n-api.service[104817]: X-Roles: member,reader,admin Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant: admin Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant-Name: admin Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-User: admin Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-User-Domain-Id: default Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-User-Domain-Name: Default Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-User-Id: c969f31d88d348b881c967fbc181256c Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: X-User-Name: admin Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: method: > Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: exception: Flavor 84 could not be found. Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: action_args: {'id': '84'} Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:13.375264 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:13.376344 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.377814 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-fdb867f2-d01b-42a2-a6a6-d61d9847b81d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:13.379160 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-fdb867f2-d01b-42a2-a6a6-d61d9847b81d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.411201 Nov 02 12:10:13.379160 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Nov 2 12:10:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:10:13.384879 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-5b4c151f-02f5-44ff-a776-0fe782d9be14 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:13.399637 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-5b4c151f-02f5-44ff-a776-0fe782d9be14 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018320 Nov 02 12:10:13.400143 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Nov 2 12:10:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:10:13.410289 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-5b5a814a-4421-4a8d-931e-f128bdff850b admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:13.426649 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-5b5a814a-4421-4a8d-931e-f128bdff850b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019891 Nov 02 12:10:13.427191 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Nov 2 12:10:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:10:13.436866 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-2e47a247-8410-4830-809e-fb4d6bb27e76 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:13.442103 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.wsgi [None req-2e47a247-8410-4830-809e-fb4d6bb27e76 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-2e47a247-8410-4830-809e-fb4d6bb27e76 admin admin] Request method failure captured: Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: Accept: application/json Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: Accept-Encoding: gzip, deflate Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: Connection: keep-alive Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: Content-Length: 0 Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: Host: 10.222.0.45 Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: Openstack-Api-Version: compute 2.92 Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: Openstack-System-Scope: None Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: User-Agent: python-novaclient Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Auth-Token: gAAAAABjYl4k80b-6BkxzdAuWCTYUJ2Ln0eP6tpeS3bn5NgAIl4q5ZU2HiaiI5DCfZ9uegAHo1NnD8R8ngsDZyQL9j5w1CuTjOf3uQ5LomE5M_fYdLis-liiuNiNrNXKHRosFjXi1bCZye2HNvig4s57uYoKVoItr0QycwpNip7BP55Vdalp5lQ Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Domain-Id: None Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Domain-Name: None Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Identity-Status: Confirmed Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Is-Admin-Project: True Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Domain-Id: default Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Domain-Name: Default Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Name: admin Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Role: member,reader,admin Nov 02 12:10:13.443625 n-d-855650-5 devstack@n-api.service[104818]: X-Roles: member,reader,admin Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant: admin Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant-Name: admin Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-User: admin Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-User-Domain-Id: default Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-User-Domain-Name: Default Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-User-Id: c969f31d88d348b881c967fbc181256c Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: X-User-Name: admin Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: method: > Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: exception: Flavor 84 could not be found. Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: action_args: {'id': '84'} Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:13.445173 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:13.446158 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:13.447482 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-2e47a247-8410-4830-809e-fb4d6bb27e76 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:13.448691 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-2e47a247-8410-4830-809e-fb4d6bb27e76 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011891 Nov 02 12:10:13.448691 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Nov 2 12:10:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:10:14.666046 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-5b5a814a-4421-4a8d-931e-f128bdff850b admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:14.667056 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-5b5a814a-4421-4a8d-931e-f128bdff850b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Nov 02 12:10:14.667480 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:15.230948 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-21ce0318-cb82-4e78-9e47-93efdb18e291 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:15.237228 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.wsgi [None req-21ce0318-cb82-4e78-9e47-93efdb18e291 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-21ce0318-cb82-4e78-9e47-93efdb18e291 admin admin] Request method failure captured: Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: Accept: application/json Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: Accept-Encoding: gzip, deflate Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: Connection: keep-alive Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: Content-Length: 0 Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: Host: 10.222.0.45 Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: Openstack-Api-Version: compute 2.92 Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: Openstack-System-Scope: None Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: User-Agent: python-novaclient Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Auth-Token: gAAAAABjYl4mjp0A0Y4PcB-BNfTu539zqNa27RejVpGJln0VUpuJSGQZDDEzoo6Yf03E7ELD_tJfDSDaG_LTwkmWRXivkadKd0ueImaW7pq92nDrwI0YHSrvitI0PFDwpDXRvrBTw-fcK9t6nayAnktd_uXzDJVqZvnMztcj9lyDUlnm-yMeISA Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Domain-Id: None Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Domain-Name: None Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Identity-Status: Confirmed Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Is-Admin-Project: True Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Domain-Id: default Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Domain-Name: Default Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Project-Name: admin Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Role: member,reader,admin Nov 02 12:10:15.238772 n-d-855650-5 devstack@n-api.service[104818]: X-Roles: member,reader,admin Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant: admin Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-Tenant-Name: admin Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-User: admin Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-User-Domain-Id: default Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-User-Domain-Name: Default Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-User-Id: c969f31d88d348b881c967fbc181256c Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: X-User-Name: admin Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: method: > Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: exception: Flavor 451 could not be found. Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: action_args: {'id': '451'} Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:15.240218 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:15.241149 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.242707 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-21ce0318-cb82-4e78-9e47-93efdb18e291 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:15.243724 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-21ce0318-cb82-4e78-9e47-93efdb18e291 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.433662 Nov 02 12:10:15.243724 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Nov 2 12:10:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:10:15.251137 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-bbf19ef6-f833-4e1f-8e12-3e7645d6aff3 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:15.268674 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-bbf19ef6-f833-4e1f-8e12-3e7645d6aff3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021137 Nov 02 12:10:15.269265 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Nov 2 12:10:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:10:15.280539 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:15.297442 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021560 Nov 02 12:10:15.298326 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Nov 2 12:10:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:10:15.309551 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-05d85ba0-5fd7-4fb2-bd41-e2deb6c360af admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:15.314980 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.wsgi [None req-05d85ba0-5fd7-4fb2-bd41-e2deb6c360af admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-05d85ba0-5fd7-4fb2-bd41-e2deb6c360af admin admin] Request method failure captured: Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: Accept: application/json Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: Accept-Encoding: gzip, deflate Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: Connection: keep-alive Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: Content-Length: 0 Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: Host: 10.222.0.45 Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: Openstack-Api-Version: compute 2.92 Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: Openstack-System-Scope: None Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: User-Agent: python-novaclient Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Auth-Token: gAAAAABjYl4mjp0A0Y4PcB-BNfTu539zqNa27RejVpGJln0VUpuJSGQZDDEzoo6Yf03E7ELD_tJfDSDaG_LTwkmWRXivkadKd0ueImaW7pq92nDrwI0YHSrvitI0PFDwpDXRvrBTw-fcK9t6nayAnktd_uXzDJVqZvnMztcj9lyDUlnm-yMeISA Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Domain-Id: None Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Domain-Name: None Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Identity-Status: Confirmed Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Is-Admin-Project: True Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Domain-Id: default Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Domain-Name: Default Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Project-Name: admin Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Role: member,reader,admin Nov 02 12:10:15.316644 n-d-855650-5 devstack@n-api.service[104817]: X-Roles: member,reader,admin Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d390fea571d34bec9ab1eaa95c33e2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant: admin Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant-Id: d390fea571d34bec9ab1eaa95c33e2b5 Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-Tenant-Name: admin Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-User: admin Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-User-Domain-Id: default Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-User-Domain-Name: Default Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-User-Id: c969f31d88d348b881c967fbc181256c Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: X-User-Name: admin Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: method: > Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: exception: Flavor 451 could not be found. Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: action_args: {'id': '451'} Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:15.318335 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:15.319334 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: ERROR nova.api.openstack.wsgi Nov 02 12:10:15.320497 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-05d85ba0-5fd7-4fb2-bd41-e2deb6c360af admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104817) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:15.321615 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-05d85ba0-5fd7-4fb2-bd41-e2deb6c360af admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013069 Nov 02 12:10:15.321615 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Nov 2 12:10:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:10:16.538976 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:16.539981 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 02 12:10:16.540400 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:10:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:17.077462 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-4ef06000-8cfb-4091-a2f4-35828c333b7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:17.097516 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-4ef06000-8cfb-4091-a2f4-35828c333b7d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.418305 Nov 02 12:10:17.098074 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Nov 2 12:10:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:10:18.304965 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:18.306069 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 02 12:10:18.306498 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:10:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:18.846194 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-93364a44-4acf-4762-89dd-e50270d07ea6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:18.864707 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-93364a44-4acf-4762-89dd-e50270d07ea6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.417369 Nov 02 12:10:18.865302 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Nov 2 12:10:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:10:20.095708 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:20.096716 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 02 12:10:20.097118 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:20.636022 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-04531656-91f8-4504-971e-58aa62a5e7db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:20.655846 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-04531656-91f8-4504-971e-58aa62a5e7db admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.418614 Nov 02 12:10:20.656403 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Nov 2 12:10:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:10:21.859567 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:21.860562 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 02 12:10:21.860954 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:22.384399 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-cbca1544-2e1a-4f9b-a55e-8e7f60017cab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:22.403327 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-cbca1544-2e1a-4f9b-a55e-8e7f60017cab admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.403984 Nov 02 12:10:22.403880 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Nov 2 12:10:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:10:23.618310 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:23.619304 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 02 12:10:23.619701 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:10:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:24.156865 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-a6878b8b-fcea-4aa1-b1e4-07c52383e9ad admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:24.177919 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-a6878b8b-fcea-4aa1-b1e4-07c52383e9ad admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.418567 Nov 02 12:10:24.178417 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Nov 2 12:10:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:11:22.712665 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.713727 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-5e3789a9-e839-404e-8982-ab4ced2bd2ee admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Nov 02 12:11:22.714174 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 931 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:22.725342 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:23.194065 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-9d3220e6-f33c-400f-8ee9-a2c043afd970 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.233606 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-9d3220e6-f33c-400f-8ee9-a2c043afd970 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.512343 Nov 02 12:11:23.234572 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:11:23.275641 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-52f857e3-23bb-42fc-83ef-43ce54f129f1 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.281044 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writing DB stats nova_api:SELECT=14 {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:23.287329 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-52f857e3-23bb-42fc-83ef-43ce54f129f1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016890 Nov 02 12:11:23.288146 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:23.301605 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-47d14f3b-c95e-43fc-a97a-ae42e7694bf5 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.311902 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-47d14f3b-c95e-43fc-a97a-ae42e7694bf5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014309 Nov 02 12:11:23.312538 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:23.330211 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-a1a56976-6f11-4b67-8896-282e432a57a4 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.339234 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-a1a56976-6f11-4b67-8896-282e432a57a4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017371 Nov 02 12:11:23.339866 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:23.352948 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-ecb87d08-5ded-4c57-b9f0-ace315182749 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.361675 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-ecb87d08-5ded-4c57-b9f0-ace315182749 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012426 Nov 02 12:11:23.362291 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:23.313905 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-a1a56976-6f11-4b67-8896-282e432a57a4 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:23.314940 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-a1a56976-6f11-4b67-8896-282e432a57a4 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 02 12:17:23.315343 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:17:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:23.456738 n-d-855650-5 devstack@n-api.service[104817]: DEBUG dbcounter [-] [104817] Writing DB stats nova_api:SELECT=6 {{(pid=104817) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:23.609789 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-9299c13f-aab1-41e5-8368-ecefc295089e admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:23.614943 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-9299c13f-aab1-41e5-8368-ecefc295089e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:23.615428 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-9299c13f-aab1-41e5-8368-ecefc295089e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:23.615865 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-9299c13f-aab1-41e5-8368-ecefc295089e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:23.616585 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-9299c13f-aab1-41e5-8368-ecefc295089e admin admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:23.617033 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-9299c13f-aab1-41e5-8368-ecefc295089e admin admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:23.617744 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-9299c13f-aab1-41e5-8368-ecefc295089e admin admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:23.656851 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-9299c13f-aab1-41e5-8368-ecefc295089e admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.201293 Nov 02 12:17:23.657421 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Nov 2 12:17:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:24.754544 n-d-855650-5 devstack@n-api.service[104818]: DEBUG nova.api.openstack.wsgi [None req-a1a56976-6f11-4b67-8896-282e432a57a4 admin admin] Calling method '>' {{(pid=104818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:24.755555 n-d-855650-5 devstack@n-api.service[104818]: INFO nova.api.openstack.requestlog [None req-a1a56976-6f11-4b67-8896-282e432a57a4 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Nov 02 12:17:24.755958 n-d-855650-5 devstack@n-api.service[104818]: [pid: 104818|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Nov 2 12:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:24.962764 n-d-855650-5 devstack@n-api.service[104817]: DEBUG nova.api.openstack.wsgi [None req-62704b31-005c-4a0c-81b1-b1058687db58 admin admin] Calling method '>' {{(pid=104817) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:24.966545 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-62704b31-005c-4a0c-81b1-b1058687db58 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.967027 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-62704b31-005c-4a0c-81b1-b1058687db58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.967476 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-62704b31-005c-4a0c-81b1-b1058687db58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.968166 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-62704b31-005c-4a0c-81b1-b1058687db58 admin admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.968611 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-62704b31-005c-4a0c-81b1-b1058687db58 admin admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.969027 n-d-855650-5 devstack@n-api.service[104817]: DEBUG oslo_concurrency.lockutils [None req-62704b31-005c-4a0c-81b1-b1058687db58 admin admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104817) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.997832 n-d-855650-5 devstack@n-api.service[104817]: INFO nova.api.openstack.requestlog [None req-62704b31-005c-4a0c-81b1-b1058687db58 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.101190 Nov 02 12:17:24.998442 n-d-855650-5 devstack@n-api.service[104817]: [pid: 104817|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Nov 2 12:17:24 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:16.280706 n-d-855650-5 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 12:18:16.281265 n-d-855650-5 devstack@n-api.service[104816]: Wed Nov 2 12:18:16 2022 - graceful shutdown triggered... Nov 02 12:18:16.281736 n-d-855650-5 devstack@n-api.service[104817]: Gracefully killing worker 1 (pid: 104817)... Nov 02 12:18:16.282242 n-d-855650-5 devstack@n-api.service[104818]: Gracefully killing worker 2 (pid: 104818)... Nov 02 12:18:16.412000 n-d-855650-5 devstack@n-api.service[104818]: DEBUG dbcounter [-] [104818] Writing DB stats nova_api:SELECT=4 {{(pid=104818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:17.282338 n-d-855650-5 devstack@n-api.service[104816]: worker 1 buried after 1 seconds Nov 02 12:18:17.282338 n-d-855650-5 devstack@n-api.service[104816]: worker 2 buried after 1 seconds Nov 02 12:18:17.282338 n-d-855650-5 devstack@n-api.service[104816]: goodbye to uWSGI. Nov 02 12:18:17.283870 n-d-855650-5 systemd[1]: devstack@n-api.service: Succeeded. Nov 02 12:18:17.284474 n-d-855650-5 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 12:18:17.287238 n-d-855650-5 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 12:18:17.302635 n-d-855650-5 devstack@n-api.service[120706]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:18:17 2022] *** Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: nodename: n-d-855650-5 Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: machine: x86_64 Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: clock source: unix Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: pcre jit disabled Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: detected number of CPU cores: 4 Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: current working directory: / Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: your processes number limit is 47680 Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: your memory page size is 4096 bytes Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: detected max file descriptor number: 2048 Nov 02 12:18:17.327142 n-d-855650-5 devstack@n-api.service[120706]: lock engine: pthread robust mutexes Nov 02 12:18:17.328598 n-d-855650-5 devstack@n-api.service[120706]: thunder lock: enabled Nov 02 12:18:17.328598 n-d-855650-5 devstack@n-api.service[120706]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 12:18:17.328598 n-d-855650-5 devstack@n-api.service[120706]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:18:17.369121 n-d-855650-5 devstack@n-api.service[120706]: Python main interpreter initialized at 0x5568d98019c0 Nov 02 12:18:17.369121 n-d-855650-5 devstack@n-api.service[120706]: python threads support enabled Nov 02 12:18:17.369121 n-d-855650-5 devstack@n-api.service[120706]: your server socket listen backlog is limited to 100 connections Nov 02 12:18:17.369121 n-d-855650-5 devstack@n-api.service[120706]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:18:17.369772 n-d-855650-5 devstack@n-api.service[120706]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:18:17.369772 n-d-855650-5 devstack@n-api.service[120706]: *** Operational MODE: preforking *** Nov 02 12:18:17.369946 n-d-855650-5 devstack@n-api.service[120706]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:18:17.369946 n-d-855650-5 devstack@n-api.service[120706]: spawned uWSGI master process (pid: 120706) Nov 02 12:18:17.370077 n-d-855650-5 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 12:18:17.370820 n-d-855650-5 devstack@n-api.service[120706]: spawned uWSGI worker 1 (pid: 120722, cores: 1) Nov 02 12:18:17.374020 n-d-855650-5 devstack@n-api.service[120706]: spawned uWSGI worker 2 (pid: 120723, cores: 1) Nov 02 12:18:17.374020 n-d-855650-5 devstack@n-api.service[120706]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:18:18.039788 n-d-855650-5 devstack@n-api.service[120722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:18:18.045005 n-d-855650-5 devstack@n-api.service[120723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:18:19.299346 n-d-855650-5 devstack@n-api.service[120722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:18:19.299346 n-d-855650-5 devstack@n-api.service[120722]: from cryptography.utils import int_from_bytes Nov 02 12:18:19.300556 n-d-855650-5 devstack@n-api.service[120722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:18:19.300556 n-d-855650-5 devstack@n-api.service[120722]: from cryptography.utils import int_from_bytes Nov 02 12:18:19.316158 n-d-855650-5 devstack@n-api.service[120723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:18:19.316158 n-d-855650-5 devstack@n-api.service[120723]: from cryptography.utils import int_from_bytes Nov 02 12:18:19.316769 n-d-855650-5 devstack@n-api.service[120723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:18:19.316769 n-d-855650-5 devstack@n-api.service[120723]: from cryptography.utils import int_from_bytes Nov 02 12:18:21.802194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:18:21.802764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:18:21.802996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:18:21.803366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:18:21.803628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:18:21.804026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.804357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.804681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.805006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.805537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.805651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.805991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.806421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.806765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.806916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.807239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.807565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-855650-5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.807892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.808206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.808523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.808843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.809575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.809575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.809804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.810295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.810748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.811063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.811533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.811730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.812068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.812364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.812695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.813005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.813331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.813647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.814159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-855650-5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.814487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.814806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.815152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.815574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.815892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.816208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.816531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.816860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.817189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.817506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.817828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.818190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.818512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.818819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.819134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.819453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.819694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:18:21.820135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.820228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:18:21.820315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.820407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.820499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:18:21.820609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.820859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:18:21.820962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.821125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:18:21.821237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.821525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.821645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.821850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.821978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.822154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.822253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.822396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.822510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.822699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.822863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.823021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.823134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.823331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.823457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.823649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.823788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.823960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.824125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.824283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.824416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.824567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.824703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.824877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.825035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-855650-5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.825185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.825366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.825495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.825683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.825817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.826022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.826167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.826350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.826493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.826662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.826806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.827000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.827125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.827353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.827539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.827788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.827950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.828101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.828198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.828448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.828596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.828772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.828883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.829082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.829182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.829406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.829511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.829731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.829913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.830070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.830161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.830379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.830474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.831258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.831413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.831554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.831704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.831880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.831982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-855650-5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.832195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.832353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.832497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.832622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.832733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.832942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.833066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.833295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.833403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.833614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.833710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.833931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.834151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.834303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.834405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.834610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.834712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.834923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.835026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.835236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.835343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.835548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.835649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.835860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.835966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.836172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.836280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.836482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.836584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.836793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.836896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.837103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.837206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.837422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.837563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.837739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.837837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.838044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.838182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.838310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.838416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.838627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.838729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.838956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.839055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.839263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.839372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.839574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.839669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.839850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.839946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.840115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.840221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.840431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.840536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.840759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.840863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.841074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.841168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.841388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.841494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.841700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.841803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.842031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.842175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.842388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.842579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.842723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.842851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.842982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.843131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.843291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.843481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.843609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.843871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.843983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.844198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.844304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.844546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.844648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.844856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.844950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.845172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.845298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.845512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.845616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.845824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.845925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.846210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.846326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.847081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.847235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.847398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.847526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.847734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.847966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.848119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.848337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.848491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.848642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.848792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.848919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.849017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.849192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.849350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.849552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.849660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.849900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.850061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.850199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.850329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.850482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.850611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.850796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.850935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.851159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.851261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.851475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.851587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.851790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.851913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.852105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.852232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.852414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.852557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.852729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.852959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.853069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.853252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.853442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.853578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.853671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.853843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.853948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.854203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.854342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.854528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.854624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.854863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.854965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.855195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.855301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.855494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.855596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.855813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.855914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.856138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.856245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.856445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.856550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.856761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.856855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.857121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.857242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.857388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.857503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.857704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.857813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.858040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.858158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.858356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.858506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.858759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.858867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.859133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.859256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.859354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.859522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.859613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.859700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.859923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.860085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.860237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.860384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.860581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.860861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.860963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.861181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.861295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.861501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.861628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.861824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.861944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.862203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.862312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.862518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.862631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.862834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.863013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.863131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.863232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.863440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.863549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.863752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.863853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.864063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.864174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.864375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.864471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.864683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.864795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.865010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.865112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.865329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.865434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.865644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.865737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.865957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.866086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.866380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.866497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.866587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.866672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:18:21.866892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.867000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.867200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.867296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.867515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.867622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.867824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.867942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.868148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.868247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.868479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.868570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.868793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.868950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.869128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.869233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.869440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.869538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.869756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.869866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.870094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.870227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.870411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.870508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.870719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.870804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.871034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.871138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.871348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.871451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.871795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.871946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.872139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.872283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.872414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.872561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.872691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.872814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.873148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.873278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.873389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.873533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.873659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.873787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.873923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.874081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.874222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.874374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.874525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.874671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.874813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.875005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.875149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.875330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.875466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.875652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.875798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.875968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.876114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.876291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.876439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.876613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.876757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.876922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.877068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.877250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.877403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.877576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.878277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.878776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.878935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.879061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.879183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.879313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.879446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.879569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.879776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.879903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.880044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.880169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.880293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.880414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.880561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.880687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.880840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.880990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.881138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.881282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.881431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.881565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.881696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.881840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.882058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.882220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.882366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.882532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.882767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.882916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.883203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.883375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.883520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.883654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.883804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.883945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.884076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.884254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.884433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.884584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.884707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.884966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.885215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.885348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.885593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.885824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.885919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.886261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.886467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.886607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.886923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.887108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.887244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.887564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.887739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.887883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.888197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.888370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.888524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.888724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.888881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.889066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.889164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.889440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.889546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.889767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.889912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.890102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.890241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.890434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.890528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.890751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.890857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.891063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.891166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.891389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.891491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.891709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.891807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.892030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.892131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.892343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.892446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.892658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.892810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.892989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.893084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.893373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.894084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.894194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.894362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.894540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.894708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.894882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.895029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.895193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.895357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.895525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.895679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.895856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.896003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.896179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.896344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.896496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.896638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.896812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.896946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.897122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.897275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.897428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.897600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.897746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.897922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.898043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.898289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.898385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.898682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.899055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.899338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.899494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.899587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.899683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.899856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.899971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.900186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.900315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.900502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.900607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.900826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.900935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.901148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.901264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.901455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.901553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.901784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.901895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.902126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.902235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.902446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.902550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.902764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.902955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.903078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.903174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.903376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.903537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.903703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.903860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.904020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.904151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.904335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.904433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.904652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.904758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.904970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.905074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.905280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.905379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.905591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.905695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.905900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.906046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.906243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.906351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.906560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.906655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.906874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.906968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.907197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.907304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.907521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.907615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.907831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.907978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.908138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.908242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.908463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.908567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.908782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.908898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.909115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.909224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.909467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.909622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.909726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.909814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.910130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.910244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.910452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.910548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.910771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.910864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.911087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.911189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.911406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.911508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.911719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.911824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.912038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.912144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.912351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.912455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.912683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.912840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.912987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.913103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.913315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.913416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.913609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.913703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.913924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.914069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.914330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.914450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.914579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.914676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.914902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.915033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.915224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.915321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.915540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.915649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.915886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.916005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.916176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.916295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.916483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.916641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.916794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.916889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.917108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.917212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.917422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.917698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.917793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.918063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.918173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.918386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.918563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.918706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.918843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.919017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.919114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.919329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.919439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.919647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.919798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.919956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.920083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.920267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.920370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.920587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.920689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.920897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.921000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.921208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.921303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.921518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.921612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.921834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.921932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.922170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.922277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.922479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.922574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.922790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.922885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.923105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.923200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.923414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.923506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.923719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.923813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.924023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.924129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.924357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.924523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.924714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.924814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.924988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.925123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.925305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.925418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.925616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.925720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.925944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.926252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.926373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.926505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.926654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.926823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.926920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.927008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.927167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.927314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.927517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.927603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.927831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.927925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.928151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.928285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.928478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.928608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.928797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.928927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.929115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.929215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.929426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.929539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.929757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.929894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.930094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.930192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.930406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.930859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.930959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.931057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.931219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.931340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.931439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.931529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.931623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.931912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.932018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.932222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.932325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.932538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.932643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.932851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.932947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.933157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.933263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.933471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.933582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.933778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.933875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.934123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.934241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.934447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.934602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.934747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.934899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.935112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.935287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.935432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.935579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.935727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.935882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.936032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.936182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.936344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.936481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.936644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.936795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.936927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.937112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.937217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.937459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.937589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.937771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.937946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.938174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.938333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.938489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.938655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.938827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.939001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.939222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.939388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.939547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.939722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.939891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.940530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.940673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.940827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.940958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.941085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.941318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.941603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.941775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.941939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.942194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.942382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.942558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.942722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.942878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.943040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.943202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.943375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.943558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.943719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.943876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.944119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.944119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.944373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.944548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.944717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.944988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.945302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.945604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.945919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.946109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.946361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.946806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.946914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.947331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.947440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.947696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.947902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.948055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.948443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.948851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.948956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.949229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.949623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.949720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.949886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.950114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.950473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.950659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.950823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.951156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.951250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.951642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.951999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.952384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.952487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.952817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.952982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.953154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.953495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.953591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.953828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.954103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.954203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.954442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.954547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.954802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.954915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.955086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.955182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.955406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.955513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.955799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.956421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.956621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.956723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.956942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.957045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.957273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.957394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.957612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.957729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.957911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.958024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.958263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.958387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.958645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.958775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.958899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.959075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.959243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.959379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.959551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.959706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.959829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.960082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.960233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.960405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.960539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.960646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.960735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.960830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.961056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.961162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.961375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.961572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.961719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.961863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.962008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.962207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.962378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.962476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.962626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.962723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.962957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.963067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.963274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.963369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.963583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.963686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.963895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.964017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.964202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.964297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.964516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.964611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.964829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.965003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.965144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.965441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.965553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.965750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.965861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.966093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.966192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.966432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.966536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.966752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.966861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.967069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.967165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.967386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.967523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.967733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.967846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.968022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.968167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.968424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.968532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.968752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.968876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.969064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.969215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.969503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.969874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.970212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.970685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.971064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.971405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.971808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.971976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.972096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.972196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.972398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.972547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.972727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.972821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.973077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.973293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.973404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.973554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.973693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.973801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.974039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.974152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.974369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.974530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.974684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.974848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.975011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.975173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.975345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.975485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.975658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.975813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.975980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.976169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.976313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.976484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.976752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.976857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.977090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.977196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.977406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.977510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.977730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.977844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.978076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.978174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.978399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.978496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.978721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.978906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.979089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.979194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.979413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.979509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.979747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.979847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.980077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.980178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.980562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.980718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.980827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.980918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.981133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.981276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.981466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.981579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.981779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.981929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.982098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.982188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.982409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.982519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.982724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.982820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.983047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.983176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.983363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.983469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.983678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.983774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.983986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.984089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.984295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.984400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.984604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.984919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.985022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.985334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.985472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.985563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.985728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.985881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.985997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.986181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.986289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.986508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.986611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.986829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.986949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.987185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.987283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.987512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.987616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.987823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.987956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.988151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.988265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.988463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.988578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.988773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.988884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.989080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.989200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.989387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.989513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.989736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.989887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.990115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.990234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.990390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.990511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.990725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.990874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.991060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.991158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.991432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.991551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.991715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.991822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.992070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.992189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.992374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.992471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.992690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.992834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.993012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.993108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.993344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.993488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.993651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.993810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.993957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.994158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.994279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.994492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.994638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.994822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.994927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.995162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.995258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.995480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.995599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.995779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.995884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.996086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.996229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.996395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.996492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.996769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.996888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.997034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.997139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.997353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.997453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.997664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.997759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.998004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.998105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.998316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.998417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.998598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.998695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.998950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.999055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.999261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.999386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.999596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.999701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:21.999915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.000047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.000251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.000400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.000572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.000687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.000901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.001067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.001198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.001322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.001518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.001617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.001825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.001939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.002173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.002307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.002490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.003107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.003369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.003482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.003691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.003795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.004011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.004114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.004332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.004428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.004643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.004959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.005057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.005291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.005402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.005607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.005715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.005926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.006074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.006272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.006426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.006592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.006688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.006909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.007004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.007219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.007328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.007641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.007752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.007851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.007940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.008147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.008246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.008464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.008574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.008767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.008877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.009118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.009295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.009448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.009672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.009816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.009911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.010101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.010241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.010389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.010586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.010707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.010910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.011074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.011289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.011437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.011680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.011787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.011999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.012095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.012324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.012441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.012635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.012741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.012952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.013049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.013266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.013365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.013577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.013681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.013891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.014040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.014235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.014331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.014547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.014653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.014860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.014955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.015174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.015267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.015482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.015593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.015800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.015906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.016108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.016212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.016441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.016579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.016756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.016850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.017076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.017171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.017390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.017486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.017710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.017940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.018117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.018841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.018960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.019423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.019566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.019691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.019807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.019921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.020045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.020160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.020282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.020431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.020618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.020759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.020883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.021056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.021179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.021363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.021487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.021770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.021903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.022034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.022127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.022312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.022463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.022637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.022734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.022951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.023054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.023258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.023355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.023580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.023687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.024144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.024242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.024697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.024817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.025049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.025146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.025367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.025464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.025693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.025798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.026040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.026153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.026365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.026512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.026677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.026784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.026998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.027093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.027308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.027417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.027619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.027715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.027940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.028047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.028248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.028344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.028557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.028661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.028865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.028969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.029258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.029375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.029481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.029699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.029798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.029887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.030108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.030225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.030417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.030514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.030778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.030890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.031057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.031164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.031366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.031471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.031673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.031836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.032079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.032267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.032361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.032449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.032581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.032678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.032865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.032997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.033172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.033318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.033491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.033634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.033827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.034052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.034165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.034380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.034476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.034699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.034832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.035021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.035155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.035341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.035445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.035673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.035783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.036023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.036171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.036345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.036443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.036651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.036749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.036972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.037067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.037285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.037381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.037611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.037829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.037925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.038177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.038282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.038516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.038626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.038848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.038944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.039180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.039447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.039557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.039787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.039894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.040108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.040208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.040430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.040536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.040742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.040847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.041061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.041156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.041379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.041485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.041690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.041835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.042187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.042315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.042416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.042520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.042655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.042762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.042983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.043078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.043296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.043399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.043611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.043848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.043956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.044209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.044314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.044522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.044630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.044836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.044940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.045149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.045300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.045461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.045564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.045779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.045874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.046122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.046241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.046436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.046541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.046747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.046850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.047074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.047177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.047393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.047492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.047705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.047823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.048019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.048124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.048336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.048432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.048650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.048752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.048960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.049065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.049326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.049480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.049714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.049860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.050079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.050203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.050392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.050496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.050706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.050818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.051096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.051208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.051372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.051510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.051686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.051830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.051996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.052157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.052337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.052482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.052605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.052798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.052928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.053220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.053340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.053549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.053655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.053861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.053958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.054215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.054359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.054536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.054652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.054866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.054970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.055180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.055284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.055517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.055626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.055834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.055938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.056145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.056252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.056476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.056578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.056794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.056988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.057157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.057254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.057504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.057608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.057824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.057928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.058164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.058276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.058482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.058621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.058794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.059106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.059250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.059416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.059522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.059740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.059836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.060051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.060261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.060370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.060469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.060619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.060723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.060929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.061025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.061244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.061364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.061577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.061730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.061867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.061988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.062168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.062254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.062472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.062600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.062782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.062953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.063111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.063280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.063431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.063593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.063690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.063910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.064018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.064227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.064330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.064543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.064680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.064859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.064963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.065699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.065826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.066039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.066159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.066359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.066491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.066677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.066774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.067002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.067159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.067328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.067432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.067653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.067757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.067988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.068100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.068288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.068383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.068613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.068749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.068975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.069083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.069230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.069338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.069543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.069647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.069856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.070033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.070198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.070294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.070534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.070631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.070864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.070969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.071175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.071279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.071509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.071618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.071832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.071930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.072160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.072260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.072482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.072567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.072800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.072924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.073280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.073428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.073609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.073750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.073869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.074021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.074156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.074275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.074390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.074536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.074686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.074783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.075007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.075110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.075320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.075428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.075636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.075770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.076063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.076215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.076324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.076413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.076663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.076831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.076931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.077029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.077236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.077334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.077566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.077670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.077897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.078072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.078234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.078338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.078553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.078648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.078870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.078987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.079182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.079305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.079494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.079596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.079814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.079988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.080147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.080303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.080432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:18:22.080523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.080919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.081237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.081552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.082386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.082781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.083021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.083340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.083652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.083959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.084307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.084617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.084959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.085304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.085627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.085959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.086357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.086639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.086954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.087285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.087616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.087943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.088262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.088605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.088932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.089245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.089570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.089950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.090364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.090556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.090892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.091227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.091642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.091876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.092204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.092551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.092951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.093188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.093531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.093848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.094195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.094523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.094845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.095165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.095491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.095809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.096128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.096490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.096825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.097157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.097498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.097815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.098176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.098511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.098876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.099198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.099550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.099888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.100212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.100532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.100847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:18:22.101099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:18:22.143993 n-d-855650-5 devstack@n-api.service[120722]: INFO dbcounter [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Registered counter for database nova_api Nov 02 12:18:22.165411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_db.sqlalchemy.engines [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:18:22.165646 n-d-855650-5 devstack@n-api.service[120723]: INFO dbcounter [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Registered counter for database nova_api Nov 02 12:18:22.172903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writer thread running {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:18:22.186692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_db.sqlalchemy.engines [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:18:22.194515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writer thread running {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:18:22.236222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.context [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) {{(pid=120722) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:18:22.240250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:22.240732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:22.242465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:22.243141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:22.243598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:22.245640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:22.247773 n-d-855650-5 devstack@n-api.service[120722]: INFO dbcounter [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Registered counter for database nova_cell0 Nov 02 12:18:22.252201 n-d-855650-5 devstack@n-api.service[120722]: INFO dbcounter [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Registered counter for database nova_cell1 Nov 02 12:18:22.256004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.context [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) {{(pid=120723) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:18:22.259853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_db.sqlalchemy.engines [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:18:22.260314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:22.260811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:22.262291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_db.sqlalchemy.engines [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:18:22.262651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:22.263336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:22.263789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:22.265934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:22.267143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writer thread running {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:18:22.268133 n-d-855650-5 devstack@n-api.service[120723]: INFO dbcounter [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Registered counter for database nova_cell0 Nov 02 12:18:22.273004 n-d-855650-5 devstack@n-api.service[120723]: INFO dbcounter [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Registered counter for database nova_cell1 Nov 02 12:18:22.281046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_db.sqlalchemy.engines [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:18:22.283160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_db.sqlalchemy.engines [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:18:22.289572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writer thread running {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:18:22.420976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writer thread running {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:18:22.431962 n-d-855650-5 devstack@n-api.service[120722]: INFO dbcounter [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Registered counter for database nova_cell0 Nov 02 12:18:22.437762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writer thread running {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:18:22.440810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_db.sqlalchemy.engines [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:18:22.447472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writer thread running {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:18:22.449466 n-d-855650-5 devstack@n-api.service[120723]: INFO dbcounter [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Registered counter for database nova_cell0 Nov 02 12:18:22.458959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_db.sqlalchemy.engines [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:18:22.465346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writer thread running {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:18:22.990561 n-d-855650-5 devstack@n-api.service[120722]: WARNING keystonemiddleware.auth_token [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:18:23.004193 n-d-855650-5 devstack@n-api.service[120722]: WARNING keystonemiddleware.auth_token [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:18:23.033329 n-d-855650-5 devstack@n-api.service[120723]: WARNING keystonemiddleware.auth_token [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:18:23.046479 n-d-855650-5 devstack@n-api.service[120723]: WARNING keystonemiddleware.auth_token [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:18:23.580389 n-d-855650-5 devstack@n-api.service[120722]: WARNING keystonemiddleware.auth_token [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:18:23.592365 n-d-855650-5 devstack@n-api.service[120722]: WARNING keystonemiddleware.auth_token [None req-bab18044-6d8f-4d64-a039-d23a2d85e800 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:18:23.602357 n-d-855650-5 devstack@n-api.service[120722]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568d98019c0 pid: 120722 (default app) Nov 02 12:18:23.615387 n-d-855650-5 devstack@n-api.service[120723]: WARNING keystonemiddleware.auth_token [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:18:23.621358 n-d-855650-5 devstack@n-api.service[120723]: WARNING keystonemiddleware.auth_token [None req-18c6ecef-bd4f-4c94-b97c-80674b5743ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:18:23.627071 n-d-855650-5 devstack@n-api.service[120723]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568d98019c0 pid: 120723 (default app) Nov 02 12:19:04.877381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:04.878692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:04.879687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:04.880685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:06.583872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26f7033d-5347-4f7c-80c7-638e71514f9e tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:06.586689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f7033d-5347-4f7c-80c7-638e71514f9e tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:06.587329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f7033d-5347-4f7c-80c7-638e71514f9e tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:06.588752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f7033d-5347-4f7c-80c7-638e71514f9e tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:06.590229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f7033d-5347-4f7c-80c7-638e71514f9e tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:06.590932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f7033d-5347-4f7c-80c7-638e71514f9e tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:06.591727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f7033d-5347-4f7c-80c7-638e71514f9e tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:06.638921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26f7033d-5347-4f7c-80c7-638e71514f9e tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] 10.222.0.45 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.773929 Nov 02 12:19:06.639547 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1/1] 10.222.0.45 () {58 vars in 1164 bytes} [Wed Nov 2 12:19:04 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:07.137672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a440193-4610-4eaf-931e-d11c8357746d tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:07.143940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a440193-4610-4eaf-931e-d11c8357746d tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:07.143940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a440193-4610-4eaf-931e-d11c8357746d tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:07.143940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a440193-4610-4eaf-931e-d11c8357746d tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:07.143940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a440193-4610-4eaf-931e-d11c8357746d tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:07.144627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a440193-4610-4eaf-931e-d11c8357746d tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:07.144627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a440193-4610-4eaf-931e-d11c8357746d tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:07.144627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:07.144627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:07.145776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:07.145996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:07.236921 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a440193-4610-4eaf-931e-d11c8357746d tempest-AZAdminV2TestJSON-518682261 tempest-AZAdminV2TestJSON-518682261-project-admin] 10.222.0.45 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.579172 Nov 02 12:19:07.237956 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1/2] 10.222.0.45 () {58 vars in 1185 bytes} [Wed Nov 2 12:19:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:08.118485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '.version_select at 0x7f22901843a0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:08.126306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) {{(pid=120722) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 12:19:08.127561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.128031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.128635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.162596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.163158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.163712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.179835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.180329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.180761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.188046 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aab42de5-edc5-4e2c-b3a0-692e133db0b1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.781185 Nov 02 12:19:08.188972 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Nov 2 12:19:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:08.653343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0d59483-4bb5-48fb-b8f5-e84fa622a56a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:08.662938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d59483-4bb5-48fb-b8f5-e84fa622a56a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.663806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d59483-4bb5-48fb-b8f5-e84fa622a56a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.664604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d59483-4bb5-48fb-b8f5-e84fa622a56a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.665938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d59483-4bb5-48fb-b8f5-e84fa622a56a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.666807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d59483-4bb5-48fb-b8f5-e84fa622a56a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.667809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d59483-4bb5-48fb-b8f5-e84fa622a56a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.709175 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a0d59483-4bb5-48fb-b8f5-e84fa622a56a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.518968 Nov 02 12:19:08.719316 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 12:19:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:08.719316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f556f9d-b566-41d4-9964-db34bd0f01e1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-842019088", "name": "tempest-test_aggregate-524053491"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:08.755719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-8f556f9d-b566-41d4-9964-db34bd0f01e1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid 030dfaf9-a7d5-4a04-b758-799c7faa7fce for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:19:08.854943 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f556f9d-b566-41d4-9964-db34bd0f01e1 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.142460 Nov 02 12:19:08.856130 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4/5] 10.222.0.45 () {60 vars in 1165 bytes} [Wed Nov 2 12:19:08 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:08.907112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Calling method '.version_select at 0x7f22902ade50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:08.925920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) {{(pid=120723) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 12:19:08.927029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.927958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.928494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.969538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.970391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.971085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.989806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.990525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.991023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.000109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1dfcddc8-c826-4ddf-afbe-717d1ee77f75 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.220376 Nov 02 12:19:09.001323 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2/6] 10.222.0.45 () {60 vars in 1208 bytes} [Wed Nov 2 12:19:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:09.058956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-958de1d0-a819-40e6-8eb5-ce3116371548 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Action: 'update', calling method: .version_select at 0x7f22900c4820>, body: {"quota_set": {"ram": "5120"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:09.292612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f6b74cfd-1b66-4fbd-9296-59b9dab069b3 tempest-FlavorMetadataValidation-1139741905 tempest-FlavorMetadataValidation-1139741905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1789880476", "id": 1057100765, "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:09.357660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-958de1d0-a819-40e6-8eb5-ce3116371548 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.358234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-958de1d0-a819-40e6-8eb5-ce3116371548 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.358720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-958de1d0-a819-40e6-8eb5-ce3116371548 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.359462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-958de1d0-a819-40e6-8eb5-ce3116371548 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.359985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-958de1d0-a819-40e6-8eb5-ce3116371548 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.360417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-958de1d0-a819-40e6-8eb5-ce3116371548 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.360790 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f6b74cfd-1b66-4fbd-9296-59b9dab069b3 tempest-FlavorMetadataValidation-1139741905 tempest-FlavorMetadataValidation-1139741905-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.358292 Nov 02 12:19:09.361532 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3/7] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:19:09 2022] POST /compute/v2.1/flavors => generated 471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:09.488046 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-958de1d0-a819-40e6-8eb5-ce3116371548 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/7e1db1f3ba904eedbb24e4a3dcaabfdc" status: 200 len: 148 microversion: 2.57 time: 0.629620 Nov 02 12:19:09.499790 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 5/8] 10.222.0.45 () {62 vars in 1303 bytes} [Wed Nov 2 12:19:08 2022] PUT /compute/v2.1/os-quota-sets/7e1db1f3ba904eedbb24e4a3dcaabfdc => generated 148 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:09.504309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f817ad77-f5c6-4713-b67c-272a303ff4a0 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:09.520261 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f817ad77-f5c6-4713-b67c-272a303ff4a0 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.024144 Nov 02 12:19:09.521149 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 6/9] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:19:09 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:09.529108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c468073-ad95-4c63-a73a-d3a70cae5567 tempest-FlavorMetadataValidation-1139741905 tempest-FlavorMetadataValidation-1139741905-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:09.610653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-053ed2c7-b526-499d-8d06-50b9fb8412f8 tempest-FlavorsV255TestJSON-552295467 tempest-FlavorsV255TestJSON-552295467-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1186099593", "id": 2032971298, "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:09.640260 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-053ed2c7-b526-499d-8d06-50b9fb8412f8 tempest-FlavorsV255TestJSON-552295467 tempest-FlavorsV255TestJSON-552295467-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.277261 Nov 02 12:19:09.641663 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 4/10] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:19:09 2022] POST /compute/v2.1/flavors => generated 449 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:09.648548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5305ad32-d00a-44fd-9b04-fc2863dda0f4 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Calling method '.version_select at 0x7f2290113e50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:09.784791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c468073-ad95-4c63-a73a-d3a70cae5567 tempest-FlavorMetadataValidation-1139741905 tempest-FlavorMetadataValidation-1139741905-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1057100765/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.261283 Nov 02 12:19:09.785882 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 7/11] 10.222.0.45 () {62 vars in 1265 bytes} [Wed Nov 2 12:19:09 2022] POST /compute/v2.1/flavors/1057100765/os-extra_specs => generated 62 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:09.804384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5dd69bf-056b-4197-9065-1af4e5e2c117 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:09.839305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dd69bf-056b-4197-9065-1af4e5e2c117 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.840680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dd69bf-056b-4197-9065-1af4e5e2c117 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.842795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dd69bf-056b-4197-9065-1af4e5e2c117 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.096533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5305ad32-d00a-44fd-9b04-fc2863dda0f4 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.098446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5305ad32-d00a-44fd-9b04-fc2863dda0f4 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.099113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5305ad32-d00a-44fd-9b04-fc2863dda0f4 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.100112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5305ad32-d00a-44fd-9b04-fc2863dda0f4 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.101323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5305ad32-d00a-44fd-9b04-fc2863dda0f4 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.101993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5305ad32-d00a-44fd-9b04-fc2863dda0f4 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.145137 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5305ad32-d00a-44fd-9b04-fc2863dda0f4 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/7e1db1f3ba904eedbb24e4a3dcaabfdc/detail" status: 200 len: 463 microversion: 2.57 time: 0.501574 Nov 02 12:19:10.146092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 5/12] 10.222.0.45 () {60 vars in 1304 bytes} [Wed Nov 2 12:19:09 2022] GET /compute/v2.1/os-quota-sets/7e1db1f3ba904eedbb24e4a3dcaabfdc/detail => generated 463 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:10.438316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9cb57d23-463a-4c2a-abcd-3edcf750c4e5 tempest-FlavorsV255TestJSON-1177674117 tempest-FlavorsV255TestJSON-1177674117-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.461136 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9cb57d23-463a-4c2a-abcd-3edcf750c4e5 tempest-FlavorsV255TestJSON-1177674117 tempest-FlavorsV255TestJSON-1177674117-project] 10.222.0.45 "GET /compute/v2.1/flavors/2032971298" status: 200 len: 449 microversion: 2.55 time: 0.313446 Nov 02 12:19:10.462214 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 6/13] 10.222.0.45 () {60 vars in 1199 bytes} [Wed Nov 2 12:19:10 2022] GET /compute/v2.1/flavors/2032971298 => generated 449 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:10.472938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ece4cf8c-1d25-45bd-b7a7-d0366bf208e5 tempest-FlavorMetadataValidation-1139741905 tempest-FlavorMetadataValidation-1139741905-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.533265 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ece4cf8c-1d25-45bd-b7a7-d0366bf208e5 tempest-FlavorMetadataValidation-1139741905 tempest-FlavorMetadataValidation-1139741905-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1057100765" status: 202 len: 0 microversion: 2.86 time: 0.069363 Nov 02 12:19:10.535593 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 7/14] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Nov 2 12:19:10 2022] DELETE /compute/v2.1/flavors/1057100765 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:10.548459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-046cb1dc-53b1-490e-9edf-a7e34f72eded tempest-FlavorsV255TestJSON-552295467 tempest-FlavorsV255TestJSON-552295467-project-admin] Action: 'update', calling method: .version_select at 0x7f22906a3c10>, body: {"flavor": {"description": "new"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:10.611736 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5dd69bf-056b-4197-9065-1af4e5e2c117 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 0.814720 Nov 02 12:19:10.612382 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 8/15] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:19:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:10.619555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-046cb1dc-53b1-490e-9edf-a7e34f72eded tempest-FlavorsV255TestJSON-552295467 tempest-FlavorsV255TestJSON-552295467-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/2032971298" status: 200 len: 450 microversion: 2.55 time: 0.082509 Nov 02 12:19:10.620940 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 8/16] 10.222.0.45 () {62 vars in 1219 bytes} [Wed Nov 2 12:19:10 2022] PUT /compute/v2.1/flavors/2032971298 => generated 450 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:10.623739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1c73ba1-be5d-48c3-b894-525fb3870525 tempest-FlavorMetadataValidation-1139741905 tempest-FlavorMetadataValidation-1139741905-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.642407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94f53252-967b-466a-a88e-16cbc493692a tempest-FlavorsV255TestJSON-1177674117 tempest-FlavorsV255TestJSON-1177674117-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.660925 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f1c73ba1-be5d-48c3-b894-525fb3870525 tempest-FlavorMetadataValidation-1139741905 tempest-FlavorMetadataValidation-1139741905-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.86 time: 0.045905 Nov 02 12:19:10.674025 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 9/17] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:10 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:10.681039 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94f53252-967b-466a-a88e-16cbc493692a tempest-FlavorsV255TestJSON-1177674117 tempest-FlavorsV255TestJSON-1177674117-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.043116 Nov 02 12:19:10.687147 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 9/18] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:10 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:10.704400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d59a2342-0eef-4981-9b04-f9e61693f6de tempest-FlavorsV255TestJSON-1177674117 tempest-FlavorsV255TestJSON-1177674117-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.735248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d59a2342-0eef-4981-9b04-f9e61693f6de tempest-FlavorsV255TestJSON-1177674117 tempest-FlavorsV255TestJSON-1177674117-project] 10.222.0.45 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.034738 Nov 02 12:19:10.736064 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 10/19] 10.222.0.45 () {60 vars in 1166 bytes} [Wed Nov 2 12:19:10 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:10.751329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Action: 'update', calling method: .version_select at 0x7f229007b280>, body: {"quota_set": {"ram": "2048"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:10.755239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f8984110-26c4-4632-b125-643d9c3dcbd9 tempest-FlavorsV255TestJSON-552295467 tempest-FlavorsV255TestJSON-552295467-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.790099 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f8984110-26c4-4632-b125-643d9c3dcbd9 tempest-FlavorsV255TestJSON-552295467 tempest-FlavorsV255TestJSON-552295467-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/2032971298" status: 202 len: 0 microversion: 2.55 time: 0.038767 Nov 02 12:19:10.790833 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Nov 2 12:19:10 2022] DELETE /compute/v2.1/flavors/2032971298 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:10.803195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1102243-8b80-444f-b46b-111e106b0a50 tempest-FlavorsV255TestJSON-552295467 tempest-FlavorsV255TestJSON-552295467-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.824409 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1102243-8b80-444f-b46b-111e106b0a50 tempest-FlavorsV255TestJSON-552295467 tempest-FlavorsV255TestJSON-552295467-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.025645 Nov 02 12:19:10.825235 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 12/21] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:10 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:11.415534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-143628221", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "availability_zone": "tempest-test_az-842019088"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:11.433362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.434244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.434524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.435041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.435479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.435935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.511419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.513173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.515601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.515933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.516562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.517172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.517330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.517921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.518453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.519000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.519432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.521000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.644580 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d0cc85ab-65cc-4fee-93cc-c037f0ac61b9 tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/7e1db1f3ba904eedbb24e4a3dcaabfdc?user_id=65a1ff093f924f80bf7b345545466ec1" status: 200 len: 148 microversion: 2.57 time: 0.901245 Nov 02 12:19:11.646009 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 10/22] 10.222.0.45 () {62 vars in 1384 bytes} [Wed Nov 2 12:19:10 2022] PUT /compute/v2.1/os-quota-sets/7e1db1f3ba904eedbb24e4a3dcaabfdc?user_id=65a1ff093f924f80bf7b345545466ec1 => generated 148 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:11.659500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-478a2e4c-6621-46ec-9d4d-f8a29c42469d tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] Calling method '.version_select at 0x7f22900343a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:12.256902 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-478a2e4c-6621-46ec-9d4d-f8a29c42469d tempest-QuotasAdminTestV257-707359824 tempest-QuotasAdminTestV257-707359824-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/7e1db1f3ba904eedbb24e4a3dcaabfdc?user_id=65a1ff093f924f80bf7b345545466ec1" status: 200 len: 190 microversion: 2.57 time: 0.601862 Nov 02 12:19:12.257516 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 11/23] 10.222.0.45 () {60 vars in 1364 bytes} [Wed Nov 2 12:19:11 2022] GET /compute/v2.1/os-quota-sets/7e1db1f3ba904eedbb24e4a3dcaabfdc?user_id=65a1ff093f924f80bf7b345545466ec1 => generated 190 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:12.502140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:19:12.632952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5897f7cb-cba9-4da9-86b3-361ede6b1b85 tempest-AZAdminNegativeTestJSON-673392551 tempest-AZAdminNegativeTestJSON-673392551-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:12.635921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5897f7cb-cba9-4da9-86b3-361ede6b1b85 tempest-AZAdminNegativeTestJSON-673392551 tempest-AZAdminNegativeTestJSON-673392551-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '9803b8d65c9f49448f0b73a13e31de05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7831dd998c0c48a19e51214146ea730f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5897f7cb-cba9-4da9-86b3-361ede6b1b85 tempest-AZAdminNegativeTestJSON-673392551 tempest-AZAdminNegativeTestJSON-673392551-project] Request method failure captured: Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA9n5dVdovFviHO6Ln4STPnNIhboGTy4iHVV2DDkci13NQrIM2q2gjz7rDUkTqoAzI3XgjADkfBOVRmbjUZ_eHkwtHcFILsBg-fKGOl0zJOCPQNSV10A2wKOoXH69cbg8An3s28YrhsQPyK7Bmo3Iwpkxao51p5aZFtruyGgVaS0S8 Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 7831dd998c0c48a19e51214146ea730f Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AZAdminNegativeTestJSON-673392551 Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:12.638752 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7831dd998c0c48a19e51214146ea730f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7831dd998c0c48a19e51214146ea730f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7831dd998c0c48a19e51214146ea730f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7831dd998c0c48a19e51214146ea730f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AZAdminNegativeTestJSON-673392551 Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 7831dd998c0c48a19e51214146ea730f Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-673392551 Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AZAdminNegativeTestJSON-673392551-project Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 9803b8d65c9f49448f0b73a13e31de05 Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AZAdminNegativeTestJSON-673392551-project Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 12:19:12.640219 n-d-855650-5 devstack@n-api.service[120723]: action_args: {} Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:12.641055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:12.643361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5897f7cb-cba9-4da9-86b3-361ede6b1b85 tempest-AZAdminNegativeTestJSON-673392551 tempest-AZAdminNegativeTestJSON-673392551-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:12.645051 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5897f7cb-cba9-4da9-86b3-361ede6b1b85 tempest-AZAdminNegativeTestJSON-673392551 tempest-AZAdminNegativeTestJSON-673392551-project] 10.222.0.45 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.383738 Nov 02 12:19:12.649947 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 12/24] 10.222.0.45 () {58 vars in 1185 bytes} [Wed Nov 2 12:19:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 388 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:12.860478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:19:12.860905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:19:12.861379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:19:12.861914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:19:12.862365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:19:12.877299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:12.877784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:12.878624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:12.879871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:12.881190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:12.881920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:12.906530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Getting quotas for project 4009f2fda4a94036868b5a27212af0c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:12.911221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Getting quotas for user 1f368d94bcc34714a39f8825be5e82ef and project 4009f2fda4a94036868b5a27212af0c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:12.923720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:19:12.926639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:19:12.998482 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-966abe1a-fb30-43f8-9cf0-fa7fc168faba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.025099 Nov 02 12:19:13.002408 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 13/25] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:19:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:19:13.015134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4345379-2201-438b-8d43-108cf488c580 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:13.015908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f4345379-2201-438b-8d43-108cf488c580 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:14.667692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f4345379-2201-438b-8d43-108cf488c580 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:14.687757 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f4345379-2201-438b-8d43-108cf488c580 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1241 microversion: 2.1 time: 1.678244 Nov 02 12:19:14.702802 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 13/26] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:13 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1241 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:15.714322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6bc7387e-24a0-4dfd-91c4-de31d0aaa872 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:15.715629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bc7387e-24a0-4dfd-91c4-de31d0aaa872 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:15.832515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6bc7387e-24a0-4dfd-91c4-de31d0aaa872 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:15.865748 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6bc7387e-24a0-4dfd-91c4-de31d0aaa872 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1241 microversion: 2.1 time: 0.156360 Nov 02 12:19:15.867386 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 14/27] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:15 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:16.904179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:16.905468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:16.908916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:16.913400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:16.914236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:16.914839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:16.915789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:16.916473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:16.917055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:17.090017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30f702ff-1ed9-4052-82ed-e68611680ed5 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-9031378", "ram": 512, "vcpus": 1, "disk": 10, "id": 1947566321, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:17.133131 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30f702ff-1ed9-4052-82ed-e68611680ed5 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.473243 Nov 02 12:19:17.143468 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 14/28] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:19:16 2022] POST /compute/v2.1/flavors => generated 413 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:17.151686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:17.166176 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2cec7a5e-703e-4491-8707-42e7f9298a10 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1297 microversion: 2.1 time: 0.265646 Nov 02 12:19:17.179496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 15/29] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:16 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1297 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:17.508144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c2d659c-33a8-4352-b7d0-cb904a9c0023 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:17.524927 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-4c2d659c-33a8-4352-b7d0-cb904a9c0023 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] HTTP exception thrown: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c2d659c-33a8-4352-b7d0-cb904a9c0023 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Request method failure captured: Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/flavors/1947566321/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBB67jB-_3aJgEF44FHkeLehGmcsKF8TamMGoMbQX0e9KWVwylji9BiMF2LgSNF15b0qRYa7s-bXNF9TcIHIgKDGx2380zvkjxyEPXk1z95wPaL79LSkQ-wDXNU7vzogeLEKNPbkKXkbrUPh56RZ50mUBEQeB7j2mibbYuGWn5oh5s Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 2ac6541e79e84fbe9a720f50aa676134 Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:17.526920 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 2ac6541e79e84fbe9a720f50aa676134 Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 57831ff2eba84fac8445be99e8e6f1ab Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:19:17.528038 n-d-855650-5 devstack@n-api.service[120723]: exception: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'flavor_id': '1947566321', 'id': 'hw:cpu_thread_policy'} Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.528758 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c2d659c-33a8-4352-b7d0-cb904a9c0023 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Returning 404 to user: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:17.530697 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c2d659c-33a8-4352-b7d0-cb904a9c0023 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] 10.222.0.45 "GET /compute/v2.1/flavors/1947566321/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.383949 Nov 02 12:19:17.539807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cdf6f5ef-8ff4-4531-b450-9096aa067b7f tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:17.543930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cdf6f5ef-8ff4-4531-b450-9096aa067b7f tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '57831ff2eba84fac8445be99e8e6f1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac6541e79e84fbe9a720f50aa676134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cdf6f5ef-8ff4-4531-b450-9096aa067b7f tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Request method failure captured: Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/flavors/1947566321/os-extra_specs HTTP/1.1 Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 66 Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBB67jB-_3aJgEF44FHkeLehGmcsKF8TamMGoMbQX0e9KWVwylji9BiMF2LgSNF15b0qRYa7s-bXNF9TcIHIgKDGx2380zvkjxyEPXk1z95wPaL79LSkQ-wDXNU7vzogeLEKNPbkKXkbrUPh56RZ50mUBEQeB7j2mibbYuGWn5oh5s Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 2ac6541e79e84fbe9a720f50aa676134 Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:19:17.548885 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 2ac6541e79e84fbe9a720f50aa676134 Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 57831ff2eba84fac8445be99e8e6f1ab Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 02 12:19:17.549986 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'flavor_id': '1947566321', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:17.550607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 12:19:17.551620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.555616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 15/30] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:19:17 2022] GET /compute/v2.1/flavors/1947566321/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:17.555691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cdf6f5ef-8ff4-4531-b450-9096aa067b7f tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:17.555691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cdf6f5ef-8ff4-4531-b450-9096aa067b7f tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] 10.222.0.45 "POST /compute/v2.1/flavors/1947566321/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.015497 Nov 02 12:19:17.555981 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 16/31] 10.222.0.45 () {60 vars in 1224 bytes} [Wed Nov 2 12:19:17 2022] POST /compute/v2.1/flavors/1947566321/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:17.560559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-99bcd4e7-1aa7-4e03-9704-46e9127c7094 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:17.627449 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-99bcd4e7-1aa7-4e03-9704-46e9127c7094 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1947566321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.070196 Nov 02 12:19:17.628814 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 16/32] 10.222.0.45 () {60 vars in 1224 bytes} [Wed Nov 2 12:19:17 2022] POST /compute/v2.1/flavors/1947566321/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:17.643537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-652240bd-cf4f-44b1-a108-09305ee07437 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:17.645891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-652240bd-cf4f-44b1-a108-09305ee07437 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '57831ff2eba84fac8445be99e8e6f1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac6541e79e84fbe9a720f50aa676134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-652240bd-cf4f-44b1-a108-09305ee07437 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Request method failure captured: Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBB67jB-_3aJgEF44FHkeLehGmcsKF8TamMGoMbQX0e9KWVwylji9BiMF2LgSNF15b0qRYa7s-bXNF9TcIHIgKDGx2380zvkjxyEPXk1z95wPaL79LSkQ-wDXNU7vzogeLEKNPbkKXkbrUPh56RZ50mUBEQeB7j2mibbYuGWn5oh5s Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 2ac6541e79e84fbe9a720f50aa676134 Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:19:17.649241 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 2ac6541e79e84fbe9a720f50aa676134 Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 57831ff2eba84fac8445be99e8e6f1ab Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:19:17.650400 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'flavor_id': '1947566321', 'id': 'hw:numa_nodes'} Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:17.650940 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.651874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-652240bd-cf4f-44b1-a108-09305ee07437 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:17.653082 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-652240bd-cf4f-44b1-a108-09305ee07437 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] 10.222.0.45 "DELETE /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016248 Nov 02 12:19:17.653082 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 17/33] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:19:17 2022] DELETE /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:17.661923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6f7aa17e-f5d9-441e-ac2c-415999fa444d tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:17.684228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:17.697270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6f7aa17e-f5d9-441e-ac2c-415999fa444d tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1947566321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038942 Nov 02 12:19:17.698561 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 17/34] 10.222.0.45 () {60 vars in 1224 bytes} [Wed Nov 2 12:19:17 2022] POST /compute/v2.1/flavors/1947566321/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:17.713544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1e255b-96e4-44c6-8496-a792b89b89c4 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:17.719035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d1e255b-96e4-44c6-8496-a792b89b89c4 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '57831ff2eba84fac8445be99e8e6f1ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac6541e79e84fbe9a720f50aa676134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1e255b-96e4-44c6-8496-a792b89b89c4 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Request method failure captured: Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 22 Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBB67jB-_3aJgEF44FHkeLehGmcsKF8TamMGoMbQX0e9KWVwylji9BiMF2LgSNF15b0qRYa7s-bXNF9TcIHIgKDGx2380zvkjxyEPXk1z95wPaL79LSkQ-wDXNU7vzogeLEKNPbkKXkbrUPh56RZ50mUBEQeB7j2mibbYuGWn5oh5s Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 2ac6541e79e84fbe9a720f50aa676134 Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:19:17.721387 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2ac6541e79e84fbe9a720f50aa676134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 2ac6541e79e84fbe9a720f50aa676134 Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 57831ff2eba84fac8445be99e8e6f1ab Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: {"hw:numa_nodes": "1"} Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:19:17.722765 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'flavor_id': '1947566321', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:17.723406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 12:19:17.724319 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.725232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1e255b-96e4-44c6-8496-a792b89b89c4 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:17.725232 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5d1e255b-96e4-44c6-8496-a792b89b89c4 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146 tempest-FlavorsExtraSpecsNegativeTestJSON-650761146-project] 10.222.0.45 "PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020157 Nov 02 12:19:17.726475 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 18/35] 10.222.0.45 () {60 vars in 1265 bytes} [Wed Nov 2 12:19:17 2022] PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:17.736728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e837d68-959a-42c0-9cc0-d3b46a5e3344 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:17.745995 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-5e837d68-959a-42c0-9cc0-d3b46a5e3344 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] HTTP exception thrown: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e837d68-959a-42c0-9cc0-d3b46a5e3344 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Request method failure captured: Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/flavors/1947566321/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBEuBNVYMYLsPujJwLd6v4Vn7YYqLcM8n-IfFTZK89A8TNQA5m6gFRDS-XIilRxKxU53EvMLttXKUVxou63tqAY4gqMzYJNS8PBoEkdIVorud1IwZJErqpyvIBnJLqvI_RWUCFb7upvjmvKOEqAqfKOLNrb4YFwCWVygFtUQueU-zI Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 665cbe6483cf49d58d802adf6e85546a Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:17.748266 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 665cbe6483cf49d58d802adf6e85546a Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 3a0b2b14ea7146179a885faa3251747f Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:19:17.749472 n-d-855650-5 devstack@n-api.service[120723]: exception: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'flavor_id': '1947566321', 'id': 'hw:cpu_thread_policy'} Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.750079 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e837d68-959a-42c0-9cc0-d3b46a5e3344 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Returning 404 to user: Flavor 1947566321 has no extra specs with key hw:cpu_thread_policy. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:17.751103 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e837d68-959a-42c0-9cc0-d3b46a5e3344 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1947566321/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.019490 Nov 02 12:19:17.751664 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 18/36] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:19:17 2022] DELETE /compute/v2.1/flavors/1947566321/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:19:17.764096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8bf5bfd-27c1-4907-acd8-c0e76d8003bb tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:17.770926 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-b8bf5bfd-27c1-4907-acd8-c0e76d8003bb tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8bf5bfd-27c1-4907-acd8-c0e76d8003bb tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Request method failure captured: Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 27 Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBEuBNVYMYLsPujJwLd6v4Vn7YYqLcM8n-IfFTZK89A8TNQA5m6gFRDS-XIilRxKxU53EvMLttXKUVxou63tqAY4gqMzYJNS8PBoEkdIVorud1IwZJErqpyvIBnJLqvI_RWUCFb7upvjmvKOEqAqfKOLNrb4YFwCWVygFtUQueU-zI Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 665cbe6483cf49d58d802adf6e85546a Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:19:17.772719 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 665cbe6483cf49d58d802adf6e85546a Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 3a0b2b14ea7146179a885faa3251747f Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: {"hw:cpu_policy": "shared"} Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:19:17.773870 n-d-855650-5 devstack@n-api.service[120722]: exception: Request body and URI mismatch Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'flavor_id': '1947566321', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.774692 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.775610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:17.775610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:17.775610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 02 12:19:17.775610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.775610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8bf5bfd-27c1-4907-acd8-c0e76d8003bb tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:17.775610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8bf5bfd-27c1-4907-acd8-c0e76d8003bb tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016653 Nov 02 12:19:17.776071 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 19/37] 10.222.0.45 () {60 vars in 1265 bytes} [Wed Nov 2 12:19:17 2022] PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:19:17.790214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-901c4ad2-6f77-4a21-8dd9-1a398c2ee36f tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-901c4ad2-6f77-4a21-8dd9-1a398c2ee36f tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Request method failure captured: Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 49 Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBEuBNVYMYLsPujJwLd6v4Vn7YYqLcM8n-IfFTZK89A8TNQA5m6gFRDS-XIilRxKxU53EvMLttXKUVxou63tqAY4gqMzYJNS8PBoEkdIVorud1IwZJErqpyvIBnJLqvI_RWUCFb7upvjmvKOEqAqfKOLNrb4YFwCWVygFtUQueU-zI Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 665cbe6483cf49d58d802adf6e85546a Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:17.800499 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_665cbe6483cf49d58d802adf6e85546a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 665cbe6483cf49d58d802adf6e85546a Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 3a0b2b14ea7146179a885faa3251747f Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 02 12:19:17.802031 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'flavor_id': '1947566321', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance: Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 02 12:19:17.802819 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.804139 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:17.805251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:17.805251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:17.805251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:19:17.805251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:19:17.805251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 12:19:17.805251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:17.806692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-901c4ad2-6f77-4a21-8dd9-1a398c2ee36f tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:17.807880 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-901c4ad2-6f77-4a21-8dd9-1a398c2ee36f tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.024744 Nov 02 12:19:17.809083 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 19/38] 10.222.0.45 () {60 vars in 1265 bytes} [Wed Nov 2 12:19:17 2022] PUT /compute/v2.1/flavors/1947566321/os-extra_specs/hw:numa_nodes => generated 117 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:19:17.828138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4466ec95-a547-41c0-b328-fd2e05c48a15 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:17.875506 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4466ec95-a547-41c0-b328-fd2e05c48a15 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1947566321" status: 202 len: 0 microversion: 2.1 time: 0.057211 Nov 02 12:19:17.882190 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:19:17 2022] DELETE /compute/v2.1/flavors/1947566321 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:19:17.886657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-357dee59-765e-445e-9a2a-265fa8d11403 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:17.923900 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-357dee59-765e-445e-9a2a-265fa8d11403 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763 tempest-FlavorsExtraSpecsNegativeTestJSON-779132763-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041053 Nov 02 12:19:17.925166 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 20/40] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:19:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:18.192228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:18.192838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:18.199144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:18.199547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:18.199996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:18.201703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:18.202320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:18.202841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:18.274587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:18.284196 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a472e358-b74a-45ce-9d06-7bf02c65aaba tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1295 microversion: 2.1 time: 0.095790 Nov 02 12:19:18.284793 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 21/41] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:18 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:19.314131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:19.315132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:19.353936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:19.355006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:19.356260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:19.358532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:19.360493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:19.362605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:19.811647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:19.853680 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58587e3b-ab07-4b48-bce8-daee01c9844e tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.545935 Nov 02 12:19:19.872007 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 21/42] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:19 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:20.847348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf989435-37bd-4d1c-ae41-8c4cae859cd1 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-717063688", "ram": 512, "vcpus": 1, "disk": 10, "id": 1845608786, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:20.894658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:20.896312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:20.904791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:20.905667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:20.906382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:20.907045 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf989435-37bd-4d1c-ae41-8c4cae859cd1 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.730243 Nov 02 12:19:20.907603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:20.908268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:20.908908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:20.910454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 22/43] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:19:20 2022] POST /compute/v2.1/flavors => generated 415 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:20.925084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65bf66d5-39a8-4829-a9af-7dab51cb752c tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:20.997682 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65bf66d5-39a8-4829-a9af-7dab51cb752c tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1845608786/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080537 Nov 02 12:19:21.000698 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1224 bytes} [Wed Nov 2 12:19:20 2022] POST /compute/v2.1/flavors/1845608786/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:21.177029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:21.195453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.305577 Nov 02 12:19:21.211664 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 22/45] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:20 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:21.215859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:21.218206 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8365c596-c4ba-4fd4-9465-7463dcca1dfb tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002220 Nov 02 12:19:21.220324 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 23/46] 10.222.0.45 () {56 vars in 886 bytes} [Wed Nov 2 12:19:21 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:19:21.806352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15056ca5-9241-44ae-b862-8ac923181169 tempest-FlavorsExtraSpecsTestJSON-996656061 tempest-FlavorsExtraSpecsTestJSON-996656061-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:21.836715 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15056ca5-9241-44ae-b862-8ac923181169 tempest-FlavorsExtraSpecsTestJSON-996656061 tempest-FlavorsExtraSpecsTestJSON-996656061-project] 10.222.0.45 "GET /compute/v2.1/flavors/1845608786/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.814955 Nov 02 12:19:21.840370 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 24/47] 10.222.0.45 () {58 vars in 1203 bytes} [Wed Nov 2 12:19:21 2022] GET /compute/v2.1/flavors/1845608786/os-extra_specs => generated 66 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:21.849238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=9 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:21.854987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65a5ce61-b999-428b-80d2-eeb7f3fb6f12 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:21.890116 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65a5ce61-b999-428b-80d2-eeb7f3fb6f12 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1845608786/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041864 Nov 02 12:19:21.896419 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 24/48] 10.222.0.45 () {60 vars in 1224 bytes} [Wed Nov 2 12:19:21 2022] POST /compute/v2.1/flavors/1845608786/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:21.905850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ddb10061-9a7a-466b-ba08-5f13d0c35bdb tempest-FlavorsExtraSpecsTestJSON-996656061 tempest-FlavorsExtraSpecsTestJSON-996656061-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:21.922962 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ddb10061-9a7a-466b-ba08-5f13d0c35bdb tempest-FlavorsExtraSpecsTestJSON-996656061 tempest-FlavorsExtraSpecsTestJSON-996656061-project] 10.222.0.45 "GET /compute/v2.1/flavors/1845608786/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.022883 Nov 02 12:19:21.931657 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 25/49] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:19:21 2022] GET /compute/v2.1/flavors/1845608786/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:21.936436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1872fbfd-4e1f-49ec-b117-1ac943bdda4b tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:21.969439 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1872fbfd-4e1f-49ec-b117-1ac943bdda4b tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1845608786/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036355 Nov 02 12:19:21.979011 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1224 bytes} [Wed Nov 2 12:19:21 2022] POST /compute/v2.1/flavors/1845608786/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:21.990753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34c032bd-9416-490a-8c8b-6927b0ed801c tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:22.021725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34c032bd-9416-490a-8c8b-6927b0ed801c tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/1845608786/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038731 Nov 02 12:19:22.023522 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 26/51] 10.222.0.45 () {58 vars in 1203 bytes} [Wed Nov 2 12:19:21 2022] GET /compute/v2.1/flavors/1845608786/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:22.034227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-428a3c09-8c70-4e9d-bf8d-662345a60b2d tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:22.092519 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-428a3c09-8c70-4e9d-bf8d-662345a60b2d tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/1845608786/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.058159 Nov 02 12:19:22.100829 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 26/52] 10.222.0.45 () {60 vars in 1265 bytes} [Wed Nov 2 12:19:22 2022] PUT /compute/v2.1/flavors/1845608786/os-extra_specs/hw:numa_nodes => generated 22 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:22.109815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe2b63d6-30d0-44f5-8005-04ecbfaac50c tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:22.130556 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe2b63d6-30d0-44f5-8005-04ecbfaac50c tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/1845608786/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025968 Nov 02 12:19:22.131576 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 27/53] 10.222.0.45 () {58 vars in 1203 bytes} [Wed Nov 2 12:19:22 2022] GET /compute/v2.1/flavors/1845608786/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:22.143093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-34cd0b49-2abb-480e-84b7-123b23c3c2ac tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:22.199291 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-34cd0b49-2abb-480e-84b7-123b23c3c2ac tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1845608786/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.061653 Nov 02 12:19:22.201159 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 27/54] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:19:22 2022] DELETE /compute/v2.1/flavors/1845608786/os-extra_specs/hw:numa_nodes => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:19:22.210834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31b85acb-ba5a-499a-8e3d-f4a83ea1257f tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:22.239525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:22.240162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:22.255892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:22.256394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:22.256842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:22.257565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:22.262049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31b85acb-ba5a-499a-8e3d-f4a83ea1257f tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1845608786/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.056617 Nov 02 12:19:22.263166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:22.264113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:22.268538 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 28/55] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:19:22 2022] DELETE /compute/v2.1/flavors/1845608786/os-extra_specs/hw:cpu_policy => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:19:22.276922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e46637f-07a2-4cac-a3ca-4a7243dfc3e7 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:22.296716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e46637f-07a2-4cac-a3ca-4a7243dfc3e7 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/1845608786/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026973 Nov 02 12:19:22.302391 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 29/56] 10.222.0.45 () {58 vars in 1203 bytes} [Wed Nov 2 12:19:22 2022] GET /compute/v2.1/flavors/1845608786/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:22.315235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d99a20e8-816d-411c-bbcd-d6d78d48e118 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:22.375270 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d99a20e8-816d-411c-bbcd-d6d78d48e118 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1845608786" status: 202 len: 0 microversion: 2.1 time: 0.063939 Nov 02 12:19:22.377343 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 30/57] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:19:22 2022] DELETE /compute/v2.1/flavors/1845608786 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:19:22.393550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7597a2f7-c661-4f4b-8eff-9bedd4a29d24 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:22.469729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7597a2f7-c661-4f4b-8eff-9bedd4a29d24 tempest-FlavorsExtraSpecsTestJSON-567125633 tempest-FlavorsExtraSpecsTestJSON-567125633-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057594 Nov 02 12:19:22.470472 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 31/58] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:19:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:22.583498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:22.592374 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-228a1433-ca40-48e2-9040-23e6e94438e5 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.357098 Nov 02 12:19:22.594858 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 28/59] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:22 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:23.128641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=10 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:23.415117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7eb8094c-b490-484b-b3d4-aa4a8633d374 req-c106635e-c353-4373-b277-069ae91cce28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76517ea9-7cac-4202-ade6-4fbb517b72e0", "tag": "9a64e082-7ce2-45f3-a2d3-e0d28ffb8f54"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:23.428835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7eb8094c-b490-484b-b3d4-aa4a8633d374 req-c106635e-c353-4373-b277-069ae91cce28 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:23.429389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7eb8094c-b490-484b-b3d4-aa4a8633d374 req-c106635e-c353-4373-b277-069ae91cce28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:23.429904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7eb8094c-b490-484b-b3d4-aa4a8633d374 req-c106635e-c353-4373-b277-069ae91cce28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:23.459047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7eb8094c-b490-484b-b3d4-aa4a8633d374 req-c106635e-c353-4373-b277-069ae91cce28 service nova] Creating event network-changed:9a64e082-7ce2-45f3-a2d3-e0d28ffb8f54 for instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 on n-h1-855650-5 Nov 02 12:19:23.459770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7eb8094c-b490-484b-b3d4-aa4a8633d374 req-c106635e-c353-4373-b277-069ae91cce28 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:19:23.460416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7eb8094c-b490-484b-b3d4-aa4a8633d374 req-c106635e-c353-4373-b277-069ae91cce28 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:19:23.461825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:23.462581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:23.463242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:23.465145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:23.466053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:23.467401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:23.486561 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.compute.rpcapi [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 12:19:23.490734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] Releasing lock "compute-rpcapi-router" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:19:23.518710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cabfde63-5901-4579-b65a-7cca6d0a35f4 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394123 Nov 02 12:19:23.519534 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 32/60] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:23.536013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-427375034", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:23.623903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:23.624927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:19:23.629269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:23.659923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:23.660843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:23.665651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:23.666881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:23.667604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:23.668272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:24.054314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:24.067812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3ec99fd-1bda-4946-848c-15519b1a8fac tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.451917 Nov 02 12:19:24.076548 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 33/61] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:23 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:24.131480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:19:24.132477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:19:24.133250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:19:24.133865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:19:24.134507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:19:24.160801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:24.161393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:24.161910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:24.163262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:24.163726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:24.164159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:24.189635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Getting quotas for project abeb11f5ac84444384ce6a3fe2253953. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:24.195742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Getting quotas for user ef6e51c338b94fc0ab741f99965a3245 and project abeb11f5ac84444384ce6a3fe2253953. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:24.212552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:19:24.217358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:19:24.321215 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-70b807c8-812a-4aea-84bd-379616b88aa3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013509 Nov 02 12:19:24.332623 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 29/62] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:19:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:19:24.338329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9221c66c-c1c9-41b5-9442-d512cb8892ff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:24.339114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9221c66c-c1c9-41b5-9442-d512cb8892ff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:24.681763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9221c66c-c1c9-41b5-9442-d512cb8892ff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:24.697595 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9221c66c-c1c9-41b5-9442-d512cb8892ff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1219 microversion: 2.1 time: 0.365929 Nov 02 12:19:24.702167 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 34/63] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:24 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1219 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:25.098545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:25.099235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:25.126548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:25.138841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:25.143149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:25.144078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:25.144933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:25.145389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:25.728777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfabcca7-c2bd-411c-98d9-50484f547cc0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:25.738723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfabcca7-c2bd-411c-98d9-50484f547cc0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:25.993825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:26.013426 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a75a381-ad70-499c-8685-cb0f6e252153 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.919506 Nov 02 12:19:26.014090 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 30/64] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:25 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:26.065717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfabcca7-c2bd-411c-98d9-50484f547cc0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:26.091813 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfabcca7-c2bd-411c-98d9-50484f547cc0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1219 microversion: 2.1 time: 0.370583 Nov 02 12:19:26.101211 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 35/65] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:25 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1219 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:27.066963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:27.071012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:27.085501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:27.086316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:27.087313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:27.088895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:27.090515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:27.092111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:27.134739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:27.136836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:27.171739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:27.172692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:27.178209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:27.180223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:27.181402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:27.182694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:27.799256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:27.812494 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3563c03b-3459-4b4b-85e5-330c57a5813b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1271 microversion: 2.1 time: 0.684030 Nov 02 12:19:27.815132 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 36/66] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:27 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1271 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:28.034735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:28.055860 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-568f37e7-ed04-4143-8c22-02d4f153de9d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 1.014726 Nov 02 12:19:28.056479 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 31/67] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:27 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:28.616095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-602dcc83-bcb2-43e5-a349-0956a91f8ffc tempest-FlavorsV261TestJSON-1816349974 tempest-FlavorsV261TestJSON-1816349974-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-474334348", "id": 641540317, "os-flavor-access:is_public": "True"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:28.656448 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-602dcc83-bcb2-43e5-a349-0956a91f8ffc tempest-FlavorsV261TestJSON-1816349974 tempest-FlavorsV261TestJSON-1816349974-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.582472 Nov 02 12:19:28.657521 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 37/68] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:19:28 2022] POST /compute/v2.1/flavors => generated 464 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:28.864717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:28.866270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:28.876450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:28.877516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:28.878630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:28.879754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:28.880855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:28.881740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:29.000377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:29.013162 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-791963ec-991f-4af7-a424-2647c21c6aff tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1277 microversion: 2.1 time: 0.154159 Nov 02 12:19:29.017556 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 38/69] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:28 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:29.084495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:29.085372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:29.097593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:29.098312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:29.099503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:29.099832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:29.100422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:29.100927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:29.358865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d42df505-6539-4a10-b37c-9bcd960259a1 tempest-FlavorsV261TestJSON-995983045 tempest-FlavorsV261TestJSON-995983045-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:29.377790 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d42df505-6539-4a10-b37c-9bcd960259a1 tempest-FlavorsV261TestJSON-995983045 tempest-FlavorsV261TestJSON-995983045-project] 10.222.0.45 "GET /compute/v2.1/flavors/641540317" status: 200 len: 464 microversion: 2.61 time: 0.702822 Nov 02 12:19:29.378710 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 32/70] 10.222.0.45 () {60 vars in 1196 bytes} [Wed Nov 2 12:19:28 2022] GET /compute/v2.1/flavors/641540317 => generated 464 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:29.404677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97d328d7-72ad-411d-859d-b5b0b93827d0 tempest-FlavorsV261TestJSON-1816349974 tempest-FlavorsV261TestJSON-1816349974-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:29.417252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:29.432523 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82720878-8420-475f-892b-a39acfbb1621 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.351760 Nov 02 12:19:29.433267 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 39/71] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:29 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:29.478692 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97d328d7-72ad-411d-859d-b5b0b93827d0 tempest-FlavorsV261TestJSON-1816349974 tempest-FlavorsV261TestJSON-1816349974-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/641540317" status: 200 len: 465 microversion: 2.61 time: 0.079571 Nov 02 12:19:29.481888 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 33/72] 10.222.0.45 () {62 vars in 1216 bytes} [Wed Nov 2 12:19:29 2022] PUT /compute/v2.1/flavors/641540317 => generated 465 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:29.509319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a3eafa9-44d0-40e0-b292-2dfc7b900bb1 tempest-FlavorsV261TestJSON-995983045 tempest-FlavorsV261TestJSON-995983045-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:29.558001 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a3eafa9-44d0-40e0-b292-2dfc7b900bb1 tempest-FlavorsV261TestJSON-995983045 tempest-FlavorsV261TestJSON-995983045-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.057763 Nov 02 12:19:29.558765 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 40/73] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:29 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:29.584237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-486d172e-8d9a-4294-874c-409a28dd6453 tempest-FlavorsV261TestJSON-995983045 tempest-FlavorsV261TestJSON-995983045-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:29.616693 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-486d172e-8d9a-4294-874c-409a28dd6453 tempest-FlavorsV261TestJSON-995983045 tempest-FlavorsV261TestJSON-995983045-project] 10.222.0.45 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.036946 Nov 02 12:19:29.617607 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 34/74] 10.222.0.45 () {60 vars in 1166 bytes} [Wed Nov 2 12:19:29 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:29.652685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff9c656a-4380-4b5d-a042-0a30386b8453 tempest-FlavorsV261TestJSON-1816349974 tempest-FlavorsV261TestJSON-1816349974-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:29.687260 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff9c656a-4380-4b5d-a042-0a30386b8453 tempest-FlavorsV261TestJSON-1816349974 tempest-FlavorsV261TestJSON-1816349974-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/641540317" status: 202 len: 0 microversion: 2.61 time: 0.041075 Nov 02 12:19:29.691169 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 41/75] 10.222.0.45 () {60 vars in 1199 bytes} [Wed Nov 2 12:19:29 2022] DELETE /compute/v2.1/flavors/641540317 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:29.700789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-170eece0-966f-4744-b6f5-97ef9799c7a0 tempest-FlavorsV261TestJSON-1816349974 tempest-FlavorsV261TestJSON-1816349974-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:29.738710 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-170eece0-966f-4744-b6f5-97ef9799c7a0 tempest-FlavorsV261TestJSON-1816349974 tempest-FlavorsV261TestJSON-1816349974-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.044626 Nov 02 12:19:29.739356 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 35/76] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:29 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:19:30.045718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:30.046389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:30.053543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:30.054556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:30.055268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:30.056122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:30.056789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:30.057288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:30.271505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:30.285740 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ef6c44d-bc23-4ba7-9d8e-9afbbca146a0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.245823 Nov 02 12:19:30.298695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 42/77] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:30 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:30.466959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:30.468400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:30.484247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:30.485136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:30.486235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:30.488796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:30.489649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:30.490448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:30.724678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:30.733348 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6780c1c7-a0cf-4b77-95c1-f4a16d9f43b1 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.271857 Nov 02 12:19:30.747336 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 36/78] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:30 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:30.987048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ba83f6f-616d-4536-9da2-6b90acaa791c tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Calling method '.version_select at 0x7f228f549d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:30.992663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ba83f6f-616d-4536-9da2-6b90acaa791c tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:30.993393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ba83f6f-616d-4536-9da2-6b90acaa791c tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:30.994069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ba83f6f-616d-4536-9da2-6b90acaa791c tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:30.995930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ba83f6f-616d-4536-9da2-6b90acaa791c tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:30.997149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ba83f6f-616d-4536-9da2-6b90acaa791c tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:30.997853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ba83f6f-616d-4536-9da2-6b90acaa791c tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:31.048610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ba83f6f-616d-4536-9da2-6b90acaa791c tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.299499 Nov 02 12:19:31.059267 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 43/79] 10.222.0.45 () {58 vars in 1128 bytes} [Wed Nov 2 12:19:30 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:31.321484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.326128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:31.354264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:31.354807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:31.355389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:31.356215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:31.356951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:31.358015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:31.474946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f4567b1-d357-4672-b4b8-39ac0f0ff389 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Calling method '.version_select at 0x7f228f613ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.481709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5f4567b1-d357-4672-b4b8-39ac0f0ff389 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '80fab6a8a9e040a19c2148545252d307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5d68b65adb4d6f9bd98e3dfe2c0331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f4567b1-d357-4672-b4b8-39ac0f0ff389 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Request method failure captured: Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBQAPr5jARm4SAkfMGsvNPblfUEoRk4FkhprEcUsKSTl3fkmCVhH5RJDL71gxB2e-TRWcO9mtgbr1mhxtEV6wIyPmpvmY_F478rmRJE-ORsZ5JsIdLqB_c__uV5W6D_UWjPB3SFR0L7Qps2yMS5FXpho8BI9-Aflf2xhzLtPXVVI7Y Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:31.486319 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 80fab6a8a9e040a19c2148545252d307 Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: action_args: {} Nov 02 12:19:31.487928 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.488805 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 12:19:31.490450 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.493292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f4567b1-d357-4672-b4b8-39ac0f0ff389 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.494539 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5f4567b1-d357-4672-b4b8-39ac0f0ff389 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.437382 Nov 02 12:19:31.496145 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 37/80] 10.222.0.45 () {58 vars in 1128 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 439 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:19:31.510441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd0b72c8-f88e-4008-8767-7cdab04bf82b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Calling method '.version_select at 0x7f228f5d3af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.535940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd0b72c8-f88e-4008-8767-7cdab04bf82b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '80fab6a8a9e040a19c2148545252d307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5d68b65adb4d6f9bd98e3dfe2c0331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd0b72c8-f88e-4008-8767-7cdab04bf82b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Request method failure captured: Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hosts/n-d-855650-5/reboot HTTP/1.1 Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBQAPr5jARm4SAkfMGsvNPblfUEoRk4FkhprEcUsKSTl3fkmCVhH5RJDL71gxB2e-TRWcO9mtgbr1mhxtEV6wIyPmpvmY_F478rmRJE-ORsZ5JsIdLqB_c__uV5W6D_UWjPB3SFR0L7Qps2yMS5FXpho8BI9-Aflf2xhzLtPXVVI7Y Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:31.537681 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 80fab6a8a9e040a19c2148545252d307 Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'n-d-855650-5'} Nov 02 12:19:31.539212 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.540046 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 12:19:31.541191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.542983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd0b72c8-f88e-4008-8767-7cdab04bf82b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.543866 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd0b72c8-f88e-4008-8767-7cdab04bf82b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-d-855650-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.041191 Nov 02 12:19:31.549557 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 38/81] 10.222.0.45 () {58 vars in 1188 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts/n-d-855650-5/reboot => generated 111 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:19:31.555570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9bebbaf7-788e-4db9-952d-b9e5561b53be tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Calling method '.version_select at 0x7f228ffbb4c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.603028 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-9bebbaf7-788e-4db9-952d-b9e5561b53be tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9bebbaf7-788e-4db9-952d-b9e5561b53be tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Request method failure captured: Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBSkvWrraFVNdcpATpJSHywQV81aQ6SBBuY9oWmSqN78FRxU_r4k_7sOXmu-nWGiEd5_r7e7trA8X3swJK4xz74jA-wbSl4B74Kci5uiVeRla5Bk8xg3wd3cBeWGxpiAMwgdNGmxhkS_pqLx0B0swZ0KN7SZTBpVD6_zvvLm0EB6eQ Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:31.610123 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f023c505abbc4b418367705126a315a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f023c505abbc4b418367705126a315a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fcb129de3333491f97d6d94687ded246 Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'nonexistent_hostname'} Nov 02 12:19:31.611616 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:19:31.612493 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 12:19:31.613695 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9bebbaf7-788e-4db9-952d-b9e5561b53be tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9bebbaf7-788e-4db9-952d-b9e5561b53be tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.061785 Nov 02 12:19:31.616259 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 39/82] 10.222.0.45 () {58 vars in 1212 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:19:31.637852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5928a60-c1b9-420e-beb8-f1eb772114b8 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Calling method '.version_select at 0x7f228f5268b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.640330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e5928a60-c1b9-420e-beb8-f1eb772114b8 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '80fab6a8a9e040a19c2148545252d307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5d68b65adb4d6f9bd98e3dfe2c0331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5928a60-c1b9-420e-beb8-f1eb772114b8 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Request method failure captured: Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hosts/n-d-855650-5 HTTP/1.1 Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBQAPr5jARm4SAkfMGsvNPblfUEoRk4FkhprEcUsKSTl3fkmCVhH5RJDL71gxB2e-TRWcO9mtgbr1mhxtEV6wIyPmpvmY_F478rmRJE-ORsZ5JsIdLqB_c__uV5W6D_UWjPB3SFR0L7Qps2yMS5FXpho8BI9-Aflf2xhzLtPXVVI7Y Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:31.642212 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 80fab6a8a9e040a19c2148545252d307 Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'n-d-855650-5'} Nov 02 12:19:31.643617 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.644307 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 12:19:31.645395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.646829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5928a60-c1b9-420e-beb8-f1eb772114b8 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.646829 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5928a60-c1b9-420e-beb8-f1eb772114b8 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-d-855650-5" status: 403 len: 109 microversion: 2.1 time: 0.023186 Nov 02 12:19:31.654090 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 40/83] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts/n-d-855650-5 => generated 109 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:31.658919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:31.667645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d46aa46-441f-4b54-ae29-f0b0ab3ba982 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Calling method '.version_select at 0x7f228f5fbee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.668036 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82231204-7762-4b2d-9f35-c1b0d099d760 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.358454 Nov 02 12:19:31.674416 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 44/84] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:31.695731 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6d46aa46-441f-4b54-ae29-f0b0ab3ba982 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d46aa46-441f-4b54-ae29-f0b0ab3ba982 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Request method failure captured: Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBSkvWrraFVNdcpATpJSHywQV81aQ6SBBuY9oWmSqN78FRxU_r4k_7sOXmu-nWGiEd5_r7e7trA8X3swJK4xz74jA-wbSl4B74Kci5uiVeRla5Bk8xg3wd3cBeWGxpiAMwgdNGmxhkS_pqLx0B0swZ0KN7SZTBpVD6_zvvLm0EB6eQ Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:31.697615 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f023c505abbc4b418367705126a315a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f023c505abbc4b418367705126a315a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fcb129de3333491f97d6d94687ded246 Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'nonexistent_hostname'} Nov 02 12:19:31.700221 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.701411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.703818 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.706457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d46aa46-441f-4b54-ae29-f0b0ab3ba982 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.706457 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d46aa46-441f-4b54-ae29-f0b0ab3ba982 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039617 Nov 02 12:19:31.706457 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 41/85] 10.222.0.45 () {58 vars in 1191 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:19:31.710971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5048b5d-3d85-4a66-8ba3-bb1e2e11f093 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Calling method '.version_select at 0x7f228f6105e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.715604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e5048b5d-3d85-4a66-8ba3-bb1e2e11f093 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '80fab6a8a9e040a19c2148545252d307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5d68b65adb4d6f9bd98e3dfe2c0331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5048b5d-3d85-4a66-8ba3-bb1e2e11f093 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Request method failure captured: Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-hosts/n-d-855650-5/shutdown HTTP/1.1 Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBQAPr5jARm4SAkfMGsvNPblfUEoRk4FkhprEcUsKSTl3fkmCVhH5RJDL71gxB2e-TRWcO9mtgbr1mhxtEV6wIyPmpvmY_F478rmRJE-ORsZ5JsIdLqB_c__uV5W6D_UWjPB3SFR0L7Qps2yMS5FXpho8BI9-Aflf2xhzLtPXVVI7Y Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:19:31.716272 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 80fab6a8a9e040a19c2148545252d307 Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'n-d-855650-5'} Nov 02 12:19:31.719534 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.721466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 12:19:31.723847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.726896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5048b5d-3d85-4a66-8ba3-bb1e2e11f093 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.726896 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5048b5d-3d85-4a66-8ba3-bb1e2e11f093 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-d-855650-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011741 Nov 02 12:19:31.726896 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 45/86] 10.222.0.45 () {58 vars in 1194 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts/n-d-855650-5/shutdown => generated 113 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:31.735725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41e18ce0-58cb-4d67-826e-0f017e2bb129 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Calling method '.version_select at 0x7f228f526f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.751205 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-41e18ce0-58cb-4d67-826e-0f017e2bb129 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41e18ce0-58cb-4d67-826e-0f017e2bb129 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Request method failure captured: Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBSkvWrraFVNdcpATpJSHywQV81aQ6SBBuY9oWmSqN78FRxU_r4k_7sOXmu-nWGiEd5_r7e7trA8X3swJK4xz74jA-wbSl4B74Kci5uiVeRla5Bk8xg3wd3cBeWGxpiAMwgdNGmxhkS_pqLx0B0swZ0KN7SZTBpVD6_zvvLm0EB6eQ Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:31.754606 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f023c505abbc4b418367705126a315a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f023c505abbc4b418367705126a315a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fcb129de3333491f97d6d94687ded246 Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'nonexistent_hostname'} Nov 02 12:19:31.757409 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:19:31.758936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 12:19:31.761045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41e18ce0-58cb-4d67-826e-0f017e2bb129 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41e18ce0-58cb-4d67-826e-0f017e2bb129 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.032364 Nov 02 12:19:31.763772 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 42/87] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:19:31.773197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.773428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b494d17b-e15f-4c8e-96dd-9c23d7752b2b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Calling method '.version_select at 0x7f228f5b5310>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.775619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b494d17b-e15f-4c8e-96dd-9c23d7752b2b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '80fab6a8a9e040a19c2148545252d307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5d68b65adb4d6f9bd98e3dfe2c0331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:31.777045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b494d17b-e15f-4c8e-96dd-9c23d7752b2b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Request method failure captured: Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hosts/n-d-855650-5/startup HTTP/1.1 Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBQAPr5jARm4SAkfMGsvNPblfUEoRk4FkhprEcUsKSTl3fkmCVhH5RJDL71gxB2e-TRWcO9mtgbr1mhxtEV6wIyPmpvmY_F478rmRJE-ORsZ5JsIdLqB_c__uV5W6D_UWjPB3SFR0L7Qps2yMS5FXpho8BI9-Aflf2xhzLtPXVVI7Y Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:31.777387 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 80fab6a8a9e040a19c2148545252d307 Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'n-d-855650-5'} Nov 02 12:19:31.778626 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.779345 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 12:19:31.780274 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.781210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b494d17b-e15f-4c8e-96dd-9c23d7752b2b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.781210 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b494d17b-e15f-4c8e-96dd-9c23d7752b2b tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-d-855650-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.010654 Nov 02 12:19:31.786117 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 43/88] 10.222.0.45 () {58 vars in 1191 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts/n-d-855650-5/startup => generated 110 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:19:31.791568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8de5db4-6a30-4b8a-b106-31b7fe5097e8 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Calling method '.version_select at 0x7f228f526790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:31.806443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:31.808275 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e8de5db4-6a30-4b8a-b106-31b7fe5097e8 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.809099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:31.810629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8de5db4-6a30-4b8a-b106-31b7fe5097e8 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Request method failure captured: Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBSkvWrraFVNdcpATpJSHywQV81aQ6SBBuY9oWmSqN78FRxU_r4k_7sOXmu-nWGiEd5_r7e7trA8X3swJK4xz74jA-wbSl4B74Kci5uiVeRla5Bk8xg3wd3cBeWGxpiAMwgdNGmxhkS_pqLx0B0swZ0KN7SZTBpVD6_zvvLm0EB6eQ Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:31.812219 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f023c505abbc4b418367705126a315a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f023c505abbc4b418367705126a315a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fcb129de3333491f97d6d94687ded246 Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'nonexistent_hostname'} Nov 02 12:19:31.813655 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:19:31.814488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 12:19:31.815640 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.817184 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.817938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:31.817938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:31.817938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:31.819337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8de5db4-6a30-4b8a-b106-31b7fe5097e8 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.821015 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8de5db4-6a30-4b8a-b106-31b7fe5097e8 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033385 Nov 02 12:19:31.828972 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 44/89] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:19:31.836560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-843529e1-3e38-4b7c-8aa5-12dc339f1872 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Action: 'update', calling method: .version_select at 0x7f228f5ab3a0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-843529e1-3e38-4b7c-8aa5-12dc339f1872 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Request method failure captured: Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/os-hosts/n-d-855650-5 HTTP/1.1 Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 51 Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBSkvWrraFVNdcpATpJSHywQV81aQ6SBBuY9oWmSqN78FRxU_r4k_7sOXmu-nWGiEd5_r7e7trA8X3swJK4xz74jA-wbSl4B74Kci5uiVeRla5Bk8xg3wd3cBeWGxpiAMwgdNGmxhkS_pqLx0B0swZ0KN7SZTBpVD6_zvvLm0EB6eQ Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:31.843240 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f023c505abbc4b418367705126a315a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f023c505abbc4b418367705126a315a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fcb129de3333491f97d6d94687ded246 Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: {"status": "enable", "maintenance_mode": "invalid"} Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.844612 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'n-d-855650-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance: Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.845622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.847357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.849869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.849869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:19:31.849869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:19:31.849869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:19:31.849869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.849869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-843529e1-3e38-4b7c-8aa5-12dc339f1872 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.849869 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-843529e1-3e38-4b7c-8aa5-12dc339f1872 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-hosts/n-d-855650-5" status: 400 len: 199 microversion: 2.1 time: 0.014302 Nov 02 12:19:31.851527 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 45/90] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:31 2022] PUT /compute/v2.1/os-hosts/n-d-855650-5 => generated 199 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:19:31.859296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70c89498-5334-4fd3-9238-8824e4ff887a tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Action: 'update', calling method: .version_select at 0x7f228f526d30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70c89498-5334-4fd3-9238-8824e4ff887a tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Request method failure captured: Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/os-hosts/n-d-855650-5 HTTP/1.1 Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 51 Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBSkvWrraFVNdcpATpJSHywQV81aQ6SBBuY9oWmSqN78FRxU_r4k_7sOXmu-nWGiEd5_r7e7trA8X3swJK4xz74jA-wbSl4B74Kci5uiVeRla5Bk8xg3wd3cBeWGxpiAMwgdNGmxhkS_pqLx0B0swZ0KN7SZTBpVD6_zvvLm0EB6eQ Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:31.864410 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f023c505abbc4b418367705126a315a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f023c505abbc4b418367705126a315a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fcb129de3333491f97d6d94687ded246 Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: {"status": "invalid", "maintenance_mode": "enable"} Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.866093 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'n-d-855650-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance: Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.866949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.868600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.872866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.872866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:19:31.872866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:19:31.872866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:19:31.872866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.872866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70c89498-5334-4fd3-9238-8824e4ff887a tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.872866 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-70c89498-5334-4fd3-9238-8824e4ff887a tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-hosts/n-d-855650-5" status: 400 len: 189 microversion: 2.1 time: 0.013029 Nov 02 12:19:31.872866 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 46/91] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:31 2022] PUT /compute/v2.1/os-hosts/n-d-855650-5 => generated 189 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:19:31.888682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-400fdd72-6338-42e7-94dc-43188b7a0329 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Action: 'update', calling method: .version_select at 0x7f228f4ae0d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:31.898625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-400fdd72-6338-42e7-94dc-43188b7a0329 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '80fab6a8a9e040a19c2148545252d307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5d68b65adb4d6f9bd98e3dfe2c0331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-400fdd72-6338-42e7-94dc-43188b7a0329 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Request method failure captured: Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/os-hosts/n-d-855650-5 HTTP/1.1 Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 50 Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBQAPr5jARm4SAkfMGsvNPblfUEoRk4FkhprEcUsKSTl3fkmCVhH5RJDL71gxB2e-TRWcO9mtgbr1mhxtEV6wIyPmpvmY_F478rmRJE-ORsZ5JsIdLqB_c__uV5W6D_UWjPB3SFR0L7Qps2yMS5FXpho8BI9-Aflf2xhzLtPXVVI7Y Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:31.907187 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0b5d68b65adb4d6f9bd98e3dfe2c0331"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0b5d68b65adb4d6f9bd98e3dfe2c0331 Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-932350099 Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 80fab6a8a9e040a19c2148545252d307 Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-932350099-project Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 12:19:31.908568 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'n-d-855650-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.909765 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 12:19:31.911004 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.914202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-400fdd72-6338-42e7-94dc-43188b7a0329 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.917346 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-400fdd72-6338-42e7-94dc-43188b7a0329 tempest-HostsAdminNegativeTestJSON-932350099 tempest-HostsAdminNegativeTestJSON-932350099-project] 10.222.0.45 "PUT /compute/v2.1/os-hosts/n-d-855650-5" status: 403 len: 111 microversion: 2.1 time: 0.042886 Nov 02 12:19:31.920438 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 47/92] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:31 2022] PUT /compute/v2.1/os-hosts/n-d-855650-5 => generated 111 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:31.933356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f4da2ea-985e-47bb-baae-31f0beaa031f tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Action: 'update', calling method: .version_select at 0x7f228f4aeaf0>, body: {"status": null, "maintenance_mode": null} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f4da2ea-985e-47bb-baae-31f0beaa031f tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Request method failure captured: Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/os-hosts/n-d-855650-5 HTTP/1.1 Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 42 Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBSkvWrraFVNdcpATpJSHywQV81aQ6SBBuY9oWmSqN78FRxU_r4k_7sOXmu-nWGiEd5_r7e7trA8X3swJK4xz74jA-wbSl4B74Kci5uiVeRla5Bk8xg3wd3cBeWGxpiAMwgdNGmxhkS_pqLx0B0swZ0KN7SZTBpVD6_zvvLm0EB6eQ Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:31.940338 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f023c505abbc4b418367705126a315a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f023c505abbc4b418367705126a315a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fcb129de3333491f97d6d94687ded246 Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: {"status": null, "maintenance_mode": null} Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 12:19:31.941783 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'n-d-855650-5', 'body': {'status': None, 'maintenance_mode': None}} Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance: Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi None Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.942970 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.944710 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.947268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:19:31.947268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:19:31.947268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 12:19:31.947268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.948617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f4da2ea-985e-47bb-baae-31f0beaa031f tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.949631 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f4da2ea-985e-47bb-baae-31f0beaa031f tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-hosts/n-d-855650-5" status: 400 len: 127 microversion: 2.1 time: 0.021336 Nov 02 12:19:31.950449 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 48/93] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:31 2022] PUT /compute/v2.1/os-hosts/n-d-855650-5 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:19:31.963630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0eb27449-0768-468d-ae95-8364ac0e3791 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Action: 'update', calling method: .version_select at 0x7f228f5abe50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:31.967966 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.hosts [None req-0eb27449-0768-468d-ae95-8364ac0e3791 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Enabling host nonexistent_hostname. Nov 02 12:19:31.979334 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-0eb27449-0768-468d-ae95-8364ac0e3791 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0eb27449-0768-468d-ae95-8364ac0e3791 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Request method failure captured: Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 50 Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBSkvWrraFVNdcpATpJSHywQV81aQ6SBBuY9oWmSqN78FRxU_r4k_7sOXmu-nWGiEd5_r7e7trA8X3swJK4xz74jA-wbSl4B74Kci5uiVeRla5Bk8xg3wd3cBeWGxpiAMwgdNGmxhkS_pqLx0B0swZ0KN7SZTBpVD6_zvvLm0EB6eQ Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:19:31.984773 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f023c505abbc4b418367705126a315a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f023c505abbc4b418367705126a315a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f023c505abbc4b418367705126a315a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f023c505abbc4b418367705126a315a8 Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1752711612 Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fcb129de3333491f97d6d94687ded246 Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1752711612-project-admin Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.986715 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:19:31.987578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:19:31.988741 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:19:31.990306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:31.992974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0eb27449-0768-468d-ae95-8364ac0e3791 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:31.994517 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0eb27449-0768-468d-ae95-8364ac0e3791 tempest-HostsAdminNegativeTestJSON-1752711612 tempest-HostsAdminNegativeTestJSON-1752711612-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.037865 Nov 02 12:19:31.995693 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 49/94] 10.222.0.45 () {60 vars in 1211 bytes} [Wed Nov 2 12:19:31 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:19:32.142151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:32.160795 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fc483ac3-95a5-4907-b92d-6560de00dbf3 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.406961 Nov 02 12:19:32.161412 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 46/95] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:31 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:32.699624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:32.701992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:32.704581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:RELEASE=8,nova_api:SELECT=79,nova_api:SAVEPOINT=7,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:32.723520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:32.725587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:32.726870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:32.729256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:32.731808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:32.733705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:33.229594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:33.240605 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c769f1c9-4c84-4989-9636-185ae54a5d09 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.545336 Nov 02 12:19:33.245149 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 50/96] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:32 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:33.253617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:33.256640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:33.269421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:33.269917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:33.270694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:33.283492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:33.283492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:33.283492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:33.585540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:33.600061 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-adde4ee9-e12f-47b4-ab16-4f7b0f977ce9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.351284 Nov 02 12:19:33.603451 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 51/97] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:33 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:33.699204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-549885550", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:33.854382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:19:34.272003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:34.272630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:34.275641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:34.277088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=26 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:34.291283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:34.293541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:34.295375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:34.301166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:34.301982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:34.302614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:34.695174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:34.697486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:19:34.697932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:19:34.699071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:19:34.700468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:19:34.702376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:19:34.722290 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16be98d4-4e6e-47b9-bb9a-25ffca256566 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.456313 Nov 02 12:19:34.723742 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 52/98] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:34 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:34.730390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:34.731092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:34.734757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:34.737727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:34.738299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:34.738800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:34.741675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:34.742690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:34.764317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:34.764930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:34.765453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:34.766214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:34.767279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:34.767738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:34.804516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Getting quotas for project 3a242625dc6c4b75919516fa58c748b4. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:34.817902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Getting quotas for user a9f59207e72940f184f57e38830ff5dd and project 3a242625dc6c4b75919516fa58c748b4. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:34.834489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:34.869365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:19:34.873834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:19:35.002918 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f2a03e3-8ad8-4407-9a34-98fc3d8b05de tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.923480 Nov 02 12:19:35.010867 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 47/99] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:19:35.023449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b29b155c-f1da-4737-9d0a-d1e1c4e69b08 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:35.024084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b29b155c-f1da-4737-9d0a-d1e1c4e69b08 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:35.159589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b29b155c-f1da-4737-9d0a-d1e1c4e69b08 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:35.162869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=27 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:35.170444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:35.181025 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b29b155c-f1da-4737-9d0a-d1e1c4e69b08 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1221 microversion: 2.1 time: 0.168440 Nov 02 12:19:35.182544 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 48/100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:35 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1221 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:35.183681 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8beb9431-2883-449e-afe7-ef0bdc4103be tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.458822 Nov 02 12:19:35.196080 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 53/101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:34 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:35.752819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:35.754415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:35.763471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:35.765619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:35.767018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:35.768260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:35.768889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:35.771104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:35.777321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=83 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:36.094720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:36.104016 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0e1d66a8-d264-4f89-a79a-6b3c4350f3b1 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.355335 Nov 02 12:19:36.105067 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 49/102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:35 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:36.212763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:36.214056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:36.214473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:36.216515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:36.229384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:36.230213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:36.231907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:36.232719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:36.233634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:36.235286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:36.236048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:36.236628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:36.238604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:36.242776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:36.244109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:36.246694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:36.494599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:36.514530 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b0441dff-4d8c-4fb7-bcb2-0ec2ba1d8ea7 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1225 microversion: 2.1 time: 0.308601 Nov 02 12:19:36.539644 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 54/103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:36 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1225 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:36.684272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:36.709418 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c68ab603-2856-4473-a1b4-bedcb8500c4c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.494828 Nov 02 12:19:36.711513 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 50/104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:36 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:36.963694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Calling method '.version_select at 0x7f228f5fbc10>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:36.971000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:36.972207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:36.973384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.036961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.044869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.050935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.086737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.089392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.092686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.101258 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09ca1e5f-ae92-47a7-880b-0e7dc78a03c9 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.559555 Nov 02 12:19:37.104094 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 55/105] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:19:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:37.115988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-06cdd98a-b279-4034-9300-5e7804858128 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Calling method '.version_select at 0x7f228f5dae50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:37.120608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06cdd98a-b279-4034-9300-5e7804858128 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.121111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06cdd98a-b279-4034-9300-5e7804858128 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.121875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06cdd98a-b279-4034-9300-5e7804858128 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.135008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:37.136315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:37.148273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06cdd98a-b279-4034-9300-5e7804858128 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.149109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06cdd98a-b279-4034-9300-5e7804858128 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.149626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06cdd98a-b279-4034-9300-5e7804858128 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.149925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.150863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.151651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.154009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.155242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.156846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.158871 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-06cdd98a-b279-4034-9300-5e7804858128 tempest-HypervisorAdminV228Test-1985206420 tempest-HypervisorAdminV228Test-1985206420-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.048192 Nov 02 12:19:37.159917 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 51/106] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Nov 2 12:19:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:19:37.565117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:37.565747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:37.578580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.579097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.582864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.583647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.584129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.584566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.827683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:37.856799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-149db993-4772-4ba1-aff0-98c423dc9990 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1273 microversion: 2.1 time: 0.294436 Nov 02 12:19:37.861956 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 52/107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:37 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:37.868260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:37.872251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:37.875772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=94 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:37.888296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:37.889391 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f329c1d4-d304-4cb3-a4bc-482b66559ba2 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.762618 Nov 02 12:19:37.890018 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 56/108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:37 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:37.908411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.908909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.909353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.916487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.917225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.917685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.186983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:38.203245 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba528f1c-49f2-4fd1-a954-67662201614c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.338878 Nov 02 12:19:38.217994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 53/109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:37 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:38.700872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Calling method '.version_select at 0x7f228f526790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:38.704918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.705700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.706410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.731283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.731988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.732970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.795608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.797141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.797942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.819355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.819812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.820394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.850247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.850966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.851694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.865846 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac2e09dd-e2bf-42f7-b3d4-02660db62023 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.386082 Nov 02 12:19:38.880142 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 57/110] 10.222.0.45 () {60 vars in 1243 bytes} [Wed Nov 2 12:19:38 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:38.886254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Calling method '.version_select at 0x7f228f50b160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:38.890397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:38.891080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:38.896893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.897384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.897823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.898266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.898918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.899535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.900407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.901011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.901603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.943900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.950771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.951205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.992877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.993539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.994056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.006403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:39.015870 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c229ff8a-cb84-49b2-97c9-63ccc3b77ab2 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1279 microversion: 2.1 time: 0.130959 Nov 02 12:19:39.016467 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 58/111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:38 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1279 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:39.021688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:39.022658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:39.022900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.023558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.024059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.030188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.031038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.031723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.032739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.033424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.034203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.059799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.060486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.061117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.069831 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d6df8cf-5442-4381-be37-cfa977f7d6a0 tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.188385 Nov 02 12:19:39.070800 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 54/112] 10.222.0.45 () {60 vars in 1222 bytes} [Wed Nov 2 12:19:38 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:39.085884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88ab20bd-8830-49f0-b93a-b6ee93ed09ad tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Calling method '.version_select at 0x7f228f549e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:39.099426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ab20bd-8830-49f0-b93a-b6ee93ed09ad tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.100210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ab20bd-8830-49f0-b93a-b6ee93ed09ad tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.100859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ab20bd-8830-49f0-b93a-b6ee93ed09ad tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.127061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ab20bd-8830-49f0-b93a-b6ee93ed09ad tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.127861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ab20bd-8830-49f0-b93a-b6ee93ed09ad tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.128509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ab20bd-8830-49f0-b93a-b6ee93ed09ad tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.136469 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88ab20bd-8830-49f0-b93a-b6ee93ed09ad tempest-HypervisorAdminV253TestBase-1480381532 tempest-HypervisorAdminV253TestBase-1480381532-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/e9df04f6-1df8-4e15-bf80-b3e0cf7ba6ab" status: 200 len: 792 microversion: 2.53 time: 0.056920 Nov 02 12:19:39.144312 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 55/113] 10.222.0.45 () {60 vars in 1298 bytes} [Wed Nov 2 12:19:39 2022] GET /compute/v2.1/os-hypervisors/e9df04f6-1df8-4e15-bf80-b3e0cf7ba6ab => generated 792 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:39.230261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:39.231473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:39.242741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.244985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.245479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.246809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.247354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.247702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.300743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:39.363734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e9c46f7-33c3-447d-933f-9b4bcfa67934 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.337545 Nov 02 12:19:39.363734 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 59/114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:39 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:39.577467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:39.586534 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2414eb12-272b-4646-8016-e1e60c858103 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.360322 Nov 02 12:19:39.603831 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 56/115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:39 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:40.044474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:40.045238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:40.051587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.052535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.053174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.054127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.055329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.055995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.189085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:40.198563 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4fa122a4-a6f3-4f62-ac21-469255f666af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1279 microversion: 2.1 time: 0.157866 Nov 02 12:19:40.206459 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 60/116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:40 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:40.242208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8031054d-7cfc-45d6-b26a-b6ff19df1046 req-2ce5befb-6622-4a4f-aed7-6ab9491bd383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552c475f-6460-4181-a3e0-b644f66d9507", "tag": "51d54560-3318-4901-b49b-aabfd17717a1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:40.262919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8031054d-7cfc-45d6-b26a-b6ff19df1046 req-2ce5befb-6622-4a4f-aed7-6ab9491bd383 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.264094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8031054d-7cfc-45d6-b26a-b6ff19df1046 req-2ce5befb-6622-4a4f-aed7-6ab9491bd383 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.264737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8031054d-7cfc-45d6-b26a-b6ff19df1046 req-2ce5befb-6622-4a4f-aed7-6ab9491bd383 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.303965 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8031054d-7cfc-45d6-b26a-b6ff19df1046 req-2ce5befb-6622-4a4f-aed7-6ab9491bd383 service nova] Creating event network-changed:51d54560-3318-4901-b49b-aabfd17717a1 for instance 552c475f-6460-4181-a3e0-b644f66d9507 on n-h2-855650-5 Nov 02 12:19:40.337799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8031054d-7cfc-45d6-b26a-b6ff19df1046 req-2ce5befb-6622-4a4f-aed7-6ab9491bd383 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099493 Nov 02 12:19:40.340999 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 57/117] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:40.390360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:40.391035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:40.401213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.401713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.404175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.405489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.406399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.414784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.642646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:40.664112 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d2b7a85b-e870-46c4-afdd-144276d8c02e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.278401 Nov 02 12:19:40.678010 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 61/118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:40 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:40.679877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:40.680506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:40.693838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.694509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.695048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.695770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.696650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.697322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:41.053300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-69f33ab3-b2b2-406d-8f30-888041ebe0de req-6f24a7bd-079c-46ab-9599-34c5609a104d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76517ea9-7cac-4202-ade6-4fbb517b72e0", "name": "network-vif-plugged", "status": "completed", "tag": "9a64e082-7ce2-45f3-a2d3-e0d28ffb8f54"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:41.074358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-69f33ab3-b2b2-406d-8f30-888041ebe0de req-6f24a7bd-079c-46ab-9599-34c5609a104d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:41.076722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-69f33ab3-b2b2-406d-8f30-888041ebe0de req-6f24a7bd-079c-46ab-9599-34c5609a104d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:41.077226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-69f33ab3-b2b2-406d-8f30-888041ebe0de req-6f24a7bd-079c-46ab-9599-34c5609a104d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:41.123044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:41.139876 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58a9c328-27e8-49d7-8114-70ca01f1d28a tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.470241 Nov 02 12:19:41.157857 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 62/119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:40 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:41.231074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:41.231699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:41.249497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:41.250024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:41.250477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:41.251220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:41.251840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:41.252141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:41.298450 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-69f33ab3-b2b2-406d-8f30-888041ebe0de req-6f24a7bd-079c-46ab-9599-34c5609a104d service nova] Creating event network-vif-plugged:9a64e082-7ce2-45f3-a2d3-e0d28ffb8f54 for instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 on n-h1-855650-5 Nov 02 12:19:41.312066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-69f33ab3-b2b2-406d-8f30-888041ebe0de req-6f24a7bd-079c-46ab-9599-34c5609a104d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.808621 Nov 02 12:19:41.313045 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 58/120] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:41.476873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:41.509526 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1bda2713-43c9-4db7-8a2f-e50e38e27cc6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1279 microversion: 2.1 time: 0.283949 Nov 02 12:19:41.523824 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 63/121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:41 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:41.701951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:41.706148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:41.730937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:41.731815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:41.739140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:41.740875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:41.742459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:41.743523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:42.052545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:42.066189 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ffc9c7d-f75a-4dd9-bded-908216cd470e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.374797 Nov 02 12:19:42.082412 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 59/122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:41 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:42.180526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:42.181134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:42.188134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:42.189101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:42.189607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:42.190571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:42.191242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:42.191891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:42.422830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:42.439512 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-42c0ccc2-6528-46d5-b7a6-5b4f50f92bd9 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.262549 Nov 02 12:19:42.455877 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 64/123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:42 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:42.562184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:42.565897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:42.597908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:42.598794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:42.600024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:42.600937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:42.601553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:42.602551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:42.891764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:42.901089 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fca7d7ae-7734-4642-8c46-6fe77e295268 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.346627 Nov 02 12:19:42.902821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 60/124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:42 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:43.091780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:43.092402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:43.099175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:43.099672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:43.101205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:43.102145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:43.102612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:43.103047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:43.273744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:43.290156 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7ab9816a-b1c0-49c5-8df1-e2e21ae6a7eb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.203348 Nov 02 12:19:43.291377 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 65/125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:43 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:43.469637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:43.470712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:43.477537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:43.478471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:43.479037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:43.480065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:43.480670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:43.481217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:43.730944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:43.744137 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f611ce4c-a996-48d2-af75-ae0c3bf89327 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.278283 Nov 02 12:19:43.744723 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 61/126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:43 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:43.929541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:43.930574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:43.940451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:43.941385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:43.942679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:43.944109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:43.945308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:43.946264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:44.131475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:44.140108 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8e34fd65-3b9d-475a-9673-073e576eacbe tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.218746 Nov 02 12:19:44.141023 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 66/127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:43 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:44.318113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:44.319708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:44.334772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:44.337727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:44.343321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:44.344576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:44.347200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:44.347924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:44.564019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:44.577065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f8c5c7c-43e9-436b-aaf2-a329717bba57 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.264999 Nov 02 12:19:44.578208 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 62/128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:44 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:44.768707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:44.770224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:44.784547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:44.786633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:44.787248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:44.790595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:44.793445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:44.795770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:45.011826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:45.041592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:45.056270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e9a9d783-3a17-4930-bb50-302c8a70b24c tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1337 microversion: 2.1 time: 0.291796 Nov 02 12:19:45.073117 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 67/129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:44 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1337 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:45.168415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:45.168651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:45.169118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:45.189330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:45.190037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:45.193839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:45.197377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:45.198221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:45.199433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:45.518029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:45.527966 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ccbc5092-74af-454e-b2dd-842c7f479c46 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.365645 Nov 02 12:19:45.532752 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 68/130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:45 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:45.551240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-49dab85c-97ec-4859-ad5c-eca2888e1000 tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Action: 'create', calling method: .version_select at 0x7f228f50bd30>, body: {"keypair": {"name": "tempest-keypair-1788971150", "type": "ssh", "user_id": "1c6087c93ace44eaa633828c0501f37a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQak0Lsi0hpHfx5p6HVsdH8AJceXawgnomql7d1+mu6L3SMWzmGMN9tHLZYgBcj89MjJ2VmzKeF+jH9xlJs60buRzAL/XiOc+0LeMUYx08Xv/CNq5hIsfO27yUWzrRYHQ=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:45.623869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-49dab85c-97ec-4859-ad5c-eca2888e1000 tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Getting quotas for project b81d9d5fd9264818ae4f53ddfd19a076. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:45.641786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-49dab85c-97ec-4859-ad5c-eca2888e1000 tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Getting quotas for user bf5bb46a276c49e0a1e29c28c29f8e1b and project b81d9d5fd9264818ae4f53ddfd19a076. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:45.668780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b9326eb-c005-40ae-8e47-415cfa0cb232 tempest-InstanceUsageAuditLogTestJSON-2086682773 tempest-InstanceUsageAuditLogTestJSON-2086682773-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:45.689529 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-49dab85c-97ec-4859-ad5c-eca2888e1000 tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.690463 Nov 02 12:19:45.690927 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 63/131] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 12:19:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 693 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:19:45.697215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:45.705727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:45.711355 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b9326eb-c005-40ae-8e47-415cfa0cb232 tempest-InstanceUsageAuditLogTestJSON-2086682773 tempest-InstanceUsageAuditLogTestJSON-2086682773-project-admin] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 12:19:45" status: 200 len: 318 microversion: 2.1 time: 0.177362 Nov 02 12:19:45.722252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 69/132] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:19:45 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2012%3A19%3A45 => generated 318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:45.723704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:45.724215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:45.724665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:45.725411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:45.725900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:45.726533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:45.729207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e30b3925-d278-4783-ab83-05ce65ad311f tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Action: 'create', calling method: .version_select at 0x7f228ff1e670>, body: {"keypair": {"name": "tempest-keypair-1898559150", "type": "ssh", "user_id": "1c6087c93ace44eaa633828c0501f37a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9BspXzhfzuVTUUW4s9jGtx1Y7HJpJ6zi/Jh3VRuYQVa3SNV/54wb3Tz3mHhoL2CakpWkyGzfCmkREUjXWmzZyooG3l9kTQvUAz9wfYudY/CvERY5co/FzuJydHjMro0g=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:45.785661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e30b3925-d278-4783-ab83-05ce65ad311f tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Getting quotas for project b81d9d5fd9264818ae4f53ddfd19a076. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:45.796956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e30b3925-d278-4783-ab83-05ce65ad311f tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Getting quotas for user bf5bb46a276c49e0a1e29c28c29f8e1b and project b81d9d5fd9264818ae4f53ddfd19a076. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:45.846670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e30b3925-d278-4783-ab83-05ce65ad311f tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.121071 Nov 02 12:19:45.847713 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 70/133] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 12:19:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:19:45.861184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e192337-011c-47b3-8f52-94f9c8f52b26 tempest-InstanceUsageAuditLogTestJSON-2086682773 tempest-InstanceUsageAuditLogTestJSON-2086682773-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:45.897894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e192337-011c-47b3-8f52-94f9c8f52b26 tempest-InstanceUsageAuditLogTestJSON-2086682773 tempest-InstanceUsageAuditLogTestJSON-2086682773-project-admin] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.048988 Nov 02 12:19:45.910583 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 71/134] 10.222.0.45 () {58 vars in 1185 bytes} [Wed Nov 2 12:19:45 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:45.937469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96f14702-2fa8-4c9a-bdca-7b69737901bd tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Calling method '.version_select at 0x7f228f4b5430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:45.957236 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-96f14702-2fa8-4c9a-bdca-7b69737901bd tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-1788971150?user_id=1c6087c93ace44eaa633828c0501f37a" status: 200 len: 512 microversion: 2.10 time: 0.044185 Nov 02 12:19:45.967398 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 72/135] 10.222.0.45 () {60 vars in 1340 bytes} [Wed Nov 2 12:19:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1788971150?user_id=1c6087c93ace44eaa633828c0501f37a => generated 512 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:45.980421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bdced17e-0e9f-4e8c-948e-5b360001e02d tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Action: 'create', calling method: .version_select at 0x7f228f4b50d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-133830190", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7PodR/7o60v9FEej7rMllAGTW1ET5QKDO6f7LGQC350AJ0TDka0rs7dg4gFCsaNSzFae6q552ZB5TkugxWpJNsfc8EsRI/ovCBI1ev9o/4zJdSJGcZl7nkLPTqqXYtLw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:46.023590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bdced17e-0e9f-4e8c-948e-5b360001e02d tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Getting quotas for project b81d9d5fd9264818ae4f53ddfd19a076. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:46.030588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bdced17e-0e9f-4e8c-948e-5b360001e02d tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Getting quotas for user bf5bb46a276c49e0a1e29c28c29f8e1b and project b81d9d5fd9264818ae4f53ddfd19a076. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:46.074734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bdced17e-0e9f-4e8c-948e-5b360001e02d tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.102336 Nov 02 12:19:46.076026 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 73/136] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 12:19:45 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:19:46.083687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:46.085100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:46.095366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:46.096082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:46.096689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:46.097918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:46.098552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:46.099294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:46.625668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:46.639638 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5640120e-afa5-4ec9-ac76-dc21753c5f9e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.947366 Nov 02 12:19:46.640415 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 64/137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:45 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:46.669943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6a797c81-5924-4c4a-9a1a-bcb29943a12a tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Calling method '.version_select at 0x7f228f67e280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:46.684660 n-d-855650-5 devstack@n-api.service[120722]: WARNING oslo_db.sqlalchemy.utils [None req-6a797c81-5924-4c4a-9a1a-bcb29943a12a tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:19:46.706982 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6a797c81-5924-4c4a-9a1a-bcb29943a12a tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] 10.222.0.45 "GET /compute/v2.1/os-keypairs?user_id=1c6087c93ace44eaa633828c0501f37a" status: 200 len: 726 microversion: 2.10 time: 0.045183 Nov 02 12:19:46.710640 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 65/138] 10.222.0.45 () {60 vars in 1259 bytes} [Wed Nov 2 12:19:46 2022] GET /compute/v2.1/os-keypairs?user_id=1c6087c93ace44eaa633828c0501f37a => generated 726 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:46.723169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:46.726222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:46.738237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:46.752978 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6703e782-7d60-4578-9230-3190ee86993d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1487 microversion: 2.1 time: 0.674601 Nov 02 12:19:46.754853 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 74/139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:46 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1487 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:46.755803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:46.758917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:46.760966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:46.762658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:46.763264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:46.764504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:46.769082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0719e2f2-5e31-4578-963c-8862124d7168 tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Calling method '.version_select at 0x7f228f4ae940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:46.822806 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0719e2f2-5e31-4578-963c-8862124d7168 tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-133830190" status: 204 len: 0 microversion: 2.10 time: 0.065418 Nov 02 12:19:46.826839 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 75/140] 10.222.0.45 () {60 vars in 1322 bytes} [Wed Nov 2 12:19:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-133830190 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:19:46.854513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:46.857464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:46.873012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:46.875559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:46.878170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:46.880130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:46.882851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:46.884755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:47.304395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:47.318891 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92907d41-1b35-460c-bd19-152750998099 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.606694 Nov 02 12:19:47.320212 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 66/141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:46 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:47.347816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84c392b6-1e1d-41d9-b086-8b6653a2788d tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Calling method '.version_select at 0x7f228f46daf0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:47.404375 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84c392b6-1e1d-41d9-b086-8b6653a2788d tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898559150?user_id=1c6087c93ace44eaa633828c0501f37a" status: 204 len: 0 microversion: 2.10 time: 0.080426 Nov 02 12:19:47.405621 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 67/142] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 12:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898559150?user_id=1c6087c93ace44eaa633828c0501f37a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:19:47.420765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a32e127-d96f-4d9d-9868-9a17edf8b4cd tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] Calling method '.version_select at 0x7f228f50b790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:47.468658 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a32e127-d96f-4d9d-9868-9a17edf8b4cd tempest-KeyPairsV210TestJSON-1745522203 tempest-KeyPairsV210TestJSON-1745522203-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788971150?user_id=1c6087c93ace44eaa633828c0501f37a" status: 204 len: 0 microversion: 2.10 time: 0.056444 Nov 02 12:19:47.471727 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 68/143] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 12:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788971150?user_id=1c6087c93ace44eaa633828c0501f37a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:19:47.665142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:47.666506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:47.681216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:47.682005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:47.682855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:47.685261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:47.686235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:47.687035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.054622 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-836fb87e-f4ab-45a2-bd93-cba044ee7eb4 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1638 microversion: 2.1 time: 1.226110 Nov 02 12:19:48.075526 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 76/144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:46 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1638 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:48.083557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0209c463-483b-430e-8e99-d6b28c522fb9 req-91cc0c66-9004-4df7-9a9f-ec8fd1e09f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5b1647-16dc-4d7b-9877-8a7a663b6475", "tag": "81a93aab-aafa-457d-96b6-77c679b9fdeb"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:48.099919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0209c463-483b-430e-8e99-d6b28c522fb9 req-91cc0c66-9004-4df7-9a9f-ec8fd1e09f00 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.100410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0209c463-483b-430e-8e99-d6b28c522fb9 req-91cc0c66-9004-4df7-9a9f-ec8fd1e09f00 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.101056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0209c463-483b-430e-8e99-d6b28c522fb9 req-91cc0c66-9004-4df7-9a9f-ec8fd1e09f00 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.133077 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0209c463-483b-430e-8e99-d6b28c522fb9 req-91cc0c66-9004-4df7-9a9f-ec8fd1e09f00 service nova] Creating event network-changed:81a93aab-aafa-457d-96b6-77c679b9fdeb for instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 on n-h2-855650-5 Nov 02 12:19:48.134917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0209c463-483b-430e-8e99-d6b28c522fb9 req-91cc0c66-9004-4df7-9a9f-ec8fd1e09f00 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:19:48.135553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0209c463-483b-430e-8e99-d6b28c522fb9 req-91cc0c66-9004-4df7-9a9f-ec8fd1e09f00 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:19:48.137390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.138128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.139305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.140326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.148019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.149768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.166366 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.compute.rpcapi [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 12:19:48.167732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] Releasing lock "compute-rpcapi-router" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:19:48.196779 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-56ef1c29-654f-4bc2-883d-71c1b1c8f83e None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119147 Nov 02 12:19:48.198061 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 77/145] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:48.203900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:48.212709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:48.213651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:48.217464 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9eb57149-43e8-49eb-94ec-39fcc68e7002 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.557568 Nov 02 12:19:48.223158 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 69/146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:47 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:48.224886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.227023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.229254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.232969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.233544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.234336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.289958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:48.317286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:19:48.346253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:48.347392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:48.366974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.369674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.370313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.375490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.376741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.377841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.433298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:48.927164 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0406ca34-94b4-40e3-96da-885d9796b53b tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "DELETE /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 204 len: 0 microversion: 2.1 time: 0.726452 Nov 02 12:19:48.932498 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 78/147] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:19:48 2022] DELETE /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:48.949094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:48.951174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:48.965166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.966112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.967069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.968054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.970354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.971100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.975453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:48.986977 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2484db43-cdae-4462-94af-c8f70632d8ff tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.646393 Nov 02 12:19:48.995914 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 70/148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:48 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:49.267205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:49.268382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:49.287919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:49.288658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:49.289107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:49.289841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:49.290336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:49.290766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:49.507286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:49.529175 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60ad8855-9e3a-454b-b4c3-1d891461e19f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1493 microversion: 2.1 time: 0.590976 Nov 02 12:19:49.536829 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 79/149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:48 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1493 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:49.763984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:49.778296 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3452e146-0ac4-4105-bc3a-ffd738fbae07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.516080 Nov 02 12:19:49.780072 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 71/150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:49 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:50.014667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:50.015285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:50.036601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.037090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.038588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.040159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.040960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.046646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.367574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:50.384964 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0dc6798f-0e72-4cfd-9642-dd39b971c78f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.374855 Nov 02 12:19:50.404515 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 80/151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:50 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:50.516652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e7a9a6f6-6b9c-4b2f-983c-d3ae1ae60689 req-9285a8a4-37c7-42f5-94a0-f8fc670d1b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552c475f-6460-4181-a3e0-b644f66d9507", "name": "network-vif-plugged", "status": "completed", "tag": "51d54560-3318-4901-b49b-aabfd17717a1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:50.558206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:50.559032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:50.566796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e7a9a6f6-6b9c-4b2f-983c-d3ae1ae60689 req-9285a8a4-37c7-42f5-94a0-f8fc670d1b4d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.567930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e7a9a6f6-6b9c-4b2f-983c-d3ae1ae60689 req-9285a8a4-37c7-42f5-94a0-f8fc670d1b4d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.570853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e7a9a6f6-6b9c-4b2f-983c-d3ae1ae60689 req-9285a8a4-37c7-42f5-94a0-f8fc670d1b4d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.586371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.586920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.587372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.588109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.588568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.589099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.615450 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e7a9a6f6-6b9c-4b2f-983c-d3ae1ae60689 req-9285a8a4-37c7-42f5-94a0-f8fc670d1b4d service nova] Creating event network-vif-plugged:51d54560-3318-4901-b49b-aabfd17717a1 for instance 552c475f-6460-4181-a3e0-b644f66d9507 on n-h2-855650-5 Nov 02 12:19:50.634702 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e7a9a6f6-6b9c-4b2f-983c-d3ae1ae60689 req-9285a8a4-37c7-42f5-94a0-f8fc670d1b4d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134105 Nov 02 12:19:50.643727 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 72/152] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:50.829462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:50.835102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:50.855961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.857007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.857717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.861098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.862784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.871680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:51.265270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:51.273842 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b4097ee4-3090-4d06-8f39-39679480828d tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1493 microversion: 2.1 time: 0.720834 Nov 02 12:19:51.274471 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 81/153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:50 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1493 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:51.411310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:51.412126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:51.440408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:51.440909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:51.441739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:51.445566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:51.446376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:51.447001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:51.522171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:51.538342 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e60c328b-3a5f-48bc-b6f8-bf98358779aa tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 0.715430 Nov 02 12:19:51.539980 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 73/154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:50 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:51.735063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:51.745636 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-28ff0394-3b91-4d3c-8954-56d07f3bc90e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.337537 Nov 02 12:19:51.754182 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 82/155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:51 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:52.320800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:52.321662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:52.380165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:52.380823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:52.381287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:52.388781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:52.391092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:52.391907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:52.579517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:52.589929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:52.591311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:52.593730 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9745f4f-ba6a-4ade-bd3b-603bba9e7766 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1451 microversion: 2.1 time: 0.279824 Nov 02 12:19:52.594409 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 74/156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:52 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1451 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:52.638467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:52.642283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:52.644239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:52.647051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:52.659326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:52.662693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:52.779256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:52.780519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:52.793186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:52.800697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:52.801170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:52.804995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:52.814548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:52.815376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:53.660227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:53.676758 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-452c4a2f-6254-4813-9601-f94145b16d2f tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 1.094493 Nov 02 12:19:53.678200 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 83/157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:52 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:53.688101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9d03e9c3-8a60-49a4-a5d2-fba395e8115d req-d1b42da6-4ea8-4b99-b641-21023fd0fdaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76517ea9-7cac-4202-ade6-4fbb517b72e0", "name": "network-vif-deleted", "tag": "9a64e082-7ce2-45f3-a2d3-e0d28ffb8f54"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:53.694289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:53.707326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:53.727903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9d03e9c3-8a60-49a4-a5d2-fba395e8115d req-d1b42da6-4ea8-4b99-b641-21023fd0fdaa service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:53.729077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9d03e9c3-8a60-49a4-a5d2-fba395e8115d req-d1b42da6-4ea8-4b99-b641-21023fd0fdaa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:53.730777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9d03e9c3-8a60-49a4-a5d2-fba395e8115d req-d1b42da6-4ea8-4b99-b641-21023fd0fdaa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:53.736091 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0398dd51-a853-4816-bf9a-01f40bc02f8c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.950483 Nov 02 12:19:53.738223 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 75/158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:52 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:53.759315 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9d03e9c3-8a60-49a4-a5d2-fba395e8115d req-d1b42da6-4ea8-4b99-b641-21023fd0fdaa service nova] Creating event network-vif-deleted:9a64e082-7ce2-45f3-a2d3-e0d28ffb8f54 for instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 on n-h1-855650-5 Nov 02 12:19:53.770588 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9d03e9c3-8a60-49a4-a5d2-fba395e8115d req-d1b42da6-4ea8-4b99-b641-21023fd0fdaa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089669 Nov 02 12:19:53.772414 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 84/159] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:53.784126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:53.786847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:53.801703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:53.802749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:53.804366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:53.806052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:53.807188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:53.808319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:53.926896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:53.935630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:53.951750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:53.958731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lazy-loading 'fault' on Instance uuid 76517ea9-7cac-4202-ade6-4fbb517b72e0 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:54.150432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12676c72-44b8-45e6-a031-b1ada2d802f8 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:54.160533 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-12676c72-44b8-45e6-a031-b1ada2d802f8 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12676c72-44b8-45e6-a031-b1ada2d802f8 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201-project-admin] Request method failure captured: Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBpzdmURPLgKR2ZHrT10pdPfoYNDwNFgvN2zxWz34gDI_bBEND-KiUKEHqxhqDQovoJIlCpPyQCcXDiYRE69ydtlLwpXRlZpdE7MwVnkLf2M556sIlAl_inv7D21MCXQw7YCF8rFHZoF_HYZ_wa2m8lPar96ghe7y43u6p3_ESJYCg Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 6ef83aba70d143a6a222dcdc825aec18 Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201 Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:19:54.173750 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6ef83aba70d143a6a222dcdc825aec18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6ef83aba70d143a6a222dcdc825aec18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6ef83aba70d143a6a222dcdc825aec18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6ef83aba70d143a6a222dcdc825aec18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201 Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 6ef83aba70d143a6a222dcdc825aec18 Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201 Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201-project-admin Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 8215b0b58b314785b6605e8c6e0a33a1 Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201-project-admin Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:19:54.176185 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid timestamp for date invalid_time Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'invalid_time'} Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:54.178204 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 02 12:19:54.182661 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.186018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f368d94bcc34714a39f8825be5e82ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4009f2fda4a94036868b5a27212af0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:54.188373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12676c72-44b8-45e6-a031-b1ada2d802f8 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:54.191191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-12676c72-44b8-45e6-a031-b1ada2d802f8 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201 tempest-InstanceUsageAuditLogNegativeTestJSON-1767116201-project-admin] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.449108 Nov 02 12:19:54.193059 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c676da70-d62b-4b7b-a13a-b838829183d7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 200 len: 1327 microversion: 2.1 time: 0.418549 Nov 02 12:19:54.207008 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 85/160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:53 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:54.210763 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 76/161] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Nov 2 12:19:53 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 472 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:19:54.470311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81bb5a7d-c53b-470c-8b4e-c784c46100a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:54.478442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-81bb5a7d-c53b-470c-8b4e-c784c46100a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '908d69df01e74787bf6880dd39b97747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2895a18bf7d41659955199ed8c9ebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81bb5a7d-c53b-470c-8b4e-c784c46100a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] Request method failure captured: Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBnCerWrjWqBaah9JYEj81svpv52JBdcpv6PoJb68pGgCYMsC1Al2ZtQn8yFdXsU5ZVMeJBJT-lxsgfG2_jkWg9Kh17cr5b1wE5snVs1TbyzaJhjg1Vc6deCJntpZ9EbiDBfboRrmJ2gom84p7MCJqGBY1Q-lbEagsU4k1CRGZBRiw Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: a2895a18bf7d41659955199ed8c9ebc8 Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:54.491343 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a2895a18bf7d41659955199ed8c9ebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a2895a18bf7d41659955199ed8c9ebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a2895a18bf7d41659955199ed8c9ebc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a2895a18bf7d41659955199ed8c9ebc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: a2895a18bf7d41659955199ed8c9ebc8 Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 908d69df01e74787bf6880dd39b97747 Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project Nov 02 12:19:54.493698 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: action_args: {} Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:54.496868 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 12:19:54.501750 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.507259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81bb5a7d-c53b-470c-8b4e-c784c46100a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:54.515762 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-81bb5a7d-c53b-470c-8b4e-c784c46100a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.293140 Nov 02 12:19:54.517226 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 86/162] 10.222.0.45 () {58 vars in 1185 bytes} [Wed Nov 2 12:19:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:54.532215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78cb08a4-ca8b-4217-a8b4-2d027d6fc5c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:54.539749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-78cb08a4-ca8b-4217-a8b4-2d027d6fc5c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '908d69df01e74787bf6880dd39b97747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2895a18bf7d41659955199ed8c9ebc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78cb08a4-ca8b-4217-a8b4-2d027d6fc5c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] Request method failure captured: Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2012:19:54 HTTP/1.1 Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBnCerWrjWqBaah9JYEj81svpv52JBdcpv6PoJb68pGgCYMsC1Al2ZtQn8yFdXsU5ZVMeJBJT-lxsgfG2_jkWg9Kh17cr5b1wE5snVs1TbyzaJhjg1Vc6deCJntpZ9EbiDBfboRrmJ2gom84p7MCJqGBY1Q-lbEagsU4k1CRGZBRiw Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a2895a18bf7d41659955199ed8c9ebc8 Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:19:54.554028 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a2895a18bf7d41659955199ed8c9ebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a2895a18bf7d41659955199ed8c9ebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a2895a18bf7d41659955199ed8c9ebc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a2895a18bf7d41659955199ed8c9ebc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a2895a18bf7d41659955199ed8c9ebc8 Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 908d69df01e74787bf6880dd39b97747 Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project Nov 02 12:19:54.556219 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2022-11-02 12:19:54'} Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:19:54.557210 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 12:19:54.559741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:19:54.564833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78cb08a4-ca8b-4217-a8b4-2d027d6fc5c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:54.568786 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78cb08a4-ca8b-4217-a8b4-2d027d6fc5c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115 tempest-InstanceUsageAuditLogNegativeTestJSON-1314052115-project] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 12:19:54" status: 403 len: 128 microversion: 2.1 time: 0.043457 Nov 02 12:19:54.569760 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 77/163] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:19:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2012%3A19%3A54 => generated 128 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:54.710218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:54.717749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:54.751878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:54.753261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:54.754436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:54.756976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:54.782759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:54.784067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:54.787105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:54.796488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:54.819422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:54.822762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:54.824515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:54.832152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:54.833584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:54.839898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:55.652963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:56.046323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=16 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:56.090961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:56.106884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:56.111399 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-621d8e39-8159-494b-8748-9a2e3dc6eb48 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1319 microversion: 2.1 time: 1.401107 Nov 02 12:19:56.121812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-768d1c70-a966-4e90-9fc4-0081607bed01 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 1.358274 Nov 02 12:19:56.129317 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 87/164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:54 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1319 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:56.138653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.139226 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 78/165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:54 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:56.154374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:56.175543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.177738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.179109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.181057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.182502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.183546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.223767 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] HTTP exception thrown: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Request method failure captured: Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 HTTP/1.1 Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA4I9s6iOigyggELWDS02vXg3lfzJB4qSBcXYKpMefV4fSOLc8o2nRfig1oXJ2ib65Om_Z26vc8n2WsE1q9ieFk8CbPZ6ekhSGZvA7caVUsZUin8TQ64hQHCTV1Xjmhi0_iwiJM_SLYEYGWtxCeRJ4R0g08h9qiCJj0p17ED00hoaw Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 4009f2fda4a94036868b5a27212af0c3 Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:19:56.244495 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 4009f2fda4a94036868b5a27212af0c3 Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminTestJSON-882265761-project Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 1f368d94bcc34714a39f8825be5e82ef Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminTestJSON-882265761-project Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:19:56.247062 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '76517ea9-7cac-4202-ade6-4fbb517b72e0'} Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:56.249012 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:19:56.252045 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:19:56.257654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Returning 404 to user: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:56.260517 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1097dd53-8ab7-409d-9637-8ec80397f0f7 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 404 len: 111 microversion: 2.1 time: 0.129438 Nov 02 12:19:56.263478 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 88/166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:56 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:56.275321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-28062ea6-a3af-415c-81fc-314ad6a0da27 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:56.317996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28062ea6-a3af-415c-81fc-314ad6a0da27 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.318686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28062ea6-a3af-415c-81fc-314ad6a0da27 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.319720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28062ea6-a3af-415c-81fc-314ad6a0da27 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.669536 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-28062ea6-a3af-415c-81fc-314ad6a0da27 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.398482 Nov 02 12:19:56.671301 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 79/167] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:19:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:56.686744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-51a86d36-692f-4ea6-99dc-240cb519dcff tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.739057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9edbc05e-f6cb-42d8-8f51-ab8e78641340 req-1c219c9f-aff5-4f1a-9f56-6fec50d6ee92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b1647-16dc-4d7b-9877-8a7a663b6475", "name": "network-vif-plugged", "status": "completed", "tag": "81a93aab-aafa-457d-96b6-77c679b9fdeb"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:56.752817 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-51a86d36-692f-4ea6-99dc-240cb519dcff tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.073261 Nov 02 12:19:56.754411 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 89/168] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:19:56 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:19:56.773854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b7268e0-e9ee-4aff-b589-828edce3b41a tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1171690343"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:56.780015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-5b7268e0-e9ee-4aff-b589-828edce3b41a tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid 5f9acac6-687e-4063-be9c-ad3b75373845 for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:19:56.781231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9edbc05e-f6cb-42d8-8f51-ab8e78641340 req-1c219c9f-aff5-4f1a-9f56-6fec50d6ee92 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.782884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9edbc05e-f6cb-42d8-8f51-ab8e78641340 req-1c219c9f-aff5-4f1a-9f56-6fec50d6ee92 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.785297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9edbc05e-f6cb-42d8-8f51-ab8e78641340 req-1c219c9f-aff5-4f1a-9f56-6fec50d6ee92 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.817162 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9edbc05e-f6cb-42d8-8f51-ab8e78641340 req-1c219c9f-aff5-4f1a-9f56-6fec50d6ee92 service nova] Creating event network-vif-plugged:81a93aab-aafa-457d-96b6-77c679b9fdeb for instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 on n-h2-855650-5 Nov 02 12:19:56.826588 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9edbc05e-f6cb-42d8-8f51-ab8e78641340 req-1c219c9f-aff5-4f1a-9f56-6fec50d6ee92 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095073 Nov 02 12:19:56.828140 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 80/169] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:56.850608 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b7268e0-e9ee-4aff-b589-828edce3b41a tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081893 Nov 02 12:19:56.852891 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 90/170] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:19:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:56.869254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f8c0a05-a8c8-4467-b9b9-bb455db85702 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:56.885437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:56.896822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f8c0a05-a8c8-4467-b9b9-bb455db85702 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.904996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f8c0a05-a8c8-4467-b9b9-bb455db85702 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.905941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f8c0a05-a8c8-4467-b9b9-bb455db85702 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.184307 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f8c0a05-a8c8-4467-b9b9-bb455db85702 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.312870 Nov 02 12:19:57.186325 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 81/171] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:19:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:57.203315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:57.205346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:57.225354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.227937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.231104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.234786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.236480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.236947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.668928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-158981874", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "88aa3408-37b9-415a-84a9-1aa8b9400b9d"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:57.672374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:57.705393 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a437f267-b596-43d8-b24b-abd513ef2ce6 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1321 microversion: 2.1 time: 0.516803 Nov 02 12:19:57.707200 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 82/172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:57 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1321 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:57.717415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:57.720656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:57.735989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.737177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.739478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.741526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.742676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.743683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.771313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] validate_networks() for [('88aa3408-37b9-415a-84a9-1aa8b9400b9d', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:19:58.164745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:58.187385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:58.201859 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b48ff83-0e28-4d66-8df6-9e5c3bc2df90 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1467 microversion: 2.1 time: 0.492496 Nov 02 12:19:58.224508 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 83/173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:57 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1467 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:58.229865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-103a55cd-3d99-4019-ab6b-9e8e55c122f0 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:58.266253 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-103a55cd-3d99-4019-ab6b-9e8e55c122f0 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.039789 Nov 02 12:19:58.272980 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 84/174] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:19:58 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:58.704284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:58.705602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:58.716969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.718383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.719503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.721079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.722262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.723394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.944898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:19:59.246970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:19:59.248275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:19:59.249100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:19:59.250217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:19:59.251929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:19:59.268026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.268644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.269233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.270511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.271293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.271970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.303098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for project 3579208e4ca549d9a0cdb14af362384e. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:59.309669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for user 9f2ebf76beec4d3185c3c279868f8366 and project 3579208e4ca549d9a0cdb14af362384e. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:59.327374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:19:59.330946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:19:59.348508 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7f7077f-b3ec-4529-968e-bc9154c91d02 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] 10.222.0.45 "DELETE /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 204 len: 0 microversion: 2.1 time: 1.069163 Nov 02 12:19:59.353861 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 85/175] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:19:58 2022] DELETE /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:59.387040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4018a87e-acfe-41ef-b698-1a74252bf278 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:59.441065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4018a87e-acfe-41ef-b698-1a74252bf278 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.442178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4018a87e-acfe-41ef-b698-1a74252bf278 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.443106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4018a87e-acfe-41ef-b698-1a74252bf278 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.464350 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05212c13-499c-427f-8883-614034554197 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.501680 Nov 02 12:19:59.466506 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 91/176] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:19:59.480757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:59.482221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:59.524421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.527051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.529461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.530814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.547837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.548834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.707172 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4018a87e-acfe-41ef-b698-1a74252bf278 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.351058 Nov 02 12:19:59.714911 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 86/177] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:19:59 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:59.726088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:59.727231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:59.754689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.757431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.758549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.763617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.764907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.770236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.091013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:00.109243 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b07a6ebc-cf09-45d6-842c-be99eab8d4af tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1471 microversion: 2.1 time: 0.640409 Nov 02 12:20:00.110130 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 92/178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:59 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1471 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:00.121838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2147da57-b59a-4de4-b3c6-2139de419211 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:00.125500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2147da57-b59a-4de4-b3c6-2139de419211 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:00.129131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:00.146883 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19918af9-d683-4acf-8c27-b534c0c1ec07 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1473 microversion: 2.1 time: 0.434427 Nov 02 12:20:00.148531 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 87/179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:59 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1473 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:00.175960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb2fe3cd-cc5f-437e-8342-f7d3627cc6bf tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:00.247467 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb2fe3cd-cc5f-437e-8342-f7d3627cc6bf tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.093549 Nov 02 12:20:00.248784 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 88/180] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:00 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:00.305351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2147da57-b59a-4de4-b3c6-2139de419211 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:00.318241 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2147da57-b59a-4de4-b3c6-2139de419211 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1210 microversion: 2.1 time: 0.202665 Nov 02 12:20:00.322174 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 93/181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:00 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1210 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:00.333777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb21f90d-3688-4881-9420-63a41710fece tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1834004791"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:00.351801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-eb21f90d-3688-4881-9420-63a41710fece tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid b52d833c-c35c-4935-96e1-b482638e7137 for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:00.416091 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb21f90d-3688-4881-9420-63a41710fece tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090810 Nov 02 12:20:00.423977 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 94/182] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:00.455568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-706c901a-027c-495b-9505-8fce96da63d9 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:00.495778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706c901a-027c-495b-9505-8fce96da63d9 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.500986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706c901a-027c-495b-9505-8fce96da63d9 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.501725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706c901a-027c-495b-9505-8fce96da63d9 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.874373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc59f08c-fa6e-4d71-b27d-b0f75f2a8a01 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:00.876037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fc59f08c-fa6e-4d71-b27d-b0f75f2a8a01 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] [instance: 43560b01-08b7-47b2-bdaf-f6f5290cc619] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:00.916202 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-fc59f08c-fa6e-4d71-b27d-b0f75f2a8a01 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] HTTP exception thrown: Instance 43560b01-08b7-47b2-bdaf-f6f5290cc619 could not be found. Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc59f08c-fa6e-4d71-b27d-b0f75f2a8a01 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Request method failure captured: Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/43560b01-08b7-47b2-bdaf-f6f5290cc619/action HTTP/1.1 Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 15 Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBUaKeEwz-uwxiKMBWko2mOGSh7ruXIj2Qz6-H_kM0ZAJwummKIUYrNvxdlXIcAJKdzJonUog9ngQiyDI3jl7xmYGAgA-E_ccVDHWCXzxaE6LrcXOVxmcWDrdhpxZ3rmnAX-I5qeq4yDA3B9Rwwo8Hp6uhPx9UR7ZyHypbDH70btRk Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:20:00.928686 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: aedd23de4b7c4c188cee7862063d9a28 Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: {"migrate": {}} Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:00.930349 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 43560b01-08b7-47b2-bdaf-f6f5290cc619 could not be found. Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '43560b01-08b7-47b2-bdaf-f6f5290cc619', 'body': {'migrate': {}}} Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43560b01-08b7-47b2-bdaf-f6f5290cc619 could not be found. Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:00.931290 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43560b01-08b7-47b2-bdaf-f6f5290cc619 could not be found. Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43560b01-08b7-47b2-bdaf-f6f5290cc619 could not be found. Nov 02 12:20:00.932709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:00.940652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc59f08c-fa6e-4d71-b27d-b0f75f2a8a01 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Returning 404 to user: Instance 43560b01-08b7-47b2-bdaf-f6f5290cc619 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:00.941557 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fc59f08c-fa6e-4d71-b27d-b0f75f2a8a01 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/43560b01-08b7-47b2-bdaf-f6f5290cc619/action" status: 404 len: 111 microversion: 2.1 time: 0.691599 Nov 02 12:20:00.949959 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 89/183] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:20:00 2022] POST /compute/v2.1/servers/43560b01-08b7-47b2-bdaf-f6f5290cc619/action => generated 111 bytes in 700 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:01.191229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:01.194059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:01.221732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:01.224343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:01.225041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:01.230573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:01.233071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:01.235638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:01.786581 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-706c901a-027c-495b-9505-8fce96da63d9 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 1.337652 Nov 02 12:20:01.801911 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 95/184] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:20:00 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:01.823828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-520240601", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:01.977440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:02.704091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:02.725231 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cda48017-3702-44e1-a56c-6adfb9656a26 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 200 len: 1473 microversion: 2.1 time: 1.539677 Nov 02 12:20:02.727746 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 90/185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:01 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 1473 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:02.768382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:02.783106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:02.810833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:02.822982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:02.823566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:02.828114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:02.830237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:02.831567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.227199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:03.240397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aad3f14c-2985-4f07-b7d2-070d74fc5826 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1268 microversion: 2.1 time: 0.511395 Nov 02 12:20:03.241009 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 91/186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:02 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1268 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:03.275610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d351d924-f72a-478c-8cfd-ccfca45ee556 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:03.303106 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d351d924-f72a-478c-8cfd-ccfca45ee556 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.038165 Nov 02 12:20:03.304755 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 92/187] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:20:03 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:03.357927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:03.359734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:03.360721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:03.361624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:03.362555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:03.390119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:03.394631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:03.405601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.407406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:03.408535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:03.409539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.440947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Getting quotas for project 3a242625dc6c4b75919516fa58c748b4. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:03.446706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Getting quotas for user a9f59207e72940f184f57e38830ff5dd and project 3a242625dc6c4b75919516fa58c748b4. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:03.461293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:20:03.464527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:20:03.554657 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ef5d2bac-6120-4c61-8751-aff50298ddc8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.746875 Nov 02 12:20:03.556061 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 96/188] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:20:03.562082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-8fc96bc1-6b8d-48a2-b7a8-1cfdf52abe55 req-7b6fb58a-1168-4cb2-8d87-647a66332cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552c475f-6460-4181-a3e0-b644f66d9507", "name": "network-vif-deleted", "tag": "51d54560-3318-4901-b49b-aabfd17717a1"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:03.577574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8fc96bc1-6b8d-48a2-b7a8-1cfdf52abe55 req-7b6fb58a-1168-4cb2-8d87-647a66332cb5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:03.579211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8fc96bc1-6b8d-48a2-b7a8-1cfdf52abe55 req-7b6fb58a-1168-4cb2-8d87-647a66332cb5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:03.579917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8fc96bc1-6b8d-48a2-b7a8-1cfdf52abe55 req-7b6fb58a-1168-4cb2-8d87-647a66332cb5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.597398 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-8fc96bc1-6b8d-48a2-b7a8-1cfdf52abe55 req-7b6fb58a-1168-4cb2-8d87-647a66332cb5 service nova] Creating event network-vif-deleted:51d54560-3318-4901-b49b-aabfd17717a1 for instance 552c475f-6460-4181-a3e0-b644f66d9507 on n-h2-855650-5 Nov 02 12:20:03.625151 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-8fc96bc1-6b8d-48a2-b7a8-1cfdf52abe55 req-7b6fb58a-1168-4cb2-8d87-647a66332cb5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065481 Nov 02 12:20:03.630760 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 97/189] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:03.647921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-439f3bc7-6ec3-402a-91dd-b708ec4b26b6 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:03.657249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e98b0c48-834e-4718-99dc-1c53e7c5740e tempest-QuotaClassesAdminTestJSON-205912274 tempest-QuotaClassesAdminTestJSON-205912274-project-admin] Calling method '.version_select at 0x7f228f2759d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:03.664675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439f3bc7-6ec3-402a-91dd-b708ec4b26b6 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:03.666197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439f3bc7-6ec3-402a-91dd-b708ec4b26b6 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:03.667611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439f3bc7-6ec3-402a-91dd-b708ec4b26b6 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.737101 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e98b0c48-834e-4718-99dc-1c53e7c5740e tempest-QuotaClassesAdminTestJSON-205912274 tempest-QuotaClassesAdminTestJSON-205912274-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.430172 Nov 02 12:20:03.740082 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 93/190] 10.222.0.45 () {58 vars in 1185 bytes} [Wed Nov 2 12:20:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:03.747946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb2619b2-fc71-4ab5-90ab-f66e793b9e30 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:03.753684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb2619b2-fc71-4ab5-90ab-f66e793b9e30 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:04.161548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-439f3bc7-6ec3-402a-91dd-b708ec4b26b6 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.528706 Nov 02 12:20:04.166317 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 98/191] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:20:03 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:04.192270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16a9fce6-ba56-4ab0-b77e-cbc890486413 tempest-QuotaClassesAdminTestJSON-205912274 tempest-QuotaClassesAdminTestJSON-205912274-project-admin] Action: 'update', calling method: .version_select at 0x7f228f4a7310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:04.561497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb2619b2-fc71-4ab5-90ab-f66e793b9e30 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:04.578362 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb2619b2-fc71-4ab5-90ab-f66e793b9e30 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1221 microversion: 2.1 time: 0.836786 Nov 02 12:20:04.580411 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 94/192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:03 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1221 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:04.595201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:04.596023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:04.620220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:04.620783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:04.625516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:04.626513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:04.629368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:04.629782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:04.685390 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] HTTP exception thrown: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Request method failure captured: Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 HTTP/1.1 Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBG4AfRQfdR_PCAZ6a22lKNnaFjq2aDRABUBUo-R4eAFVm_3PN44HDMJPjSPGMBwqHWCuCL5Ho_KoSk5LSw85Y3YlQSsPIVxXhus6_vseq-w0f4BU_6OTo74CzbBn2PFtuVDopdcT9x9xwmkqIMcvYIh8-lMTwL3RphRBJ_ZhLcF3E Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:04.699194 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ef6e51c338b94fc0ab741f99965a3245 Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:04.701751 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '552c475f-6460-4181-a3e0-b644f66d9507'} Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:04.702668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:04.704796 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.710240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Returning 404 to user: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:04.710240 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e821a305-35f6-43dc-b347-4dcb996a0160 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 404 len: 111 microversion: 2.1 time: 0.121519 Nov 02 12:20:04.710240 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 95/193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:04 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:04.720966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=3,nova_api:INSERT=13,nova_api:UPDATE=5 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:04.747747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c64679b8-2d11-4aea-a349-d8fc0b0a5340 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:04.825625 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c64679b8-2d11-4aea-a349-d8fc0b0a5340 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.104660 Nov 02 12:20:04.827570 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 96/194] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:04 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:04.845085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:04.846198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:04.857148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:04.858254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:04.859013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:04.860131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:04.860916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:04.862498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:04.893487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:05.382552 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16a9fce6-ba56-4ab0-b77e-cbc890486413 tempest-QuotaClassesAdminTestJSON-205912274 tempest-QuotaClassesAdminTestJSON-205912274-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.213474 Nov 02 12:20:05.394110 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 99/195] 10.222.0.45 () {60 vars in 1206 bytes} [Wed Nov 2 12:20:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:05.400290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8beec524-ea3d-4806-ba0b-8d7a9d7943ae tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2094919790"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:05.406103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-8beec524-ea3d-4806-ba0b-8d7a9d7943ae tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid 7983a3b3-7756-4dec-b762-d76e4a4ef8f0 for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:05.449909 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8beec524-ea3d-4806-ba0b-8d7a9d7943ae tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054052 Nov 02 12:20:05.466436 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 100/196] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:05.473699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:05.476759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1540048378", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:05.533345 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-afae69b3-6d47-44d5-adef-c71a8be1295c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1310 microversion: 2.1 time: 0.704153 Nov 02 12:20:05.534500 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 97/197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:04 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1310 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:05.544278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-432c90a7-cbce-4ad9-83ff-114a4b84ad6b tempest-QuotaClassesAdminTestJSON-205912274 tempest-QuotaClassesAdminTestJSON-205912274-project-admin] Calling method '.version_select at 0x7f228f282af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:05.577308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:05.578989 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-432c90a7-cbce-4ad9-83ff-114a4b84ad6b tempest-QuotaClassesAdminTestJSON-205912274 tempest-QuotaClassesAdminTestJSON-205912274-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.042866 Nov 02 12:20:05.581956 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 98/198] 10.222.0.45 () {58 vars in 1185 bytes} [Wed Nov 2 12:20:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:05.595188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ec27956-a7a4-4a7e-8caa-a24f674dcaeb tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:05.622118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ec27956-a7a4-4a7e-8caa-a24f674dcaeb tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:05.623058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ec27956-a7a4-4a7e-8caa-a24f674dcaeb tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:05.623960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ec27956-a7a4-4a7e-8caa-a24f674dcaeb tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:05.953788 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ec27956-a7a4-4a7e-8caa-a24f674dcaeb tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.367562 Nov 02 12:20:05.954755 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 99/199] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:20:05 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:05.962819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-773b7ca4-9159-4ed7-bd9f-1645cba29a92 tempest-QuotaClassesAdminTestJSON-205912274 tempest-QuotaClassesAdminTestJSON-205912274-project-admin] Action: 'update', calling method: .version_select at 0x7f228f275dc0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:06.215355 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-773b7ca4-9159-4ed7-bd9f-1645cba29a92 tempest-QuotaClassesAdminTestJSON-205912274 tempest-QuotaClassesAdminTestJSON-205912274-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.257797 Nov 02 12:20:06.216949 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 100/200] 10.222.0.45 () {60 vars in 1206 bytes} [Wed Nov 2 12:20:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:06.227915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:06.233739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:06.250552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.252443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.253397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.254399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.255168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.255805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.662972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:06.679112 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f55cae2d-2ab8-416f-895e-185dc67d6384 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1273 microversion: 2.1 time: 0.459930 Nov 02 12:20:06.679723 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 101/201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:06 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1273 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:06.694339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-29f3d015-69ec-414a-9b89-55d39efb4f4d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:06.701634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:06.702735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:06.703491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:06.703904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:06.704480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:06.730842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.731391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.731827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.732602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.733045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.733466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.748786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29f3d015-69ec-414a-9b89-55d39efb4f4d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.749287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29f3d015-69ec-414a-9b89-55d39efb4f4d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.749731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29f3d015-69ec-414a-9b89-55d39efb4f4d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.805629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Getting quotas for project abeb11f5ac84444384ce6a3fe2253953. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:06.813022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Getting quotas for user ef6e51c338b94fc0ab741f99965a3245 and project abeb11f5ac84444384ce6a3fe2253953. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:06.852091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:20:06.854771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:20:07.045165 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7dadd808-8459-43f7-9ab2-33b909713e0e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576336 Nov 02 12:20:07.046199 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 101/202] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:20:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:20:07.059213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-8489d591-5d8c-4aee-9e37-82699f608ba0 req-f7caafaf-7e9d-4e77-a149-e6ded20449b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4728b36-5541-47b1-8f1d-773945ed64dd", "tag": "57302fa0-ed89-4f1b-baf4-32d04a5d7684"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:07.087566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8489d591-5d8c-4aee-9e37-82699f608ba0 req-f7caafaf-7e9d-4e77-a149-e6ded20449b7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.090778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8489d591-5d8c-4aee-9e37-82699f608ba0 req-f7caafaf-7e9d-4e77-a149-e6ded20449b7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.091455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8489d591-5d8c-4aee-9e37-82699f608ba0 req-f7caafaf-7e9d-4e77-a149-e6ded20449b7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.118358 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-8489d591-5d8c-4aee-9e37-82699f608ba0 req-f7caafaf-7e9d-4e77-a149-e6ded20449b7 service nova] Creating event network-changed:57302fa0-ed89-4f1b-baf4-32d04a5d7684 for instance c4728b36-5541-47b1-8f1d-773945ed64dd on n-h1-855650-5 Nov 02 12:20:07.134697 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-8489d591-5d8c-4aee-9e37-82699f608ba0 req-f7caafaf-7e9d-4e77-a149-e6ded20449b7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083674 Nov 02 12:20:07.143484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 102/203] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:07.168679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:07.170622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:07.180014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.180688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.181134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.182195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.182837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.183628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.237342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=2,nova_api:UPDATE=13,nova_api:DELETE=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:07.282374 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-29f3d015-69ec-414a-9b89-55d39efb4f4d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.601121 Nov 02 12:20:07.296647 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 102/204] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:20:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:07.316647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f8b54117-1a3a-45f2-b3e4-574a4d9a3d70 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:07.320307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8b54117-1a3a-45f2-b3e4-574a4d9a3d70 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:07.633619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8b54117-1a3a-45f2-b3e4-574a4d9a3d70 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:07.642743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f8b54117-1a3a-45f2-b3e4-574a4d9a3d70 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1220 microversion: 2.1 time: 0.344457 Nov 02 12:20:07.645624 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 103/205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:07 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1220 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:07.659367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c219e859-8c09-43b2-abfa-01b9edbd1a8b tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:07.734943 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c219e859-8c09-43b2-abfa-01b9edbd1a8b tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.085049 Nov 02 12:20:07.743006 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 104/206] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:07 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:07.766393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:07.768185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:07.809552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.811231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.813579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.820950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.824440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.828538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.261902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:08.278855 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f5d5e043-12dd-4dbb-88bc-3b832e8e280d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1279 microversion: 2.1 time: 0.533259 Nov 02 12:20:08.282377 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 105/207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:07 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1279 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:08.292671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b19f8732-3083-477e-ab1a-65c334710f8b tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-522564327"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:08.297402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-b19f8732-3083-477e-ab1a-65c334710f8b tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid 3b26fcfb-44e0-43c5-8c80-1e7237feb2c6 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:08.338330 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b19f8732-3083-477e-ab1a-65c334710f8b tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053806 Nov 02 12:20:08.340165 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 106/208] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:08.347630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99bed52d-df25-4b3c-bc7e-54c041b8f7ba tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1488493355"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:08.374866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-99bed52d-df25-4b3c-bc7e-54c041b8f7ba tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid 687b2f21-c245-474e-9bb9-a45643386651 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:08.420215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99bed52d-df25-4b3c-bc7e-54c041b8f7ba tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076810 Nov 02 12:20:08.422217 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 107/209] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:08.431553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1672aa4-5d31-42a4-a380-f3357750661a tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:08.474725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1672aa4-5d31-42a4-a380-f3357750661a tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.050277 Nov 02 12:20:08.478989 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 108/210] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:08 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:08.484790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-282fddcc-afd4-48c2-8e45-fd473af301eb tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:08.498095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-282fddcc-afd4-48c2-8e45-fd473af301eb tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.499005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-282fddcc-afd4-48c2-8e45-fd473af301eb tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.499798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-282fddcc-afd4-48c2-8e45-fd473af301eb tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.587080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:08.605256 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac7f75d0-1467-478d-8d08-db48994f924c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1310 microversion: 2.1 time: 1.459757 Nov 02 12:20:08.613863 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 103/211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:07 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1310 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:08.637958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8799939a-7802-4046-95d5-86d16c826b7d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:08.689290 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8799939a-7802-4046-95d5-86d16c826b7d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8799939a-7802-4046-95d5-86d16c826b7d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Request method failure captured: Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA7hEIS19_HSRsVo02bGtoMKSV9Q58j4paVF4VTa_0nr79khRfKIlUUHFJ3gxoSYzGjJZFBYBB1ugZiLi1tQCRgya4o6C6lHaaGQgdUyFeD6_4TK6gMCgJjWG43Qc3wQC9uEmFGkWkwOBR_Aj0alcOyxgZRs1KO9rjcviqNW-Q6Hds Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 898112b902e5497eb86b0cfd992b4fa5 Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:08.702863 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 898112b902e5497eb86b0cfd992b4fa5 Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminTestJSON-647713775-project-admin Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 2e3385e6cf364994975f3cd0c8302418 Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminTestJSON-647713775-project-admin Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: exception: Aggregate 5 could not be found. Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '5'} Nov 02 12:20:08.705632 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.707511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Nov 02 12:20:08.710178 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.712459 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-282fddcc-afd4-48c2-8e45-fd473af301eb tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.221953 Nov 02 12:20:08.712617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8799939a-7802-4046-95d5-86d16c826b7d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:08.712617 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8799939a-7802-4046-95d5-86d16c826b7d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.087155 Nov 02 12:20:08.712617 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 104/212] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:20:08 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:08.716685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:08.718369 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 109/213] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:20:08 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:08.722209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:08.733678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03deefed-d19e-4110-b65c-9bb9e7171d99 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:08.745548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.747217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.747821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.750491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.751327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.755626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.788590 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-03deefed-d19e-4110-b65c-9bb9e7171d99 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03deefed-d19e-4110-b65c-9bb9e7171d99 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Request method failure captured: Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmA7hEIS19_HSRsVo02bGtoMKSV9Q58j4paVF4VTa_0nr79khRfKIlUUHFJ3gxoSYzGjJZFBYBB1ugZiLi1tQCRgya4o6C6lHaaGQgdUyFeD6_4TK6gMCgJjWG43Qc3wQC9uEmFGkWkwOBR_Aj0alcOyxgZRs1KO9rjcviqNW-Q6Hds Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 898112b902e5497eb86b0cfd992b4fa5 Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:20:08.809369 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 898112b902e5497eb86b0cfd992b4fa5 Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AggregatesAdminTestJSON-647713775-project-admin Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 2e3385e6cf364994975f3cd0c8302418 Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AggregatesAdminTestJSON-647713775-project-admin Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: exception: Aggregate 5 could not be found. Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '5'} Nov 02 12:20:08.810834 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:08.811531 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.812560 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:08.813678 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:08.813678 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:08.813678 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:08.813678 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Nov 02 12:20:08.813678 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.813678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03deefed-d19e-4110-b65c-9bb9e7171d99 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:08.816676 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03deefed-d19e-4110-b65c-9bb9e7171d99 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.094649 Nov 02 12:20:08.830672 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 110/214] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:08 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:08.836864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee14982f-80e4-4030-b660-df1424e00cc1 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:08.857808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee14982f-80e4-4030-b660-df1424e00cc1 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.858749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee14982f-80e4-4030-b660-df1424e00cc1 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.859787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee14982f-80e4-4030-b660-df1424e00cc1 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.930540 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-ee14982f-80e4-4030-b660-df1424e00cc1 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h1-855650-5. Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee14982f-80e4-4030-b660-df1424e00cc1 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Request method failure captured: Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 39 Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmA71_WEQkdY_ZQNcmnHj0sIdV_agzboRNvaXUAp8_vzodut2VZKRc8Ha6GhaWcmw6laji3GyqRLQ3MMyBZ8XEvjkML6DHXSp6hc0UogsDX8X2BQJp_JaHPBcePclL3A9rewe3bpN0NO4ddjTtgVw_qZ1pIPDqkJZV4NUj7XX8gCv-A Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:20:08.980045 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ed03072b9a0a4dd7be1804d781b104b6 Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: {"add_host": {"host": "n-h1-855650-5"}} Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:08.981824 n-d-855650-5 devstack@n-api.service[120722]: exception: Aggregate 6 already has host n-h1-855650-5. Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-855650-5'}}} Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:20:08.982652 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-855650-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:20:08.983671 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:20:08.984688 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:20:08.987720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-855650-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 12, 20, 8, 895244), 'updated_at': None, 'host': 'n-h1-855650-5', 'aggregate_id': 6}] Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.989928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h1-855650-5. Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.991086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h1-855650-5. Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:08.992244 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:08.993529 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h1-855650-5. Nov 02 12:20:08.993529 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:08.993529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee14982f-80e4-4030-b660-df1424e00cc1 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Returning 409 to user: Aggregate 6 already has host n-h1-855650-5. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:08.993529 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ee14982f-80e4-4030-b660-df1424e00cc1 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.156056 Nov 02 12:20:08.993529 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 111/215] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:20:08 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 02 12:20:09.018120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:09.035484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b7088be-17e4-450c-8055-8f65a1458d6b tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1355044695", "name": "tempest-test_aggregate-771350128"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:09.054748 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-79b76893-950c-4b36-b99f-9056c6613c5b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1272 microversion: 2.1 time: 0.342106 Nov 02 12:20:09.087391 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 105/216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:08 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1272 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:09.103363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78f265bd-7326-4af4-b122-c8c17731f809 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:09.129331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78f265bd-7326-4af4-b122-c8c17731f809 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:09.132189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78f265bd-7326-4af4-b122-c8c17731f809 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:09.133026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78f265bd-7326-4af4-b122-c8c17731f809 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:09.157438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-8b7088be-17e4-450c-8055-8f65a1458d6b tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid 62bfa691-29ec-4647-97df-0bb8745587c5 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:09.166314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:09.277544 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8b7088be-17e4-450c-8055-8f65a1458d6b tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.289937 Nov 02 12:20:09.290189 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 112/217] 10.222.0.45 () {60 vars in 1165 bytes} [Wed Nov 2 12:20:08 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:09.305060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9c0e798-de34-40ce-9ce4-4c4a69754e15 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:09.389915 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9c0e798-de34-40ce-9ce4-4c4a69754e15 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.097748 Nov 02 12:20:09.390851 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 113/218] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:09 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:09.399201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:09.400177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:09.408323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:09.409452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:09.410768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:09.411733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:09.412531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:09.413246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:09.501721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78f265bd-7326-4af4-b122-c8c17731f809 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.409199 Nov 02 12:20:09.503647 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 106/219] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:20:09 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:09.536649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3cf602cd-c6d6-4fba-ad2e-c1cfdd5fbb92 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:09.563673 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3cf602cd-c6d6-4fba-ad2e-c1cfdd5fbb92 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3cf602cd-c6d6-4fba-ad2e-c1cfdd5fbb92 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Request method failure captured: Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA7hEIS19_HSRsVo02bGtoMKSV9Q58j4paVF4VTa_0nr79khRfKIlUUHFJ3gxoSYzGjJZFBYBB1ugZiLi1tQCRgya4o6C6lHaaGQgdUyFeD6_4TK6gMCgJjWG43Qc3wQC9uEmFGkWkwOBR_Aj0alcOyxgZRs1KO9rjcviqNW-Q6Hds Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 898112b902e5497eb86b0cfd992b4fa5 Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:09.565643 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 898112b902e5497eb86b0cfd992b4fa5 Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminTestJSON-647713775-project-admin Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 2e3385e6cf364994975f3cd0c8302418 Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminTestJSON-647713775-project-admin Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: exception: Aggregate 7 could not be found. Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7'} Nov 02 12:20:09.566986 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:09.567685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Nov 02 12:20:09.568687 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.574293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3cf602cd-c6d6-4fba-ad2e-c1cfdd5fbb92 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:09.576001 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3cf602cd-c6d6-4fba-ad2e-c1cfdd5fbb92 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.070318 Nov 02 12:20:09.579225 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 107/220] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:20:09 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:09.587172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8eaea557-1995-46ac-94ed-36e1f80a7c25 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:09.680043 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8eaea557-1995-46ac-94ed-36e1f80a7c25 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.098981 Nov 02 12:20:09.700975 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 108/221] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:09 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:09.727422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02d9457a-94bd-489a-aae2-1b7354d3f0d8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:09.797904 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-02d9457a-94bd-489a-aae2-1b7354d3f0d8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02d9457a-94bd-489a-aae2-1b7354d3f0d8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Request method failure captured: Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA7hEIS19_HSRsVo02bGtoMKSV9Q58j4paVF4VTa_0nr79khRfKIlUUHFJ3gxoSYzGjJZFBYBB1ugZiLi1tQCRgya4o6C6lHaaGQgdUyFeD6_4TK6gMCgJjWG43Qc3wQC9uEmFGkWkwOBR_Aj0alcOyxgZRs1KO9rjcviqNW-Q6Hds Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 898112b902e5497eb86b0cfd992b4fa5 Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:09.806237 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_898112b902e5497eb86b0cfd992b4fa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 898112b902e5497eb86b0cfd992b4fa5 Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-647713775 Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminTestJSON-647713775-project-admin Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 2e3385e6cf364994975f3cd0c8302418 Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminTestJSON-647713775-project-admin Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: exception: Aggregate 7 could not be found. Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7'} Nov 02 12:20:09.809619 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:09.811435 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:09.813901 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:09.817709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:09.817709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:09.817709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:09.817709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Nov 02 12:20:09.817709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:09.820939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:09.831776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02d9457a-94bd-489a-aae2-1b7354d3f0d8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:09.835016 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02d9457a-94bd-489a-aae2-1b7354d3f0d8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.131637 Nov 02 12:20:09.847618 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 109/222] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:09 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:09.856948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:09.857226 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb7d7f08-02cd-4530-9df6-9cd267dda9bd tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1279 microversion: 2.1 time: 0.462237 Nov 02 12:20:09.863254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:09.867152 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 114/223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:09 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1279 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:09.883676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b196f324-8163-4fbd-9805-b401edacb778 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1996671045"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:09.888455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-b196f324-8163-4fbd-9805-b401edacb778 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid 63a30785-4b35-4543-8e97-7b3be8dd7945 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:09.902925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:09.906137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:09.906894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:09.907973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:09.910209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:09.919511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:09.981242 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b196f324-8163-4fbd-9805-b401edacb778 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.111802 Nov 02 12:20:10.002294 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 115/224] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:10.017888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6df295d0-6d8d-476b-9324-a71cddeed265 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1241781805"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:10.024259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-6df295d0-6d8d-476b-9324-a71cddeed265 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Generated uuid 7408a730-2614-4640-aeac-deacaa2d1481 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:10.101116 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6df295d0-6d8d-476b-9324-a71cddeed265 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.094992 Nov 02 12:20:10.103412 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 116/225] 10.222.0.45 () {62 vars in 1205 bytes} [Wed Nov 2 12:20:10 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:10.111077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44f9bb74-dc3b-43b1-a38b-f92bba544fd7 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-554511688"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:10.116514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-44f9bb74-dc3b-43b1-a38b-f92bba544fd7 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid 9e970ad5-7fe2-481d-ab13-25d089863cc0 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:10.157900 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44f9bb74-dc3b-43b1-a38b-f92bba544fd7 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052359 Nov 02 12:20:10.160758 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 117/226] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:10.545548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:10.558310 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32e39ae7-beb3-4977-a337-97f761480aa2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1310 microversion: 2.1 time: 0.713709 Nov 02 12:20:10.586065 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 110/227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:09 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1310 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:10.601698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:10.606812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:10.619341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:10.620955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:10.621690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:10.626994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:10.627726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:10.628331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:10.823772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:10.863487 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-45a16323-e767-463d-b1de-aca5b42aaecb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1278 microversion: 2.1 time: 0.262696 Nov 02 12:20:10.864573 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 111/228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:10 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:10.886482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a1caed32-f15f-4ee2-a65f-5a1d74153c8a tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1352063879"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:11.020173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53417bf7-a705-4ab4-a3a4-4105f4052f78 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:11.024375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53417bf7-a705-4ab4-a3a4-4105f4052f78 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'a9bcc7504eb54f6492376ac82952f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb8432fdf314b62ab8972b36dcb43dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53417bf7-a705-4ab4-a3a4-4105f4052f78 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Request method failure captured: Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 39 Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmA44Fn1w1TZybiI96ztUksIz-aY7YNIyoNazQvXO-3zSDvimvxYWrpoUC3IotU_4q6XqLWkQVA7vEcBqYJRl2K48TcQ2x9J807XxY1fa1DmpMKitpf1G9wHysI88s9mOoarRm2YFjyvnOxeh7FmS9ufhfd6-TO4TzwIst5VqEfPcI8 Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:11.029618 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a9bcc7504eb54f6492376ac82952f271 Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: {"add_host": {"host": "n-h1-855650-5"}} Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:11.032315 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-855650-5'}}} Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:11.033944 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 12:20:11.036420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.038721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53417bf7-a705-4ab4-a3a4-4105f4052f78 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:11.041162 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53417bf7-a705-4ab4-a3a4-4105f4052f78 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] 10.222.0.45 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.874676 Nov 02 12:20:11.041521 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 118/229] 10.222.0.45 () {60 vars in 1191 bytes} [Wed Nov 2 12:20:10 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 880 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:11.057646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a8871ef-281e-4a0c-a7c9-b23754402668 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:11.078084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a8871ef-281e-4a0c-a7c9-b23754402668 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.030704 Nov 02 12:20:11.081371 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 119/230] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:11 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:11.093862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:11.094680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:11.104496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.110181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.110839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.111924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.112516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.113871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.141179 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a1caed32-f15f-4ee2-a65f-5a1d74153c8a tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.269418 Nov 02 12:20:11.144073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 112/231] 10.222.0.45 () {62 vars in 1210 bytes} [Wed Nov 2 12:20:10 2022] PUT /compute/v2.1/os-aggregates/9 => generated 299 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:11.186298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-da8d57d6-4eca-41f3-a146-b103aa6b230d tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:11.226410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=12,nova_api:UPDATE=8,nova_api:DELETE=5 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:11.248782 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-da8d57d6-4eca-41f3-a146-b103aa6b230d tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.101461 Nov 02 12:20:11.251850 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 113/232] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:11.266656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b04075aa-c892-4dea-a813-d66d51c826c8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:11.333068 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b04075aa-c892-4dea-a813-d66d51c826c8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.079338 Nov 02 12:20:11.335170 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 114/233] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 12:20:11 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:11.354263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-373761cf-0d41-443b-acdd-c30c585340fc tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:11.375493 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-373761cf-0d41-443b-acdd-c30c585340fc tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.037191 Nov 02 12:20:11.377732 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 115/234] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Nov 2 12:20:11 2022] GET /compute/v2.1/os-aggregates/9 => generated 299 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:11.407314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fdc6ef12-db93-4d57-a676-332e4ef8ac45 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-244969686"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:11.424344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-fdc6ef12-db93-4d57-a676-332e4ef8ac45 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid ab672bdc-c886-45df-89a5-bc4770bfad0f for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:11.486093 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fdc6ef12-db93-4d57-a676-332e4ef8ac45 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.100569 Nov 02 12:20:11.488572 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 116/235] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:11.508430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-822d871e-ec8f-445b-acd1-905cdef17679 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:11.537908 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-822d871e-ec8f-445b-acd1-905cdef17679 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.046677 Nov 02 12:20:11.539742 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 117/236] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:11 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:11.560912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27d5de28-6953-4110-8733-58bbc5cb8e34 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:11.617276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d5de28-6953-4110-8733-58bbc5cb8e34 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.631126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d5de28-6953-4110-8733-58bbc5cb8e34 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.631126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d5de28-6953-4110-8733-58bbc5cb8e34 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.779841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:11.801605 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d17097a-fc8e-4d8d-bbf1-84e0b47fee3a tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1321 microversion: 2.1 time: 0.718293 Nov 02 12:20:11.802723 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 120/237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:11 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1321 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:11.824026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-137941691"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:11.892965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.893767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.895991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.921537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.923729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.926732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.965892 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-137941691 could not be found. Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Request method failure captured: Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 57 Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmA71_WEQkdY_ZQNcmnHj0sIdV_agzboRNvaXUAp8_vzodut2VZKRc8Ha6GhaWcmw6laji3GyqRLQ3MMyBZ8XEvjkML6DHXSp6hc0UogsDX8X2BQJp_JaHPBcePclL3A9rewe3bpN0NO4ddjTtgVw_qZ1pIPDqkJZV4NUj7XX8gCv-A Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:20:11.976661 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ed03072b9a0a4dd7be1804d781b104b6 Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: {"add_host": {"host": "tempest-nonexist_host-137941691"}} Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:11.978225 n-d-855650-5 devstack@n-api.service[120722]: exception: Compute host tempest-nonexist_host-137941691 could not be found. Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-137941691'}}} Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-137941691' is not mapped to any cell Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:11.979338 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Nov 02 12:20:11.980377 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-137941691 could not be found. Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-137941691 could not be found. Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:11.982178 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.983535 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:11.983535 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:11.983535 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:11.983535 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:11.983535 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:11.983535 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-137941691 could not be found. Nov 02 12:20:11.983535 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:11.987574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-137941691 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:11.989386 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af6f2bb6-35ed-40c7-a822-db15e3545bc8 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.185302 Nov 02 12:20:11.996515 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 121/238] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 12:20:11 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:12.014072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab39130b-bd13-4492-9230-6b08acfce4f3 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:12.078366 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab39130b-bd13-4492-9230-6b08acfce4f3 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.075691 Nov 02 12:20:12.081548 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 122/239] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:11 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:12.100029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:12.101925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:12.144177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.150059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.150906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.154841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.160167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.162173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.399450 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-27d5de28-6953-4110-8733-58bbc5cb8e34 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 314 microversion: 2.41 time: 0.855851 Nov 02 12:20:12.400466 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 118/240] 10.222.0.45 () {62 vars in 1232 bytes} [Wed Nov 2 12:20:11 2022] POST /compute/v2.1/os-aggregates/9/action => generated 314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:12.438396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:12.440169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:12.460636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.466018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.469268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.471449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.475995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.477178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:13.002420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:13.022386 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb59bde1-77a5-4345-80e1-a7e1102ff66d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1310 microversion: 2.1 time: 0.938848 Nov 02 12:20:13.030374 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 123/241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:12 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1310 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:13.036034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fee3884e-aef9-42cd-a515-cbe5d6928e0b tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:13.083199 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fee3884e-aef9-42cd-a515-cbe5d6928e0b tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.051301 Nov 02 12:20:13.091026 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 124/242] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:13 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:13.098587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f756bfcf-16e1-41cb-a0f2-593392c82492 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1493080694", "availability_zone": "tempest-test_az-1519375062"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:13.123975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-f756bfcf-16e1-41cb-a0f2-593392c82492 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid 7cd32e92-abe4-4b6c-8fa4-d9d6754ae270 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:13.180101 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f756bfcf-16e1-41cb-a0f2-593392c82492 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.087841 Nov 02 12:20:13.180720 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 125/243] 10.222.0.45 () {60 vars in 1165 bytes} [Wed Nov 2 12:20:13 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:13.198198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77a42b93-e566-4d20-95b0-2fa09f34314f tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:13.227617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=10,nova_api:INSERT=11 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:13.233808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a42b93-e566-4d20-95b0-2fa09f34314f tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:13.239249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a42b93-e566-4d20-95b0-2fa09f34314f tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:13.240186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a42b93-e566-4d20-95b0-2fa09f34314f tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:13.550113 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77a42b93-e566-4d20-95b0-2fa09f34314f tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 299 microversion: 2.41 time: 0.363961 Nov 02 12:20:13.554549 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 126/244] 10.222.0.45 () {62 vars in 1232 bytes} [Wed Nov 2 12:20:13 2022] POST /compute/v2.1/os-aggregates/9/action => generated 299 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:13.566759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:13.614434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:13.615448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:13.617876 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2dcfad61-1e40-4682-9aa2-d8775eaddfca tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 1.215347 Nov 02 12:20:13.622584 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 119/245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:12 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:13.658914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8d6af02f-ec07-4f37-84ec-e0f36fbc5bb4 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:13.663312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:13.666298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:13.666984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:13.668103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:13.668947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:13.679932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8d6af02f-ec07-4f37-84ec-e0f36fbc5bb4 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Request method failure captured: Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 283 Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA71_WEQkdY_ZQNcmnHj0sIdV_agzboRNvaXUAp8_vzodut2VZKRc8Ha6GhaWcmw6laji3GyqRLQ3MMyBZ8XEvjkML6DHXSp6hc0UogsDX8X2BQJp_JaHPBcePclL3A9rewe3bpN0NO4ddjTtgVw_qZ1pIPDqkJZV4NUj7XX8gCv-A Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:13.688521 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ed03072b9a0a4dd7be1804d781b104b6 Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:13.689788 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:20:13.691241 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:13.692669 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:13.694999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:13.697072 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:20:13.697072 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:20:13.697072 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:20:13.697072 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.697072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8d6af02f-ec07-4f37-84ec-e0f36fbc5bb4 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:13.703980 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8d6af02f-ec07-4f37-84ec-e0f36fbc5bb4 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.075972 Nov 02 12:20:13.714298 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 120/246] 10.222.0.45 () {60 vars in 1165 bytes} [Wed Nov 2 12:20:13 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:20:13.766392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52f29e90-8bd2-4215-b63b-e4ecc458e47d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1493080694_new", "availability_zone": "tempest-test_az-1519375062_new"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:13.939321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52f29e90-8bd2-4215-b63b-e4ecc458e47d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:13.941306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52f29e90-8bd2-4215-b63b-e4ecc458e47d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:13.942078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52f29e90-8bd2-4215-b63b-e4ecc458e47d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:14.034088 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52f29e90-8bd2-4215-b63b-e4ecc458e47d tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.320079 Nov 02 12:20:14.038017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 121/247] 10.222.0.45 () {60 vars in 1173 bytes} [Wed Nov 2 12:20:13 2022] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:14.051227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2813ab75-17ba-4149-ab27-794468657165 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:14.110285 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2813ab75-17ba-4149-ab27-794468657165 tempest-AggregatesAdminTestV241-1346363385 tempest-AggregatesAdminTestV241-1346363385-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.070813 Nov 02 12:20:14.117595 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 122/248] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Nov 2 12:20:14 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:14.127352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf826149-cc68-4d5c-bc9f-d63af9cefa89 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf826149-cc68-4d5c-bc9f-d63af9cefa89 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Request method failure captured: Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 27 Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA71_WEQkdY_ZQNcmnHj0sIdV_agzboRNvaXUAp8_vzodut2VZKRc8Ha6GhaWcmw6laji3GyqRLQ3MMyBZ8XEvjkML6DHXSp6hc0UogsDX8X2BQJp_JaHPBcePclL3A9rewe3bpN0NO4ddjTtgVw_qZ1pIPDqkJZV4NUj7XX8gCv-A Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:14.134466 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ed03072b9a0a4dd7be1804d781b104b6 Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: {"aggregate": {"name": ""}} Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:14.135919 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi '' Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:14.136789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:20:14.140080 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.154326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf826149-cc68-4d5c-bc9f-d63af9cefa89 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:14.156898 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bf826149-cc68-4d5c-bc9f-d63af9cefa89 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.044262 Nov 02 12:20:14.169364 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 123/249] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:14 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:20:14.179564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:14.180532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:14.196433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:14.197280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:14.197891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:14.199805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:14.203932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:14.204901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:14.727475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:14.745119 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d76143dc-d9e0-4040-b47e-6cd1ee85499e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1321 microversion: 2.1 time: 1.187565 Nov 02 12:20:14.748325 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 127/250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:13 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1321 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:14.764157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:14.772390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-532618c9-79f3-4a74-bc5d-2a8aa4037215 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:14.791589 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-532618c9-79f3-4a74-bc5d-2a8aa4037215 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.039497 Nov 02 12:20:14.791845 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9981d698-a85e-4f7d-b718-172b02ed9a95 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1310 microversion: 2.1 time: 0.620177 Nov 02 12:20:14.792320 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 124/251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:14 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1310 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:14.798022 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 128/252] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:20:14 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:14.805274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0c3151cc-d979-4e75-b4ff-feb0374b7ed3 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-563906769"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:14.830336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0c3151cc-d979-4e75-b4ff-feb0374b7ed3 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'a9bcc7504eb54f6492376ac82952f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb8432fdf314b62ab8972b36dcb43dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0c3151cc-d979-4e75-b4ff-feb0374b7ed3 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Request method failure captured: Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 59 Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA44Fn1w1TZybiI96ztUksIz-aY7YNIyoNazQvXO-3zSDvimvxYWrpoUC3IotU_4q6XqLWkQVA7vEcBqYJRl2K48TcQ2x9J807XxY1fa1DmpMKitpf1G9wHysI88s9mOoarRm2YFjyvnOxeh7FmS9ufhfd6-TO4TzwIst5VqEfPcI8 Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:14.838982 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a9bcc7504eb54f6492376ac82952f271 Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: {"aggregate": {"name": "tempest-test_aggregate-563906769"}} Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:14.842400 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-563906769'}}} Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:14.845337 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:14.848057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 12:20:14.851591 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:14.855092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0c3151cc-d979-4e75-b4ff-feb0374b7ed3 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:14.858331 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0c3151cc-d979-4e75-b4ff-feb0374b7ed3 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.064282 Nov 02 12:20:14.860692 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 125/253] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:14 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:14.871509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:14.878147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:14.913858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:14.914817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:14.915589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:14.921585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:14.924111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:14.924744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:15.293779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2ea62fb1-4feb-4819-acdc-c7a891baff68 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Calling method '.version_select at 0x7f228f008d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:15.475899 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2ea62fb1-4feb-4819-acdc-c7a891baff68 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 371 microversion: 2.1 time: 0.676215 Nov 02 12:20:15.477174 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 129/254] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 12:20:14 2022] GET /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 371 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:15.485144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-10e449ce-8549-4184-82c4-0af3a09cefb7 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:15.536802 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-10e449ce-8549-4184-82c4-0af3a09cefb7 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.058217 Nov 02 12:20:15.538479 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 130/255] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:15 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:15.553099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7c30946-e06f-4d5d-b247-6e32db8732c0 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-320457153"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:15.561752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-a7c30946-e06f-4d5d-b247-6e32db8732c0 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid f08d4ce5-1de0-47ee-8e9b-a73416d821d5 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:15.592873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7c30946-e06f-4d5d-b247-6e32db8732c0 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051695 Nov 02 12:20:15.594386 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 131/256] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:15.601714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-383534f6-cc7a-463c-89c9-1554b2b32576 req-107716f0-1567-49b8-9433-a70069d41799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4728b36-5541-47b1-8f1d-773945ed64dd", "name": "network-vif-plugged", "status": "completed", "tag": "57302fa0-ed89-4f1b-baf4-32d04a5d7684"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:15.615865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-383534f6-cc7a-463c-89c9-1554b2b32576 req-107716f0-1567-49b8-9433-a70069d41799 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:15.616778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-383534f6-cc7a-463c-89c9-1554b2b32576 req-107716f0-1567-49b8-9433-a70069d41799 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:15.617714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-383534f6-cc7a-463c-89c9-1554b2b32576 req-107716f0-1567-49b8-9433-a70069d41799 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:15.655888 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-383534f6-cc7a-463c-89c9-1554b2b32576 req-107716f0-1567-49b8-9433-a70069d41799 service nova] Creating event network-vif-plugged:57302fa0-ed89-4f1b-baf4-32d04a5d7684 for instance c4728b36-5541-47b1-8f1d-773945ed64dd on n-h1-855650-5 Nov 02 12:20:15.662740 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-383534f6-cc7a-463c-89c9-1554b2b32576 req-107716f0-1567-49b8-9433-a70069d41799 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066657 Nov 02 12:20:15.663914 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 132/257] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:15.676106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:15.684048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b20e8989-6aa1-4e1a-9d15-fbb5a9da4f6c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Action: 'update', calling method: .version_select at 0x7f228f0083a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:15.687006 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-591858ba-8784-4336-88ca-1d57bc32e9fd tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 0.824317 Nov 02 12:20:15.687614 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 126/258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:14 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:15.841808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-696fe641-06a3-434c-b4b4-721d7aa35a76 req-4b91feac-b197-4c9b-adb6-46a599917853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "780388e3-a8e6-4554-b949-7b1863155117", "tag": "00ed3f2b-f2c1-4ef9-8258-786d4df69be7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:15.847913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b20e8989-6aa1-4e1a-9d15-fbb5a9da4f6c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:15.849097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b20e8989-6aa1-4e1a-9d15-fbb5a9da4f6c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:15.849701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b20e8989-6aa1-4e1a-9d15-fbb5a9da4f6c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:15.850727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b20e8989-6aa1-4e1a-9d15-fbb5a9da4f6c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:15.851354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b20e8989-6aa1-4e1a-9d15-fbb5a9da4f6c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:15.852094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b20e8989-6aa1-4e1a-9d15-fbb5a9da4f6c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:15.865395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-696fe641-06a3-434c-b4b4-721d7aa35a76 req-4b91feac-b197-4c9b-adb6-46a599917853 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:15.866021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-696fe641-06a3-434c-b4b4-721d7aa35a76 req-4b91feac-b197-4c9b-adb6-46a599917853 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:15.866572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-696fe641-06a3-434c-b4b4-721d7aa35a76 req-4b91feac-b197-4c9b-adb6-46a599917853 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:15.891651 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-696fe641-06a3-434c-b4b4-721d7aa35a76 req-4b91feac-b197-4c9b-adb6-46a599917853 service nova] Creating event network-changed:00ed3f2b-f2c1-4ef9-8258-786d4df69be7 for instance 780388e3-a8e6-4554-b949-7b1863155117 on n-h1-855650-5 Nov 02 12:20:15.909695 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-696fe641-06a3-434c-b4b4-721d7aa35a76 req-4b91feac-b197-4c9b-adb6-46a599917853 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203717 Nov 02 12:20:15.910672 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 127/259] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:15.922625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e0ccece8-3f2a-4ef6-ab65-8d9ec20da5a3 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1814944750"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:15.926433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-e0ccece8-3f2a-4ef6-ab65-8d9ec20da5a3 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Generated uuid 09716d2c-c838-43b9-841c-9a1ee039c065 for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:15.927753 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b20e8989-6aa1-4e1a-9d15-fbb5a9da4f6c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 328 microversion: 2.1 time: 0.261087 Nov 02 12:20:15.929825 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 133/260] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:15 2022] PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 328 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:15.936262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da5bddb1-7652-4b96-aef4-2adb70f26988 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-320457153"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:15.940703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.aggregate [None req-da5bddb1-7652-4b96-aef4-2adb70f26988 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid 8f4db4d7-febe-4b1d-801c-63bcc2aa2710 for aggregate {{(pid=120722) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:15.960608 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-da5bddb1-7652-4b96-aef4-2adb70f26988 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-320457153 already exists. Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da5bddb1-7652-4b96-aef4-2adb70f26988 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Request method failure captured: Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 59 Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmA71_WEQkdY_ZQNcmnHj0sIdV_agzboRNvaXUAp8_vzodut2VZKRc8Ha6GhaWcmw6laji3GyqRLQ3MMyBZ8XEvjkML6DHXSp6hc0UogsDX8X2BQJp_JaHPBcePclL3A9rewe3bpN0NO4ddjTtgVw_qZ1pIPDqkJZV4NUj7XX8gCv-A Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:20:15.963996 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ed03072b9a0a4dd7be1804d781b104b6 Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: {"aggregate": {"name": "tempest-test_aggregate-320457153"}} Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:15.965441 n-d-855650-5 devstack@n-api.service[120722]: exception: Aggregate tempest-test_aggregate-320457153 already exists. Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-320457153'}}} Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 02 12:20:15.966878 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-320457153 already exists. Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:15.967954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-320457153 already exists. Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-320457153 already exists. Nov 02 12:20:15.969107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:15.971922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da5bddb1-7652-4b96-aef4-2adb70f26988 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-320457153 already exists. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:15.972960 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e0ccece8-3f2a-4ef6-ab65-8d9ec20da5a3 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060559 Nov 02 12:20:15.973316 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da5bddb1-7652-4b96-aef4-2adb70f26988 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.041762 Nov 02 12:20:15.974547 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 134/261] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:15 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:15.981317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:15.981698 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 128/262] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:15.982973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:15.988146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:15.989085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:15.997232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:15.998190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:15.999101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.000205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:16.001066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:16.001884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.006435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:16.006991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:16.007636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.008512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:16.009374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:16.010126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.455946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:16.477263 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95cba9e8-e317-4e5e-905e-893af8339090 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1321 microversion: 2.1 time: 0.501005 Nov 02 12:20:16.478167 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 135/263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:15 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:16.483924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f77dca66-0409-4636-ac86-56537654f3bb req-93fe862f-b66c-4d09-bbc1-6f63f8962810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f63610-cc86-49e6-a711-072754b812a0", "tag": "867136fb-ca58-4208-aef8-dfd3aeb1a72c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:16.502690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f77dca66-0409-4636-ac86-56537654f3bb req-93fe862f-b66c-4d09-bbc1-6f63f8962810 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:16.506650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f77dca66-0409-4636-ac86-56537654f3bb req-93fe862f-b66c-4d09-bbc1-6f63f8962810 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:16.509199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f77dca66-0409-4636-ac86-56537654f3bb req-93fe862f-b66c-4d09-bbc1-6f63f8962810 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.516888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:16.543122 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6a33e941-beca-446b-8861-1abf07898b5c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1310 microversion: 2.1 time: 0.560187 Nov 02 12:20:16.543757 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 129/264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:15 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1310 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:16.549851 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f77dca66-0409-4636-ac86-56537654f3bb req-93fe862f-b66c-4d09-bbc1-6f63f8962810 service nova] Creating event network-changed:867136fb-ca58-4208-aef8-dfd3aeb1a72c for instance 42f63610-cc86-49e6-a711-072754b812a0 on n-h2-855650-5 Nov 02 12:20:16.553397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d9a8247-52de-4dc8-b082-02551dda31e2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:16.563259 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f77dca66-0409-4636-ac86-56537654f3bb req-93fe862f-b66c-4d09-bbc1-6f63f8962810 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083586 Nov 02 12:20:16.566450 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 136/265] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:16.580845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f2f0b14-e7c2-4f92-97af-eb83ee1a22a8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:16.598757 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f2f0b14-e7c2-4f92-97af-eb83ee1a22a8 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.029649 Nov 02 12:20:16.601846 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 137/266] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:20:16 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:16.623219 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d9a8247-52de-4dc8-b082-02551dda31e2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.077745 Nov 02 12:20:16.640921 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 130/267] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:16 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:16.656537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7095ebe1-1d95-441a-8cf0-cfa6e3296018 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:16.692183 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7095ebe1-1d95-441a-8cf0-cfa6e3296018 tempest-AggregatesAdminTestJSON-647713775 tempest-AggregatesAdminTestJSON-647713775-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.049099 Nov 02 12:20:16.698568 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 131/268] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:16 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:16.706721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-220a005d-6b2d-4f2c-bee9-0b91a8a11dce tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-736918939"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:16.712758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-220a005d-6b2d-4f2c-bee9-0b91a8a11dce tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid bf101422-f40b-4bae-ae30-a31130b706bb for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:16.773778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:16.776576 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-220a005d-6b2d-4f2c-bee9-0b91a8a11dce tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076250 Nov 02 12:20:16.777689 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 132/269] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:16.778810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2014481446", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:16.783504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:16.785580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:16.799398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:16.800091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:16.800691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.803055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:16.803805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:16.804405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.836974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=58,nova_cell0:UPDATE=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:16.839237 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] HTTP exception thrown: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Request method failure captured: Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 HTTP/1.1 Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA4I9s6iOigyggELWDS02vXg3lfzJB4qSBcXYKpMefV4fSOLc8o2nRfig1oXJ2ib65Om_Z26vc8n2WsE1q9ieFk8CbPZ6ekhSGZvA7caVUsZUin8TQ64hQHCTV1Xjmhi0_iwiJM_SLYEYGWtxCeRJ4R0g08h9qiCJj0p17ED00hoaw Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 4009f2fda4a94036868b5a27212af0c3 Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:16.845618 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 4009f2fda4a94036868b5a27212af0c3 Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminTestJSON-882265761-project Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 1f368d94bcc34714a39f8825be5e82ef Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminTestJSON-882265761-project Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:16.847876 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '76517ea9-7cac-4202-ade6-4fbb517b72e0'} Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:16.848666 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:16.849797 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:16.855286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Returning 404 to user: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:16.858103 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1c7566c-81b5-470f-bc95-f673ed86c711 tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "DELETE /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 404 len: 111 microversion: 2.1 time: 0.077464 Nov 02 12:20:16.860123 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 133/270] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:20:16 2022] DELETE /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:16.869815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:16.870993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:16.904468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:16.904988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:16.905601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.906791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:16.907424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:16.908075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.910397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:17.309807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:17.320600 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ad2a665-ecb4-4f13-b7fa-a10cf3465dcb tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 0.457936 Nov 02 12:20:17.324093 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 134/271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:16 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:17.329487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41d66355-87ba-442e-97c8-7853f2895582 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:17.336216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-41d66355-87ba-442e-97c8-7853f2895582 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'a9bcc7504eb54f6492376ac82952f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb8432fdf314b62ab8972b36dcb43dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41d66355-87ba-442e-97c8-7853f2895582 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Request method failure captured: Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA44Fn1w1TZybiI96ztUksIz-aY7YNIyoNazQvXO-3zSDvimvxYWrpoUC3IotU_4q6XqLWkQVA7vEcBqYJRl2K48TcQ2x9J807XxY1fa1DmpMKitpf1G9wHysI88s9mOoarRm2YFjyvnOxeh7FmS9ufhfd6-TO4TzwIst5VqEfPcI8 Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:17.338064 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a9bcc7504eb54f6492376ac82952f271 Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 12:20:17.340652 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '15'} Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:17.342958 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.346355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41d66355-87ba-442e-97c8-7853f2895582 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:17.350236 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41d66355-87ba-442e-97c8-7853f2895582 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.017835 Nov 02 12:20:17.350236 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 135/272] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:17 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:17.357129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:17.358101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] [instance: 76517ea9-7cac-4202-ade6-4fbb517b72e0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:17.366625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.367123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.367565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.368312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.368767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.369200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.387183 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] HTTP exception thrown: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Request method failure captured: Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 HTTP/1.1 Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA4I9s6iOigyggELWDS02vXg3lfzJB4qSBcXYKpMefV4fSOLc8o2nRfig1oXJ2ib65Om_Z26vc8n2WsE1q9ieFk8CbPZ6ekhSGZvA7caVUsZUin8TQ64hQHCTV1Xjmhi0_iwiJM_SLYEYGWtxCeRJ4R0g08h9qiCJj0p17ED00hoaw Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 4009f2fda4a94036868b5a27212af0c3 Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:17.389297 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4009f2fda4a94036868b5a27212af0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 4009f2fda4a94036868b5a27212af0c3 Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-882265761 Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminTestJSON-882265761-project Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 1f368d94bcc34714a39f8825be5e82ef Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminTestJSON-882265761-project Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:17.390840 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '76517ea9-7cac-4202-ade6-4fbb517b72e0'} Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:17.391511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. Nov 02 12:20:17.392574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.393689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] Returning 404 to user: Instance 76517ea9-7cac-4202-ade6-4fbb517b72e0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:17.393689 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5f5abef0-ced1-443e-a13c-7920ddfb8c1f tempest-AggregatesAdminTestJSON-882265761 tempest-AggregatesAdminTestJSON-882265761-project] 10.222.0.45 "GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0" status: 404 len: 111 microversion: 2.1 time: 0.039823 Nov 02 12:20:17.394925 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 136/273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:17 2022] GET /compute/v2.1/servers/76517ea9-7cac-4202-ade6-4fbb517b72e0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:17.400759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24135a33-e0b6-4134-ba13-6bf5d2a12bba tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:17.438551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:17.439988 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-24135a33-e0b6-4134-ba13-6bf5d2a12bba tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.043949 Nov 02 12:20:17.443265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:17.443618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:17.444111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:17.444606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:17.446253 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 137/274] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:17 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:17.452726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-648e7113-4222-483b-9b62-7557aa3c5fa2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:17.456605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.457184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.457696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.458612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.459174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.459866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.475170 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-648e7113-4222-483b-9b62-7557aa3c5fa2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-648e7113-4222-483b-9b62-7557aa3c5fa2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Request method failure captured: Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA71_WEQkdY_ZQNcmnHj0sIdV_agzboRNvaXUAp8_vzodut2VZKRc8Ha6GhaWcmw6laji3GyqRLQ3MMyBZ8XEvjkML6DHXSp6hc0UogsDX8X2BQJp_JaHPBcePclL3A9rewe3bpN0NO4ddjTtgVw_qZ1pIPDqkJZV4NUj7XX8gCv-A Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:17.478788 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ed03072b9a0a4dd7be1804d781b104b6 Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: exception: Aggregate -1 could not be found. Nov 02 12:20:17.480150 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '-1'} Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:20:17.480839 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.481925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.483121 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:17.483121 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:17.483121 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:17.483121 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:17.483121 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 12:20:17.483121 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.485492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-648e7113-4222-483b-9b62-7557aa3c5fa2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:17.487126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-648e7113-4222-483b-9b62-7557aa3c5fa2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.039212 Nov 02 12:20:17.488580 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 138/275] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:17 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:17.492529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Getting quotas for project 91258974fedf4a13bd46785fc7eee09a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:17.515912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Getting quotas for user 431b1e9b193042c7a96045019efcf3c1 and project 91258974fedf4a13bd46785fc7eee09a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:17.539967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c693db7-10e9-4586-a821-ff9fe077afbd tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-488533845"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:17.553406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.utils [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] cores quota exceeded for 91258974fedf4a13bd46785fc7eee09a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120722) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 12:20:17.555140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:20:17.557067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-6c693db7-10e9-4586-a821-ff9fe077afbd tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid ea1b2049-48ab-4487-83b9-88296a5366ba for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Request method failure captured: Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 145 Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmB8UoDhjRpvlLeKQSUPh21xwHuv_Yu-4WD3i0ns7wk2oyiz6k4U0LY13CGe3jpisN9P5Ka6Uimqckh8Ah0iSDmxdlFlkRSRnFkdKkatkH1mUUHBUFRk_GqkSKuc8zH9dhNfROKlvkLgA3AGBvrsOlRduVCEgkN_NsGy-qkOnh8MPIQ Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 91258974fedf4a13bd46785fc7eee09a Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:17.559037 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 91258974fedf4a13bd46785fc7eee09a Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-QuotasAdminNegativeTest-1465753222-project Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 431b1e9b193042c7a96045019efcf3c1 Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-QuotasAdminNegativeTest-1465753222-project Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2014481446", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} Nov 02 12:20:17.560417 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2014481446', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452'}}} Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 12:20:17.561090 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:17.563198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.568212 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:17.572066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:17.572066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:17.572066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:17.572066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:17.572066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:20:17.572066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:17.575120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:17.577544 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8766d5e1-268a-4f87-a6b6-be80b6722d1e tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.973380 Nov 02 12:20:17.579480 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 138/276] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:20:16 2022] POST /compute/v2.1/servers => generated 111 bytes in 976 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:17.586366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:17.587252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:17.612672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.613421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.614086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.617010 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c693db7-10e9-4586-a821-ff9fe077afbd tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103687 Nov 02 12:20:17.628854 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 139/277] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:17.629123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.629123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.629123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.635877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:17.636918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:17.649857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.650457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.650951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.659937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.660549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.660987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.002125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:18.003007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:18.017107 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-49478f4c-2ab6-44af-a3e5-75f0ad9cc5da tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1321 microversion: 2.1 time: 0.436172 Nov 02 12:20:18.021610 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 139/278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:17 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:18.030438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b493d55-fb54-41e5-8b8f-73cf868e0036 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Action: 'update', calling method: .version_select at 0x7f228f028040>, body: {"quota_set": {"cores": 20}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:18.032954 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-857ef439-b998-433c-9684-6cb1fa29a47d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1310 microversion: 2.1 time: 0.411072 Nov 02 12:20:18.034543 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 140/279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:17 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1310 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:18.050560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e176a9db-a6ec-4329-946a-267a65deabfd tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:18.052780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e176a9db-a6ec-4329-946a-267a65deabfd tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'a9bcc7504eb54f6492376ac82952f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb8432fdf314b62ab8972b36dcb43dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e176a9db-a6ec-4329-946a-267a65deabfd tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Request method failure captured: Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA44Fn1w1TZybiI96ztUksIz-aY7YNIyoNazQvXO-3zSDvimvxYWrpoUC3IotU_4q6XqLWkQVA7vEcBqYJRl2K48TcQ2x9J807XxY1fa1DmpMKitpf1G9wHysI88s9mOoarRm2YFjyvnOxeh7FmS9ufhfd6-TO4TzwIst5VqEfPcI8 Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:18.055191 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a9bcc7504eb54f6492376ac82952f271 Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 12:20:18.056523 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '16'} Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:18.057287 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 12:20:18.058725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.061077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e176a9db-a6ec-4329-946a-267a65deabfd tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:18.062143 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e176a9db-a6ec-4329-946a-267a65deabfd tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] 10.222.0.45 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.026515 Nov 02 12:20:18.064242 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 141/280] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:18 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:18.075060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d8c15c56-19a1-4a0e-8a5a-38e6da9dcc0c tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:18.130530 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d8c15c56-19a1-4a0e-8a5a-38e6da9dcc0c tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.060397 Nov 02 12:20:18.132277 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 142/281] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:18 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:18.143291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e4c8bf2-e149-49ff-821f-af94e2468c23 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:18.153912 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7e4c8bf2-e149-49ff-821f-af94e2468c23 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e4c8bf2-e149-49ff-821f-af94e2468c23 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Request method failure captured: Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA71_WEQkdY_ZQNcmnHj0sIdV_agzboRNvaXUAp8_vzodut2VZKRc8Ha6GhaWcmw6laji3GyqRLQ3MMyBZ8XEvjkML6DHXSp6hc0UogsDX8X2BQJp_JaHPBcePclL3A9rewe3bpN0NO4ddjTtgVw_qZ1pIPDqkJZV4NUj7XX8gCv-A Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:18.157069 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ed03072b9a0a4dd7be1804d781b104b6 Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: exception: Aggregate -1 could not be found. Nov 02 12:20:18.159012 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '-1'} Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 12:20:18.161738 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.164409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e4c8bf2-e149-49ff-821f-af94e2468c23 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:18.165597 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e4c8bf2-e149-49ff-821f-af94e2468c23 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026370 Nov 02 12:20:18.167468 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 143/282] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:18 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:18.179885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3aee9d6-4896-434c-9544-8e4acce1f922 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:18.182272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f3aee9d6-4896-434c-9544-8e4acce1f922 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'a9bcc7504eb54f6492376ac82952f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb8432fdf314b62ab8972b36dcb43dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3aee9d6-4896-434c-9544-8e4acce1f922 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Request method failure captured: Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA44Fn1w1TZybiI96ztUksIz-aY7YNIyoNazQvXO-3zSDvimvxYWrpoUC3IotU_4q6XqLWkQVA7vEcBqYJRl2K48TcQ2x9J807XxY1fa1DmpMKitpf1G9wHysI88s9mOoarRm2YFjyvnOxeh7FmS9ufhfd6-TO4TzwIst5VqEfPcI8 Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:18.184125 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a9bcc7504eb54f6492376ac82952f271 Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 12:20:18.186243 n-d-855650-5 devstack@n-api.service[120723]: action_args: {} Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:18.187085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 12:20:18.189075 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.195827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3aee9d6-4896-434c-9544-8e4acce1f922 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:18.205501 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f3aee9d6-4896-434c-9544-8e4acce1f922 tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.023783 Nov 02 12:20:18.219762 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 144/283] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:20:18 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:20:18.229059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b809832d-83d8-46da-beff-38131af6be7b tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1008571450"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:18.239488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-b809832d-83d8-46da-beff-38131af6be7b tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid 1d2654f5-5b44-4c6e-8d81-ad66bab56e32 for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:18.292903 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b809832d-83d8-46da-beff-38131af6be7b tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066569 Nov 02 12:20:18.312012 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 145/284] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:18.327865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05fab00c-2fed-4c89-bae0-0040005579f9 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:18.366574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:18.395096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fab00c-2fed-4c89-bae0-0040005579f9 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.395974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fab00c-2fed-4c89-bae0-0040005579f9 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.396753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fab00c-2fed-4c89-bae0-0040005579f9 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.644631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b493d55-fb54-41e5-8b8f-73cf868e0036 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.645182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b493d55-fb54-41e5-8b8f-73cf868e0036 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.645678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b493d55-fb54-41e5-8b8f-73cf868e0036 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.649691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b493d55-fb54-41e5-8b8f-73cf868e0036 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.650316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b493d55-fb54-41e5-8b8f-73cf868e0036 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.650775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b493d55-fb54-41e5-8b8f-73cf868e0036 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.744424 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05fab00c-2fed-4c89-bae0-0040005579f9 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.429774 Nov 02 12:20:18.746101 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 146/285] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 12:20:18 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:18.787068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:18.788475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:18.791110 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b493d55-fb54-41e5-8b8f-73cf868e0036 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 329 microversion: 2.1 time: 0.767967 Nov 02 12:20:18.792089 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 140/286] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:18 2022] PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 329 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:18.803130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74c4a481-efad-46ea-9c81-621653e2446b tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:18.807726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.809403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.811102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.812212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-74c4a481-efad-46ea-9c81-621653e2446b tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'a9bcc7504eb54f6492376ac82952f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb8432fdf314b62ab8972b36dcb43dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:18.813845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.814978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74c4a481-efad-46ea-9c81-621653e2446b tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Request method failure captured: Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 42 Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmA44Fn1w1TZybiI96ztUksIz-aY7YNIyoNazQvXO-3zSDvimvxYWrpoUC3IotU_4q6XqLWkQVA7vEcBqYJRl2K48TcQ2x9J807XxY1fa1DmpMKitpf1G9wHysI88s9mOoarRm2YFjyvnOxeh7FmS9ufhfd6-TO4TzwIst5VqEfPcI8 Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:18.815581 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cb8432fdf314b62ab8972b36dcb43dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5cb8432fdf314b62ab8972b36dcb43dd Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663 Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a9bcc7504eb54f6492376ac82952f271 Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1524777663-project Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: {"remove_host": {"host": "n-h1-855650-5"}} Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:18.818277 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-855650-5'}}} Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:18.825158 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 12:20:18.827813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:18.831341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74c4a481-efad-46ea-9c81-621653e2446b tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:18.831341 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-74c4a481-efad-46ea-9c81-621653e2446b tempest-AggregatesAdminNegativeTestJSON-1524777663 tempest-AggregatesAdminNegativeTestJSON-1524777663-project] 10.222.0.45 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.024093 Nov 02 12:20:18.831341 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 141/287] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 12:20:18 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:18.831341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7499c5e-ba99-4a4a-bfbf-689293e80078 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Calling method '.version_select at 0x7f228f282940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:18.831892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:19.008109 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7499c5e-ba99-4a4a-bfbf-689293e80078 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 371 microversion: 2.1 time: 0.186626 Nov 02 12:20:19.011521 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 142/288] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 12:20:18 2022] GET /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:19.022657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-176fc29c-b76e-4fe3-8c85-5b63d0a4a7c2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:19.052754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-176fc29c-b76e-4fe3-8c85-5b63d0a4a7c2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:19.054139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-176fc29c-b76e-4fe3-8c85-5b63d0a4a7c2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:19.055486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-176fc29c-b76e-4fe3-8c85-5b63d0a4a7c2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:19.113808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:19.132449 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e983e8e-cd3e-4084-a0d9-d13e375a338d tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 0.371524 Nov 02 12:20:19.146727 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 147/289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:18 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:19.176274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe54ce21-3ef0-4e4d-8d24-41e303305198 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Action: 'update', calling method: .version_select at 0x7f228f266280>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:19.377477 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-176fc29c-b76e-4fe3-8c85-5b63d0a4a7c2 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.363303 Nov 02 12:20:19.379703 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 143/290] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 12:20:19 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:19.393819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:19.395053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:19.406280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:19.407084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:19.407724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:19.408638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:19.410291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:19.411604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:19.793238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:19.808136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe54ce21-3ef0-4e4d-8d24-41e303305198 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:19.809515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe54ce21-3ef0-4e4d-8d24-41e303305198 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:19.810262 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-52c66fbf-f351-4dab-8977-bef6549e22aa tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1321 microversion: 2.1 time: 0.428454 Nov 02 12:20:19.811852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe54ce21-3ef0-4e4d-8d24-41e303305198 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:19.814182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe54ce21-3ef0-4e4d-8d24-41e303305198 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:19.815400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe54ce21-3ef0-4e4d-8d24-41e303305198 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:19.816690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe54ce21-3ef0-4e4d-8d24-41e303305198 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:19.824001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 144/291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:19 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:19.850267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:19.854052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:19.881037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:19.887188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:19.888970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:19.895115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:19.896903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:19.899762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:19.985534 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe54ce21-3ef0-4e4d-8d24-41e303305198 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 328 microversion: 2.1 time: 0.836728 Nov 02 12:20:19.987826 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 148/292] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:19 2022] PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 328 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:19.997818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41ede416-6240-477d-a007-52578a8ab423 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:20.052050 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41ede416-6240-477d-a007-52578a8ab423 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.062061 Nov 02 12:20:20.053886 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 149/293] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:19 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:20.065587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-543cce4f-0cb3-4320-80c4-2d6bf60a58f0 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-650591142"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:20.069321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-543cce4f-0cb3-4320-80c4-2d6bf60a58f0 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Generated uuid d79b559f-fd27-496d-a801-2cc53ec72be7 for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:20:20.151653 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-543cce4f-0cb3-4320-80c4-2d6bf60a58f0 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.089263 Nov 02 12:20:20.154482 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 150/294] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 12:20:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:20.178510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:20.202730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:20.205188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:20.206354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:20.240667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:20.246198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:20.249175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:20.275453 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.compute.aggregates [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 12:20:20.276094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Request method failure captured: Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 42 Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmA71_WEQkdY_ZQNcmnHj0sIdV_agzboRNvaXUAp8_vzodut2VZKRc8Ha6GhaWcmw6laji3GyqRLQ3MMyBZ8XEvjkML6DHXSp6hc0UogsDX8X2BQJp_JaHPBcePclL3A9rewe3bpN0NO4ddjTtgVw_qZ1pIPDqkJZV4NUj7XX8gCv-A Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:20.279266 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1cb0550e33c4a63ba01f2b96cc05e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: e1cb0550e33c4a63ba01f2b96cc05e5e Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-799704387 Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ed03072b9a0a4dd7be1804d781b104b6 Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: {"remove_host": {"host": "nonexist_host"}} Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:20.280925 n-d-855650-5 devstack@n-api.service[120723]: exception: Cannot remove host nonexist_host in aggregate 18 Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 12:20:20.281748 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 02 12:20:20.284368 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.286021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:20.287767 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:20.287767 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:20.287767 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:20.287767 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:20.287767 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Nov 02 12:20:20.287767 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:20.292000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:20.299371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:20.308682 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-19ea2924-9c36-446c-b630-2da3d396a13a tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.143121 Nov 02 12:20:20.314240 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 151/295] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 12:20:20 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:20.319487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:20.320261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:20.322222 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bcd9d00f-21ab-4017-9490-dec7a468cb0b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1310 microversion: 2.1 time: 0.494686 Nov 02 12:20:20.323877 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 145/296] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:19 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1310 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:20.343732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:20.344489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:20.345230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:20.346207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:20.347045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:20.348396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:20.351843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-529353447", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:20.512726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:20.947189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:20.956035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-255d8651-eb72-482c-8dc9-8bd2732c3e3e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 0.640301 Nov 02 12:20:20.956733 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 152/297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:20 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:20.993608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c03f9f94-92cc-44f9-a3f6-4455040ca660 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:21.033006 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c03f9f94-92cc-44f9-a3f6-4455040ca660 tempest-AggregatesAdminNegativeTestJSON-799704387 tempest-AggregatesAdminNegativeTestJSON-799704387-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.052205 Nov 02 12:20:21.034356 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 153/298] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:20:20 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:20:21.053867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:21.054596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:21.078360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:21.078960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:21.079408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:21.080199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:21.081788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:21.082257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:21.561299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:21.562189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:21.562189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:21.562593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:21.563169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:21.597838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:21.598737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:21.599490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:21.612270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:21.613192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:21.613985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:21.697873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Getting quotas for project 91258974fedf4a13bd46785fc7eee09a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:21.697873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:21.727323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Getting quotas for user 431b1e9b193042c7a96045019efcf3c1 and project 91258974fedf4a13bd46785fc7eee09a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:21.777647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.utils [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] instances quota exceeded for 91258974fedf4a13bd46785fc7eee09a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120722) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 12:20:21.788387 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Request method failure captured: Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 144 Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmB8UoDhjRpvlLeKQSUPh21xwHuv_Yu-4WD3i0ns7wk2oyiz6k4U0LY13CGe3jpisN9P5Ka6Uimqckh8Ah0iSDmxdlFlkRSRnFkdKkatkH1mUUHBUFRk_GqkSKuc8zH9dhNfROKlvkLgA3AGBvrsOlRduVCEgkN_NsGy-qkOnh8MPIQ Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 91258974fedf4a13bd46785fc7eee09a Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:21.790505 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 91258974fedf4a13bd46785fc7eee09a Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-QuotasAdminNegativeTest-1465753222-project Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 431b1e9b193042c7a96045019efcf3c1 Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-QuotasAdminNegativeTest-1465753222-project Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-529353447", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} Nov 02 12:20:21.791941 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-529353447', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452'}}} Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 12:20:21.792591 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:21.794383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:21.796252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01c4a61e-931a-462a-a611-89fd770cab2d tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.467271 Nov 02 12:20:21.797476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 146/299] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:20:20 2022] POST /compute/v2.1/servers => generated 119 bytes in 1468 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:21.805417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:21.806363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:21.821451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:21.822255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:21.822714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:21.825523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:21.826091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:21.828848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:21.884598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:21.946723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:21.963658 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e48a54ef-f637-4fbc-83bd-483c33bfbb1d tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1321 microversion: 2.1 time: 0.927810 Nov 02 12:20:21.974492 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 154/300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:21 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1321 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:21.978353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bc8626c-c023-4906-9893-efda48de89ce tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Action: 'update', calling method: .version_select at 0x7f228f266820>, body: {"quota_set": {"instances": 10}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:22.235526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:22.254667 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6ca33ec1-aec8-4344-a3fa-10b81e001017 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1493 microversion: 2.1 time: 0.453688 Nov 02 12:20:22.255325 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 147/301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:21 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1493 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:22.263082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:22.267970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:22.282754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:22.285794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:22.292563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:22.296011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:22.296659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:22.297418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:22.936233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc8626c-c023-4906-9893-efda48de89ce tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:22.937625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc8626c-c023-4906-9893-efda48de89ce tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:22.938614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc8626c-c023-4906-9893-efda48de89ce tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:22.941014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc8626c-c023-4906-9893-efda48de89ce tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:22.941854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc8626c-c023-4906-9893-efda48de89ce tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:22.942635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc8626c-c023-4906-9893-efda48de89ce tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:22.999248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:23.044510 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-927f94d7-6498-4d09-bb31-0f68fc33375e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 0.774389 Nov 02 12:20:23.045633 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 148/302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:22 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:23.177463 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7bc8626c-c023-4906-9893-efda48de89ce tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 329 microversion: 2.1 time: 1.208389 Nov 02 12:20:23.179836 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 155/303] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:21 2022] PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 329 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:23.546289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:23.547281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:23.557475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:23.563436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:23.564266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:23.566551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:23.568191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:23.570125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:23.890879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228f29aee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:23.899573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:23.901858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:23.910539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:23.979120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:23.985894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:23.986645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.028153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:24.029020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:24.030416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.062800 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-619525bc-e913-44f0-8065-5b38f4feb902 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.880654 Nov 02 12:20:24.066444 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 156/304] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:20:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:24.088641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:24.092691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:24.127857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:24.128741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:24.129529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.130845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:24.131609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:24.132351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.147678 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5ad2338-f7aa-4463-9037-431e6ea01d12 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1644 microversion: 2.1 time: 1.097287 Nov 02 12:20:24.153301 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 149/305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:23 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1644 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:24.167521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab1f2f2d-125c-4760-8f61-ee7e2f5b311c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Calling method '.version_select at 0x7f228f028310>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:24.765052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:24.770814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:24.801079 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6da31b61-cc02-4df1-92d9-a1a7677a924f tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1321 microversion: 2.1 time: 0.732597 Nov 02 12:20:24.804815 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 157/306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:24 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1321 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:24.832872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228f17fd30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:24.836620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:24.842537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:24.843566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.867793 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab1f2f2d-125c-4760-8f61-ee7e2f5b311c tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 371 microversion: 2.1 time: 0.711816 Nov 02 12:20:24.868406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 150/307] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 12:20:24 2022] GET /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 371 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:24.893262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:24.894238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:24.895241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:24.895930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.896551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:24.913019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:24.914604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:24.915408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.919170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:24.921099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:24.922690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.925860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:24.930643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:24.932931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:24.954225 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-342ce5a1-f86a-4ffb-979a-2116dc3f2545 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.141208 Nov 02 12:20:24.965949 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 158/308] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Nov 2 12:20:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:24.986326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:24.987319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:25.016702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.023596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.025869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.026686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.029701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.034100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.456321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:25.477852 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2b43da3c-06cb-4a90-9501-621be5c242e9 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 0.598749 Nov 02 12:20:25.483200 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 151/309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:24 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:25.491709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-35d122a7-3b9a-4732-af49-8fe4170a281e tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Action: 'update', calling method: .version_select at 0x7f228ef415e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:25.534883 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2302bd4e-3935-47f1-a0bb-a261309fa736 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1644 microversion: 2.1 time: 0.564796 Nov 02 12:20:25.546007 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 159/310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:24 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1644 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:25.546007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228f29a040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:25.546594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.550586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.550586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.601254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.602465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.603297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.628988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.629622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.630421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.644603 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c7c33ede-9050-4a64-83b3-75aebfccfb88 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.106522 Nov 02 12:20:25.646507 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 160/311] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:20:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:25.658141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-cbf3b2c4-2bbc-4c5c-bbe5-e61ac1d95048 req-e9f87d75-fb2a-4b0b-8849-76e4d92177c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780388e3-a8e6-4554-b949-7b1863155117", "name": "network-vif-plugged", "status": "completed", "tag": "00ed3f2b-f2c1-4ef9-8258-786d4df69be7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:25.678993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cbf3b2c4-2bbc-4c5c-bbe5-e61ac1d95048 req-e9f87d75-fb2a-4b0b-8849-76e4d92177c5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.679453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cbf3b2c4-2bbc-4c5c-bbe5-e61ac1d95048 req-e9f87d75-fb2a-4b0b-8849-76e4d92177c5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.680357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cbf3b2c4-2bbc-4c5c-bbe5-e61ac1d95048 req-e9f87d75-fb2a-4b0b-8849-76e4d92177c5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.702849 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-cbf3b2c4-2bbc-4c5c-bbe5-e61ac1d95048 req-e9f87d75-fb2a-4b0b-8849-76e4d92177c5 service nova] Creating event network-vif-plugged:00ed3f2b-f2c1-4ef9-8258-786d4df69be7 for instance 780388e3-a8e6-4554-b949-7b1863155117 on n-h1-855650-5 Nov 02 12:20:25.712609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-cbf3b2c4-2bbc-4c5c-bbe5-e61ac1d95048 req-e9f87d75-fb2a-4b0b-8849-76e4d92177c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063723 Nov 02 12:20:25.714185 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 161/312] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:25.724356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-762370b7-0347-46e6-bc99-aee447a519af tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:25.731800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762370b7-0347-46e6-bc99-aee447a519af tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.733177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762370b7-0347-46e6-bc99-aee447a519af tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.734603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762370b7-0347-46e6-bc99-aee447a519af tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.735724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762370b7-0347-46e6-bc99-aee447a519af tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.736592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762370b7-0347-46e6-bc99-aee447a519af tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.737398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762370b7-0347-46e6-bc99-aee447a519af tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.813448 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-762370b7-0347-46e6-bc99-aee447a519af tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097006 Nov 02 12:20:25.818095 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 162/313] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 12:20:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:25.860832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bdf0f33a-93a2-4210-9cbf-bf30aeee6e6d tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228f40ad30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:25.876171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf0f33a-93a2-4210-9cbf-bf30aeee6e6d tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.877390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf0f33a-93a2-4210-9cbf-bf30aeee6e6d tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.878497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf0f33a-93a2-4210-9cbf-bf30aeee6e6d tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.915533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf0f33a-93a2-4210-9cbf-bf30aeee6e6d tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.923008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf0f33a-93a2-4210-9cbf-bf30aeee6e6d tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.924249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf0f33a-93a2-4210-9cbf-bf30aeee6e6d tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.942786 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bdf0f33a-93a2-4210-9cbf-bf30aeee6e6d tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.110880 Nov 02 12:20:25.945484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 163/314] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:25.959127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:25.960568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:25.972990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.973904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.974766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:25.976125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:25.977002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:25.978013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.349078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=45 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:26.376282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35d122a7-3b9a-4732-af49-8fe4170a281e tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.379300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35d122a7-3b9a-4732-af49-8fe4170a281e tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.379499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:26.380074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35d122a7-3b9a-4732-af49-8fe4170a281e tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.386302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35d122a7-3b9a-4732-af49-8fe4170a281e tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.391750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35d122a7-3b9a-4732-af49-8fe4170a281e tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.392241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35d122a7-3b9a-4732-af49-8fe4170a281e tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.392955 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f97b5874-5ab2-4346-ac43-6993489d5885 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1321 microversion: 2.1 time: 0.445868 Nov 02 12:20:26.422376 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 164/315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:25 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:26.439112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855650-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:26.453258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:26.475771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.476307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.476764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.477521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.479514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.483012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.555448 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-35d122a7-3b9a-4732-af49-8fe4170a281e tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 325 microversion: 2.1 time: 1.070810 Nov 02 12:20:26.570080 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 152/316] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:25 2022] PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 325 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:26.575229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ca24c9a-5873-4aab-badc-3b900bad5d96 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228f028af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:26.580035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ca24c9a-5873-4aab-badc-3b900bad5d96 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.580544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ca24c9a-5873-4aab-badc-3b900bad5d96 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.581027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ca24c9a-5873-4aab-badc-3b900bad5d96 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.652426 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ca24c9a-5873-4aab-badc-3b900bad5d96 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.094272 Nov 02 12:20:26.653243 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 153/317] 10.222.0.45 () {58 vars in 1179 bytes} [Wed Nov 2 12:20:26 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:26.675299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:26.679533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:26.686880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.687601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.688234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.689140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.689757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.690371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.698331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lazy-loading 'flavor' on Instance uuid c4728b36-5541-47b1-8f1d-773945ed64dd {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:26.807329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Going to try to live migrate instance to n-h2-855650-5 {{(pid=120723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:20:27.212777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:27.228157 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98c24993-a855-4903-8cba-a9690d1147d7 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 0.571245 Nov 02 12:20:27.242611 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 154/318] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:26 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:27.287516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228efa6940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:27.291299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:27.292149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:27.292919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:27.321815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:27.322610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:27.323331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:27.347580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:27.348473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:27.349267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:27.363169 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2c008fbc-8520-41f3-9ae5-2c45b36f447f tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.118285 Nov 02 12:20:27.373546 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 155/319] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:20:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:27.951130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f442d22-7327-49ed-bf71-a8959651ede3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Calling method '.version_select at 0x7f228efa69d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:27.955096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f442d22-7327-49ed-bf71-a8959651ede3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b5f58cd74cd148fb819bb34914e64ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af3f2b3a5b4789b048f40e132b8890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f442d22-7327-49ed-bf71-a8959651ede3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Request method failure captured: Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmCIFG1QPk-9zIFbN00qABtiXYXkov7dibw2fQS77HJbFB6z50NlB6lnGKGKl1OQs6DeJRTP8QP8xReYtJA4pN1TxI9o6tRKHAy6ks7I0caYh95cbAl0_C6WixKO3VDKpC5oF2L1u6o6aklg2RXCoSVK7sPbf74JW9TXAbsMxwi19Ds Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:27.959317 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b5f58cd74cd148fb819bb34914e64ea0 Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: action_args: {} Nov 02 12:20:27.961642 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:27.963096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 12:20:27.965183 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:27.969628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f442d22-7327-49ed-bf71-a8959651ede3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:27.971554 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f442d22-7327-49ed-bf71-a8959651ede3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.604931 Nov 02 12:20:27.973441 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 156/320] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Nov 2 12:20:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 608 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:27.983717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1791681118", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:28.098822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:28.722160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:28.723752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:28.724771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:28.725858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:28.727041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:28.750959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:28.752420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:28.754179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:28.756619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:28.757716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:28.758674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:28.801827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Getting quotas for project 91258974fedf4a13bd46785fc7eee09a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:28.814114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Getting quotas for user 431b1e9b193042c7a96045019efcf3c1 and project 91258974fedf4a13bd46785fc7eee09a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:28.864938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.utils [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] ram quota exceeded for 91258974fedf4a13bd46785fc7eee09a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120722) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 12:20:28.867700 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Request method failure captured: Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 145 Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmB8UoDhjRpvlLeKQSUPh21xwHuv_Yu-4WD3i0ns7wk2oyiz6k4U0LY13CGe3jpisN9P5Ka6Uimqckh8Ah0iSDmxdlFlkRSRnFkdKkatkH1mUUHBUFRk_GqkSKuc8zH9dhNfROKlvkLgA3AGBvrsOlRduVCEgkN_NsGy-qkOnh8MPIQ Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 91258974fedf4a13bd46785fc7eee09a Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:28.876460 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 91258974fedf4a13bd46785fc7eee09a Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-QuotasAdminNegativeTest-1465753222-project Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 431b1e9b193042c7a96045019efcf3c1 Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-QuotasAdminNegativeTest-1465753222-project Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1791681118", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} Nov 02 12:20:28.879315 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1791681118', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452'}}} Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 12:20:28.881017 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:28.883459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:28.890307 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:28.893607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:28.893607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:28.893607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:28.893607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:28.893607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:20:28.893607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:28.894633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:28.898117 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe88e85d-f964-41af-a592-1e6fdc6cd446 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.921532 Nov 02 12:20:28.900904 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 157/321] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:20:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 926 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:28.913712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-23b38ee4-9f2b-4759-a77e-46850bc1fde9 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228f0284c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:28.920927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23b38ee4-9f2b-4759-a77e-46850bc1fde9 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:28.923009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23b38ee4-9f2b-4759-a77e-46850bc1fde9 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:28.924441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23b38ee4-9f2b-4759-a77e-46850bc1fde9 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:28.960409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23b38ee4-9f2b-4759-a77e-46850bc1fde9 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:28.961835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23b38ee4-9f2b-4759-a77e-46850bc1fde9 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:28.964226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23b38ee4-9f2b-4759-a77e-46850bc1fde9 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:28.982263 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-23b38ee4-9f2b-4759-a77e-46850bc1fde9 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.077211 Nov 02 12:20:28.990348 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 158/322] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:28.996257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:28.997129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:29.021258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:29.022504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:29.026648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:29.028702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:29.030671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:29.031852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:29.264822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:29.276424 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3009399c-a2df-44db-90e5-5eefe102d730 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1471 microversion: 2.1 time: 0.284735 Nov 02 12:20:29.299890 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 159/323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:28 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:29.306667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c52a84d6-7fad-4e67-9edb-69f4943c6e2f req-08217877-47fe-45de-a164-0e2019454628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f63610-cc86-49e6-a711-072754b812a0", "name": "network-vif-plugged", "status": "completed", "tag": "867136fb-ca58-4208-aef8-dfd3aeb1a72c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:29.317701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c52a84d6-7fad-4e67-9edb-69f4943c6e2f req-08217877-47fe-45de-a164-0e2019454628 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:29.318547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c52a84d6-7fad-4e67-9edb-69f4943c6e2f req-08217877-47fe-45de-a164-0e2019454628 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:29.319272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c52a84d6-7fad-4e67-9edb-69f4943c6e2f req-08217877-47fe-45de-a164-0e2019454628 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:29.335432 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c52a84d6-7fad-4e67-9edb-69f4943c6e2f req-08217877-47fe-45de-a164-0e2019454628 service nova] Creating event network-vif-plugged:867136fb-ca58-4208-aef8-dfd3aeb1a72c for instance 42f63610-cc86-49e6-a711-072754b812a0 on n-h2-855650-5 Nov 02 12:20:29.341756 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c52a84d6-7fad-4e67-9edb-69f4943c6e2f req-08217877-47fe-45de-a164-0e2019454628 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040177 Nov 02 12:20:29.343609 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 160/324] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:29.418055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-870574722", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a9f510fb-b50d-4af2-b983-5038fdf1b237"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:29.496103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] validate_networks() for [('a9f510fb-b50d-4af2-b983-5038fdf1b237', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:30.234813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:30.236138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:30.236778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:30.237451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:30.238103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:30.249594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:30.250197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:30.250762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:30.251631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:30.252918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:30.253363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:30.277041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for project 61f9f821af56421c98639028cc700a64. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:30.283133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for user a71d3feaad3148cc89c28cb18acf0cd0 and project 61f9f821af56421c98639028cc700a64. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:30.300932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:20:30.303620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:20:30.368919 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b76d17f-74d0-4c83-96eb-babb3a449149 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.023492 Nov 02 12:20:30.377215 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 161/325] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:20:30.383677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7caf730-b4e3-448a-8bdd-8bf707a30cc3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Calling method '.version_select at 0x7f228efa6a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:30.385928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7caf730-b4e3-448a-8bdd-8bf707a30cc3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b5f58cd74cd148fb819bb34914e64ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af3f2b3a5b4789b048f40e132b8890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7caf730-b4e3-448a-8bdd-8bf707a30cc3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Request method failure captured: Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmCIFG1QPk-9zIFbN00qABtiXYXkov7dibw2fQS77HJbFB6z50NlB6lnGKGKl1OQs6DeJRTP8QP8xReYtJA4pN1TxI9o6tRKHAy6ks7I0caYh95cbAl0_C6WixKO3VDKpC5oF2L1u6o6aklg2RXCoSVK7sPbf74JW9TXAbsMxwi19Ds Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:30.387907 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b5f58cd74cd148fb819bb34914e64ea0 Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: action_args: {} Nov 02 12:20:30.389666 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:30.390741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 12:20:30.392380 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:30.400879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7caf730-b4e3-448a-8bdd-8bf707a30cc3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:30.404115 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7caf730-b4e3-448a-8bdd-8bf707a30cc3 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.023984 Nov 02 12:20:30.414806 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 162/326] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:20:30 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:30.422887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:30.424612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:30.437919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:30.438671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:30.439260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:30.440639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:30.443254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:30.446982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:30.581624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b52bf283-abb0-4767-a74c-b4404bfcca6a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd/action" status: 202 len: 0 microversion: 2.1 time: 4.157031 Nov 02 12:20:30.583348 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 165/327] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:20:26 2022] POST /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd/action => generated 0 bytes in 4160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:20:30.589633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff98cdef-7ebe-42ef-a401-24435de9d9f3 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Action: 'update', calling method: .version_select at 0x7f228f29f790>, body: {"quota_set": {"ram": 51200}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:30.800170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:30.867423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-914d54cd-b9cb-4197-82b6-0c48dba52a93 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1320 microversion: 2.1 time: 0.450663 Nov 02 12:20:30.870550 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 163/328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:30 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:30.897504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6df537e5-fa35-4f8f-a1a0-39ff38070285 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228f028f70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:30.907883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df537e5-fa35-4f8f-a1a0-39ff38070285 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:30.909292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df537e5-fa35-4f8f-a1a0-39ff38070285 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:30.910424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df537e5-fa35-4f8f-a1a0-39ff38070285 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.003418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df537e5-fa35-4f8f-a1a0-39ff38070285 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.004181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df537e5-fa35-4f8f-a1a0-39ff38070285 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.004867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df537e5-fa35-4f8f-a1a0-39ff38070285 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.033486 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6df537e5-fa35-4f8f-a1a0-39ff38070285 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.160791 Nov 02 12:20:31.039058 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 164/329] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:30 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:31.056831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:31.057066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff98cdef-7ebe-42ef-a401-24435de9d9f3 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.057437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff98cdef-7ebe-42ef-a401-24435de9d9f3 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.058044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:31.058356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff98cdef-7ebe-42ef-a401-24435de9d9f3 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.059467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff98cdef-7ebe-42ef-a401-24435de9d9f3 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.067140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff98cdef-7ebe-42ef-a401-24435de9d9f3 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.068034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff98cdef-7ebe-42ef-a401-24435de9d9f3 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.082199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.082707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.083512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.085019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.085646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.089920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.140882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lazy-loading 'flavor' on Instance uuid 780388e3-a8e6-4554-b949-7b1863155117 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:31.243281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:31.308032 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff98cdef-7ebe-42ef-a401-24435de9d9f3 tempest-QuotasAdminNegativeTest-2119361130 tempest-QuotasAdminNegativeTest-2119361130-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 200 len: 329 microversion: 2.1 time: 0.723724 Nov 02 12:20:31.309586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 166/330] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:30 2022] PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 329 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:31.322865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9829790d-2174-4b69-a5a2-bffc7c66faa9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:31.324791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9829790d-2174-4b69-a5a2-bffc7c66faa9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:31.446060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9829790d-2174-4b69-a5a2-bffc7c66faa9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.452716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d62bd36c-94dd-4730-abce-7d3dcad76a12 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117/action" status: 202 len: 0 microversion: 2.1 time: 0.411171 Nov 02 12:20:31.458383 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 165/331] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:20:31 2022] POST /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:20:31.466159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9829790d-2174-4b69-a5a2-bffc7c66faa9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.471043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9829790d-2174-4b69-a5a2-bffc7c66faa9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.478336 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9829790d-2174-4b69-a5a2-bffc7c66faa9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1261 microversion: 2.25 time: 0.162869 Nov 02 12:20:31.485741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ee54615-87da-4d92-8612-c20901e7d6fa tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Calling method '.version_select at 0x7f228efa6ee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:31.490253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ee54615-87da-4d92-8612-c20901e7d6fa tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b5f58cd74cd148fb819bb34914e64ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af3f2b3a5b4789b048f40e132b8890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.494524 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 167/332] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:31 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ee54615-87da-4d92-8612-c20901e7d6fa tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Request method failure captured: Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmCIFG1QPk-9zIFbN00qABtiXYXkov7dibw2fQS77HJbFB6z50NlB6lnGKGKl1OQs6DeJRTP8QP8xReYtJA4pN1TxI9o6tRKHAy6ks7I0caYh95cbAl0_C6WixKO3VDKpC5oF2L1u6o6aklg2RXCoSVK7sPbf74JW9TXAbsMxwi19Ds Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:31.499147 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b5f58cd74cd148fb819bb34914e64ea0 Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: action_args: {} Nov 02 12:20:31.500593 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:31.501341 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 12:20:31.502737 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:31.503944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:31.504928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:31.506521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ee54615-87da-4d92-8612-c20901e7d6fa tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:31.511484 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ee54615-87da-4d92-8612-c20901e7d6fa tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.044542 Nov 02 12:20:31.512096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 166/333] 10.222.0.45 () {58 vars in 1179 bytes} [Wed Nov 2 12:20:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:31.517697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.518507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.519130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.520042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.520754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.525757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.526226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Calling method '.version_select at 0x7f228f0280d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:31.532609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.534814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.536495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.573445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.573939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.578481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.613135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.613642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.614133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.687031 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-adc9acde-6223-4ff1-a5bd-72ef61d61566 tempest-HypervisorAdminTestJSON-1148730218 tempest-HypervisorAdminTestJSON-1148730218-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.170998 Nov 02 12:20:31.714536 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 167/334] 10.222.0.45 () {58 vars in 1173 bytes} [Wed Nov 2 12:20:31 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:31.752313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8b23eec-d3c1-43df-ba63-ecf99968be82 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Action: 'update', calling method: .version_select at 0x7f228f0088b0>, body: {"quota_set": {"ram": 0}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:31.777302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8b23eec-d3c1-43df-ba63-ecf99968be82 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '431b1e9b193042c7a96045019efcf3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91258974fedf4a13bd46785fc7eee09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8b23eec-d3c1-43df-ba63-ecf99968be82 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Request method failure captured: Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a HTTP/1.1 Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 25 Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmB8UoDhjRpvlLeKQSUPh21xwHuv_Yu-4WD3i0ns7wk2oyiz6k4U0LY13CGe3jpisN9P5Ka6Uimqckh8Ah0iSDmxdlFlkRSRnFkdKkatkH1mUUHBUFRk_GqkSKuc8zH9dhNfROKlvkLgA3AGBvrsOlRduVCEgkN_NsGy-qkOnh8MPIQ Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 91258974fedf4a13bd46785fc7eee09a Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:31.788009 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_91258974fedf4a13bd46785fc7eee09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 91258974fedf4a13bd46785fc7eee09a Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1465753222 Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-QuotasAdminNegativeTest-1465753222-project Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 431b1e9b193042c7a96045019efcf3c1 Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-QuotasAdminNegativeTest-1465753222-project Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: {"quota_set": {"ram": 0}} Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 12:20:31.790725 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '91258974fedf4a13bd46785fc7eee09a', 'body': {'quota_set': {'ram': 0}}} Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:31.792642 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:31.794896 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:31.797664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:31.797664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:31.797664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:31.797664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:31.797664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 12:20:31.797664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:31.803302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.804489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8b23eec-d3c1-43df-ba63-ecf99968be82 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:31.804489 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8b23eec-d3c1-43df-ba63-ecf99968be82 tempest-QuotasAdminNegativeTest-1465753222 tempest-QuotasAdminNegativeTest-1465753222-project] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a" status: 403 len: 116 microversion: 2.1 time: 0.083650 Nov 02 12:20:31.804983 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0130f108-ae1c-460e-aa29-e83e462be4a5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 0.306495 Nov 02 12:20:31.805240 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 168/335] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:31 2022] PUT /compute/v2.1/os-quota-sets/91258974fedf4a13bd46785fc7eee09a => generated 116 bytes in 87 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:31.807221 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 168/336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:31 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:31.834913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:31.838732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:31.863705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.864891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.868221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.868940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.869416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.869867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:32.614017 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca4441ad-e1da-4f80-8e48-819be3ed994a tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1630 microversion: 2.1 time: 0.805057 Nov 02 12:20:32.630714 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 169/337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:31 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1630 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:32.647607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:32.649318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:32.686933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:32.688044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:32.694767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:32.697217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:32.698159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:32.700779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:32.864895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Calling method '.version_select at 0x7f228f1a1820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:32.877062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:32.877959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:32.881756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:32.961778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:32.963044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:32.965250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.031250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.033041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.037099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.040386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.067489 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b02e5378-fbda-4b0d-85c0-690e92c4cf6b tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1468 microversion: 2.1 time: 0.443105 Nov 02 12:20:33.069157 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 170/338] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:32 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1468 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:33.085633 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64ca68a8-1e15-41b6-8383-b1e2b668c3a1 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.273196 Nov 02 12:20:33.097485 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 169/339] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:20:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:33.115831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:33.117258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:33.118691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:33.121818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:33.140784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.141498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.142132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.143505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.144399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.145245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.147260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.148500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.152458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.153796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.154482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.155118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.158936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:33.427785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.445863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.448331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.450764 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f8d870aa-3f25-46e6-8757-74fb44083a92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1321 microversion: 2.25 time: 0.355721 Nov 02 12:20:33.452559 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 171/340] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:33 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:33.460318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:33.465590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:33.488606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.490549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.491576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.493273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.494238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.495026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.643190 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99907bd7-79b4-480b-afad-795e67cc87f9 tempest-DeleteServersAdminTestJSON-1067273548 tempest-DeleteServersAdminTestJSON-1067273548-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0/action" status: 202 len: 0 microversion: 2.1 time: 0.188504 Nov 02 12:20:33.644621 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 172/341] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:20:33 2022] POST /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:20:33.650613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b58d550-a2f2-48fb-85a2-27a881564170 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Calling method '.version_select at 0x7f228eedba60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:33.652835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b58d550-a2f2-48fb-85a2-27a881564170 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b5f58cd74cd148fb819bb34914e64ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af3f2b3a5b4789b048f40e132b8890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b58d550-a2f2-48fb-85a2-27a881564170 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Request method failure captured: Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmCIFG1QPk-9zIFbN00qABtiXYXkov7dibw2fQS77HJbFB6z50NlB6lnGKGKl1OQs6DeJRTP8QP8xReYtJA4pN1TxI9o6tRKHAy6ks7I0caYh95cbAl0_C6WixKO3VDKpC5oF2L1u6o6aklg2RXCoSVK7sPbf74JW9TXAbsMxwi19Ds Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:33.654825 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b5f58cd74cd148fb819bb34914e64ea0 Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1'} Nov 02 12:20:33.656364 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:33.657103 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 12:20:33.661937 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:33.665783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b58d550-a2f2-48fb-85a2-27a881564170 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:33.665783 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b58d550-a2f2-48fb-85a2-27a881564170 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018484 Nov 02 12:20:33.665783 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 173/342] 10.222.0.45 () {58 vars in 1173 bytes} [Wed Nov 2 12:20:33 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:33.675230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:33.675865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:33.684571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.685075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.685521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.686263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.687252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.688232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.878914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.894502 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78e0d66d-a9c2-4880-b631-6bb6f34a4e22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 0.792874 Nov 02 12:20:33.911567 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 170/343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:33 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:33.936132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:33.937833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:33.962490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.967449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.972487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.973369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:33.974171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:33.974610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.066688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.067172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.067610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.068067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lazy-loading 'fault' on Instance uuid 42f63610-cc86-49e6-a711-072754b812a0 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:34.102137 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9563afe6-2671-4bb7-9eba-363cec0007f5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1613 microversion: 2.1 time: 0.430974 Nov 02 12:20:34.108740 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 174/344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:33 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1613 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:34.116125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ff5b17c-5768-40e1-8078-d398e6c66ee5 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Calling method '.version_select at 0x7f228eedb280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.122913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-9ff5b17c-5768-40e1-8078-d398e6c66ee5 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] HTTP exception thrown: Hypervisor with ID '94e93e39-846d-4524-9eaa-3d72a305e8f1' could not be found. Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ff5b17c-5768-40e1-8078-d398e6c66ee5 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Request method failure captured: Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-hypervisors/94e93e39-846d-4524-9eaa-3d72a305e8f1/uptime HTTP/1.1 Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmCKoID_P50NeoB1ilJLv5rvNTwg5eyHGtzhyS9HDS6OqWgvd2Nrkq8oSFJIW1g5UNtSgEFgtDhY0exCZlufQr8tExmW-gHZTteoUq4dIDGt6uM4Xtf74UM5RHKCBWxCk-TUCteoRj2rPvYcAFazFdvsjHnRZ4s7WiGJ9XWKdOHVB4g Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 884bf255e9f64120a0db505d72f87ce8 Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2021003280 Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:20:34.147399 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/884bf255e9f64120a0db505d72f87ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/884bf255e9f64120a0db505d72f87ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/884bf255e9f64120a0db505d72f87ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_884bf255e9f64120a0db505d72f87ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2021003280 Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 884bf255e9f64120a0db505d72f87ce8 Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2021003280 Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a3fd650d05b048989f2bccba6a09435a Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: exception: Hypervisor with ID '94e93e39-846d-4524-9eaa-3d72a305e8f1' could not be found. Nov 02 12:20:34.149090 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '94e93e39-846d-4524-9eaa-3d72a305e8f1'} Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '94e93e39-846d-4524-9eaa-3d72a305e8f1' Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 12:20:34.150009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '94e93e39-846d-4524-9eaa-3d72a305e8f1' could not be found. Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.151696 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.154392 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.154392 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.154392 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.154392 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:34.154392 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:34.154392 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '94e93e39-846d-4524-9eaa-3d72a305e8f1' could not be found. Nov 02 12:20:34.154392 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.156937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ff5b17c-5768-40e1-8078-d398e6c66ee5 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Returning 404 to user: Hypervisor with ID '94e93e39-846d-4524-9eaa-3d72a305e8f1' could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:34.158223 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ff5b17c-5768-40e1-8078-d398e6c66ee5 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/94e93e39-846d-4524-9eaa-3d72a305e8f1/uptime" status: 404 len: 123 microversion: 2.1 time: 0.047535 Nov 02 12:20:34.159350 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 175/345] 10.222.0.45 () {58 vars in 1278 bytes} [Wed Nov 2 12:20:34 2022] GET /compute/v2.1/os-hypervisors/94e93e39-846d-4524-9eaa-3d72a305e8f1/uptime => generated 123 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:34.167173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:34.168271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:34.177456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.178397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.179597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.180573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.181433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.182615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.346447 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] HTTP exception thrown: Cannot 'migrate' instance 780388e3-a8e6-4554-b949-7b1863155117 while it is in vm_state suspended Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Request method failure captured: Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117/action HTTP/1.1 Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 15 Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBUaKeEwz-uwxiKMBWko2mOGSh7ruXIj2Qz6-H_kM0ZAJwummKIUYrNvxdlXIcAJKdzJonUog9ngQiyDI3jl7xmYGAgA-E_ccVDHWCXzxaE6LrcXOVxmcWDrdhpxZ3rmnAX-I5qeq4yDA3B9Rwwo8Hp6uhPx9UR7ZyHypbDH70btRk Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:20:34.349149 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: aedd23de4b7c4c188cee7862063d9a28 Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: {"migrate": {}} Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:34.350843 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'migrate' instance 780388e3-a8e6-4554-b949-7b1863155117 while it is in vm_state suspended Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '780388e3-a8e6-4554-b949-7b1863155117', 'body': {'migrate': {}}} Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 780388e3-a8e6-4554-b949-7b1863155117 in vm_state suspended. Cannot resize while the instance is in this state. Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.351852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 780388e3-a8e6-4554-b949-7b1863155117 while it is in vm_state suspended Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.353476 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.354809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:34.354809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:34.354809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 780388e3-a8e6-4554-b949-7b1863155117 while it is in vm_state suspended Nov 02 12:20:34.354809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.354809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Returning 409 to user: Cannot 'migrate' instance 780388e3-a8e6-4554-b949-7b1863155117 while it is in vm_state suspended {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:34.354809 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5a9c0403-a028-42de-bf7e-e72f47acb7c5 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117/action" status: 409 len: 148 microversion: 2.1 time: 0.190142 Nov 02 12:20:34.354809 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 176/346] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:20:34 2022] POST /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117/action => generated 148 bytes in 192 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:34.363201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Calling method '.version_select at 0x7f228ef41670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.365225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.365713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.366257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.385340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.386315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.386948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.395131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:34.418899 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df8918b1-de95-45c9-9e69-6c0cb3045540 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1451 microversion: 2.1 time: 0.496810 Nov 02 12:20:34.419678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.420212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.420812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.422214 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 171/347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:33 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1451 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:34.432456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82cf6cc4-440b-4c10-b74a-c1b284dc57d8 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:34.446906 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02bea777-1050-475f-ba0f-8ce9e60c8688 tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.085531 Nov 02 12:20:34.446906 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 177/348] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:20:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82cf6cc4-440b-4c10-b74a-c1b284dc57d8 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Request method failure captured: Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475/action HTTP/1.1 Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 39 Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBUaKeEwz-uwxiKMBWko2mOGSh7ruXIj2Qz6-H_kM0ZAJwummKIUYrNvxdlXIcAJKdzJonUog9ngQiyDI3jl7xmYGAgA-E_ccVDHWCXzxaE6LrcXOVxmcWDrdhpxZ3rmnAX-I5qeq4yDA3B9Rwwo8Hp6uhPx9UR7ZyHypbDH70btRk Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:34.447759 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: aedd23de4b7c4c188cee7862063d9a28 Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: {"os-resetState": {"state": "invalid"}} Nov 02 12:20:34.449008 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7e5b1647-16dc-4d7b-9877-8a7a663b6475', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.449734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:20:34.451813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 12:20:34.457791 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.457791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82cf6cc4-440b-4c10-b74a-c1b284dc57d8 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:34.457791 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-82cf6cc4-440b-4c10-b74a-c1b284dc57d8 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475/action" status: 400 len: 144 microversion: 2.1 time: 0.021493 Nov 02 12:20:34.457791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 172/349] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:20:34 2022] POST /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475/action => generated 144 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:20:34.458515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f06ba68e-53b8-4077-9f70-0f5a2fa81178 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Calling method '.version_select at 0x7f228efa24c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.462177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f06ba68e-53b8-4077-9f70-0f5a2fa81178 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b5f58cd74cd148fb819bb34914e64ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60af3f2b3a5b4789b048f40e132b8890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:34.469059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8863638-4b13-4878-ad55-41190f67db07 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f06ba68e-53b8-4077-9f70-0f5a2fa81178 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Request method failure captured: Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmCIFG1QPk-9zIFbN00qABtiXYXkov7dibw2fQS77HJbFB6z50NlB6lnGKGKl1OQs6DeJRTP8QP8xReYtJA4pN1TxI9o6tRKHAy6ks7I0caYh95cbAl0_C6WixKO3VDKpC5oF2L1u6o6aklg2RXCoSVK7sPbf74JW9TXAbsMxwi19Ds Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:34.470197 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60af3f2b3a5b4789b048f40e132b8890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60af3f2b3a5b4789b048f40e132b8890 Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372 Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b5f58cd74cd148fb819bb34914e64ea0 Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1226617372-project Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1'} Nov 02 12:20:34.471416 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:20:34.472154 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 12:20:34.473233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.477051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f06ba68e-53b8-4077-9f70-0f5a2fa81178 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:34.478284 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f06ba68e-53b8-4077-9f70-0f5a2fa81178 tempest-HypervisorAdminNegativeTestJSON-1226617372 tempest-HypervisorAdminNegativeTestJSON-1226617372-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.026647 Nov 02 12:20:34.479850 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 178/350] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:20:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8863638-4b13-4878-ad55-41190f67db07 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Request method failure captured: Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475/action HTTP/1.1 Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 31 Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBUaKeEwz-uwxiKMBWko2mOGSh7ruXIj2Qz6-H_kM0ZAJwummKIUYrNvxdlXIcAJKdzJonUog9ngQiyDI3jl7xmYGAgA-E_ccVDHWCXzxaE6LrcXOVxmcWDrdhpxZ3rmnAX-I5qeq4yDA3B9Rwwo8Hp6uhPx9UR7ZyHypbDH70btRk Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:34.480690 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: aedd23de4b7c4c188cee7862063d9a28 Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: {"os-resetState": {"state": 1}} Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:34.482156 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7e5b1647-16dc-4d7b-9877-8a7a663b6475', 'body': {'os-resetState': {'state': 1}}} Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 1 Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:34.482918 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 12:20:34.484984 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.486888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8863638-4b13-4878-ad55-41190f67db07 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:34.488693 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8863638-4b13-4878-ad55-41190f67db07 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475/action" status: 400 len: 120 microversion: 2.1 time: 0.027405 Nov 02 12:20:34.496593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.497464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:34.497597 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 173/351] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:20:34 2022] POST /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475/action => generated 120 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:20:34.507343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.508392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.509068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.510769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.511184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e847e93-e164-49cf-aec0-1e385ac79bdd tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Calling method '.version_select at 0x7f228f081820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.511932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.512585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.515335 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7e847e93-e164-49cf-aec0-1e385ac79bdd tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] HTTP exception thrown: Hypervisor with ID '5f5ff519-d06e-490f-b0cf-9eb7ae56621d' could not be found. Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e847e93-e164-49cf-aec0-1e385ac79bdd tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Request method failure captured: Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hypervisors/5f5ff519-d06e-490f-b0cf-9eb7ae56621d HTTP/1.1 Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCKoID_P50NeoB1ilJLv5rvNTwg5eyHGtzhyS9HDS6OqWgvd2Nrkq8oSFJIW1g5UNtSgEFgtDhY0exCZlufQr8tExmW-gHZTteoUq4dIDGt6uM4Xtf74UM5RHKCBWxCk-TUCteoRj2rPvYcAFazFdvsjHnRZ4s7WiGJ9XWKdOHVB4g Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 884bf255e9f64120a0db505d72f87ce8 Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2021003280 Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:34.533882 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/884bf255e9f64120a0db505d72f87ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/884bf255e9f64120a0db505d72f87ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/884bf255e9f64120a0db505d72f87ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_884bf255e9f64120a0db505d72f87ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2021003280 Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 884bf255e9f64120a0db505d72f87ce8 Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2021003280 Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a3fd650d05b048989f2bccba6a09435a Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: exception: Hypervisor with ID '5f5ff519-d06e-490f-b0cf-9eb7ae56621d' could not be found. Nov 02 12:20:34.535238 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '5f5ff519-d06e-490f-b0cf-9eb7ae56621d'} Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5f5ff519-d06e-490f-b0cf-9eb7ae56621d' Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 12:20:34.535915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:20:34.537277 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5f5ff519-d06e-490f-b0cf-9eb7ae56621d' could not be found. Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5f5ff519-d06e-490f-b0cf-9eb7ae56621d' could not be found. Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.538405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e847e93-e164-49cf-aec0-1e385ac79bdd tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] Returning 404 to user: Hypervisor with ID '5f5ff519-d06e-490f-b0cf-9eb7ae56621d' could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:34.540467 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e847e93-e164-49cf-aec0-1e385ac79bdd tempest-HypervisorAdminNegativeTestJSON-2021003280 tempest-HypervisorAdminNegativeTestJSON-2021003280-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/5f5ff519-d06e-490f-b0cf-9eb7ae56621d" status: 404 len: 123 microversion: 2.1 time: 0.041325 Nov 02 12:20:34.543841 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 174/352] 10.222.0.45 () {58 vars in 1257 bytes} [Wed Nov 2 12:20:34 2022] GET /compute/v2.1/os-hypervisors/5f5ff519-d06e-490f-b0cf-9eb7ae56621d => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:34.565597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:20:34.567467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.568633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:34.583354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.585211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.587977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.589180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.590295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.593354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.782301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:34.801415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:34.805288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:34.807195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:34.808756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b0dde9bc-8c2d-4728-b7a3-4903455132ba tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1319 microversion: 2.25 time: 0.262368 Nov 02 12:20:34.810821 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 175/353] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:34 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:34.851656 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9923b986-64aa-4e74-9886-637a57c9e1c3 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "DELETE /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 204 len: 0 microversion: 2.1 time: 0.369855 Nov 02 12:20:34.852061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d667943-1a90-49b0-b7cf-f3f7fa3a5792 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:34.852922 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 179/354] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:20:34 2022] DELETE /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:20:34.856524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d667943-1a90-49b0-b7cf-f3f7fa3a5792 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Failed to fetch instance by id 999 {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:20:34.863765 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3d667943-1a90-49b0-b7cf-f3f7fa3a5792 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 02 12:20:34.867155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.867919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d667943-1a90-49b0-b7cf-f3f7fa3a5792 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Request method failure captured: Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 37 Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBUaKeEwz-uwxiKMBWko2mOGSh7ruXIj2Qz6-H_kM0ZAJwummKIUYrNvxdlXIcAJKdzJonUog9ngQiyDI3jl7xmYGAgA-E_ccVDHWCXzxaE6LrcXOVxmcWDrdhpxZ3rmnAX-I5qeq4yDA3B9Rwwo8Hp6uhPx9UR7ZyHypbDH70btRk Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:20:34.877151 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0caa26dd67d9446ca771831f6666c98d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0caa26dd67d9446ca771831f6666c98d Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074522769 Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: aedd23de4b7c4c188cee7862063d9a28 Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074522769-project-admin Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: {"os-resetState": {"state": "error"}} Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:34.879758 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 999 could not be found. Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:20:34.880528 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 12:20:34.882195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:34.883717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.883717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.883717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.883717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.883990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.883990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.886186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d667943-1a90-49b0-b7cf-f3f7fa3a5792 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:34.887465 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d667943-1a90-49b0-b7cf-f3f7fa3a5792 tempest-ServersAdminNegativeTestJSON-2074522769 tempest-ServersAdminNegativeTestJSON-2074522769-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.074962 Nov 02 12:20:34.888810 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 176/355] 10.222.0.45 () {60 vars in 1179 bytes} [Wed Nov 2 12:20:34 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:20:34.905152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.906137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:34.918769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.919740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.920463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.922163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.923125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.923723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.963351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.964851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.966121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.966656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:20:34.967172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lazy-loading 'fault' on Instance uuid 42f63610-cc86-49e6-a711-072754b812a0 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:35.055838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:35.107134 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-653c7716-34c9-4929-b759-7b291aef7530 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 204 len: 0 microversion: 2.1 time: 0.209236 Nov 02 12:20:35.112115 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 177/356] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:20:34 2022] DELETE /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:20:35.122035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:35.122975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:35.132443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:35.133434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:35.134327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:35.135472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:35.136239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:35.137262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:35.326239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:35.339942 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1abef02-e0bf-4ae6-86bf-99eef7cf6c58 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1457 microversion: 2.1 time: 0.479239 Nov 02 12:20:35.344359 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 180/357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:34 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1457 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:35.361248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:35.364168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:35.377800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:35.378335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:35.378782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:35.383505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:35.384374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:35.385899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:35.460091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:35.484601 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2834434f-6953-496e-ba33-d5352c078a31 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 0.366699 Nov 02 12:20:35.500381 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 178/358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:35 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:35.842325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:35.842785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:35.858564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:35.859585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:35.860348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:35.862079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:35.863448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:35.864411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:36.094704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:36.106960 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3e2b1a0-7215-4279-8cb1-be31138fdb89 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1468 microversion: 2.1 time: 0.758514 Nov 02 12:20:36.110512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 181/359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:35 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1468 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:36.367847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:36.368473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:36.384763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:36.385402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:36.385886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:36.386756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:36.387302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:36.387822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:36.482618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:36.483120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:36.483636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:36.484288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lazy-loading 'fault' on Instance uuid 42f63610-cc86-49e6-a711-072754b812a0 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:37.000209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:37.030168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:37.035413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:37.045792 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-18ae2be4-fdf4-41f0-bb7e-cb072f795cc9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 1.209586 Nov 02 12:20:37.052017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 179/360] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:35 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:20:37.074746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:37.077043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:37.103525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:37.105684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:37.106642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:37.109744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:37.114494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:37.118594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:37.235537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:37.254047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-714aa525-6190-4955-a6c1-104314f6bf66 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1457 microversion: 2.1 time: 0.889923 Nov 02 12:20:37.254726 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 182/361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:36 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1457 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:37.268310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:37.269427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:37.293751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:37.300086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:37.301609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:37.303172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:37.308052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:37.308540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.196771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:38.229699 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67df9174-49c0-471e-952b-4b4d977a779e tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1468 microversion: 2.1 time: 0.972583 Nov 02 12:20:38.233738 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 183/362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:37 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1468 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:38.243738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2c598dae-604a-4fab-8574-49588e0ade2a req-2a80ff5e-cc3e-4bfc-9696-8ead0f746af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4728b36-5541-47b1-8f1d-773945ed64dd", "name": "network-vif-unplugged", "status": "completed", "tag": "57302fa0-ed89-4f1b-baf4-32d04a5d7684"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:38.257744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:38.263839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2c598dae-604a-4fab-8574-49588e0ade2a req-2a80ff5e-cc3e-4bfc-9696-8ead0f746af5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.264739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2c598dae-604a-4fab-8574-49588e0ade2a req-2a80ff5e-cc3e-4bfc-9696-8ead0f746af5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.265901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2c598dae-604a-4fab-8574-49588e0ade2a req-2a80ff5e-cc3e-4bfc-9696-8ead0f746af5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.266925 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2c124e7-377f-472f-9089-7c912623b70f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 1.210706 Nov 02 12:20:38.267522 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 180/363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:37 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:38.290425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:38.291170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:38.297829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.298373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.298824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.299555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.300017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.300494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.306250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2c598dae-604a-4fab-8574-49588e0ade2a req-2a80ff5e-cc3e-4bfc-9696-8ead0f746af5 service nova] Creating event network-vif-unplugged:57302fa0-ed89-4f1b-baf4-32d04a5d7684 for instance c4728b36-5541-47b1-8f1d-773945ed64dd on n-h1-855650-5 Nov 02 12:20:38.317648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2c598dae-604a-4fab-8574-49588e0ade2a req-2a80ff5e-cc3e-4bfc-9696-8ead0f746af5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078778 Nov 02 12:20:38.320544 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 184/364] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:38.334791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:38.336190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:38.354702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.355670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.356459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.357698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.362147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.364367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.428413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.428910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.429567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.430599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lazy-loading 'fault' on Instance uuid 42f63610-cc86-49e6-a711-072754b812a0 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:39.310270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:39.343315 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3acbb5f-377a-41c6-9c1d-eda69e78e772 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1457 microversion: 2.1 time: 1.016860 Nov 02 12:20:39.360509 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 185/365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:38 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1457 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:39.369476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:39.373205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:39.389853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:39.390969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:39.391428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:39.402919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:39.403686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:39.404155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:39.414718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:39.431473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:39.432862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:39.444998 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b03711e-c0ae-4179-bff5-334729e245ef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 1.175190 Nov 02 12:20:39.455611 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 181/366] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:38 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:39.479037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:39.479611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:39.518576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:39.519377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:39.520022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:39.520921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:39.521547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:39.522173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:39.682058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:39.699769 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b2992e7-e817-44ba-bd15-206087f5d4d0 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1426 microversion: 2.1 time: 0.336731 Nov 02 12:20:39.702727 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 186/367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:39 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1426 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:39.813720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f7b26867-f196-4bdf-a9ef-0284b84d4a98 req-1099424c-a765-405d-a07b-767ac1fe8be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780388e3-a8e6-4554-b949-7b1863155117", "name": "network-vif-deleted", "tag": "00ed3f2b-f2c1-4ef9-8258-786d4df69be7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:39.844159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f7b26867-f196-4bdf-a9ef-0284b84d4a98 req-1099424c-a765-405d-a07b-767ac1fe8be7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:39.848997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f7b26867-f196-4bdf-a9ef-0284b84d4a98 req-1099424c-a765-405d-a07b-767ac1fe8be7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:39.849669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f7b26867-f196-4bdf-a9ef-0284b84d4a98 req-1099424c-a765-405d-a07b-767ac1fe8be7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:39.935629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f7b26867-f196-4bdf-a9ef-0284b84d4a98 req-1099424c-a765-405d-a07b-767ac1fe8be7 service nova] Creating event network-vif-deleted:00ed3f2b-f2c1-4ef9-8258-786d4df69be7 for instance 780388e3-a8e6-4554-b949-7b1863155117 on n-h1-855650-5 Nov 02 12:20:39.973067 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f7b26867-f196-4bdf-a9ef-0284b84d4a98 req-1099424c-a765-405d-a07b-767ac1fe8be7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163709 Nov 02 12:20:39.976995 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 187/368] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 12:20:40.375131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:40.377319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:40.391404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=16 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:40.401412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=19 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:40.429514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:40.431218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:40.433013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:40.439486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:40.440091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:40.443337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:40.468725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:40.544488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:40.574585 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2f8c964d-0595-4ead-9df9-ad5998cdc0c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 1.104286 Nov 02 12:20:40.580251 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 182/369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:39 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:40.607568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:40.608255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:40.628205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:40.631365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:40.633147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:40.634969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:40.636154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:40.636887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:40.638916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:40.639779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:40.641175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:40.641942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lazy-loading 'fault' on Instance uuid 42f63610-cc86-49e6-a711-072754b812a0 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:41.117786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6e51c338b94fc0ab741f99965a3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abeb11f5ac84444384ce6a3fe2253953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.143706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:41.179119 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a069c614-2cab-4f8f-9a38-3aedf2c83e11 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 200 len: 1310 microversion: 2.1 time: 0.808259 Nov 02 12:20:41.190105 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 188/370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:40 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 1310 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:41.351874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.377476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.381312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.386042 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-23697ae2-2863-4416-bb8f-d1d98f3ad1f4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 0.800846 Nov 02 12:20:41.387760 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 183/371] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:40 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:41.404466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:41.408591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:41.434213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.435515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.436679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.440841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.441339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.444404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.475538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e057ff69-1777-497d-b7c6-474a9adc693b tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Calling method '.version_select at 0x7f228ed6dc10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:41.476340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=26 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:41.517600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.518597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.519052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.519546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lazy-loading 'fault' on Instance uuid 780388e3-a8e6-4554-b949-7b1863155117 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:41.612181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.622946 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3335aea0-d6b0-4704-87d4-557c6acf8b1c tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 200 len: 1311 microversion: 2.1 time: 0.232871 Nov 02 12:20:41.637768 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 184/372] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:41 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 1311 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:41.637996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e057ff69-1777-497d-b7c6-474a9adc693b tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/6627fcf42303431cb571ea2cda4449d5" status: 200 len: 371 microversion: 2.1 time: 0.454324 Nov 02 12:20:41.638118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-4b0b1bd3-e565-4ae1-bdfb-170ff75ba804 req-6c42fc65-21ec-46c2-bd10-cc194ff83de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f63610-cc86-49e6-a711-072754b812a0", "name": "network-vif-deleted", "tag": "867136fb-ca58-4208-aef8-dfd3aeb1a72c"}, {"name": "network-changed", "server_uuid": "c4728b36-5541-47b1-8f1d-773945ed64dd", "tag": "57302fa0-ed89-4f1b-baf4-32d04a5d7684"}, {"name": "network-changed", "server_uuid": "82743148-2181-435d-868d-b5a11835e6ac", "tag": "8bd2df87-fa0f-4d69-9959-45c6c7b34a0f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:41.638213 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 189/373] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 12:20:41 2022] GET /compute/v2.1/os-quota-sets/6627fcf42303431cb571ea2cda4449d5 => generated 371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:41.654266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:41.655486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:41.680396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4b0b1bd3-e565-4ae1-bdfb-170ff75ba804 req-6c42fc65-21ec-46c2-bd10-cc194ff83de1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.680953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4b0b1bd3-e565-4ae1-bdfb-170ff75ba804 req-6c42fc65-21ec-46c2-bd10-cc194ff83de1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.684255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.685141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.686080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.687239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.688142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.690556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4b0b1bd3-e565-4ae1-bdfb-170ff75ba804 req-6c42fc65-21ec-46c2-bd10-cc194ff83de1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.695795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.748429 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4b0b1bd3-e565-4ae1-bdfb-170ff75ba804 req-6c42fc65-21ec-46c2-bd10-cc194ff83de1 service nova] Creating event network-vif-deleted:867136fb-ca58-4208-aef8-dfd3aeb1a72c for instance 42f63610-cc86-49e6-a711-072754b812a0 on n-h2-855650-5 Nov 02 12:20:41.749163 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4b0b1bd3-e565-4ae1-bdfb-170ff75ba804 req-6c42fc65-21ec-46c2-bd10-cc194ff83de1 service nova] Creating event network-changed:57302fa0-ed89-4f1b-baf4-32d04a5d7684 for instance c4728b36-5541-47b1-8f1d-773945ed64dd on n-h1-855650-5 Nov 02 12:20:41.749930 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4b0b1bd3-e565-4ae1-bdfb-170ff75ba804 req-6c42fc65-21ec-46c2-bd10-cc194ff83de1 service nova] Creating event network-changed:8bd2df87-fa0f-4d69-9959-45c6c7b34a0f for instance 82743148-2181-435d-868d-b5a11835e6ac on n-h1-855650-5 Nov 02 12:20:41.774676 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-4b0b1bd3-e565-4ae1-bdfb-170ff75ba804 req-6c42fc65-21ec-46c2-bd10-cc194ff83de1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.148964 Nov 02 12:20:41.776104 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 185/374] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:41.785685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60a5f00c-ff9a-48f2-a6ce-a1d99740d000 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Action: 'update', calling method: .version_select at 0x7f228f035af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:42.188541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60a5f00c-ff9a-48f2-a6ce-a1d99740d000 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.189437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60a5f00c-ff9a-48f2-a6ce-a1d99740d000 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.190169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60a5f00c-ff9a-48f2-a6ce-a1d99740d000 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.198757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60a5f00c-ff9a-48f2-a6ce-a1d99740d000 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.203007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60a5f00c-ff9a-48f2-a6ce-a1d99740d000 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.205435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60a5f00c-ff9a-48f2-a6ce-a1d99740d000 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.215625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:42.224697 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71ae0b50-7906-4a9d-a180-cfbf976109ad tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 0.585140 Nov 02 12:20:42.229750 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 190/375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:41 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:42.242573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.243531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:42.276076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.278913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.281561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.282926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.283770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.291045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.324605 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] HTTP exception thrown: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Request method failure captured: Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 HTTP/1.1 Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBG4AfRQfdR_PCAZ6a22lKNnaFjq2aDRABUBUo-R4eAFVm_3PN44HDMJPjSPGMBwqHWCuCL5Ho_KoSk5LSw85Y3YlQSsPIVxXhus6_vseq-w0f4BU_6OTo74CzbBn2PFtuVDopdcT9x9xwmkqIMcvYIh8-lMTwL3RphRBJ_ZhLcF3E Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:42.330248 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ef6e51c338b94fc0ab741f99965a3245 Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.332976 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '42f63610-cc86-49e6-a711-072754b812a0'} Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:42.334528 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.337173 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.341740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Returning 404 to user: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:42.344037 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1def3f60-eb00-4f3c-94b3-a9e8f1107b19 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 404 len: 111 microversion: 2.1 time: 0.112395 Nov 02 12:20:42.345535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 191/376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:42 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:42.367073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.370873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:42.385596 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60a5f00c-ff9a-48f2-a6ce-a1d99740d000 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/6627fcf42303431cb571ea2cda4449d5" status: 200 len: 328 microversion: 2.1 time: 0.607086 Nov 02 12:20:42.388017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 186/377] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:41 2022] PUT /compute/v2.1/os-quota-sets/6627fcf42303431cb571ea2cda4449d5 => generated 328 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:42.390212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.390936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.392133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.393525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.394409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.395038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.411852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a7be425c-54de-41be-9173-5aa367f98fa3 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.413208 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] HTTP exception thrown: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Request method failure captured: Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 HTTP/1.1 Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBG4AfRQfdR_PCAZ6a22lKNnaFjq2aDRABUBUo-R4eAFVm_3PN44HDMJPjSPGMBwqHWCuCL5Ho_KoSk5LSw85Y3YlQSsPIVxXhus6_vseq-w0f4BU_6OTo74CzbBn2PFtuVDopdcT9x9xwmkqIMcvYIh8-lMTwL3RphRBJ_ZhLcF3E Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:42.415122 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ef6e51c338b94fc0ab741f99965a3245 Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.416825 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '42f63610-cc86-49e6-a711-072754b812a0'} Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:42.417738 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.419102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.421531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Returning 404 to user: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:42.423254 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d4e46a63-2760-4741-ab4d-b791e18083b0 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "DELETE /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 404 len: 111 microversion: 2.1 time: 0.060354 Nov 02 12:20:42.424359 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 192/378] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:20:42 2022] DELETE /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:42.433456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.435308 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a7be425c-54de-41be-9173-5aa367f98fa3 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-quota-sets/6627fcf42303431cb571ea2cda4449d5" status: 202 len: 0 microversion: 2.1 time: 0.039700 Nov 02 12:20:42.440432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:42.441303 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 187/379] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:20:42 2022] DELETE /compute/v2.1/os-quota-sets/6627fcf42303431cb571ea2cda4449d5 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:20:42.449304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.450454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 42f63610-cc86-49e6-a711-072754b812a0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:42.458668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.459504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.460194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.461070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.461571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.462028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.462148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.462722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.463333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.464031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.464490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.464920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.495898 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] HTTP exception thrown: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Request method failure captured: Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 HTTP/1.1 Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBG4AfRQfdR_PCAZ6a22lKNnaFjq2aDRABUBUo-R4eAFVm_3PN44HDMJPjSPGMBwqHWCuCL5Ho_KoSk5LSw85Y3YlQSsPIVxXhus6_vseq-w0f4BU_6OTo74CzbBn2PFtuVDopdcT9x9xwmkqIMcvYIh8-lMTwL3RphRBJ_ZhLcF3E Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:42.501072 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ef6e51c338b94fc0ab741f99965a3245 Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.503489 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '42f63610-cc86-49e6-a711-072754b812a0'} Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:42.510702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. Nov 02 12:20:42.514980 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.520369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Returning 404 to user: Instance 42f63610-cc86-49e6-a711-072754b812a0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:42.520369 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e837e32c-aa72-4f02-be02-816ffcc827b5 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0" status: 404 len: 111 microversion: 2.1 time: 0.061201 Nov 02 12:20:42.520369 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 188/380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:42 2022] GET /compute/v2.1/servers/42f63610-cc86-49e6-a711-072754b812a0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:42.522426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e85cec62-9de7-4294-a590-bb321aa41373 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Calling method '.version_select at 0x7f228f29cc10>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.815183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:42.830537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:42.832031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:42.836075 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0620d8dc-2fd7-4e95-93d9-6ab3e4b35699 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 0.409070 Nov 02 12:20:42.837033 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 193/381] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:42 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:42.846646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.847136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:42.861262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.864872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.865404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.869868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.871739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.872487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.906185 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] HTTP exception thrown: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Request method failure captured: Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 HTTP/1.1 Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBG4AfRQfdR_PCAZ6a22lKNnaFjq2aDRABUBUo-R4eAFVm_3PN44HDMJPjSPGMBwqHWCuCL5Ho_KoSk5LSw85Y3YlQSsPIVxXhus6_vseq-w0f4BU_6OTo74CzbBn2PFtuVDopdcT9x9xwmkqIMcvYIh8-lMTwL3RphRBJ_ZhLcF3E Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:42.908500 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ef6e51c338b94fc0ab741f99965a3245 Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:42.910090 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '552c475f-6460-4181-a3e0-b644f66d9507'} Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:42.910918 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:42.912296 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:42.914180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Returning 404 to user: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:42.914180 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96209efd-4138-4e7b-875c-ea7fd728757e tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "DELETE /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 404 len: 111 microversion: 2.1 time: 0.071196 Nov 02 12:20:42.914180 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 194/382] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:20:42 2022] DELETE /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:42.924325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.924941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 780388e3-a8e6-4554-b949-7b1863155117] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:42.952530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.955343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.955851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.956602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.957102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.957550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.996896 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e85cec62-9de7-4294-a590-bb321aa41373 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/6627fcf42303431cb571ea2cda4449d5" status: 200 len: 371 microversion: 2.1 time: 0.489206 Nov 02 12:20:42.998715 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 189/383] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 12:20:42 2022] GET /compute/v2.1/os-quota-sets/6627fcf42303431cb571ea2cda4449d5 => generated 371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:42.999949 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] HTTP exception thrown: Instance 780388e3-a8e6-4554-b949-7b1863155117 could not be found. Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Request method failure captured: Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 HTTP/1.1 Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBTAVYJLhEHqcGv_EukQbfhLM8QB3SJJxLjsTVmRlLIo6PU9GD3OV9XUplF09CfPpIUL4gA3W82ZNd4XnoOQp8xaomg76TNh8-vCoz3HT_sWlMmHHWYyIyi2L5W1Jp1qqqdW8eJFSaWVYecKvpvD_NJw8cX39Kwi0rP1aeaM6bGzIA Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 3a242625dc6c4b75919516fa58c748b4 Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-906424446 Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:20:43.002186 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a242625dc6c4b75919516fa58c748b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a242625dc6c4b75919516fa58c748b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a242625dc6c4b75919516fa58c748b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a242625dc6c4b75919516fa58c748b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdminNegativeTestJSON-906424446 Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 3a242625dc6c4b75919516fa58c748b4 Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-906424446 Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdminNegativeTestJSON-906424446-project Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a9f59207e72940f184f57e38830ff5dd Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdminNegativeTestJSON-906424446-project Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 780388e3-a8e6-4554-b949-7b1863155117 could not be found. Nov 02 12:20:43.003491 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '780388e3-a8e6-4554-b949-7b1863155117'} Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780388e3-a8e6-4554-b949-7b1863155117 could not be found. Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:43.004198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780388e3-a8e6-4554-b949-7b1863155117 could not be found. Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780388e3-a8e6-4554-b949-7b1863155117 could not be found. Nov 02 12:20:43.005433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.009113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Returning 404 to user: Instance 780388e3-a8e6-4554-b949-7b1863155117 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:43.019404 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5bf3b4aa-6e41-4554-aba8-a90afcbb5903 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117" status: 404 len: 111 microversion: 2.1 time: 0.107776 Nov 02 12:20:43.020318 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 195/384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:42 2022] GET /compute/v2.1/servers/780388e3-a8e6-4554-b949-7b1863155117 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:43.032553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:43.034110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] [instance: 552c475f-6460-4181-a3e0-b644f66d9507] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:43.044469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:43.044973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:43.066907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.071258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.073181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.073669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.081063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.081407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.082121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.082906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.083364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.083800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.084818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.087212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.126000 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] HTTP exception thrown: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Request method failure captured: Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 HTTP/1.1 Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBG4AfRQfdR_PCAZ6a22lKNnaFjq2aDRABUBUo-R4eAFVm_3PN44HDMJPjSPGMBwqHWCuCL5Ho_KoSk5LSw85Y3YlQSsPIVxXhus6_vseq-w0f4BU_6OTo74CzbBn2PFtuVDopdcT9x9xwmkqIMcvYIh8-lMTwL3RphRBJ_ZhLcF3E Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:43.137115 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_abeb11f5ac84444384ce6a3fe2253953"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: abeb11f5ac84444384ce6a3fe2253953 Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169630837 Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ef6e51c338b94fc0ab741f99965a3245 Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169630837-project Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:43.138943 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '552c475f-6460-4181-a3e0-b644f66d9507'} Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:43.139652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. Nov 02 12:20:43.142556 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:43.143701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] Returning 404 to user: Instance 552c475f-6460-4181-a3e0-b644f66d9507 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:43.143701 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1908498a-7531-4eb8-9480-19b012c2d814 tempest-DeleteServersAdminTestJSON-1169630837 tempest-DeleteServersAdminTestJSON-1169630837-project] 10.222.0.45 "GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507" status: 404 len: 111 microversion: 2.1 time: 0.138494 Nov 02 12:20:43.143898 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 190/385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:42 2022] GET /compute/v2.1/servers/552c475f-6460-4181-a3e0-b644f66d9507 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:43.180952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:20:43.258177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:43.259203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:43.282221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.282853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.286135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.287703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.290244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.293090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.398906 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-902e7bcf-c2fd-4ac5-b95e-a642304c2e03 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 204 len: 0 microversion: 2.1 time: 0.372651 Nov 02 12:20:43.403851 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 196/386] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:20:43 2022] DELETE /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:20:43.413650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66d41e54-dc2b-44eb-98e4-baa67b065403 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Calling method '.version_select at 0x7f228edd7160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:43.593686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:43.602747 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ef6e7da0-7e3f-4080-b133-60742956ed53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 0.352684 Nov 02 12:20:43.622349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 191/387] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:43 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:43.629727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:43.631107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:43.640158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.641326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.642237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.643402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.644144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.644977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.854202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:43.871216 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-68021a68-8a3c-4922-9930-5924b15c75f9 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1477 microversion: 2.1 time: 0.246588 Nov 02 12:20:43.872715 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 192/388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:43 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:43.884881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:43.887136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:43.898576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.899651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.900423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.902335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.903022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.903875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:44.170926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:44.183272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:44.184805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:44.186345 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-80cc872d-b9b4-4ef9-af7e-0999f76d67de tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 0.311084 Nov 02 12:20:44.190021 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 193/389] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:43 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:44.638210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:44.640189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:44.664427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:44.666852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:44.668781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:44.670568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:44.674699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:44.675482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:44.723590 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66d41e54-dc2b-44eb-98e4-baa67b065403 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/b853e88f9d094798a7a028fb9a80e383/defaults" status: 200 len: 371 microversion: 2.1 time: 1.320113 Nov 02 12:20:44.741615 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 197/390] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:20:43 2022] GET /compute/v2.1/os-quota-sets/b853e88f9d094798a7a028fb9a80e383/defaults => generated 371 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:44.909453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:44.911078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:44.928680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:44.931856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:44.933449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:44.935204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:44.936489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:44.938367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:45.381016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:45.393585 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-debc8568-3c45-49b1-a085-79ad6107650f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 0.767715 Nov 02 12:20:45.396440 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 194/391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:44 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:45.408162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:45.411265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:45.427722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:45.428718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:45.429531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:45.432858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:45.433586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:45.436753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:45.713862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:45.736744 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-603b21d4-5953-43e0-b9a4-76fcf97ef162 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1477 microversion: 2.1 time: 0.832705 Nov 02 12:20:45.739401 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 198/392] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:44 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1477 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:45.748345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6644dacf-9e24-4c6c-8f63-c1d82910a95c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Action: 'update', calling method: .version_select at 0x7f228edd7c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:46.091466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6644dacf-9e24-4c6c-8f63-c1d82910a95c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:46.091980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6644dacf-9e24-4c6c-8f63-c1d82910a95c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:46.092709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6644dacf-9e24-4c6c-8f63-c1d82910a95c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:46.093677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6644dacf-9e24-4c6c-8f63-c1d82910a95c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:46.094988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6644dacf-9e24-4c6c-8f63-c1d82910a95c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:46.095803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6644dacf-9e24-4c6c-8f63-c1d82910a95c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:46.178134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:46.216728 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6644dacf-9e24-4c6c-8f63-c1d82910a95c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/d8f86413844a48c791f1f77c9d71504b" status: 200 len: 328 microversion: 2.1 time: 0.473458 Nov 02 12:20:46.232684 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 199/393] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:45 2022] PUT /compute/v2.1/os-quota-sets/d8f86413844a48c791f1f77c9d71504b => generated 328 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:46.240561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7cbe9745-d670-4b72-abbf-3812c6f6437d tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Calling method '.version_select at 0x7f228f028c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:46.250218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:46.254189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:46.260003 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5a98ca07-5277-4349-b613-484069301ec4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 0.861717 Nov 02 12:20:46.263793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 195/394] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:45 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:46.435634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:46.441535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:46.465690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:46.471410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:46.474611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:46.478222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:46.480474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:46.481859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.080920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbe9745-d670-4b72-abbf-3812c6f6437d tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.081825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbe9745-d670-4b72-abbf-3812c6f6437d tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.081825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbe9745-d670-4b72-abbf-3812c6f6437d tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.082885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbe9745-d670-4b72-abbf-3812c6f6437d tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.083353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbe9745-d670-4b72-abbf-3812c6f6437d tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.083800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbe9745-d670-4b72-abbf-3812c6f6437d tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.137676 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7cbe9745-d670-4b72-abbf-3812c6f6437d tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/d8f86413844a48c791f1f77c9d71504b/detail" status: 200 len: 916 microversion: 2.1 time: 0.904133 Nov 02 12:20:47.149995 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 200/395] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:20:46 2022] GET /compute/v2.1/os-quota-sets/d8f86413844a48c791f1f77c9d71504b/detail => generated 916 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:20:47.149995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:47.149995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:47.164083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.164683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.165384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.166560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.175812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.176549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.187271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:47.215130 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-687b88f9-d6c7-4e35-9725-75c0deab2a39 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 0.785968 Nov 02 12:20:47.216233 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 196/396] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:46 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:47.318368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:47.320428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:47.349090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.352024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.355435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.358980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.362926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.365832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.475222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:48.483513 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9ac2522-5b85-4e5d-b2dc-ae8fe39d99cc tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1477 microversion: 2.1 time: 1.343963 Nov 02 12:20:48.495527 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 201/397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:47 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1477 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:48.499395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Action: 'update', calling method: .version_select at 0x7f228f028430>, body: {"quota_set": {"ram": "2048"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:48.591414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:48.647791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:48.668761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:48.670152 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b495329a-5105-468d-96fb-5ef64ddf6bb2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 1.358920 Nov 02 12:20:48.674627 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 197/398] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:47 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:48.687614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:48.688893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:48.713027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.714420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.714942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.716548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.719231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.725166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.821010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.821780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.823652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.824980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.825724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.826580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.878708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.879519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.880341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.881775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.882482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.883105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.966463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:48.987698 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef00e6b9-a9f9-4132-bc2c-bc523cc3d04c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/d8f86413844a48c791f1f77c9d71504b?user_id=e6b8522af3894515a7a61feefa4ac782" status: 200 len: 328 microversion: 2.1 time: 0.491853 Nov 02 12:20:48.989277 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 202/399] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 12:20:48 2022] PUT /compute/v2.1/os-quota-sets/d8f86413844a48c791f1f77c9d71504b?user_id=e6b8522af3894515a7a61feefa4ac782 => generated 328 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:49.013722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d331f74-0a2a-4eb3-ad83-cca63d0d801f tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Calling method '.version_select at 0x7f228ee5e280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:49.232705 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d331f74-0a2a-4eb3-ad83-cca63d0d801f tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/d8f86413844a48c791f1f77c9d71504b?user_id=e6b8522af3894515a7a61feefa4ac782" status: 200 len: 370 microversion: 2.1 time: 0.228592 Nov 02 12:20:49.233309 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 203/400] 10.222.0.45 () {58 vars in 1323 bytes} [Wed Nov 2 12:20:49 2022] GET /compute/v2.1/os-quota-sets/d8f86413844a48c791f1f77c9d71504b?user_id=e6b8522af3894515a7a61feefa4ac782 => generated 370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:49.419427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:49.424715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:49.441471 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-077fcdeb-63ee-441a-8ca1-06b3205f91e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 0.761304 Nov 02 12:20:49.453453 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 198/401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:48 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:49.519887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:49.522671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:49.560032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:49.563035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:49.573597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:49.576745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:49.577540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:49.580170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:49.748903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:49.749742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:49.772468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:49.773516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:49.774573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:49.776373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:49.777026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:49.778649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:50.121396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9f59207e72940f184f57e38830ff5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a242625dc6c4b75919516fa58c748b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:50.152760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-806f5736-987b-4b91-aaa8-b0d0bd4e81d8 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 200 len: 1477 microversion: 2.1 time: 0.632994 Nov 02 12:20:50.154863 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 204/402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:49 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 1477 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:50.173686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea973d63-bc2c-47be-99b2-33585116d800 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Calling method '.version_select at 0x7f228ee5e280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:50.264346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:50.280376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:50.285060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:50.289091 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-166bc0b1-ea86-47e3-a2f7-1954912ca82c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 0.566844 Nov 02 12:20:50.291612 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 199/403] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:49 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:50.485225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:50.486232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:50.522350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:50.525814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:50.528589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:50.534501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:50.540984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:50.544347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:51.095573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea973d63-bc2c-47be-99b2-33585116d800 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/b853e88f9d094798a7a028fb9a80e383/defaults" status: 200 len: 371 microversion: 2.1 time: 0.932016 Nov 02 12:20:51.104131 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 205/404] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:20:50 2022] GET /compute/v2.1/os-quota-sets/b853e88f9d094798a7a028fb9a80e383/defaults => generated 371 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:51.120311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-de791753-2768-40df-8d81-19b0dcac44d1 req-b30ac062-9dd2-4c8c-b58f-10bc5e50a90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b1647-16dc-4d7b-9877-8a7a663b6475", "name": "network-vif-deleted", "tag": "81a93aab-aafa-457d-96b6-77c679b9fdeb"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:51.148848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de791753-2768-40df-8d81-19b0dcac44d1 req-b30ac062-9dd2-4c8c-b58f-10bc5e50a90b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:51.149351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de791753-2768-40df-8d81-19b0dcac44d1 req-b30ac062-9dd2-4c8c-b58f-10bc5e50a90b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:51.151338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de791753-2768-40df-8d81-19b0dcac44d1 req-b30ac062-9dd2-4c8c-b58f-10bc5e50a90b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:51.202292 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-de791753-2768-40df-8d81-19b0dcac44d1 req-b30ac062-9dd2-4c8c-b58f-10bc5e50a90b service nova] Creating event network-vif-deleted:81a93aab-aafa-457d-96b6-77c679b9fdeb for instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 on n-h2-855650-5 Nov 02 12:20:51.220630 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-de791753-2768-40df-8d81-19b0dcac44d1 req-b30ac062-9dd2-4c8c-b58f-10bc5e50a90b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117100 Nov 02 12:20:51.222810 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 206/405] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:51.240215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-929ab656-c17a-4e3a-aadf-ac1bc083d3a8 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Action: 'update', calling method: .version_select at 0x7f228ed6d430>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:51.783792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-929ab656-c17a-4e3a-aadf-ac1bc083d3a8 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:51.793064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-929ab656-c17a-4e3a-aadf-ac1bc083d3a8 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:51.795705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-929ab656-c17a-4e3a-aadf-ac1bc083d3a8 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:51.799543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-929ab656-c17a-4e3a-aadf-ac1bc083d3a8 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:51.800376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-929ab656-c17a-4e3a-aadf-ac1bc083d3a8 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:51.800974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-929ab656-c17a-4e3a-aadf-ac1bc083d3a8 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.248884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:52.285876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:52.334972 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93a1406e-22a0-419e-aff0-3a342f7567d5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 1.853770 Nov 02 12:20:52.350588 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 200/406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:50 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:52.361880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:52.364690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] [instance: 7e5b1647-16dc-4d7b-9877-8a7a663b6475] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:52.383593 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-929ab656-c17a-4e3a-aadf-ac1bc083d3a8 tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/b853e88f9d094798a7a028fb9a80e383" status: 200 len: 329 microversion: 2.1 time: 1.158613 Nov 02 12:20:52.386567 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 207/407] 10.222.0.45 () {60 vars in 1263 bytes} [Wed Nov 2 12:20:51 2022] PUT /compute/v2.1/os-quota-sets/b853e88f9d094798a7a028fb9a80e383 => generated 329 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:52.411714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:52.415197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:52.418794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:52.419458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:52.420182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.425163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:52.428832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:52.431835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.443279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:52.444991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:52.446082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.447198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:52.447826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:52.448454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.504859 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] HTTP exception thrown: Instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 could not be found. Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Request method failure captured: Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 HTTP/1.1 Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBTAVYJLhEHqcGv_EukQbfhLM8QB3SJJxLjsTVmRlLIo6PU9GD3OV9XUplF09CfPpIUL4gA3W82ZNd4XnoOQp8xaomg76TNh8-vCoz3HT_sWlMmHHWYyIyi2L5W1Jp1qqqdW8eJFSaWVYecKvpvD_NJw8cX39Kwi0rP1aeaM6bGzIA Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 3a242625dc6c4b75919516fa58c748b4 Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-906424446 Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:20:52.508169 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a242625dc6c4b75919516fa58c748b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a242625dc6c4b75919516fa58c748b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a242625dc6c4b75919516fa58c748b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a242625dc6c4b75919516fa58c748b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-906424446 Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 3a242625dc6c4b75919516fa58c748b4 Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-906424446 Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersAdminNegativeTestJSON-906424446-project Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a9f59207e72940f184f57e38830ff5dd Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-906424446-project Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 could not be found. Nov 02 12:20:52.510384 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7e5b1647-16dc-4d7b-9877-8a7a663b6475'} Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 could not be found. Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:52.511318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 could not be found. Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 could not be found. Nov 02 12:20:52.513406 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:20:52.514941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] Returning 404 to user: Instance 7e5b1647-16dc-4d7b-9877-8a7a663b6475 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:52.523317 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c8f1e9b-c8e6-4f15-b547-6960a95cd534 tempest-ServersAdminNegativeTestJSON-906424446 tempest-ServersAdminNegativeTestJSON-906424446-project] 10.222.0.45 "GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475" status: 404 len: 111 microversion: 2.1 time: 0.170074 Nov 02 12:20:52.534949 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 201/408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:52 2022] GET /compute/v2.1/servers/7e5b1647-16dc-4d7b-9877-8a7a663b6475 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:20:52.551370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5890f3da-dbb2-49d4-a6c5-7ae359a9954c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Action: 'update', calling method: .version_select at 0x7f228f29a700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:52.980986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:53.048314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:53.067038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:53.071639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:53.078066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d48e18b7-a761-4dd9-ab7e-62ec81851f0d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 0.685649 Nov 02 12:20:53.080394 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 208/409] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:52 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:53.379206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:53.389857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:53.432167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:53.433069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:53.433953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:53.435458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:53.436252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:53.437756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:54.098885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5890f3da-dbb2-49d4-a6c5-7ae359a9954c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:54.107163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5890f3da-dbb2-49d4-a6c5-7ae359a9954c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:54.108494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5890f3da-dbb2-49d4-a6c5-7ae359a9954c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:54.122067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5890f3da-dbb2-49d4-a6c5-7ae359a9954c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:54.138475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5890f3da-dbb2-49d4-a6c5-7ae359a9954c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:54.143740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5890f3da-dbb2-49d4-a6c5-7ae359a9954c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:54.249563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:54.420483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:54.462165 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3481156d-1ec5-4d08-b2dd-908cb78fc2de tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 1.088140 Nov 02 12:20:54.470489 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 209/410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:53 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:54.497581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:54.499474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:54.521835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:54.522975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:54.524589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:54.525949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:54.526969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:54.527629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.123326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:55.141512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:55.146882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:55.157072 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d45a64d3-80a3-4053-8d1c-9b1a9cfede34 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 0.684523 Nov 02 12:20:55.170759 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 210/411] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:54 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:55.191029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-aa779d25-29f4-46ad-9ab0-6bf1ddb8ffda req-e1c21227-87f2-4d0d-8044-a85fb506988f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82743148-2181-435d-868d-b5a11835e6ac", "name": "network-vif-plugged", "status": "completed", "tag": "8bd2df87-fa0f-4d69-9959-45c6c7b34a0f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:55.221151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa779d25-29f4-46ad-9ab0-6bf1ddb8ffda req-e1c21227-87f2-4d0d-8044-a85fb506988f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.221934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa779d25-29f4-46ad-9ab0-6bf1ddb8ffda req-e1c21227-87f2-4d0d-8044-a85fb506988f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.222566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa779d25-29f4-46ad-9ab0-6bf1ddb8ffda req-e1c21227-87f2-4d0d-8044-a85fb506988f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.252461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-aa779d25-29f4-46ad-9ab0-6bf1ddb8ffda req-e1c21227-87f2-4d0d-8044-a85fb506988f service nova] Creating event network-vif-plugged:8bd2df87-fa0f-4d69-9959-45c6c7b34a0f for instance 82743148-2181-435d-868d-b5a11835e6ac on n-h1-855650-5 Nov 02 12:20:55.268927 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-aa779d25-29f4-46ad-9ab0-6bf1ddb8ffda req-e1c21227-87f2-4d0d-8044-a85fb506988f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089324 Nov 02 12:20:55.270199 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 211/412] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:55.323243 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5890f3da-dbb2-49d4-a6c5-7ae359a9954c tempest-QuotasAdminTestJSON-1070813657 tempest-QuotasAdminTestJSON-1070813657-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/b853e88f9d094798a7a028fb9a80e383" status: 200 len: 329 microversion: 2.1 time: 2.786646 Nov 02 12:20:55.324600 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 202/413] 10.222.0.45 () {60 vars in 1263 bytes} [Wed Nov 2 12:20:52 2022] PUT /compute/v2.1/os-quota-sets/b853e88f9d094798a7a028fb9a80e383 => generated 329 bytes in 2789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:55.513120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:55.514465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:55.552229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.559083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.559779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.560745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.561410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.562495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.791239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Calling method '.version_select at 0x7f228ed47940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:55.796059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.797785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.799085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.870745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.873812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.877542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.925408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.927425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.931769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.953912 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b7da2ca9-b47f-40dc-b264-fc7a0f1f64b1 tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.682044 Nov 02 12:20:55.959068 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 212/414] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:20:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:55.980152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Calling method '.version_select at 0x7f228ef59040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:55.982825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.986446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.987346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.993578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:56.075886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.077622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.078402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.149731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.150620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.151328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.160837 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8f9c019-3e61-466a-a7bf-363e631de84b tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/n-h1-855650-5/servers" status: 200 len: 275 microversion: 2.1 time: 0.185302 Nov 02 12:20:56.162307 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 213/415] 10.222.0.45 () {58 vars in 1212 bytes} [Wed Nov 2 12:20:55 2022] GET /compute/v2.1/os-hypervisors/n-h1-855650-5/servers => generated 275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:56.183525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Calling method '.version_select at 0x7f228ed8a280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:56.186441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.187088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.187662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.228453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.229598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.230372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.273137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.273638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.276342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.296486 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-485cf273-650a-45bc-b457-93db1d24e32f tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.111384 Nov 02 12:20:56.297246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 214/416] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:20:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:56.311195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:56.315787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:56.341238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.341910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.342556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.343397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.343981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.344412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.806011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:56.820276 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-647423b9-0f79-43e3-a489-b49e40b65e1b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 1.325316 Nov 02 12:20:56.821741 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 203/417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:55 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:56.835072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5840d80a-b031-412d-b486-47c58e12b18d tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Calling method '.version_select at 0x7f228eff5160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:56.840292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5840d80a-b031-412d-b486-47c58e12b18d tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.841106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5840d80a-b031-412d-b486-47c58e12b18d tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.841703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5840d80a-b031-412d-b486-47c58e12b18d tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.880989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5840d80a-b031-412d-b486-47c58e12b18d tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.881837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5840d80a-b031-412d-b486-47c58e12b18d tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.884958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5840d80a-b031-412d-b486-47c58e12b18d tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.910346 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5840d80a-b031-412d-b486-47c58e12b18d tempest-HypervisorAdminUnderV252Test-1152362984 tempest-HypervisorAdminUnderV252Test-1152362984-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/n-h1-855650-5/search" status: 200 len: 104 microversion: 2.1 time: 0.085612 Nov 02 12:20:56.911808 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 204/418] 10.222.0.45 () {58 vars in 1209 bytes} [Wed Nov 2 12:20:56 2022] GET /compute/v2.1/os-hypervisors/n-h1-855650-5/search => generated 104 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:57.356326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:57.369380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:57.371495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:57.373127 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f95aec61-6985-4eac-a3d1-01974344b632 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1361 microversion: 2.25 time: 1.074876 Nov 02 12:20:57.374387 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 215/419] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:56 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1361 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:57.852121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:57.854941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:57.868707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:57.870012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:57.870808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:57.871794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:57.872483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:57.873120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:58.400280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:58.401464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:58.419892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:58.420649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:58.421301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:58.422236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:58.422868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:58.424014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:58.928311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:58.983348 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dbea8cbf-6124-4448-8f6f-72ad11d30596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1503 microversion: 2.1 time: 1.140039 Nov 02 12:20:58.984701 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 205/420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:57 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1503 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:59.112492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:59.132511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:59.138469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:59.141322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1cb1d64-12b3-4b1e-b8a3-05b337ea9325 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1557 microversion: 2.25 time: 0.744583 Nov 02 12:20:59.146496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 216/421] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:58 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1557 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:20:59.958716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:59.959598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:59.979714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:59.980860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:59.983553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:59.984555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:59.987387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:59.988111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.015789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:00.018137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:00.056777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.057730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.058257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.059672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.060471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.066293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.946170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:00.960835 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d9518ff-6ef5-435c-ac6a-db838e0cf876 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1493 microversion: 2.1 time: 0.949071 Nov 02 12:21:00.962417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid 82743148-2181-435d-868d-b5a11835e6ac {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:00.965766 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 217/422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:00 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1493 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:00.999936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64bf4c21-f42b-437c-91d2-56511ed029e0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '.version_select at 0x7f228ed9d430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:01.014552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64bf4c21-f42b-437c-91d2-56511ed029e0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.015507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64bf4c21-f42b-437c-91d2-56511ed029e0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.016446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64bf4c21-f42b-437c-91d2-56511ed029e0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.037877 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64bf4c21-f42b-437c-91d2-56511ed029e0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.046377 Nov 02 12:21:01.039018 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 218/423] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:21:00 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:21:01.054885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:01.055849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:01.064114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.064986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.066543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.067616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.068375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.069695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.209941 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-995a9af8-d2d7-4151-9542-8365e7a81de5 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 2049 microversion: 2.25 time: 2.035612 Nov 02 12:21:01.214267 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 206/424] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:59 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 2049 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:01.257774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:01.258818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:01.268149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.269475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.270292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.272088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.272849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.273668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.781287 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53c69256-d4e7-4e6f-85cf-928d2fcd7dd0 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1644 microversion: 2.1 time: 0.730417 Nov 02 12:21:01.781902 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 219/425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:01 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1644 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:01.902671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=11 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:02.315037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid 82743148-2181-435d-868d-b5a11835e6ac {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:02.347304 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4900b32e-4deb-499a-b8b7-420e4dd27c3a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 2049 microversion: 2.25 time: 1.098998 Nov 02 12:21:02.351425 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 207/426] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:01 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 2049 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:02.356798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1193609890", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "88aa3408-37b9-415a-84a9-1aa8b9400b9d"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:02.375295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=62 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:02.545089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] validate_networks() for [('88aa3408-37b9-415a-84a9-1aa8b9400b9d', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:02.796726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67d1aadf-c1d7-4568-ab23-eda4a5987007 tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] Calling method '.version_select at 0x7f228ed478b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:04.054216 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67d1aadf-c1d7-4568-ab23-eda4a5987007 tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 2.159250 Nov 02 12:21:04.055216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 220/427] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:21:01 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:21:04.063108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9f0cbfd-cadc-461b-8ae0-7becee21a25d tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:04.074614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9f0cbfd-cadc-461b-8ae0-7becee21a25d tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:04.081933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9f0cbfd-cadc-461b-8ae0-7becee21a25d tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:04.083309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9f0cbfd-cadc-461b-8ae0-7becee21a25d tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:04.087961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9f0cbfd-cadc-461b-8ae0-7becee21a25d tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:04.092372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9f0cbfd-cadc-461b-8ae0-7becee21a25d tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:04.096487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9f0cbfd-cadc-461b-8ae0-7becee21a25d tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:04.181721 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9f0cbfd-cadc-461b-8ae0-7becee21a25d tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.122560 Nov 02 12:21:04.203284 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 221/428] 10.222.0.45 () {60 vars in 1217 bytes} [Wed Nov 2 12:21:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:21:04.211272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:04.214975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1326cca-0837-4f65-9bd9-4f24fbf25383 tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] Action: 'create', calling method: .version_select at 0x7f228ed0cca0>, body: {"pool": "non_exist_pool"} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:04.463653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d1326cca-0837-4f65-9bd9-4f24fbf25383 tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] HTTP exception thrown: Floating IP pool not found. Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1326cca-0837-4f65-9bd9-4f24fbf25383 tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] Request method failure captured: Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 26 Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmCt6kw1Vi9o5npX6DTNrJ5o7EM098PYvdjRO1vFqSV_VxRu4BKn_wYbnIoggmHmndCseKJ_V_FHboDO-L0n3nJHFBMCt7IR8pZf-KeX0V2X6vlKz4JSUO-OIEZ1UD5vo9hXd00ebyR_ZVyBQaftpLaiw7t4Pi-lFstcxYXlwhl6xJg Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 4dc31a6d56c84423ae0486bacdc43bc6 Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1029742300 Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:21:04.474781 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4dc31a6d56c84423ae0486bacdc43bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4dc31a6d56c84423ae0486bacdc43bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4dc31a6d56c84423ae0486bacdc43bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4dc31a6d56c84423ae0486bacdc43bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1029742300 Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 4dc31a6d56c84423ae0486bacdc43bc6 Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1029742300 Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FloatingIPsNegativeTestJSON-1029742300-project Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 03f9efa8a1b244dbb38214ae0542cdcd Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1029742300-project Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: {"pool": "non_exist_pool"} Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: exception: Floating IP pool not found. Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 02 12:21:04.476213 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:04.477083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 02 12:21:04.478287 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:04.484024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1326cca-0837-4f65-9bd9-4f24fbf25383 tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] Returning 404 to user: Floating IP pool not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:04.485497 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1326cca-0837-4f65-9bd9-4f24fbf25383 tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.280864 Nov 02 12:21:04.488221 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 222/429] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:21:04 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:21:04.494690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855650-5", "block_migration": "auto"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:04.498081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:04.517013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:04.518223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:04.519856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:04.521132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:04.521841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:04.522524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:04.768988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'flavor' on Instance uuid 82743148-2181-435d-868d-b5a11835e6ac {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:04.814126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Going to try to live migrate instance to n-h2-855650-5 {{(pid=120722) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:21:05.245304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=34 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:05.648744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:05.649263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:05.650040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:05.650883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:05.651751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:05.689635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:05.696744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:05.699087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:05.700859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:05.705059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:05.706043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:05.786526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for project 3579208e4ca549d9a0cdb14af362384e. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:05.813309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for user 9f2ebf76beec4d3185c3c279868f8366 and project 3579208e4ca549d9a0cdb14af362384e. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:05.856197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:05.870128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:06.022358 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a1e44b6-7161-474e-a56a-2ad1f3e28834 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.668159 Nov 02 12:21:06.023554 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 208/430] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:06.919798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a45975c0-b3fa-454d-a3b8-cce18afcb576 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:06.946357 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a45975c0-b3fa-454d-a3b8-cce18afcb576 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.921326 Nov 02 12:21:06.958471 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 209/431] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:06.979010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb5965a2-dbd5-4e97-8e47-c288fa8da14b tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] Calling method '.version_select at 0x7f228f00ed30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:07.191843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-fb5965a2-dbd5-4e97-8e47-c288fa8da14b tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c3b92943-95ed-4f2c-a88a-389b0b6152eb could not be found", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:21:07.192663 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-fb5965a2-dbd5-4e97-8e47-c288fa8da14b tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] HTTP exception thrown: Floating IP not found for ID c3b92943-95ed-4f2c-a88a-389b0b6152eb Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb5965a2-dbd5-4e97-8e47-c288fa8da14b tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] Request method failure captured: Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-floating-ips/c3b92943-95ed-4f2c-a88a-389b0b6152eb HTTP/1.1 Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCt6kw1Vi9o5npX6DTNrJ5o7EM098PYvdjRO1vFqSV_VxRu4BKn_wYbnIoggmHmndCseKJ_V_FHboDO-L0n3nJHFBMCt7IR8pZf-KeX0V2X6vlKz4JSUO-OIEZ1UD5vo9hXd00ebyR_ZVyBQaftpLaiw7t4Pi-lFstcxYXlwhl6xJg Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 4dc31a6d56c84423ae0486bacdc43bc6 Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1029742300 Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:21:07.203445 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4dc31a6d56c84423ae0486bacdc43bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4dc31a6d56c84423ae0486bacdc43bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4dc31a6d56c84423ae0486bacdc43bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4dc31a6d56c84423ae0486bacdc43bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1029742300 Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 4dc31a6d56c84423ae0486bacdc43bc6 Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1029742300 Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FloatingIPsNegativeTestJSON-1029742300-project Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 03f9efa8a1b244dbb38214ae0542cdcd Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1029742300-project Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: exception: Floating IP not found for ID c3b92943-95ed-4f2c-a88a-389b0b6152eb Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c3b92943-95ed-4f2c-a88a-389b0b6152eb'} Nov 02 12:21:07.205036 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:21:07.207068 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c3b92943-95ed-4f2c-a88a-389b0b6152eb could not be found Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd9fd60-fdda-4cd0-b253-7cdc4a865a7d'] Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c3b92943-95ed-4f2c-a88a-389b0b6152eb. Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:07.208446 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c3b92943-95ed-4f2c-a88a-389b0b6152eb Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:07.209826 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:07.211475 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c3b92943-95ed-4f2c-a88a-389b0b6152eb Nov 02 12:21:07.211475 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.211475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb5965a2-dbd5-4e97-8e47-c288fa8da14b tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] Returning 404 to user: Floating IP not found for ID c3b92943-95ed-4f2c-a88a-389b0b6152eb {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:07.211475 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb5965a2-dbd5-4e97-8e47-c288fa8da14b tempest-FloatingIPsNegativeTestJSON-1029742300 tempest-FloatingIPsNegativeTestJSON-1029742300-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/c3b92943-95ed-4f2c-a88a-389b0b6152eb" status: 404 len: 111 microversion: 2.1 time: 0.245741 Nov 02 12:21:07.211475 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 210/432] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:21:06 2022] DELETE /compute/v2.1/os-floating-ips/c3b92943-95ed-4f2c-a88a-389b0b6152eb => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:07.226405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:07.227384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:07.271083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:07.271986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:07.273149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:07.275935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:07.279830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:07.283843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:07.513116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:07.522807 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b3a444b5-871f-421d-b4a2-488c1c53d933 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1215 microversion: 2.1 time: 0.315050 Nov 02 12:21:07.528084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 211/433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:07 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:07.549736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ee67a65b-0bbc-4edd-849b-268be5050f62 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:07.622683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ee67a65b-0bbc-4edd-849b-268be5050f62 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.092642 Nov 02 12:21:07.629769 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 212/434] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:21:07 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:07.669392 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad97e7ab-79df-4ebf-bc8d-1065085a7b7c tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac/action" status: 202 len: 0 microversion: 2.25 time: 3.179544 Nov 02 12:21:07.673384 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 223/435] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:21:04 2022] POST /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac/action => generated 0 bytes in 3181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:21:07.676388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-261c32cb-17db-4b07-b743-81569802b0a3 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:07.712219 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-261c32cb-17db-4b07-b743-81569802b0a3 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040542 Nov 02 12:21:07.712952 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 224/436] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:07.740096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:07.748868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:07.784880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:07.785709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:07.786180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:07.789487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:07.790267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:07.790909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:08.590306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:08.601914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:08.619145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:08.630314 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77f9e13c-eb68-4e4e-9242-97b8e08871a0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.902570 Nov 02 12:21:08.636133 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 225/437] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:07 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:08.664882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-768ab333-8a5e-4c8b-a809-92d38ed6e67a tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:08.703644 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-768ab333-8a5e-4c8b-a809-92d38ed6e67a tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062494 Nov 02 12:21:08.706967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3576ae33-6c2f-469c-bd87-0944fa3d1cbf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:08.721668 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 226/438] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:08.721955 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3576ae33-6c2f-469c-bd87-0944fa3d1cbf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.088720 Nov 02 12:21:08.738175 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 213/439] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:08.743459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:08.755642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:08.758322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=17,nova_api:UPDATE=14 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:08.784910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:08.785800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:08.785912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:08.786626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:08.787096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:08.787525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.030216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:09.039022 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ad946c4-dd09-4bc6-8ce5-8aeafd26ed4f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1269 microversion: 2.1 time: 0.299254 Nov 02 12:21:09.043866 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 214/440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:08 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1269 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:09.056970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61d3452f-dd57-4ddd-9cfc-22df84deda34 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.136476 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-61d3452f-dd57-4ddd-9cfc-22df84deda34 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.089406 Nov 02 12:21:09.139600 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 215/441] 10.222.0.45 () {58 vars in 1165 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:09.236126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-68cb9dc1-6f60-429f-9ac2-da881318a70c tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.246276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68cb9dc1-6f60-429f-9ac2-da881318a70c tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.247180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68cb9dc1-6f60-429f-9ac2-da881318a70c tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.248139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68cb9dc1-6f60-429f-9ac2-da881318a70c tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.249474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68cb9dc1-6f60-429f-9ac2-da881318a70c tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.250675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68cb9dc1-6f60-429f-9ac2-da881318a70c tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.252116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68cb9dc1-6f60-429f-9ac2-da881318a70c tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.272810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:09.289568 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-68cb9dc1-6f60-429f-9ac2-da881318a70c tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.576251 Nov 02 12:21:09.291272 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 227/442] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:08 2022] GET /compute/v2.1/os-services => generated 944 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.406843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d3af071-34a1-4c86-8c8a-414426c46074 tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-433336216", "id": 182260224, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:09.409847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Calling method '.version_select at 0x7f228ec41e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.414651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.418997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.419640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.459227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.459888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.460437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.470449 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d3af071-34a1-4c86-8c8a-414426c46074 tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.327182 Nov 02 12:21:09.471908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 216/443] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:09 2022] POST /compute/v2.1/flavors => generated 421 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.479733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.479733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.479733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.485078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5f54743-b9fc-4667-be12-530fe84610a6 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.492829 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05fed6f5-d1a8-4fe9-8c2d-dd5f616d8a90 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.200099 Nov 02 12:21:09.494505 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 228/444] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.501131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-00d9f7ab-6b69-4e83-99f3-c3492dd8dab6 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.504670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5f54743-b9fc-4667-be12-530fe84610a6 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023288 Nov 02 12:21:09.506126 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 217/445] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.506798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00d9f7ab-6b69-4e83-99f3-c3492dd8dab6 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.507587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00d9f7ab-6b69-4e83-99f3-c3492dd8dab6 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.508305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00d9f7ab-6b69-4e83-99f3-c3492dd8dab6 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.510752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00d9f7ab-6b69-4e83-99f3-c3492dd8dab6 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.511399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-549f5a23-de7f-4ae2-8dfa-15742f7ee1d5 tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.512681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00d9f7ab-6b69-4e83-99f3-c3492dd8dab6 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.513942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00d9f7ab-6b69-4e83-99f3-c3492dd8dab6 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.527897 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-549f5a23-de7f-4ae2-8dfa-15742f7ee1d5 tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020583 Nov 02 12:21:09.534690 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 218/446] 10.222.0.45 () {58 vars in 1182 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:21:09.564196 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-00d9f7ab-6b69-4e83-99f3-c3492dd8dab6 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=n-d-855650-5" status: 200 len: 578 microversion: 2.1 time: 0.067857 Nov 02 12:21:09.568709 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 229/447] 10.222.0.45 () {58 vars in 1172 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/os-services?host=n-d-855650-5 => generated 578 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.576727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e94e1f15-554e-4d39-8b2c-272940366d33 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.620781 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e94e1f15-554e-4d39-8b2c-272940366d33 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.050169 Nov 02 12:21:09.621744 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 230/448] 10.222.0.45 () {58 vars in 1169 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:09.628150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-749ce8a4-9c82-4c97-9fc9-2141d402efe7 tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-487824597", "id": 1003665394, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:09.662044 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-749ce8a4-9c82-4c97-9fc9-2141d402efe7 tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.037842 Nov 02 12:21:09.663117 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 231/449] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:09 2022] POST /compute/v2.1/flavors => generated 424 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.670968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fa07ca64-f2e1-48d3-a674-0e99e5e2de74 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.676203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa07ca64-f2e1-48d3-a674-0e99e5e2de74 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.677140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa07ca64-f2e1-48d3-a674-0e99e5e2de74 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.678216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa07ca64-f2e1-48d3-a674-0e99e5e2de74 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.679429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa07ca64-f2e1-48d3-a674-0e99e5e2de74 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.680951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa07ca64-f2e1-48d3-a674-0e99e5e2de74 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.681671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa07ca64-f2e1-48d3-a674-0e99e5e2de74 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.732266 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fa07ca64-f2e1-48d3-a674-0e99e5e2de74 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066513 Nov 02 12:21:09.734259 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 232/450] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.741804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-843b456d-0e21-42d6-ab4e-a19d1cc320a7 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.759329 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-843b456d-0e21-42d6-ab4e-a19d1cc320a7 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021959 Nov 02 12:21:09.760778 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 233/451] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.775914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.778112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:09.791593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.792248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.792801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.793640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.793764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-185bcc09-842b-4d22-bb56-7442e5813c08 tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] Calling method '.version_select at 0x7f228eec4af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.794538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.795112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.795556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-185bcc09-842b-4d22-bb56-7442e5813c08 tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3dc63e8e34084ef79287ea1f4d29e50f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ba5ecdbca648168f82096502d06e91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-185bcc09-842b-4d22-bb56-7442e5813c08 tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] Request method failure captured: Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hypervisors/n-h1-855650-5/search HTTP/1.1 Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCx4WV0tHRqpZ9FBj2rVagI21u6Q_MNZk1-KgYrYYT5mOzkmd4GZU5qj-1nOSbSCeHcT_u35SVv8jlNfwd_BsEJj5G2waVylU5RH7W-932RI5iPCuncMoijGHiBg4G_--KyOVs3xz17-bpmwbcYcOKJ521A4IyEYXOmMibRd1mLQOs Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 00ba5ecdbca648168f82096502d06e91 Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-556892592 Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:21:09.797174 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00ba5ecdbca648168f82096502d06e91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00ba5ecdbca648168f82096502d06e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00ba5ecdbca648168f82096502d06e91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00ba5ecdbca648168f82096502d06e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-556892592 Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 00ba5ecdbca648168f82096502d06e91 Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-556892592 Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-556892592-project Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 3dc63e8e34084ef79287ea1f4d29e50f Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-556892592-project Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 12:21:09.798670 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'n-h1-855650-5'} Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:21:09.800070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 12:21:09.801281 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:09.802383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-185bcc09-842b-4d22-bb56-7442e5813c08 tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:09.802383 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-185bcc09-842b-4d22-bb56-7442e5813c08 tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/n-h1-855650-5/search" status: 403 len: 117 microversion: 2.1 time: 0.262288 Nov 02 12:21:09.802383 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 219/452] 10.222.0.45 () {58 vars in 1209 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/os-hypervisors/n-h1-855650-5/search => generated 117 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:09.823757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-15f788ee-9bfe-4aff-bcdd-cd97f3d80b1f tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.847021 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-15f788ee-9bfe-4aff-bcdd-cd97f3d80b1f tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023456 Nov 02 12:21:09.847700 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 220/453] 10.222.0.45 () {58 vars in 1182 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:21:09.860541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a674b2f6-7e44-45c6-a0fc-cf16f55322c5 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.865030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a674b2f6-7e44-45c6-a0fc-cf16f55322c5 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.865781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a674b2f6-7e44-45c6-a0fc-cf16f55322c5 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.866407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a674b2f6-7e44-45c6-a0fc-cf16f55322c5 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.867611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a674b2f6-7e44-45c6-a0fc-cf16f55322c5 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.868263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a674b2f6-7e44-45c6-a0fc-cf16f55322c5 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.868846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a674b2f6-7e44-45c6-a0fc-cf16f55322c5 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.910529 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a674b2f6-7e44-45c6-a0fc-cf16f55322c5 tempest-ServicesAdminTestJSON-349978858 tempest-ServicesAdminTestJSON-349978858-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053678 Nov 02 12:21:09.911708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 221/454] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/os-services => generated 944 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.917338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c80d9ec1-bb4c-4461-beea-1ccb8faa016d tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.928290 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c80d9ec1-bb4c-4461-beea-1ccb8faa016d tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015210 Nov 02 12:21:09.929890 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 222/455] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:09.935293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5d25a2a-4bbb-4913-9faa-c91220ebc063 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Calling method '.version_select at 0x7f228f0354c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:09.937268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5d25a2a-4bbb-4913-9faa-c91220ebc063 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:09.937756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5d25a2a-4bbb-4913-9faa-c91220ebc063 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:09.938353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5d25a2a-4bbb-4913-9faa-c91220ebc063 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:09.946689 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c5d25a2a-4bbb-4913-9faa-c91220ebc063 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5d25a2a-4bbb-4913-9faa-c91220ebc063 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Request method failure captured: Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmC0-xu7UPaiCTKkVi5welnOAMecd-WUGBf0rGYs_RglPNCd1M2EpSskwRwHf-usk_k9m7SzXHL1XRyQtSQMr07operTz_pf6ezXEbVuvAN2zVSl7el5hNvH-3nSt-nM621pe9khGhWl-Gs60QSNw_O5pPzyTS7mM6bxuL8v2lPbOD4 Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 57d4b04d6c2d4d9585d4b6d556f7524c Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1988361472 Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:21:09.948590 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/57d4b04d6c2d4d9585d4b6d556f7524c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/57d4b04d6c2d4d9585d4b6d556f7524c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/57d4b04d6c2d4d9585d4b6d556f7524c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_57d4b04d6c2d4d9585d4b6d556f7524c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1988361472 Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 57d4b04d6c2d4d9585d4b6d556f7524c Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1988361472 Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ac48c795d9af49f6b237bb617c31e3a8 Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 12:21:09.949864 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:09.950646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:09.952393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:09.952393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:09.952393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:09.952393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 12:21:09.952393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:09.952393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5d25a2a-4bbb-4913-9faa-c91220ebc063 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:09.952393 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5d25a2a-4bbb-4913-9faa-c91220ebc063 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.018988 Nov 02 12:21:09.956666 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 223/456] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:09.965723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-188b71c4-880a-4732-afb7-0f2a20da5d04 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Action: 'create', calling method: .version_select at 0x7f228eff5f70>, body: {"keypair": {"name": "tempest-keypair-961828759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd6n3fyOTNAyv6l6J0rAcN+5MkxeXyUp4C3hgttqrggL2H8nAhIAkw0FA5xZEK2pbumanr5J/rKKG/PvyoEaYHJSOFGe3je2uZrWdf2eaImRayzf2QGJ3wUFHBX8pZ97Q=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:09.984572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-188b71c4-880a-4732-afb7-0f2a20da5d04 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Getting quotas for project f19f46a5675c4f028057725f509a1d50. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:09.991525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-188b71c4-880a-4732-afb7-0f2a20da5d04 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Getting quotas for user 20bdb026c50545849ac88f7c744cbf50 and project f19f46a5675c4f028057725f509a1d50. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:10.035238 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-188b71c4-880a-4732-afb7-0f2a20da5d04 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076717 Nov 02 12:21:10.036936 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 224/457] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:21:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:10.045389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6dac6f0a-82b6-40d7-89d6-0fb123d92b91 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.106900 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6dac6f0a-82b6-40d7-89d6-0fb123d92b91 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.068609 Nov 02 12:21:10.107718 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 225/458] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:10.113294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Calling method '.version_select at 0x7f228eefeb80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.115688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:10.116481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:10.118218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:10.137477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:10.138390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:10.139175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:10.160926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:10.161727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:10.162314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:10.176695 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-efb9882f-60d9-4242-9d91-ca6987230301 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067360 Nov 02 12:21:10.184753 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 226/459] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:10.193131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.193763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:10.201452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:10.208545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:10.209385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:10.211720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:10.212486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:10.213086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:10.324418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:10.364173 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60d95f24-1b9e-4645-9de0-d6a737b733c4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1269 microversion: 2.1 time: 0.176821 Nov 02 12:21:10.368174 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 227/460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:10.384197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7cd9a79c-209f-4850-be71-356c0d7f6077 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.396373 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7cd9a79c-209f-4850-be71-356c0d7f6077 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026826 Nov 02 12:21:10.397339 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 228/461] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:10.403858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56f799c3-0a8a-44ea-81d3-fd6f59f2bd9d tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] Calling method '.version_select at 0x7f228eec4f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.408378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-56f799c3-0a8a-44ea-81d3-fd6f59f2bd9d tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3dc63e8e34084ef79287ea1f4d29e50f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ba5ecdbca648168f82096502d06e91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56f799c3-0a8a-44ea-81d3-fd6f59f2bd9d tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] Request method failure captured: Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCx4WV0tHRqpZ9FBj2rVagI21u6Q_MNZk1-KgYrYYT5mOzkmd4GZU5qj-1nOSbSCeHcT_u35SVv8jlNfwd_BsEJj5G2waVylU5RH7W-932RI5iPCuncMoijGHiBg4G_--KyOVs3xz17-bpmwbcYcOKJ521A4IyEYXOmMibRd1mLQOs Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 00ba5ecdbca648168f82096502d06e91 Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-556892592 Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:21:10.427599 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00ba5ecdbca648168f82096502d06e91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00ba5ecdbca648168f82096502d06e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00ba5ecdbca648168f82096502d06e91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00ba5ecdbca648168f82096502d06e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-556892592 Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 00ba5ecdbca648168f82096502d06e91 Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-556892592 Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-556892592-project Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 3dc63e8e34084ef79287ea1f4d29e50f Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-556892592-project Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 12:21:10.429234 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1'} Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:21:10.430136 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 12:21:10.431457 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:21:10.442012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56f799c3-0a8a-44ea-81d3-fd6f59f2bd9d tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:10.448609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-56f799c3-0a8a-44ea-81d3-fd6f59f2bd9d tempest-HypervisorAdminNegativeUnderV252Test-556892592 tempest-HypervisorAdminNegativeUnderV252Test-556892592-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.044552 Nov 02 12:21:10.451477 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 229/462] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:10.461140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:10.466270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2eaf2588-ee41-4f65-b120-b297241225ad tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.474497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:10.482776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:10.484465 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42b77340-d134-4376-a844-123d334e4433 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.721352 Nov 02 12:21:10.488691 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 234/463] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:09 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:10.498080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-953b1bf5-b2f7-4cea-acad-4bdf64780325 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Calling method '.version_select at 0x7f228ec411f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.505433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-953b1bf5-b2f7-4cea-acad-4bdf64780325 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:10.506362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-953b1bf5-b2f7-4cea-acad-4bdf64780325 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:10.508757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-953b1bf5-b2f7-4cea-acad-4bdf64780325 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:10.538691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-953b1bf5-b2f7-4cea-acad-4bdf64780325 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] HTTP exception thrown: No hypervisor matching '5b79f820-5a49-468a-b6bd-6022285187f6' could be found. Nov 02 12:21:10.541881 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2eaf2588-ee41-4f65-b120-b297241225ad tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.089029 Nov 02 12:21:10.552064 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 230/464] 10.222.0.45 () {58 vars in 1144 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-953b1bf5-b2f7-4cea-acad-4bdf64780325 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Request method failure captured: Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-hypervisors/5b79f820-5a49-468a-b6bd-6022285187f6/servers HTTP/1.1 Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmC0-xu7UPaiCTKkVi5welnOAMecd-WUGBf0rGYs_RglPNCd1M2EpSskwRwHf-usk_k9m7SzXHL1XRyQtSQMr07operTz_pf6ezXEbVuvAN2zVSl7el5hNvH-3nSt-nM621pe9khGhWl-Gs60QSNw_O5pPzyTS7mM6bxuL8v2lPbOD4 Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 57d4b04d6c2d4d9585d4b6d556f7524c Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1988361472 Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:21:10.553777 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/57d4b04d6c2d4d9585d4b6d556f7524c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/57d4b04d6c2d4d9585d4b6d556f7524c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/57d4b04d6c2d4d9585d4b6d556f7524c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_57d4b04d6c2d4d9585d4b6d556f7524c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1988361472 Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 57d4b04d6c2d4d9585d4b6d556f7524c Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1988361472 Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ac48c795d9af49f6b237bb617c31e3a8 Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: exception: No hypervisor matching '5b79f820-5a49-468a-b6bd-6022285187f6' could be found. Nov 02 12:21:10.555318 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '5b79f820-5a49-468a-b6bd-6022285187f6'} Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5b79f820-5a49-468a-b6bd-6022285187f6' could be found. Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:10.556179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:10.557579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:10.557579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:10.557579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:10.557579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:10.557579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5b79f820-5a49-468a-b6bd-6022285187f6' could be found. Nov 02 12:21:10.557579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:10.561517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-953b1bf5-b2f7-4cea-acad-4bdf64780325 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] Returning 404 to user: No hypervisor matching '5b79f820-5a49-468a-b6bd-6022285187f6' could be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:10.564606 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-953b1bf5-b2f7-4cea-acad-4bdf64780325 tempest-HypervisorAdminNegativeUnderV252Test-1988361472 tempest-HypervisorAdminNegativeUnderV252Test-1988361472-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/5b79f820-5a49-468a-b6bd-6022285187f6/servers" status: 404 len: 123 microversion: 2.1 time: 0.072803 Nov 02 12:21:10.565501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-603faa8e-cafd-4ca5-b85a-21ce2ea6e23d tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.568229 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 235/465] 10.222.0.45 () {58 vars in 1281 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/os-hypervisors/5b79f820-5a49-468a-b6bd-6022285187f6/servers => generated 123 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:10.579134 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-603faa8e-cafd-4ca5-b85a-21ce2ea6e23d tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018570 Nov 02 12:21:10.588703 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 231/466] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:10.598695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d191b5a6-6207-4f3a-94c4-54aa160a1c8e tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.636853 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d191b5a6-6207-4f3a-94c4-54aa160a1c8e tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.046588 Nov 02 12:21:10.644081 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 236/467] 10.222.0.45 () {58 vars in 1148 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:10.657740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-292c8a5c-313f-4a3d-ae51-032b200c3403 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.678158 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-292c8a5c-313f-4a3d-ae51-032b200c3403 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026879 Nov 02 12:21:10.679195 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 232/468] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:10.692383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3aeb64b-4339-44a8-919b-970e94ae916d tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.710458 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3aeb64b-4339-44a8-919b-970e94ae916d tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018030 Nov 02 12:21:10.713066 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 237/469] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:10.740092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d95b400f-18e6-46dc-9727-100f1b7c7093 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.812802 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d95b400f-18e6-46dc-9727-100f1b7c7093 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.092521 Nov 02 12:21:10.820368 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 233/470] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:10.837360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-488b6bd0-f04a-4c7c-aae5-d4b265a1e354 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.916879 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-488b6bd0-f04a-4c7c-aae5-d4b265a1e354 tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.085870 Nov 02 12:21:10.925581 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 238/471] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:10.944922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c038d421-67fb-44ca-9944-d639bcaeb74a tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:10.961890 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c038d421-67fb-44ca-9944-d639bcaeb74a tempest-FlavorsV2TestJSON-1328587336 tempest-FlavorsV2TestJSON-1328587336-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020013 Nov 02 12:21:10.962892 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 234/472] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:21:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:11.391804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:11.393335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:11.405358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:11.406474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:11.414619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:11.415674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:11.416398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:11.417133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:11.521558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:11.522474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:11.560624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:11.561756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:11.562523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:11.563445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:11.566973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:11.567750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:12.081448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:12.096155 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f13ceeae-6658-48cc-b205-78044a57758f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1269 microversion: 2.1 time: 0.711164 Nov 02 12:21:12.097334 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 239/473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:11 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1269 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:12.320200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:12.345345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:12.350759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:12.352624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f8811be-c90b-4185-a27c-c18d560b857f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.835590 Nov 02 12:21:12.375084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 235/474] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:11 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:12.501385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4825237e-c8ad-40fd-80da-fff171cea28a req-79997f7d-faf8-4957-b81b-86df859c31ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82743148-2181-435d-868d-b5a11835e6ac", "name": "network-vif-unplugged", "status": "completed", "tag": "8bd2df87-fa0f-4d69-9959-45c6c7b34a0f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:12.519288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4825237e-c8ad-40fd-80da-fff171cea28a req-79997f7d-faf8-4957-b81b-86df859c31ed service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:12.520054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4825237e-c8ad-40fd-80da-fff171cea28a req-79997f7d-faf8-4957-b81b-86df859c31ed service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:12.520651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4825237e-c8ad-40fd-80da-fff171cea28a req-79997f7d-faf8-4957-b81b-86df859c31ed service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:12.534591 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4825237e-c8ad-40fd-80da-fff171cea28a req-79997f7d-faf8-4957-b81b-86df859c31ed service nova] Creating event network-vif-unplugged:8bd2df87-fa0f-4d69-9959-45c6c7b34a0f for instance 82743148-2181-435d-868d-b5a11835e6ac on n-h1-855650-5 Nov 02 12:21:12.540810 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4825237e-c8ad-40fd-80da-fff171cea28a req-79997f7d-faf8-4957-b81b-86df859c31ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043049 Nov 02 12:21:12.542168 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 240/475] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:13.120622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:13.121251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:13.132054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:13.132565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:13.133018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:13.133757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:13.134252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:13.134693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:13.389681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:13.391411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:13.406721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:13.407265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:13.407725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:13.408457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:13.408966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:13.409397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:13.977667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:13.996424 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-abdc2038-34ac-4120-b81d-e04fe446b7c7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 0.875689 Nov 02 12:21:14.005178 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 236/476] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:13 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:14.218643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:14.232247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:14.234005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:14.235006 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba12852d-9997-4d7c-b2f5-2be0c5d7d36a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.850542 Nov 02 12:21:14.235562 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 241/477] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:13 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:15.020814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:15.021623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:15.044498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:15.045093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:15.049461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:15.051043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:15.058304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:15.059122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:15.272262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:15.273578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:15.298515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:15.299377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:15.300150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:15.301136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:15.301838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:15.302539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:15.365657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:16.504025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:16.530958 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0b5ca2b-d974-41bc-bae3-b86ccc6844b9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 1.514625 Nov 02 12:21:16.533726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 237/478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:15 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:16.541723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-607f966b-3e73-4e80-91f7-f4538af3bbf1 req-0d0410e1-d60c-41c8-9e46-38ad0ec2ef9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82743148-2181-435d-868d-b5a11835e6ac", "tag": "8bd2df87-fa0f-4d69-9959-45c6c7b34a0f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:16.580291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-607f966b-3e73-4e80-91f7-f4538af3bbf1 req-0d0410e1-d60c-41c8-9e46-38ad0ec2ef9c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:16.581050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-607f966b-3e73-4e80-91f7-f4538af3bbf1 req-0d0410e1-d60c-41c8-9e46-38ad0ec2ef9c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:16.581643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-607f966b-3e73-4e80-91f7-f4538af3bbf1 req-0d0410e1-d60c-41c8-9e46-38ad0ec2ef9c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:16.601285 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-607f966b-3e73-4e80-91f7-f4538af3bbf1 req-0d0410e1-d60c-41c8-9e46-38ad0ec2ef9c service nova] Creating event network-changed:8bd2df87-fa0f-4d69-9959-45c6c7b34a0f for instance 82743148-2181-435d-868d-b5a11835e6ac on n-h1-855650-5 Nov 02 12:21:16.610665 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-607f966b-3e73-4e80-91f7-f4538af3bbf1 req-0d0410e1-d60c-41c8-9e46-38ad0ec2ef9c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073506 Nov 02 12:21:16.611797 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 238/479] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:16.652570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:16.662143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:16.664366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:16.666155 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba4e7e6c-e3c1-4f3b-a5d5-7ba450ab1fdf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 1.405180 Nov 02 12:21:16.682570 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 242/480] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:15 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:17.559809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:17.562654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:17.573548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:17.574525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:17.575296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:17.576370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:17.577000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:17.581837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:17.585477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:17.699298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:17.700040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:17.708794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:17.710960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:17.711785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:17.712833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:17.713624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:17.714236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:18.707660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:18.719280 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09154be8-1404-4505-a67e-2a6fa189bfe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 1.165089 Nov 02 12:21:18.719787 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 239/481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:17 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:18.741781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d55bce04-c2f7-47e9-a0c3-a6cebaa2874b req-13e0fa36-cc11-439e-9d41-ec4202c5aa7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9", "tag": "8dcc914c-ba8a-4857-ace9-4305134a0d30"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:18.759803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d55bce04-c2f7-47e9-a0c3-a6cebaa2874b req-13e0fa36-cc11-439e-9d41-ec4202c5aa7c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:18.760997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d55bce04-c2f7-47e9-a0c3-a6cebaa2874b req-13e0fa36-cc11-439e-9d41-ec4202c5aa7c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:18.761833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d55bce04-c2f7-47e9-a0c3-a6cebaa2874b req-13e0fa36-cc11-439e-9d41-ec4202c5aa7c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:18.776100 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d55bce04-c2f7-47e9-a0c3-a6cebaa2874b req-13e0fa36-cc11-439e-9d41-ec4202c5aa7c service nova] Creating event network-changed:8dcc914c-ba8a-4857-ace9-4305134a0d30 for instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 on n-h1-855650-5 Nov 02 12:21:18.782652 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d55bce04-c2f7-47e9-a0c3-a6cebaa2874b req-13e0fa36-cc11-439e-9d41-ec4202c5aa7c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045762 Nov 02 12:21:18.784027 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 240/482] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:18.891005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:18.903441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:18.911332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:18.912814 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4da18b63-c352-4e31-803e-0abe5f4522a6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 1.218856 Nov 02 12:21:18.914799 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 243/483] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:17 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:19.169353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1113160274", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "1003665394", "adminPass": "***", "networks": [{"uuid": "f1d02c46-05ef-4c49-8d45-8dbd809ddd5a"}], "security_groups": [{"name": "tempest-securitygroup--24862227"}], "key_name": "tempest-keypair-961828759", "user_data": "}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:19.492150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] validate_networks() for [('f1d02c46-05ef-4c49-8d45-8dbd809ddd5a', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:19.743672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:19.745512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:19.750590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:19.775723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:19.777501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:19.779466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:19.783747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:19.786120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:19.787297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:19.879697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:19.999759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:20.231294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:20.261905 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1ce3b681-e3e7-42e2-b0bf-e432503926f0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 0.520450 Nov 02 12:21:20.265476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 244/484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:19 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:20.291946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:20.294622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:20.349950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:20.351360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:20.355577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:20.356523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:20.357020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:20.357469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:20.836915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:20.837871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:20.838614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:20.839272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:20.839942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:20.866575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:20.867649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:20.870512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:20.879300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:20.880454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:20.882655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:20.932763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Getting quotas for project f19f46a5675c4f028057725f509a1d50. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:20.949463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Getting quotas for user 20bdb026c50545849ac88f7c744cbf50 and project f19f46a5675c4f028057725f509a1d50. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:20.986260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:20.996703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:21.058169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:21.078525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:21.080366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:21.083057 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d2d6a826-b2fa-449a-933a-8b276a13fd90 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.816486 Nov 02 12:21:21.101009 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e59596c9-ddc7-4063-81e1-7eaff15273a7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.939474 Nov 02 12:21:21.115436 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 241/485] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:19 2022] POST /compute/v2.1/servers => generated 400 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:21.116568 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 245/486] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:20 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:21.134997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb36dbb3-b4da-4d5d-93ed-402dba428145 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:21.135929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb36dbb3-b4da-4d5d-93ed-402dba428145 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:21.310227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb36dbb3-b4da-4d5d-93ed-402dba428145 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:21.318357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb36dbb3-b4da-4d5d-93ed-402dba428145 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1264 microversion: 2.1 time: 0.200572 Nov 02 12:21:21.318949 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 246/487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:21 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:21.343579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:21.344367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:21.353798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:21.354673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:21.355289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:21.357294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:21.358712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:21.359844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:21.813655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-805479604", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:21.942078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:21.977609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:21.996996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d715e931-a992-457d-b50b-8503888cbdf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 0.673365 Nov 02 12:21:22.009444 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 247/488] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:21 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:22.115131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:22.115972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:22.127263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.128020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.128676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.129884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.137018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.137825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.897581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:22.917579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:22.919411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:22.920848 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-811fc1c9-6c1a-4557-b498-3952853ab8dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.810645 Nov 02 12:21:22.921428 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 248/489] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:22 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:22.938298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:22.939203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:22.949914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.950126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:22.950597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:22.950883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:22.951349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:22.951767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:22.952159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.953647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.954665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.965595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.966358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.976425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.977215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.978604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.979638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.980298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.980902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:23.021267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Getting quotas for project 7999252f99d945058b53b83a4aa23fb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:23.061567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Getting quotas for user a5d7acebd00d425d98eeb19124a5722d and project 7999252f99d945058b53b83a4aa23fb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:23.112672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:23.115071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:23.279271 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1dbb73ea-0508-4907-a7ed-cf4f05363f60 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.168576 Nov 02 12:21:23.279942 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 242/490] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:24.127863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:24.145679 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24be13ac-3f24-4057-ac03-e478dfd4da08 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1316 microversion: 2.1 time: 1.220788 Nov 02 12:21:24.149184 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 249/491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:22 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1316 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:24.166592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1026375111", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:24.179926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:24.182990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:24.204978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:24.206979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:24.208236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:24.209500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:24.215468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:24.216374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:24.220739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:24.298708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:24.930225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:24.943974 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-befbc1f7-3def-4656-92fb-49078bfea998 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 0.789871 Nov 02 12:21:24.945308 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 250/492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:24 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:24.959040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:24.960059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:24.976814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:24.978047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:24.978721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:24.982813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:24.989838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:24.990846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.318997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:25.329739 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-307c4395-6360-4e7c-b16d-cf6d59e8e183 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1270 microversion: 2.1 time: 0.383027 Nov 02 12:21:25.333181 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 251/493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:24 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1270 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:25.343430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:25.349835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:25.362522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.363817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.364505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.365535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.366243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.368815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.381025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:25.382251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:25.384225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:25.384936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:25.385538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:25.413729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.414306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.414971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.418308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.419267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.420190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.471476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Getting quotas for project a2f902d5297e461c86c49431e4ed2414. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:25.486295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Getting quotas for user 5ba2cd128dcb4c2cb2afd3f271e62e21 and project a2f902d5297e461c86c49431e4ed2414. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:25.571750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:25.608026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:25.802206 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c84dd320-05ed-4d06-a8dc-83522f1d069b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514640 Nov 02 12:21:25.802884 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 243/494] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:25.813448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:25.825257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:25.826391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:25.831979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:25.833539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:25.837047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-79a7fc22-e178-4498-a06d-154859211667 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.501883 Nov 02 12:21:25.839266 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 252/495] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:25 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:25.845797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b282d836-e32e-4458-b075-dec1c85fb566 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:25.851716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b282d836-e32e-4458-b075-dec1c85fb566 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:25.856354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.857371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.859916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.860876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.864681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.865354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:26.030527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b282d836-e32e-4458-b075-dec1c85fb566 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:26.039781 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b282d836-e32e-4458-b075-dec1c85fb566 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1214 microversion: 2.1 time: 0.198654 Nov 02 12:21:26.040378 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 253/496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:25 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:26.060513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:26.061593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:26.070898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:26.071654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:26.072361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:26.073767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:26.075561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:26.076106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:26.233077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:26.245943 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2849b5a-73f4-4ce3-8377-dc451e082aca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1322 microversion: 2.1 time: 0.441920 Nov 02 12:21:26.247957 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 244/497] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:25 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:26.366653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:26.367827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:26.385068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:26.385717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:26.386044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:26.387032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:26.388574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:26.389307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:26.417769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:26.431863 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1455273a-36dc-4368-9636-12fc752963a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 0.376492 Nov 02 12:21:26.438607 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 254/498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:26 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:26.555727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:26.568514 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e51acb5c-8285-4dcf-8491-e7482fabd012 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1276 microversion: 2.1 time: 0.212216 Nov 02 12:21:26.570191 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 245/499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:26 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:26.868435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:26.869163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:26.892211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:26.893181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:26.896916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:26.897954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:26.898634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:26.899359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.072641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:27.075955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:27.104992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.107233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.108069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.112563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.118815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.119321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.278246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:27.287501 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4a903a80-6c7e-42ce-8550-c043a930cecd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1266 microversion: 2.1 time: 0.224662 Nov 02 12:21:27.291089 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 246/500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:27 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:27.300054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:27.302948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:27.330635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.331572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.332262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.333209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.333846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.334477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.763679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:27.777083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:27.795804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:27.798647 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2fdcd733-8cb8-4a45-96f8-36a60d2e153d tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1322 microversion: 2.1 time: 0.505260 Nov 02 12:21:27.799969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:27.804380 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 247/501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:27 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:27.807034 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24cab386-7d70-4d89-a17b-04d9136e66b0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.941431 Nov 02 12:21:27.807885 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 255/502] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:26 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:27.816055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:27.820252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:27.821149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:27.824969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:27.839012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.839351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.840177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.840835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.841550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.842591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.844558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.848653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.850180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.850879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.851628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.854526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.140898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:28.151595 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d84aecc3-e18d-4750-b3a6-163bcbee77b0 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1276 microversion: 2.1 time: 0.342390 Nov 02 12:21:28.153053 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 256/503] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:27 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1276 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:28.221176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d3cedfcc-00f9-4175-8153-410e9b7d56da req-ae79d892-2b23-453c-98ee-e44a651e0dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9", "name": "network-vif-plugged", "status": "completed", "tag": "8dcc914c-ba8a-4857-ace9-4305134a0d30"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:28.250409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d3cedfcc-00f9-4175-8153-410e9b7d56da req-ae79d892-2b23-453c-98ee-e44a651e0dfe service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.250769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d3cedfcc-00f9-4175-8153-410e9b7d56da req-ae79d892-2b23-453c-98ee-e44a651e0dfe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.251422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d3cedfcc-00f9-4175-8153-410e9b7d56da req-ae79d892-2b23-453c-98ee-e44a651e0dfe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.286399 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d3cedfcc-00f9-4175-8153-410e9b7d56da req-ae79d892-2b23-453c-98ee-e44a651e0dfe service nova] Creating event network-vif-plugged:8dcc914c-ba8a-4857-ace9-4305134a0d30 for instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 on n-h1-855650-5 Nov 02 12:21:28.294151 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d3cedfcc-00f9-4175-8153-410e9b7d56da req-ae79d892-2b23-453c-98ee-e44a651e0dfe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077396 Nov 02 12:21:28.295391 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 257/504] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:21:28.317698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:28.319215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:28.330530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.331260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.331960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.332888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.334599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.335313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.460455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:28.509563 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-065d07f8-dd65-4678-83d1-6652dee0d0b8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 0.700441 Nov 02 12:21:28.512939 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 248/505] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:27 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:28.629723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:28.640904 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fcb9088d-62ee-4757-910a-6cfa4785bd10 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1272 microversion: 2.1 time: 0.329701 Nov 02 12:21:28.676381 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 258/506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:28 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:28.827570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:28.828590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:28.842625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.843467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.843959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:28.844666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:28.850336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.854698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.855378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.855683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.855951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.856971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.857946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.859327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.863318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.864165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:29.185733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:29.203899 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb4a9977-75fa-44d2-94b4-d66d9fe96478 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.383440 Nov 02 12:21:29.206853 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 249/507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:28 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:29.228468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:29.234329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:29.235169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:29.249260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:29.251697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:29.252096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:29.252531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:29.255498 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d181914-2fcc-4d14-af86-c8d6dc30b227 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.419275 Nov 02 12:21:29.256856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:29.261558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:29.262466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:29.263135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:29.271780 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 259/508] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:28 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:29.453864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:29.476237 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d98f612-692b-4ddd-a463-f3e4df5eef90 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1276 microversion: 2.1 time: 0.262385 Nov 02 12:21:29.476838 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 250/509] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:29 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1276 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:29.543139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:29.544147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:29.552009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:29.552933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:29.553589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:29.555214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:29.556066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:29.557004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:29.679792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:29.680420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:29.690613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:29.691670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:29.692127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:29.692866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:29.693336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:29.693786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:29.810964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:29.838807 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94c78398-65d5-4a38-b0d6-f715e97f49a5 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1272 microversion: 2.1 time: 0.162268 Nov 02 12:21:29.842422 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 251/510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:29 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:29.907184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:29.918183 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-337f916a-2ee6-48fa-b99a-c48456a4aaf4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1311 microversion: 2.1 time: 0.381455 Nov 02 12:21:29.919185 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 260/511] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:29 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:30.232673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:30.233338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:30.244808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.247309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.259352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.267745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.268538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.269044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.285518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:30.286172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:30.301311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.307900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.308374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.309478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.314866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.323170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.385182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:30.790016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:30.799709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:30.811627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:30.813039 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de6ce386-8ad5-4194-9625-af229e28b108 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1567 microversion: 2.25 time: 0.532091 Nov 02 12:21:30.814138 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 261/512] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:30 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1567 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:30.823224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:30.824134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:30.834226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.842381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.843464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.844646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.845060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:30.845552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.845718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.862080 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5a1776a-779f-4b30-8368-c854a2403f72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.633725 Nov 02 12:21:30.862864 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 252/513] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:30 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:30.873447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:30.874099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:30.905021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.905660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.906244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.907218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.907687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.908121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:31.019639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:31.032721 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c788062b-2292-424f-8ced-12cac6bcbe4f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1276 microversion: 2.1 time: 0.216963 Nov 02 12:21:31.036108 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 262/514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:30 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:31.043756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:31.048711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:31.054508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:31.059791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.060302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.060749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:31.061473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.061934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.062388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:31.074492 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d15d0a94-9f73-42aa-8a8a-e3e3808750dd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1272 microversion: 2.1 time: 0.204732 Nov 02 12:21:31.075289 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 253/515] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:30 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:31.369785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:31.386107 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d39dd6a-9f1f-4c60-97af-3292fe53c032 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1495 microversion: 2.1 time: 0.348567 Nov 02 12:21:31.398782 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 263/516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:31 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1495 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:31.412454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:31.413451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:31.431038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.431986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.432680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:31.434027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.434736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.435393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:31.779093 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b6269ad7-5613-4f20-9360-6385cac0c48e tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1646 microversion: 2.1 time: 0.371765 Nov 02 12:21:31.799445 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 254/517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:31 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1646 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:31.824350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:31.824983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:31.840260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.841769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.842488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:31.843401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.844847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.849376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:32.207279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-732823596", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Nov 02 12:21:32.340310 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Nov 02 12:21:32.341751 n-d-855650-5 devstack@n-api.service[120722]: ERROR sqlalchemy.pool.impl.QueuePool Nov 02 12:21:32.342610 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16eb93bc-4b2c-49bd-ad5d-8fd2cad1dd77 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1646 microversion: 2.1 time: 0.519316 Nov 02 12:21:32.344575 n-d-855650-5 devstack@n-api.service[120722]: Exception ignored in: . at 0x7f228ebaaaf0> Nov 02 12:21:32.344995 n-d-855650-5 devstack@n-api.service[120722]: Traceback (most recent call last): Nov 02 12:21:32.345145 n-d-855650-5 devstack@n-api.service[120722]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Nov 02 12:21:32.345617 n-d-855650-5 devstack@n-api.service[120722]: and _finalize_fairy(None, rec, pool, ref, echo, True), Nov 02 12:21:32.345787 n-d-855650-5 devstack@n-api.service[120722]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Nov 02 12:21:32.346324 n-d-855650-5 devstack@n-api.service[120722]: connection_record.checkin() Nov 02 12:21:32.346477 n-d-855650-5 devstack@n-api.service[120722]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Nov 02 12:21:32.346915 n-d-855650-5 devstack@n-api.service[120722]: pool.dispatch.checkin(connection, self) Nov 02 12:21:32.347080 n-d-855650-5 devstack@n-api.service[120722]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Nov 02 12:21:32.354741 n-d-855650-5 devstack@n-api.service[120722]: fn(*args, **kw) Nov 02 12:21:32.355097 n-d-855650-5 devstack@n-api.service[120722]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Nov 02 12:21:32.355461 n-d-855650-5 devstack@n-api.service[120722]: time.sleep(0) Nov 02 12:21:32.355822 n-d-855650-5 devstack@n-api.service[120722]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Nov 02 12:21:32.357520 n-d-855650-5 devstack@n-api.service[120722]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 12:21:32.357893 n-d-855650-5 devstack@n-api.service[120722]: AssertionError: do not call blocking functions from the mainloop Nov 02 12:21:32.358974 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 255/518] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:31 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1646 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:32.369853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:32.370512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:32.390056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:32.390571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:32.391063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:32.391790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:32.392258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:32.405255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:32.408042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] validate_networks() for [('bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:32.962594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:32.996449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:33.006295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:33.012687 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e9187090-834b-4e33-92cd-c0b311715ad2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1557 microversion: 2.25 time: 0.648130 Nov 02 12:21:33.016412 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 256/519] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:32 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1557 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:33.038690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:33.039904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:33.059619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.061376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.062098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.063630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.064468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.065152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.650237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:33.667745 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-61f03af5-708e-492e-80bd-2b108ec6236c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.648299 Nov 02 12:21:33.668704 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 257/520] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:33 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:33.673334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:33.673949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:33.691219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.691803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.692255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.692973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.693432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.693863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.724617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:34.203486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:34.203486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:34.204384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:34.204912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:34.205465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:34.221710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.239974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:34.244956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.250336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.259863 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c18350c-e2f7-4949-b22a-c353b79ca94c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.582173 Nov 02 12:21:34.264361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.265506 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 258/521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:33 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:34.268943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.271512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.288851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:34.295309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:34.313510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.318791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.319758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.321299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.325222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.326089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.326867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Getting quotas for project 82dbd88241604726a6c21297724cf95d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:34.336081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Getting quotas for user c9fc9d8509544dcb8df90bdf49c60df6 and project 82dbd88241604726a6c21297724cf95d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:34.367246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:34.376893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:34.526962 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f24b4cad-4ee6-4c7a-89ad-861b68c20795 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.916135 Nov 02 12:21:34.537143 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 264/522] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:34.538282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-080a4d30-a0fe-43d9-aaa1-bc1dd5541794 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:34.544358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080a4d30-a0fe-43d9-aaa1-bc1dd5541794 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.544890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080a4d30-a0fe-43d9-aaa1-bc1dd5541794 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.545329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080a4d30-a0fe-43d9-aaa1-bc1dd5541794 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.570380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080a4d30-a0fe-43d9-aaa1-bc1dd5541794 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.571597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080a4d30-a0fe-43d9-aaa1-bc1dd5541794 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.572828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080a4d30-a0fe-43d9-aaa1-bc1dd5541794 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.657265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:34.738470 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-080a4d30-a0fe-43d9-aaa1-bc1dd5541794 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.204657 Nov 02 12:21:34.745729 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 265/523] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 12:21:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:34.757877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e478bf46-d207-46fd-9cee-4001f62f03d9 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '.version_select at 0x7f228ebaa160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:34.763411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e478bf46-d207-46fd-9cee-4001f62f03d9 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.767551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e478bf46-d207-46fd-9cee-4001f62f03d9 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.772456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e478bf46-d207-46fd-9cee-4001f62f03d9 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.798016 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e478bf46-d207-46fd-9cee-4001f62f03d9 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.050656 Nov 02 12:21:34.806921 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 266/524] 10.222.0.45 () {60 vars in 1184 bytes} [Wed Nov 2 12:21:34 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:34.834477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7eeec981-67ef-4253-8c8e-ca24d8c7bec0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:34.835117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7eeec981-67ef-4253-8c8e-ca24d8c7bec0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:35.154074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:35.178905 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b7b38931-64ac-4ae4-8e74-39daa1c1b734 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.902645 Nov 02 12:21:35.182332 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 259/525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:34 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:35.209508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:35.211963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:35.225486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.228539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.233037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.237891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.239519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.241430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.386099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7eeec981-67ef-4253-8c8e-ca24d8c7bec0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:35.408236 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7eeec981-67ef-4253-8c8e-ca24d8c7bec0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1223 microversion: 2.1 time: 0.599369 Nov 02 12:21:35.408954 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 267/526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:34 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1223 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:35.431412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:35.433586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:35.439603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:35.460426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.470898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.471684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.473105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.473651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.477710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.525679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=18 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:35.659302 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb27060d-fe0f-4fb6-b47c-c315724a91f9 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9/action" status: 202 len: 0 microversion: 2.1 time: 0.245084 Nov 02 12:21:35.659965 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 268/527] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:21:35 2022] POST /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:21:35.669179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:35.670302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:35.679790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.680482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.681102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.682243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.683040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.683629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:36.051382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:36.087161 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce218dda-d106-4fd7-8ac4-7d4616394afe tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.899545 Nov 02 12:21:36.106284 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 260/528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:35 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:36.127730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:36.129884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:36.147776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:36.148966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:36.149580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:36.150533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:36.151338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:36.152057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:36.525760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid 82743148-2181-435d-868d-b5a11835e6ac {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:36.778217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe5e0274-1149-4d08-90c2-309911763542 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 2049 microversion: 2.25 time: 1.113516 Nov 02 12:21:36.782879 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 269/529] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:35 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 2049 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:36.802450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:36.803086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:36.817340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:36.817852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:36.818327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:36.836226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:36.837019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:36.839449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.211934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:37.235602 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f17d6d9-9730-45d0-831d-8f630b446c37 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 1.127167 Nov 02 12:21:37.237145 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 261/530] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:36 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:37.247193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:37.248188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:37.262129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.263120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.264092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.265372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.266357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.267059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.548564 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff06408b-08de-4674-96c1-da6bc3065fb4 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1631 microversion: 2.1 time: 0.764421 Nov 02 12:21:37.549176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 270/531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:36 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1631 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:37.560993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:37.584577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:37.607296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.609547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.614475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.616381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.619922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.620690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.760018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:37.768832 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d2eda91-418b-4aa0-928b-d013775ad23c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.528670 Nov 02 12:21:37.774461 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 262/532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:37 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:37.790879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6de87626-ae0a-4d03-a74a-3455f319de3c req-d36a66b1-874f-4765-9ab9-b0978a7a826f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa17e49-fd4f-4121-932a-3d8aad79bab1", "tag": "be3b893e-ad60-40bd-98b3-160fdc19a1fe"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:37.834162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6de87626-ae0a-4d03-a74a-3455f319de3c req-d36a66b1-874f-4765-9ab9-b0978a7a826f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.834662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6de87626-ae0a-4d03-a74a-3455f319de3c req-d36a66b1-874f-4765-9ab9-b0978a7a826f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.835109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6de87626-ae0a-4d03-a74a-3455f319de3c req-d36a66b1-874f-4765-9ab9-b0978a7a826f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.867637 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6de87626-ae0a-4d03-a74a-3455f319de3c req-d36a66b1-874f-4765-9ab9-b0978a7a826f service nova] Creating event network-changed:be3b893e-ad60-40bd-98b3-160fdc19a1fe for instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 on n-h2-855650-5 Nov 02 12:21:37.878758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:37.889570 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a03bd01e-84a5-44ec-9be7-a6092dc1bbc1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1275 microversion: 2.1 time: 0.334286 Nov 02 12:21:37.892407 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6de87626-ae0a-4d03-a74a-3455f319de3c req-d36a66b1-874f-4765-9ab9-b0978a7a826f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111135 Nov 02 12:21:37.895621 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 263/533] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:37.902657 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 271/534] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:37 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1275 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:37.917059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1203417920", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a9f510fb-b50d-4af2-b983-5038fdf1b237"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:37.923841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:37.925090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:37.939843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.940216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.940658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.941400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.941900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.947350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:38.013017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] validate_networks() for [('a9f510fb-b50d-4af2-b983-5038fdf1b237', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:38.631806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:38.642552 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f40997b-69f3-429c-8295-20aa3b7d0b26 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.732182 Nov 02 12:21:38.664794 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 272/535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:37 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:38.673421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855650-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:38.677519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:38.687034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:38.687925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:38.688636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:38.690234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:38.691147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:38.692387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:38.727362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lazy-loading 'flavor' on Instance uuid f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:38.744422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Going to try to live migrate instance to n-h2-855650-5 {{(pid=120722) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:21:39.355568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:39.356128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:39.356457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:39.357245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:39.358214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:39.370302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.371167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.372032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.373022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.373766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.374393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.407626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for project 61f9f821af56421c98639028cc700a64. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:39.416740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for user a71d3feaad3148cc89c28cb18acf0cd0 and project 61f9f821af56421c98639028cc700a64. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:39.448248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:39.451206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:39.547405 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-711ddf65-9ca4-4795-bea9-f613a64c4aa8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.649306 Nov 02 12:21:39.554233 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 264/536] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:21:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:21:39.554233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:39.554233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:39.563839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.564349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.567902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.569134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.569799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.576981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.145889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:40.165914 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55515b8b-31dd-48cd-8e0a-7304a9ea0b70 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.616316 Nov 02 12:21:40.167917 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 265/537] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:39 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:40.197281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:40.198299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:40.206447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.207315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:40.209281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.210487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.211478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:40.212074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.609397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:40.622183 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9d0a98b4-ee2e-4f59-be63-8d1741dc4b94 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.450276 Nov 02 12:21:40.623818 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 266/538] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:40 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:40.641242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:40.641907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:40.684985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.685500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:40.689335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.690161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.690653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:40.691259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.880708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:40.929051 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84051c25-b177-40b5-855f-fdd338edbbb8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1281 microversion: 2.1 time: 0.303830 Nov 02 12:21:40.936121 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 267/539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:40 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1281 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:40.950044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:40.950987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:40.966626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.969408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:40.970114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.973673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.974397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:40.976297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.295089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:41.308691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:41.314401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:41.316509 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0cdd55a-72ea-4c01-8fee-f6dc9b1450d5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1258 microversion: 2.25 time: 0.377916 Nov 02 12:21:41.335221 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 268/540] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:40 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1258 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:41.342843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:41.344040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:41.352051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.353031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.353723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.356575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.357642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.358397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.782394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:41.795757 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6a0ae022-419a-4c06-a833-f77985136a75 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.458924 Nov 02 12:21:41.807956 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 269/541] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:41 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:41.817696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-cca9039b-8d1f-4b61-8a2b-82d08e34d6b6 req-4c41068b-2e46-4a51-9cbe-1bf4be65fca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ced03fd-249c-44d2-b1a4-3ba8e35d0517", "tag": "0a958d25-bdeb-4308-99ed-c7560ed66729"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:41.844962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cca9039b-8d1f-4b61-8a2b-82d08e34d6b6 req-4c41068b-2e46-4a51-9cbe-1bf4be65fca7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.845467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cca9039b-8d1f-4b61-8a2b-82d08e34d6b6 req-4c41068b-2e46-4a51-9cbe-1bf4be65fca7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.846182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cca9039b-8d1f-4b61-8a2b-82d08e34d6b6 req-4c41068b-2e46-4a51-9cbe-1bf4be65fca7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.868686 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-cca9039b-8d1f-4b61-8a2b-82d08e34d6b6 req-4c41068b-2e46-4a51-9cbe-1bf4be65fca7 service nova] Creating event network-changed:0a958d25-bdeb-4308-99ed-c7560ed66729 for instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 on n-h1-855650-5 Nov 02 12:21:41.875075 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-cca9039b-8d1f-4b61-8a2b-82d08e34d6b6 req-4c41068b-2e46-4a51-9cbe-1bf4be65fca7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065689 Nov 02 12:21:41.876879 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 270/542] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:41.884826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:41.897125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:41.911545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.913216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.913949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.917487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.918360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.919006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.491989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:42.515385 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-462ed5f5-646f-4855-906d-095bc6b8cc38 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.629144 Nov 02 12:21:42.516071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 271/543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:41 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:42.551435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:42.552498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:42.563123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.563888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.565946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.567720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.572813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.573536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.108264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.120201 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2cbd5f3-c063-4020-9756-41dfb7cb1b9f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.600439 Nov 02 12:21:43.134326 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 272/544] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:42 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:43.149904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.150872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:43.158910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.159960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.160758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.162722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.163637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.164485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.510852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.526820 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-808c5764-6b45-44ed-b34a-4bebdf089822 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1323 microversion: 2.1 time: 0.382308 Nov 02 12:21:43.530373 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 273/545] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:43.541176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.542640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:43.550145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.550646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.551102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.553279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.553752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.554238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.640882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.650301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.651776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.652923 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67b5c518-3363-482f-9075-bede6db339d4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1322 microversion: 2.25 time: 0.121125 Nov 02 12:21:43.653522 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 274/546] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1322 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:43.658432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.659046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:43.667905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.668429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.669115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.669834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.670476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.671237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.902232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.914397 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2c7f8d2-1627-4c7f-9088-a1f9d121eeb5 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.259689 Nov 02 12:21:43.915000 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 275/547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:43.922660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.923698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:43.933729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.934535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.935139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.936098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.936562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.937027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:44.302750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:44.314113 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9719d80f-9f16-45bb-ace1-fbb0fe2e68fd tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.397694 Nov 02 12:21:44.316236 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 276/548] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:44.324325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-07cb4704-4662-4508-a688-0efbc3394574 req-b1e8e201-25d5-4237-aeac-51b7ebecab98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd378caa-481b-4ea2-a97e-e9c76bac12a5", "tag": "213d0dd7-7c6f-44fc-bc8e-5a3ad3a2a9f9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:44.356316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-07cb4704-4662-4508-a688-0efbc3394574 req-b1e8e201-25d5-4237-aeac-51b7ebecab98 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:44.357122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-07cb4704-4662-4508-a688-0efbc3394574 req-b1e8e201-25d5-4237-aeac-51b7ebecab98 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:44.360060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-07cb4704-4662-4508-a688-0efbc3394574 req-b1e8e201-25d5-4237-aeac-51b7ebecab98 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:44.364830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:44.381623 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-07cb4704-4662-4508-a688-0efbc3394574 req-b1e8e201-25d5-4237-aeac-51b7ebecab98 service nova] Creating event network-changed:213d0dd7-7c6f-44fc-bc8e-5a3ad3a2a9f9 for instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 on n-h2-855650-5 Nov 02 12:21:44.393584 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-07cb4704-4662-4508-a688-0efbc3394574 req-b1e8e201-25d5-4237-aeac-51b7ebecab98 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071191 Nov 02 12:21:44.394482 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 277/549] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:44.514288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-733689042", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "d9b0ad1f-05f3-4f33-9884-e47d7be88f0a"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:44.613620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] validate_networks() for [('d9b0ad1f-05f3-4f33-9884-e47d7be88f0a', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:44.619150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:45.281863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:45.282595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:45.283725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:45.284357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:45.284978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:45.291871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:45.300388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.300881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.301363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.302205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.302662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.303229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.334635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Getting quotas for project 92830a9448754f3294124498e566bd7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:45.344666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Getting quotas for user 428b0b12566f4173bce276f0dd8fe5f8 and project 92830a9448754f3294124498e566bd7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:45.376617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:45.380391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:45.391036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:45.440301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e4637ffc-d66a-47a5-b2ef-4d3be5217b1e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043538 Nov 02 12:21:45.448875 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 278/550] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:45.454555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:45.455563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:45.465332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.466240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.467001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.468002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.469167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.469937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.076996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:46.089572 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-157d52f0-4c8c-49d5-8bce-60924d7ef8b2 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.636029 Nov 02 12:21:46.091792 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 279/551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:45 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:46.102506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:46.108827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:46.120168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.125072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.125782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.126765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.130270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.130919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.652159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:46.660725 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c3b04354-f6fe-4171-b124-e35a2d45df1e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1323 microversion: 2.1 time: 0.567070 Nov 02 12:21:46.682797 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 280/552] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:46 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1323 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:46.682797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:46.686339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:46.696903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.698769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.699552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.700603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.701340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.702012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.137433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.157317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.159092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.160248 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39e2cd12-d111-4d86-a36d-693dce799b2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1362 microversion: 2.25 time: 0.490947 Nov 02 12:21:47.162493 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 281/553] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:46 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:47.168155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:47.172894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:47.179854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:47.180704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:47.181387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.182390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:47.183111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:47.183763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.404889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.414850 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a33e3bb-2a4f-42a5-b639-fc70ddee4076 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.250291 Nov 02 12:21:47.416355 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 282/554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:47 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:47.422210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:47.423162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:47.433500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:47.434942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:47.436011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.437533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:47.438754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:47.439854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.746893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.764520 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-460f71f2-dc7d-48b4-a286-586836a2e5fa tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.343869 Nov 02 12:21:47.765561 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 283/555] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:47 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:47.811930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:47.814508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:47.826073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:47.831716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:47.835711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.836812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:47.838076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:47.839942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.993946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:48.009765 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d87f22a-8c16-458d-be49-dd4312767b64 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1275 microversion: 2.1 time: 0.240591 Nov 02 12:21:48.010701 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 284/556] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:47 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:48.022046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a2b11f6f-9992-4215-bbfe-f750338a40cf req-f6fb55bd-5768-445a-bccf-ae299e7438bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d8ccfc-5664-420a-bf9d-841e82aa1ab1", "tag": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:48.050600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a2b11f6f-9992-4215-bbfe-f750338a40cf req-f6fb55bd-5768-445a-bccf-ae299e7438bb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.051904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a2b11f6f-9992-4215-bbfe-f750338a40cf req-f6fb55bd-5768-445a-bccf-ae299e7438bb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.053772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a2b11f6f-9992-4215-bbfe-f750338a40cf req-f6fb55bd-5768-445a-bccf-ae299e7438bb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.087248 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a2b11f6f-9992-4215-bbfe-f750338a40cf req-f6fb55bd-5768-445a-bccf-ae299e7438bb service nova] Creating event network-changed:3dd63f67-75a2-455b-ae9d-2766c6a3eedf for instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 on n-h1-855650-5 Nov 02 12:21:48.092573 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a2b11f6f-9992-4215-bbfe-f750338a40cf req-f6fb55bd-5768-445a-bccf-ae299e7438bb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079760 Nov 02 12:21:48.093993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 285/557] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:48.100878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:48.102000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:48.111775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.112636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.113280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.114824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.115519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.116161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.430487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:48.444188 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08304afc-ae68-496b-a02e-1606bfc4984e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.348157 Nov 02 12:21:48.448515 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 286/558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:48 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:48.453660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:48.461728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:48.482950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.483991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.484543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.485477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.485993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.498524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.761769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=21 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:48.827998 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05337589-8be6-4f73-b204-c5709fc9b5d2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9/action" status: 202 len: 0 microversion: 2.1 time: 10.160661 Nov 02 12:21:48.828643 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 273/559] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:21:38 2022] POST /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9/action => generated 0 bytes in 10163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:21:48.834585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:48.835145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:48.851431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:48.863687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.868251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.868769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.869542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.870041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.870477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.904411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:48.925425 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ad694cc5-2ff5-467f-a871-38251f6d9ef6 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1323 microversion: 2.1 time: 0.472127 Nov 02 12:21:48.932334 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 287/560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:48 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1323 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:48.946644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:48.956058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:48.964910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.967041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.967725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.969108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.974755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.975498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:49.441475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.460587 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d2a5a4a-30c2-4d19-a225-4f61e773352e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.520284 Nov 02 12:21:49.464092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 288/561] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:48 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:49.474251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:49.476111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:49.493957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:49.494977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:49.495663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:49.496429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:49.500145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:49.500776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:49.656888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.678451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.682120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.690015 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6ebfe1b-f3e4-49dd-bda4-db79b71f6484 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1362 microversion: 2.25 time: 0.860060 Nov 02 12:21:49.693256 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 274/562] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:48 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1362 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:49.726036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:49.727001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:49.742896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:49.743807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:49.744925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:49.745815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:49.746370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:49.750100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.303615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:50.314998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:50.330022 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-636439b7-82ea-4337-8a26-3dd04df639d7 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.861103 Nov 02 12:21:50.344800 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2a3f260-6f67-4f8d-916a-366e91c99300 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.646147 Nov 02 12:21:50.345415 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 275/563] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:49 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:50.351002 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 289/564] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:49 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:50.356069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:50.356697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:50.363959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:50.364828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:50.379517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.382965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.385525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.386338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.388115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.388438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.389077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.389811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.390697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.391739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.394247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.394927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.877265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:50.884051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:50.923953 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3fcf5bd-353e-48aa-a6cb-343fa4454750 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.576011 Nov 02 12:21:50.926560 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e085069b-5c78-44fd-a334-49efaec96922 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.571644 Nov 02 12:21:50.928753 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 276/565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:50 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:50.930307 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 290/566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:50 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:50.938764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:50.939671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:50.950014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9fbdcd2b-9329-4464-8331-563dfee9d283 req-dd2c1cc8-c2ab-4171-b145-c90aa2beee0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb59ac2b-fb2c-4690-9a9e-9cb56f78155a", "tag": "a4f98e06-82ae-4a12-b885-9551951ad05a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:50.963539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.964631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.965683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.966776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.967843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.968449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.972678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9fbdcd2b-9329-4464-8331-563dfee9d283 req-dd2c1cc8-c2ab-4171-b145-c90aa2beee0d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.973456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9fbdcd2b-9329-4464-8331-563dfee9d283 req-dd2c1cc8-c2ab-4171-b145-c90aa2beee0d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.977257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9fbdcd2b-9329-4464-8331-563dfee9d283 req-dd2c1cc8-c2ab-4171-b145-c90aa2beee0d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.021209 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9fbdcd2b-9329-4464-8331-563dfee9d283 req-dd2c1cc8-c2ab-4171-b145-c90aa2beee0d service nova] Creating event network-changed:a4f98e06-82ae-4a12-b885-9551951ad05a for instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a on n-h1-855650-5 Nov 02 12:21:51.026851 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9fbdcd2b-9329-4464-8331-563dfee9d283 req-dd2c1cc8-c2ab-4171-b145-c90aa2beee0d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095141 Nov 02 12:21:51.028032 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 291/567] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:51.033432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-fd9fc509-bdc7-41c6-879b-0ccc07e56059 req-f96bf12a-cc96-4b44-adaa-76fcabe2542a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa17e49-fd4f-4121-932a-3d8aad79bab1", "name": "network-vif-plugged", "status": "completed", "tag": "be3b893e-ad60-40bd-98b3-160fdc19a1fe"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:51.043953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fd9fc509-bdc7-41c6-879b-0ccc07e56059 req-f96bf12a-cc96-4b44-adaa-76fcabe2542a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.044694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fd9fc509-bdc7-41c6-879b-0ccc07e56059 req-f96bf12a-cc96-4b44-adaa-76fcabe2542a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.045320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fd9fc509-bdc7-41c6-879b-0ccc07e56059 req-f96bf12a-cc96-4b44-adaa-76fcabe2542a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.059522 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-fd9fc509-bdc7-41c6-879b-0ccc07e56059 req-f96bf12a-cc96-4b44-adaa-76fcabe2542a service nova] Creating event network-vif-plugged:be3b893e-ad60-40bd-98b3-160fdc19a1fe for instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 on n-h2-855650-5 Nov 02 12:21:51.066221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-fd9fc509-bdc7-41c6-879b-0ccc07e56059 req-f96bf12a-cc96-4b44-adaa-76fcabe2542a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Nov 02 12:21:51.070521 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 292/568] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:51.076471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:51.078191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:51.085509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.086036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.086489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.087270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.087732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.088158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.306646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:51.318950 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-993c6a11-c6eb-4aa5-bc5f-e23ed9ad6bbc tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1323 microversion: 2.1 time: 0.388837 Nov 02 12:21:51.325211 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 277/569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:50 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:51.331448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:51.332644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:51.354544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.358849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.359236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.360221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.361257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.362675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.398446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:51.426248 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1fe81395-d3f2-4e73-a1a5-438395c09301 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.353499 Nov 02 12:21:51.441743 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 293/570] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:51 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:51.463261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:51.470412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:51.480096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.480914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.481602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.482653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.483427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.484083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.763328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:51.788330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:51.790108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:51.794474 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d28951c8-e9e1-43e4-8f89-c59aba97ccc8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1362 microversion: 2.25 time: 0.465024 Nov 02 12:21:51.795454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 278/571] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:51 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:51.804668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:51.805279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:51.817602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.818187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.818722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.819680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.820340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.821159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.838023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:51.856486 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3b96a7e-f490-4eb2-a4ea-eb50f4c0ca2f tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.412071 Nov 02 12:21:51.858083 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 294/572] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:51 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:51.954222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:51.957237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:51.978052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.981199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.982812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.983932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.984628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.985499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.206668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.216374 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef448caa-62c6-4546-bd9a-b69e1d15ffbb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.417655 Nov 02 12:21:52.217221 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 279/573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:51 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:52.222751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:52.224306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:52.231456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.232358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.233013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.233936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.234922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.235828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.274454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.300739 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-89b49e01-f23d-4a16-8d1a-7f0aaf4ab25f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.354022 Nov 02 12:21:52.301493 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 295/574] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:51 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:52.349656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:52.350474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:52.363263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.364687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.366483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.368104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.372487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.373372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.467572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.480155 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05fd12b7-5d98-495e-9a55-df128f835e4c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.261586 Nov 02 12:21:52.483874 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 280/575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:52 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:52.490410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:52.491477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:52.499016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.501451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.502482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.503509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.504203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.504925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.574136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.586898 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f3eba3c-06ab-415d-b093-7a0fdb9837ae tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1323 microversion: 2.1 time: 0.243580 Nov 02 12:21:52.603351 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 296/576] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:52 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1323 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:52.717234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.726265 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11654d76-b7bf-4b73-a0bf-353e5ede3684 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1388 microversion: 2.1 time: 0.240659 Nov 02 12:21:52.734150 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 281/577] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:52 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1388 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:52.822660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:52.823742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:52.830604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.831900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.832505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.833641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.834388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.835072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.840373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:52.912738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:52.915206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:52.938428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.939104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.940784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.941925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.942461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.944869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.068952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.085217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.087973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.090678 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb8463b7-7a24-4ee2-be6d-4880daf23f46 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1362 microversion: 2.25 time: 0.274598 Nov 02 12:21:53.108097 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 297/578] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:52 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:53.118978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0c7e149f-e0ec-4133-a891-0774353a4f5d req-63e70ebd-b98c-4f9f-8b5c-771ff1de48ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ced03fd-249c-44d2-b1a4-3ba8e35d0517", "name": "network-vif-plugged", "status": "completed", "tag": "0a958d25-bdeb-4308-99ed-c7560ed66729"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:53.133295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0c7e149f-e0ec-4133-a891-0774353a4f5d req-63e70ebd-b98c-4f9f-8b5c-771ff1de48ff service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.133894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0c7e149f-e0ec-4133-a891-0774353a4f5d req-63e70ebd-b98c-4f9f-8b5c-771ff1de48ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.134411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0c7e149f-e0ec-4133-a891-0774353a4f5d req-63e70ebd-b98c-4f9f-8b5c-771ff1de48ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.152096 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0c7e149f-e0ec-4133-a891-0774353a4f5d req-63e70ebd-b98c-4f9f-8b5c-771ff1de48ff service nova] Creating event network-vif-plugged:0a958d25-bdeb-4308-99ed-c7560ed66729 for instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 on n-h1-855650-5 Nov 02 12:21:53.158422 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0c7e149f-e0ec-4133-a891-0774353a4f5d req-63e70ebd-b98c-4f9f-8b5c-771ff1de48ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048253 Nov 02 12:21:53.159603 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 298/579] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:53.173876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.183632 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9d61ed3-3a27-40a3-806e-e19d90644edc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.300787 Nov 02 12:21:53.184351 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 282/580] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:52 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:53.241148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:53.241894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:53.248323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.248798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.249234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.249929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.250403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.250819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.325365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:53.326495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:53.345269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.346294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.346742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.347529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.348004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.348438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.438278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.448761 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-706490d9-a98e-4b38-89b0-08a46503b272 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.211756 Nov 02 12:21:53.449842 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 299/581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:53 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:53.513451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:53.514504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:53.519296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.527820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.528503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.529790 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-019c23e4-bcbe-4da5-9dfd-18e899c3ac3f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.208904 Nov 02 12:21:53.530467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.531101 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 283/582] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:53 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:53.531276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.531803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.532245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.612873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:53.613762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:53.621040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.621832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.622523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.623437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.623901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.624327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.751727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.768662 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a84ba876-6160-4ac8-92a4-78824f3f9b60 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.261284 Nov 02 12:21:53.769539 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 300/583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:53 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:53.794960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1d26aeae-6300-47d2-ab58-a16d5295aa9a req-2f6d125b-05d1-424b-bab9-c78052e8784b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60569df-ffab-45d8-9b9b-c29f4c2a3cf3", "tag": "e8a5cb11-e922-4e31-83a6-5244ac066053"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:53.815730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1d26aeae-6300-47d2-ab58-a16d5295aa9a req-2f6d125b-05d1-424b-bab9-c78052e8784b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.816262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1d26aeae-6300-47d2-ab58-a16d5295aa9a req-2f6d125b-05d1-424b-bab9-c78052e8784b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.816639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1d26aeae-6300-47d2-ab58-a16d5295aa9a req-2f6d125b-05d1-424b-bab9-c78052e8784b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.845675 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1d26aeae-6300-47d2-ab58-a16d5295aa9a req-2f6d125b-05d1-424b-bab9-c78052e8784b service nova] Creating event network-changed:e8a5cb11-e922-4e31-83a6-5244ac066053 for instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 on n-h2-855650-5 Nov 02 12:21:53.863473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.863715 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1d26aeae-6300-47d2-ab58-a16d5295aa9a req-2f6d125b-05d1-424b-bab9-c78052e8784b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093122 Nov 02 12:21:53.866413 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 301/584] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:53.873580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:53.874293 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da2be662-1c2a-444f-a1f7-e845963a0e5f tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1323 microversion: 2.1 time: 0.265308 Nov 02 12:21:53.874452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:53.874939 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 284/585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:53 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1323 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:53.883703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.884301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.884818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.885709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.886336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.886847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.123526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:54.124210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:54.142560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.143153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.143663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.144465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.144990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.146041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.162231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.177796 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-44b2a0d9-fb98-4618-8ef7-669d57a61a72 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1587 microversion: 2.1 time: 0.308800 Nov 02 12:21:54.179507 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 302/586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:53 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1587 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:54.212305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:54.215107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:54.231283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.232269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.232909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.234034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.234769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.235378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.402851 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0aabf205-243c-4bc0-8f3b-68810da3da0e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196888 Nov 02 12:21:54.403611 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 303/587] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:21:54 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:54.410587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:54.412116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:54.421182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.422020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.422677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.423651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.424324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.424977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.716530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.731171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.733125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.735246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7299d59-3de4-474d-9ef6-bc6d43e9c8a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1362 microversion: 2.25 time: 0.616097 Nov 02 12:21:54.735968 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 285/588] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:54 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1362 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:54.746053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:54.748594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:54.761934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.763218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.764026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.765382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.766550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.768145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.931853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.943273 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1dedb704-d34b-4d22-b85c-f056e9bf534e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.537930 Nov 02 12:21:54.964866 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 304/589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:54 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:54.983978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:54.984198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:55.003371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.004127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.005568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.009471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.011744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.014827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.142602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:55.188659 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d915b15-a140-4eeb-abe7-ccedecca7148 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.449153 Nov 02 12:21:55.191383 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 286/590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:54 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:55.213030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:55.216857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:55.232805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.235399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.237011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.240289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.241491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.242954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.314595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:55.369944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:55.919092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:55.941298 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b9db864-0f28-4664-a317-7964c697d39c tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.968452 Nov 02 12:21:55.944167 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 305/591] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:54 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:55.951474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:55.953671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:55.962291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.963213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.963888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.964627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.967110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.967110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.125554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.135377 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f58eaf2c-24fc-4052-aa57-fdd2a0d084e2 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.939066 Nov 02 12:21:56.136214 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 287/592] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:55 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:56.143686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f9bb6f94-a303-44d1-88db-22da0cad636d req-ef903233-91d4-44f4-a657-21642cd3e0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd378caa-481b-4ea2-a97e-e9c76bac12a5", "name": "network-vif-plugged", "status": "completed", "tag": "213d0dd7-7c6f-44fc-bc8e-5a3ad3a2a9f9"}, {"server_uuid": "54d8ccfc-5664-420a-bf9d-841e82aa1ab1", "name": "network-vif-plugged", "status": "completed", "tag": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:56.161073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9bb6f94-a303-44d1-88db-22da0cad636d req-ef903233-91d4-44f4-a657-21642cd3e0bc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.161985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9bb6f94-a303-44d1-88db-22da0cad636d req-ef903233-91d4-44f4-a657-21642cd3e0bc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.162664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9bb6f94-a303-44d1-88db-22da0cad636d req-ef903233-91d4-44f4-a657-21642cd3e0bc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.178539 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f9bb6f94-a303-44d1-88db-22da0cad636d req-ef903233-91d4-44f4-a657-21642cd3e0bc service nova] Creating event network-vif-plugged:213d0dd7-7c6f-44fc-bc8e-5a3ad3a2a9f9 for instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 on n-h2-855650-5 Nov 02 12:21:56.179333 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f9bb6f94-a303-44d1-88db-22da0cad636d req-ef903233-91d4-44f4-a657-21642cd3e0bc service nova] Creating event network-vif-plugged:3dd63f67-75a2-455b-ae9d-2766c6a3eedf for instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 on n-h1-855650-5 Nov 02 12:21:56.188681 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f9bb6f94-a303-44d1-88db-22da0cad636d req-ef903233-91d4-44f4-a657-21642cd3e0bc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050871 Nov 02 12:21:56.189921 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 288/593] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:56.196109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:56.197178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:56.205878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.206735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.207496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.209167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.209868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.210712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.342139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.356188 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a1634859-0f07-4751-988a-f801882d262c tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1323 microversion: 2.1 time: 0.409669 Nov 02 12:21:56.372370 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 306/594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:55 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1323 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:56.372370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7396fc6c-1042-4eea-9d59-6544a46344ff req-1bc23e15-a1fc-486b-9382-29298ca2a1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9", "name": "network-vif-unplugged", "status": "completed", "tag": "8dcc914c-ba8a-4857-ace9-4305134a0d30"}, {"name": "network-changed", "server_uuid": "f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9", "tag": "8dcc914c-ba8a-4857-ace9-4305134a0d30"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:56.384464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7396fc6c-1042-4eea-9d59-6544a46344ff req-1bc23e15-a1fc-486b-9382-29298ca2a1e6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.385199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7396fc6c-1042-4eea-9d59-6544a46344ff req-1bc23e15-a1fc-486b-9382-29298ca2a1e6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.385722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7396fc6c-1042-4eea-9d59-6544a46344ff req-1bc23e15-a1fc-486b-9382-29298ca2a1e6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.400420 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7396fc6c-1042-4eea-9d59-6544a46344ff req-1bc23e15-a1fc-486b-9382-29298ca2a1e6 service nova] Creating event network-vif-unplugged:8dcc914c-ba8a-4857-ace9-4305134a0d30 for instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 on n-h1-855650-5 Nov 02 12:21:56.401108 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7396fc6c-1042-4eea-9d59-6544a46344ff req-1bc23e15-a1fc-486b-9382-29298ca2a1e6 service nova] Creating event network-changed:8dcc914c-ba8a-4857-ace9-4305134a0d30 for instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 on n-h1-855650-5 Nov 02 12:21:56.407874 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7396fc6c-1042-4eea-9d59-6544a46344ff req-1bc23e15-a1fc-486b-9382-29298ca2a1e6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.048684 Nov 02 12:21:56.409577 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 307/595] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:56.416248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:56.416953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:56.425472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.426492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.427282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.428386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.429070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.429841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.586426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.594880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.596694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.597822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e4adf8c-0546-4b94-880e-83be9931dd13 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1362 microversion: 2.25 time: 0.406332 Nov 02 12:21:56.610717 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 289/596] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:56 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:56.610717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:56.610717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:56.614054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.615840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.617147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.618820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.619291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.619789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.708935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.722529 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-efba4e37-e2ce-434c-bed5-1963002fa3c4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1318 microversion: 2.1 time: 0.311698 Nov 02 12:21:56.734299 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 308/597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:56 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:56.845374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.854371 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46982fe1-92c7-4e8a-b300-68f42af05b7d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.254044 Nov 02 12:21:56.855314 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 290/598] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:56 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:56.965780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:56.967099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:56.977658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.978196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.978648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.979370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.981215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.982344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.166235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:57.166969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:57.186596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.187171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.187646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.188582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.189521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.190224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.201589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:57.251646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:57.269318 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93a10540-ef35-4803-97f7-1144e4e058c7 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.307328 Nov 02 12:21:57.273309 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 309/599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:56 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:57.289654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:57.291028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:57.306088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.307331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.308446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.309906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.310416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.310865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.399272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:57.409100 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0bb752ac-302d-45ed-9728-3b712d903700 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.247814 Nov 02 12:21:57.410215 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 291/600] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:57 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:57.415905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f7aca322-d10a-498d-abc8-86d6ddcdca63 req-ff31e8ec-7e13-4074-828a-f0aa357fb28b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa17e49-fd4f-4121-932a-3d8aad79bab1", "tag": "be3b893e-ad60-40bd-98b3-160fdc19a1fe"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:57.429170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f7aca322-d10a-498d-abc8-86d6ddcdca63 req-ff31e8ec-7e13-4074-828a-f0aa357fb28b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.430276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f7aca322-d10a-498d-abc8-86d6ddcdca63 req-ff31e8ec-7e13-4074-828a-f0aa357fb28b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.430929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f7aca322-d10a-498d-abc8-86d6ddcdca63 req-ff31e8ec-7e13-4074-828a-f0aa357fb28b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.444748 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f7aca322-d10a-498d-abc8-86d6ddcdca63 req-ff31e8ec-7e13-4074-828a-f0aa357fb28b service nova] Creating event network-changed:be3b893e-ad60-40bd-98b3-160fdc19a1fe for instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 on n-h2-855650-5 Nov 02 12:21:57.452806 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f7aca322-d10a-498d-abc8-86d6ddcdca63 req-ff31e8ec-7e13-4074-828a-f0aa357fb28b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039347 Nov 02 12:21:57.453689 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 292/601] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:57.485269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:57.498825 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eeab1d9f-80f6-4abb-b2ea-2ae931d24b9c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 200 len: 1587 microversion: 2.1 time: 0.222839 Nov 02 12:21:57.499329 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 310/602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:57 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 1587 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:57.504432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:57.505729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:57.512447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.512945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.513586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.514402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.514896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.515327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.613574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1444398082", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:57.670638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:57.677316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:57.687954 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-51e193ec-f2d8-41bf-bd5d-f466353684f9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1323 microversion: 2.1 time: 0.187137 Nov 02 12:21:57.688789 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 311/603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:57 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:57.708218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:57.708941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:57.715925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.716737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.717377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.718594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.719251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.720642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.269706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:58.280688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:58.282692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:58.284596 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e4f53d3-98fb-4c2c-a5d3-739c9b13f06e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1362 microversion: 2.25 time: 0.594377 Nov 02 12:21:58.291553 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 312/604] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:57 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:58.291767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:58.291767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:58.291767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:58.291767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:58.291767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:58.292583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:58.292583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:58.299139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:58.300278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:58.300875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.302069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:58.302301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:58.302915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:58.303156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:58.303354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.303612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.304384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:58.305562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:58.306151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.329587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Getting quotas for project 0018d1abb96f47d78acb47c69ffd5348. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:58.336906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Getting quotas for user 592a24a9aa8c4229a3829ace625e3238 and project 0018d1abb96f47d78acb47c69ffd5348. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:58.354638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:58.357993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:58.462694 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26ef7d8f-948f-4ef5-83c0-fe0419491c8b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005778 Nov 02 12:21:58.464507 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 293/605] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:58.474176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:58.474804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:58.494967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:58.495467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:58.496281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.497177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:58.497797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:58.498410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.949128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:58.977688 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6d49d2e-c789-402e-b592-12641bf7957e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.510337 Nov 02 12:21:58.978763 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 294/606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:58 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:58.995767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:58.998846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:59.000842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:59.015053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.016897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.017484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.021653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.022190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.023097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.024214 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e13d923-d221-499c-808b-f9c59e0a2682 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1467 microversion: 2.1 time: 0.737294 Nov 02 12:21:59.033758 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 313/607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:58 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1467 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:59.039036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:59.048321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:59.058222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.061814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.063112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.064020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.066545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.066981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.261651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:59.269790 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53719817-ee98-45cc-9a02-39f2eb53e2dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.289514 Nov 02 12:21:59.271393 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 295/608] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:58 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:59.277154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-27bed842-60dc-4f4f-82ba-a5868830c106 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:59.278036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-27bed842-60dc-4f4f-82ba-a5868830c106 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:59.307298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:59.319049 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea1b00e7-b617-4a8e-bbe1-ee10bdc7646c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.283686 Nov 02 12:21:59.320922 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 314/609] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:59 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:59.327771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:59.328687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:59.336386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.337322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.338108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.339219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.340105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.341188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.365938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-27bed842-60dc-4f4f-82ba-a5868830c106 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:59.374986 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-27bed842-60dc-4f4f-82ba-a5868830c106 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1217 microversion: 2.1 time: 0.102076 Nov 02 12:21:59.390560 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 296/610] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:59 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:59.398761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-94f444ba-9560-46b8-b66a-80c950d4e1ce req-b27b483d-4cf7-4acd-84ff-6e1621958ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb59ac2b-fb2c-4690-9a9e-9cb56f78155a", "name": "network-vif-plugged", "status": "completed", "tag": "a4f98e06-82ae-4a12-b885-9551951ad05a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:59.413823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-94f444ba-9560-46b8-b66a-80c950d4e1ce req-b27b483d-4cf7-4acd-84ff-6e1621958ffc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.414564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-94f444ba-9560-46b8-b66a-80c950d4e1ce req-b27b483d-4cf7-4acd-84ff-6e1621958ffc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.415023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-94f444ba-9560-46b8-b66a-80c950d4e1ce req-b27b483d-4cf7-4acd-84ff-6e1621958ffc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.431975 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-94f444ba-9560-46b8-b66a-80c950d4e1ce req-b27b483d-4cf7-4acd-84ff-6e1621958ffc service nova] Creating event network-vif-plugged:a4f98e06-82ae-4a12-b885-9551951ad05a for instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a on n-h1-855650-5 Nov 02 12:21:59.437095 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-94f444ba-9560-46b8-b66a-80c950d4e1ce req-b27b483d-4cf7-4acd-84ff-6e1621958ffc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044709 Nov 02 12:21:59.437725 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 297/611] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:59.602988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:59.628764 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dc631b97-d919-4dfc-8d77-1a30a6e5b473 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1518 microversion: 2.1 time: 0.306514 Nov 02 12:21:59.629040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2077371293", "block_migration": true, "disk_over_commit": false}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:59.630018 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 315/612] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:59 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1518 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:59.635096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:59.641656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:59.644125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:59.651438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.652819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.653447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.653959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.654377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.654504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.655210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.656114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.656114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.656664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.657824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.658494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.662964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:59.692584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lazy-loading 'flavor' on Instance uuid 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:59.707620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Going to try to live migrate instance to tempest-host-2077371293 {{(pid=120722) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:21:59.718410 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] HTTP exception thrown: Compute host tempest-host-2077371293 could not be found. Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Request method failure captured: Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517/action HTTP/1.1 Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 107 Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDAMJ9mgQbbFFpF5h2cTqxIA8oqgzLIN5PqkdlLuTl0eAHms0le6g4Ki5D0htB4cydNX0m-zrbnV96E3FCBXrm09RxnEDAZaCN9fhTmOnrWJSEKR75XkhhKLOpexqQEwvCPfTdgOs3ajCUCsE0rwR9Udv-9sRYawSHD3FeYHz4mzmE Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d0d72316e75f4668bb30e957204bbb34 Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-LiveMigrationNegativeTest-1495823185 Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:21:59.723065 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0d72316e75f4668bb30e957204bbb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d0d72316e75f4668bb30e957204bbb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0d72316e75f4668bb30e957204bbb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d0d72316e75f4668bb30e957204bbb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-LiveMigrationNegativeTest-1495823185 Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d0d72316e75f4668bb30e957204bbb34 Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1495823185 Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-LiveMigrationNegativeTest-1495823185-project-admin Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: bb5d92bc8fe24e0abe931c591bdd7f97 Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-LiveMigrationNegativeTest-1495823185-project-admin Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: {"os-migrateLive": {"host": "tempest-host-2077371293", "block_migration": true, "disk_over_commit": false}} Nov 02 12:21:59.725634 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: exception: Compute host tempest-host-2077371293 could not be found. Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2ced03fd-249c-44d2-b1a4-3ba8e35d0517', 'body': {'os-migrateLive': {'host': 'tempest-host-2077371293', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:21:59.727521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2077371293 could not be found. Nov 02 12:21:59.730283 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2077371293 could not be found. Nov 02 12:21:59.732826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2077371293 could not be found. Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Returning 400 to user: Compute host tempest-host-2077371293 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-09079202-3e2d-4217-a7ae-9988c0ca6a96 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517/action" status: 400 len: 100 microversion: 2.1 time: 0.286096 Nov 02 12:21:59.736816 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 298/613] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Nov 2 12:21:59 2022] POST /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517/action => generated 100 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:21:59.738413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-87d8bc5e-8f8b-4d2f-8597-dc0cddf5655e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'create', calling method: .version_select at 0x7f228eb35af0>, body: {"pool": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:00.029470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.039500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.040971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.042135 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-68515a83-0e1c-4bad-bdec-6cd91fac4249 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1362 microversion: 2.25 time: 0.405436 Nov 02 12:22:00.043324 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 316/614] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:59 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:00.050602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:00.051278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:00.057936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.058645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.059249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.060145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.060887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.061325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.323974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.338751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7de6e210-e506-44c2-a16f-2eb66b597717 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1467 microversion: 2.1 time: 0.293815 Nov 02 12:22:00.339603 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 317/615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:00 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1467 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:00.350785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:00.351962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:00.363956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.364866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.365645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.366955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.367896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.368693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.646551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.655254 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a1717b7-1cc1-471b-9912-c156a7074036 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.311617 Nov 02 12:22:00.655849 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 318/616] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:00 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:00.660825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:00.661436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:00.667595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.668359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.668473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.669174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.669826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.670092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.898596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.907029 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3bcfeddb-1082-4ae7-858c-c1fd9b226cbd tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1314 microversion: 2.1 time: 0.250043 Nov 02 12:22:00.907877 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 319/617] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:00 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:00.913749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:00.914658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:00.921976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.922510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.923204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.923993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.924521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.925370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:01.259890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:01.278153 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60deeb84-72f6-4c20-8b4b-dc8f47be22ac tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.367646 Nov 02 12:22:01.279545 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 320/618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:00 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:01.287919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:01.290938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:01.300207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:01.300871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:01.301411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:01.302854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:01.303593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:01.304141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:01.411598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:01.425903 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-77c47617-cebc-46f5-ba61-987d17cbb996 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1213 microversion: 2.1 time: 0.145052 Nov 02 12:22:01.439867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 321/619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:01 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:01.456084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1907047243", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:01.499085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:01.598651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:22:01.782978 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-87d8bc5e-8f8b-4d2f-8597-dc0cddf5655e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.054985 Nov 02 12:22:01.798659 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 299/620] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:21:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:01.813520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:01.814701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:01.821636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:01.822474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:01.823102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:01.824871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:01.825615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:01.826272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.023210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:22:02.024217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:22:02.025109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:22:02.026616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:22:02.028029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:22:02.041841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.042654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.043126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.043980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.044837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.044974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.055430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:02.064643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:02.066168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:02.067387 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5c240c6f-16bf-4935-9b54-557cbfa156a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1559 microversion: 2.25 time: 0.266857 Nov 02 12:22:02.067959 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 300/621] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:01 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1559 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:02.073028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:02.073642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:02.080533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.081301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.081745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.082682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.083781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.084459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.089578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Getting quotas for project 7999252f99d945058b53b83a4aa23fb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:02.098689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Getting quotas for user a5d7acebd00d425d98eeb19124a5722d and project 7999252f99d945058b53b83a4aa23fb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:02.116091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:22:02.118716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:22:02.175411 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c264ad21-27b4-4e4a-9ab9-8058efcc63cb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735015 Nov 02 12:22:02.183783 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 322/622] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:22:02.189054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:02.189691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:02.198506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.199050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.214544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.215888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.216298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.216736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.324259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:02.337083 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2364d705-88c9-4233-be42-4802b6e11e49 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.267643 Nov 02 12:22:02.338836 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 301/623] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:02 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:02.344574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-683221343", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:02.432573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:02.446432 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c06cc9a-93a2-4069-9e9d-ca98665f55b9 tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1464 microversion: 2.1 time: 0.261425 Nov 02 12:22:02.448104 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 323/624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:02 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:02.458886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:02.459660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:02.460279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] validate_networks() for [('bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:22:02.477485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.481045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.482554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.484934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.485430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.485867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.013466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid eb59ac2b-fb2c-4690-9a9e-9cb56f78155a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:03.032573 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b2fc1df-3246-4e85-b655-23f83c8dc1a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 2052 microversion: 2.25 time: 0.582743 Nov 02 12:22:03.033601 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 324/625] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:02 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 2052 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:03.038684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:03.039296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:03.046351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.046935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.047381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.048091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.048553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.048967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.159826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:03.171311 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-34a3c69b-5e2c-4553-8b82-77bd8333a792 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1215 microversion: 2.1 time: 0.136822 Nov 02 12:22:03.172926 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 325/626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:03 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:03.179020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:03.179975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:03.191894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.192390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.193401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.194136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.194770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.195356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.575903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:03.592093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:22:03.593203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:22:03.594175 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4509a95c-805c-4dd4-b197-eb635ba44d6e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.419604 Nov 02 12:22:03.594832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:22:03.595681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:22:03.599956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:22:03.607164 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 326/627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:03 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:03.638848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.641601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:03.642494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.642766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:03.647137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.648067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.648552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.649075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.658512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.659842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.661181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.663637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.664896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.665890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.670608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Getting quotas for project 82dbd88241604726a6c21297724cf95d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:03.676642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Getting quotas for user c9fc9d8509544dcb8df90bdf49c60df6 and project 82dbd88241604726a6c21297724cf95d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:03.691531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:22:03.694691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:22:03.756939 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e6d22cc-1a34-499c-801b-3a40e76d46e9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416581 Nov 02 12:22:03.757793 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 302/628] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:22:03.791147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:03.801028 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fcdcc343-bac1-4fd5-9ee3-fadbdb7c6454 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1275 microversion: 2.1 time: 0.192028 Nov 02 12:22:03.802464 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 327/629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:03 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:03.807343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:03.808084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:03.814236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.814715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.815187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.815899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.816357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.816801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.048959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-032787f6-b08f-48da-bdce-270ee282c4b0 tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Calling method '.version_select at 0x7f228ebfa280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.119658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-032787f6-b08f-48da-bdce-270ee282c4b0 tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.120413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-032787f6-b08f-48da-bdce-270ee282c4b0 tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.120811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-032787f6-b08f-48da-bdce-270ee282c4b0 tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.149501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-032787f6-b08f-48da-bdce-270ee282c4b0 tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.150371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-032787f6-b08f-48da-bdce-270ee282c4b0 tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.151012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-032787f6-b08f-48da-bdce-270ee282c4b0 tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.178423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-032787f6-b08f-48da-bdce-270ee282c4b0 tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage/a2f902d5297e461c86c49431e4ed2414?start=2022-11-01T12%3A22%3A02.468497&end=2022-11-03T12%3A22%3A02.468497" status: 200 len: 695 microversion: 2.1 time: 0.417964 Nov 02 12:22:04.179496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 303/630] 10.222.0.45 () {58 vars in 1412 bytes} [Wed Nov 2 12:22:03 2022] GET /compute/v2.1/os-simple-tenant-usage/a2f902d5297e461c86c49431e4ed2414?start=2022-11-01T12%3A22%3A02.468497&end=2022-11-03T12%3A22%3A02.468497 => generated 695 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:04.183751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid eb59ac2b-fb2c-4690-9a9e-9cb56f78155a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:04.202593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.204543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:04.214941 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9c751570-3cd8-4a35-83c9-545c379fd31e tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 2052 microversion: 2.25 time: 0.410114 Nov 02 12:22:04.227872 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 328/631] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:03 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 2052 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:04.228512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.229282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.230032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.231006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.232027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.232697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.251158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-77780860-f46c-4751-b07c-95f4aeb4d7af tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.252102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-77780860-f46c-4751-b07c-95f4aeb4d7af tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:04.358135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-77780860-f46c-4751-b07c-95f4aeb4d7af tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:04.371192 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-77780860-f46c-4751-b07c-95f4aeb4d7af tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1223 microversion: 2.1 time: 0.130329 Nov 02 12:22:04.387648 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 329/632] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1223 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:04.392898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.393514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:04.400413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.400879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.401375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.402121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.402573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.403005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.510461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:04.522128 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e9b6dd2c-a7b9-4a27-a64f-d50c1ae54ec9 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1277 microversion: 2.1 time: 0.132149 Nov 02 12:22:04.523950 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 330/633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:04.529594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe30f322-fb0c-4723-a3a1-237e36c6b9dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '.version_select at 0x7f228eec4ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.542227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe30f322-fb0c-4723-a3a1-237e36c6b9dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.543152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe30f322-fb0c-4723-a3a1-237e36c6b9dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.543880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe30f322-fb0c-4723-a3a1-237e36c6b9dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.567334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe30f322-fb0c-4723-a3a1-237e36c6b9dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.568336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe30f322-fb0c-4723-a3a1-237e36c6b9dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.569017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe30f322-fb0c-4723-a3a1-237e36c6b9dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.592356 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe30f322-fb0c-4723-a3a1-237e36c6b9dc tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage/a2f902d5297e461c86c49431e4ed2414?start=2022-11-01T12%3A22%3A02.468497&end=2022-11-03T12%3A22%3A02.468497" status: 200 len: 695 microversion: 2.1 time: 0.066800 Nov 02 12:22:04.600414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:04.606040 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 331/634] 10.222.0.45 () {58 vars in 1412 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/os-simple-tenant-usage/a2f902d5297e461c86c49431e4ed2414?start=2022-11-01T12%3A22%3A02.468497&end=2022-11-03T12%3A22%3A02.468497 => generated 695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:04.611408 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7c647f5-8474-4f2e-b3d6-63a90e30e047 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.429933 Nov 02 12:22:04.611967 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 304/635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:04.612200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-deb81e66-6c45-44c0-ba6c-a582829b17c8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.616613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb81e66-6c45-44c0-ba6c-a582829b17c8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.617347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb81e66-6c45-44c0-ba6c-a582829b17c8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.618025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb81e66-6c45-44c0-ba6c-a582829b17c8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.619044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb81e66-6c45-44c0-ba6c-a582829b17c8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.619718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb81e66-6c45-44c0-ba6c-a582829b17c8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.620334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb81e66-6c45-44c0-ba6c-a582829b17c8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.621342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4bda22a6-7eeb-4c65-bc32-992b9a21e0fe tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Calling method '.version_select at 0x7f228ed62700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.637655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bda22a6-7eeb-4c65-bc32-992b9a21e0fe tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.638194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bda22a6-7eeb-4c65-bc32-992b9a21e0fe tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.638642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bda22a6-7eeb-4c65-bc32-992b9a21e0fe tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.657596 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-deb81e66-6c45-44c0-ba6c-a582829b17c8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049981 Nov 02 12:22:04.657817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bda22a6-7eeb-4c65-bc32-992b9a21e0fe tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.658408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bda22a6-7eeb-4c65-bc32-992b9a21e0fe tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.658854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bda22a6-7eeb-4c65-bc32-992b9a21e0fe tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.666683 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 332/636] 10.222.0.45 () {60 vars in 1217 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:04.674481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.675499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:04.682168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.683018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.683652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.684598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.685254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.685889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.710190 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4bda22a6-7eeb-4c65-bc32-992b9a21e0fe tempest-TenantUsagesTestJSON-2048764214 tempest-TenantUsagesTestJSON-2048764214-project-admin] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A22%3A02.468497&end=2022-11-03T12%3A22%3A02.468497&detailed=1" status: 200 len: 7741 microversion: 2.1 time: 0.095802 Nov 02 12:22:04.711522 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 305/637] 10.222.0.45 () {58 vars in 1335 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A22%3A02.468497&end=2022-11-03T12%3A22%3A02.468497&detailed=1 => generated 7741 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:04.720779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:04.721923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:04.734691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.736822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.737609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.738663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.739412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.741320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.894158 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4c1bb726-b18e-4b61-8a12-b39f50d98ea2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a/action" status: 202 len: 0 microversion: 2.25 time: 0.180625 Nov 02 12:22:04.894820 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 306/638] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:22:04 2022] POST /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:04.911032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.912214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:04.938841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.942037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.942524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.943316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.943826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.944264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.989098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:22:05.033787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:05.054263 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-35ed4448-443f-4925-bd56-6941a55b8e9f tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.381681 Nov 02 12:22:05.071427 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 333/639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:05.077856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:05.078654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:05.086831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.087586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.088161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.088991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.089571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.090258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.185051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:05.193791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0bbdcbf-dc82-4d8e-b711-c314dcb1ac4f tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 204 len: 0 microversion: 2.1 time: 0.293054 Nov 02 12:22:05.193791 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 307/640] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:22:04 2022] DELETE /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:05.211621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:05.212837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:05.235028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.235541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.235987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.236761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.237275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.237703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.460522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:05.469229 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-716e60b9-f7e8-4de9-84d9-821b533a5f42 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1317 microversion: 2.1 time: 0.396519 Nov 02 12:22:05.486340 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 334/641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:05 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:05.491615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-2dee52e0-4003-401c-9e5a-9fdf6f5180a8 req-3ffb9665-43ab-41c3-be12-111aafee51d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60569df-ffab-45d8-9b9b-c29f4c2a3cf3", "name": "network-vif-plugged", "status": "completed", "tag": "e8a5cb11-e922-4e31-83a6-5244ac066053"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:05.502111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2dee52e0-4003-401c-9e5a-9fdf6f5180a8 req-3ffb9665-43ab-41c3-be12-111aafee51d9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.502849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2dee52e0-4003-401c-9e5a-9fdf6f5180a8 req-3ffb9665-43ab-41c3-be12-111aafee51d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.503496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2dee52e0-4003-401c-9e5a-9fdf6f5180a8 req-3ffb9665-43ab-41c3-be12-111aafee51d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.509266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:05.519044 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-2dee52e0-4003-401c-9e5a-9fdf6f5180a8 req-3ffb9665-43ab-41c3-be12-111aafee51d9 service nova] Creating event network-vif-plugged:e8a5cb11-e922-4e31-83a6-5244ac066053 for instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 on n-h2-855650-5 Nov 02 12:22:05.525718 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-2dee52e0-4003-401c-9e5a-9fdf6f5180a8 req-3ffb9665-43ab-41c3-be12-111aafee51d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Nov 02 12:22:05.527154 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 335/642] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:05.533125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:05.534453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:05.543166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.544081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.544737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.547036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.547759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid eb59ac2b-fb2c-4690-9a9e-9cb56f78155a {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:05.548092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.549487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.572775 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6a134f45-f279-4690-b966-a9cec207c6ba tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 2037 microversion: 2.25 time: 0.374092 Nov 02 12:22:05.585997 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 308/643] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:05 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 2037 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:05.585997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:05.585997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:05.606437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.607198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.607359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.608180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.608647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.609078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.755815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:05.766511 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-623ea37c-9221-4866-8e90-939fe66365ab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1275 microversion: 2.1 time: 0.191674 Nov 02 12:22:05.772321 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 309/644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:05 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:05.788432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:05.789650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:05.797279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.797934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.799498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.800500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.801083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.801905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.835732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:05.865532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:05.877098 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf6b5d52-877b-4c19-aeb8-c64033e6c3ae tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1470 microversion: 2.1 time: 0.348222 Nov 02 12:22:05.890024 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 336/645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:05 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1470 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:05.890024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855650-5", "block_migration": "auto"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:05.890024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:05.897856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.898857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.899451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.900302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:05.900862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:05.901393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:05.941050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'flavor' on Instance uuid eb59ac2b-fb2c-4690-9a9e-9cb56f78155a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:05.956738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Going to try to live migrate instance to n-h2-855650-5 {{(pid=120723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:22:06.157566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:06.168529 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca32178e-1c30-4a5a-8fd2-8cdc5ecfb6da tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.392464 Nov 02 12:22:06.169157 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 310/646] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:05 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:06.184929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:06.185814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:06.193413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:06.194020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:06.194501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:06.195242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:06.195950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:06.196398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:06.437903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:06.452559 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-74c79855-edd3-4e56-bd86-186d5e00a983 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.282235 Nov 02 12:22:06.453171 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 311/647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:06 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:06.477112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:06.477740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:06.498291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:06.498973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:06.499278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:06.499989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:06.500448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:06.500878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:06.826834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:06.856072 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30d6bced-9fe2-4d66-8ca2-e529b363339c tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.388574 Nov 02 12:22:06.876042 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 312/648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:06 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:06.884069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:06.886551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:06.901940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:06.902925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:06.903588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:06.904558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:06.905097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:06.905603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.143458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:07.151682 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99b808a7-9fae-4fa2-8d16-c8ba490489cc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1317 microversion: 2.1 time: 0.274085 Nov 02 12:22:07.152427 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 313/649] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:06 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:07.157142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d2b903ac-5e9b-4695-8c8f-ec975811cfc2 req-84dcd9cb-7772-4f8b-8a58-9280f87a0ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13c5d8d-ba99-4f40-a4a2-d7d5d463a237", "tag": "da686012-05f8-4fdf-b251-5cd7e4d3b039"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:07.170329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2b903ac-5e9b-4695-8c8f-ec975811cfc2 req-84dcd9cb-7772-4f8b-8a58-9280f87a0ffa service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.170969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2b903ac-5e9b-4695-8c8f-ec975811cfc2 req-84dcd9cb-7772-4f8b-8a58-9280f87a0ffa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.179082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2b903ac-5e9b-4695-8c8f-ec975811cfc2 req-84dcd9cb-7772-4f8b-8a58-9280f87a0ffa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.205409 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d2b903ac-5e9b-4695-8c8f-ec975811cfc2 req-84dcd9cb-7772-4f8b-8a58-9280f87a0ffa service nova] Creating event network-changed:da686012-05f8-4fdf-b251-5cd7e4d3b039 for instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 on n-h1-855650-5 Nov 02 12:22:07.211291 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d2b903ac-5e9b-4695-8c8f-ec975811cfc2 req-84dcd9cb-7772-4f8b-8a58-9280f87a0ffa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057480 Nov 02 12:22:07.212256 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 314/650] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:07.217575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:07.218376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:07.226944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.227513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.228515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.229226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.229699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.230622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.313422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:07.322756 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d772a183-3c9c-43ea-b8f4-d84ea6cddcc9 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1275 microversion: 2.1 time: 0.109110 Nov 02 12:22:07.323278 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 315/651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:07 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:07.328676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:07.329376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:07.342199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.342657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.343144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.343880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.344399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.344850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.502543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:07.512051 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-41597950-1d95-4c0c-b617-13462bd491bb tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1470 microversion: 2.1 time: 0.187486 Nov 02 12:22:07.512671 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 316/652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:07 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:07.518057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:07.518995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:07.536048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.536809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.537540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.538397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.538964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.539499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.684447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:07.692677 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e0a9648-4d8d-46e2-8a3d-7495452cdeab tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.178946 Nov 02 12:22:07.693819 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 317/653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:07 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:07.698667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-b208d573-47ca-4998-a972-932588a7b6e7 req-1dbc5422-9407-42e0-850d-f2c080bc633d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d1cacf-fba6-4284-8771-3ece6797fa31", "tag": "a6889f29-1d1f-4865-99a7-33924dd0d866"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:07.708997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b208d573-47ca-4998-a972-932588a7b6e7 req-1dbc5422-9407-42e0-850d-f2c080bc633d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.709206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b208d573-47ca-4998-a972-932588a7b6e7 req-1dbc5422-9407-42e0-850d-f2c080bc633d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.709576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b208d573-47ca-4998-a972-932588a7b6e7 req-1dbc5422-9407-42e0-850d-f2c080bc633d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.722013 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-b208d573-47ca-4998-a972-932588a7b6e7 req-1dbc5422-9407-42e0-850d-f2c080bc633d service nova] Creating event network-changed:a6889f29-1d1f-4865-99a7-33924dd0d866 for instance e6d1cacf-fba6-4284-8771-3ece6797fa31 on n-h1-855650-5 Nov 02 12:22:07.727956 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-b208d573-47ca-4998-a972-932588a7b6e7 req-1dbc5422-9407-42e0-850d-f2c080bc633d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032684 Nov 02 12:22:07.728697 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 318/654] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:07.734559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:07.735346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:07.742318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.742822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.743394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.744732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.745204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.745642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.887477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:07.896026 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-28ed44e1-9c99-4f76-bab1-528dea2f2c02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.165897 Nov 02 12:22:07.896634 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 319/655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:07 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:07.901482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:07.902128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:07.909205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.910619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.911074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.912285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.912742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.913169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.067873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:08.076166 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e55f4c1e-622f-4386-96c4-707082537c6d tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.178447 Nov 02 12:22:08.082298 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 320/656] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:07 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:08.175663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:08.177355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:08.189214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.190431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.191184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.192441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.193293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.194050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.369113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:08.376930 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da34174f-fb0f-42d7-a251-ec97d00a83af tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1317 microversion: 2.1 time: 0.205257 Nov 02 12:22:08.377492 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 321/657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:08 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:08.381949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:08.382573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:08.388409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.388895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.389327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.390034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.390490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.390908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.453587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:08.462085 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f2a31c0-87ab-4fdd-8493-f7e8e2f4965a tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1275 microversion: 2.1 time: 0.083535 Nov 02 12:22:08.462664 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 322/658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:08 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:08.535668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:08.536285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:08.542503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.543024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.543516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.544136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.544585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.545014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.577827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.578346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.578785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.579236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lazy-loading 'fault' on Instance uuid fd378caa-481b-4ea2-a97e-e9c76bac12a5 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:08.620462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:08.628396 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d622244-7878-4c0b-8bce-64f4819d284b tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1304 microversion: 2.1 time: 0.096903 Nov 02 12:22:08.628983 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 323/659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:08 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:08.719500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:08.720033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:08.726945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.727444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.727888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.728597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.729056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.729485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.870329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:08.880331 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-878033a1-da9f-4a84-b55e-f4bf51edc0ba tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.162664 Nov 02 12:22:08.880331 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 324/660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:08 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:08.921643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:08.922472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:08.930788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.931540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.932130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.932737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.933212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.933646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.077103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:09.089487 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78c97795-7bc2-48cd-8044-14d9f6293981 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.172737 Nov 02 12:22:09.090170 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 325/661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:08 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:09.099715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:09.100314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:09.106583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.107064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.107496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.108205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.108628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.109046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.244142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:09.251865 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-09071d02-1c4d-4e7e-8740-9b37086985d4 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1315 microversion: 2.1 time: 0.155953 Nov 02 12:22:09.252429 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 326/662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:09 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:09.400007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:09.400609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:09.408771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.409269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.409740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.410704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.411167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.412079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.566266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:09.574318 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4c17a118-48ad-487e-a350-d7160e76175d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1317 microversion: 2.1 time: 0.178178 Nov 02 12:22:09.574906 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 327/663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:09 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:09.579439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:09.580040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:09.586594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.587098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.587541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.588237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.588716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.589119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.593435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:09.656115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:09.670916 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3de7279e-831c-4c54-af70-5d469e5412a0 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1275 microversion: 2.1 time: 0.094541 Nov 02 12:22:09.672851 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 328/664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:09 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:09.680667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:09.681329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:09.687759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.688248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.688696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.689413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.689875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.690420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.739431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.740398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.741063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.741720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lazy-loading 'fault' on Instance uuid fd378caa-481b-4ea2-a97e-e9c76bac12a5 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:09.811378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba2cd128dcb4c2cb2afd3f271e62e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f902d5297e461c86c49431e4ed2414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:09.823062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5decb457-8deb-4e1c-bed9-298ab817e69d tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 200 len: 1304 microversion: 2.1 time: 0.148594 Nov 02 12:22:09.824229 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 329/665] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:09 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:09.830808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2b53ad63-8b58-4a5d-b784-58fd7e3ffbae req-3024f381-1eb4-431f-8c72-770ca69616c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd378caa-481b-4ea2-a97e-e9c76bac12a5", "name": "network-vif-deleted", "tag": "213d0dd7-7c6f-44fc-bc8e-5a3ad3a2a9f9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:09.847461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b53ad63-8b58-4a5d-b784-58fd7e3ffbae req-3024f381-1eb4-431f-8c72-770ca69616c3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.848067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b53ad63-8b58-4a5d-b784-58fd7e3ffbae req-3024f381-1eb4-431f-8c72-770ca69616c3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.848636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b53ad63-8b58-4a5d-b784-58fd7e3ffbae req-3024f381-1eb4-431f-8c72-770ca69616c3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.864245 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2b53ad63-8b58-4a5d-b784-58fd7e3ffbae req-3024f381-1eb4-431f-8c72-770ca69616c3 service nova] Creating event network-vif-deleted:213d0dd7-7c6f-44fc-bc8e-5a3ad3a2a9f9 for instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 on n-h2-855650-5 Nov 02 12:22:09.870484 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2b53ad63-8b58-4a5d-b784-58fd7e3ffbae req-3024f381-1eb4-431f-8c72-770ca69616c3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045203 Nov 02 12:22:09.871647 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 330/666] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:09.924688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:09.928803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:09.939727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.940656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.941112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.941832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.942338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.943290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:10.422727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:10.433431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2fd0ebc2-bad0-4e97-8b46-d0679333c9fb tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.527063 Nov 02 12:22:10.446206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 331/667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:09 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:10.446206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:10.446206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:10.447506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:10.451259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:10.451259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:10.451259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:10.451259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:10.451667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:10.647837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:10.656195 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f1aa57b1-b033-4a2b-b8ad-f74c417350e4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1505 microversion: 2.1 time: 0.220206 Nov 02 12:22:10.671210 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 332/668] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:10 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:10.682035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:10.682602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:10.690702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:10.691929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:10.692560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:10.694235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:10.695224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:10.695224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:10.860696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:10.875936 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b09d0100-b2fb-46d0-b2fe-0fcf68ea8758 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1503 microversion: 2.1 time: 0.203135 Nov 02 12:22:10.878457 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 333/669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:10 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:10.895851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:10.897759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:10.906662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:10.907588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:10.907709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:10.908471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:10.908835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:10.909513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.083411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:11.103994 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff018321-b48b-4e65-8247-704b3db1a548 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1317 microversion: 2.1 time: 0.223845 Nov 02 12:22:11.104694 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 334/670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:10 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:11.109789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:11.110917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:11.118149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.119069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.119806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.120978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.121821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.122674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.132906 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce4f735e-9bd8-462c-9fcb-43234adcdfcc tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a/action" status: 202 len: 0 microversion: 2.25 time: 5.252625 Nov 02 12:22:11.133856 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 337/671] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:22:05 2022] POST /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a/action => generated 0 bytes in 5255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:11.139218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:11.139846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] [instance: fd378caa-481b-4ea2-a97e-e9c76bac12a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:11.147338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.147865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.148555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.149040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.149801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.150272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.167043 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] HTTP exception thrown: Instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 could not be found. Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Request method failure captured: Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 HTTP/1.1 Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmDApcCDsWmJWo_n5mRVe-rmUewQVxAmOUanV6glgCVrm8CHoA1M_YK4qQ41dnvloCmfQBdPbxceH5XszYswmKzIjoaAo6A0yFU8ez2FfatGI94BJNq6comysgcCNbd4_jKC54gNcwyyvPKquSAKkh4eEYiQNNiCied_Vv8T39P_x5M Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: a2f902d5297e461c86c49431e4ed2414 Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TenantUsagesTestJSON-861786107 Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:22:11.168732 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a2f902d5297e461c86c49431e4ed2414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a2f902d5297e461c86c49431e4ed2414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a2f902d5297e461c86c49431e4ed2414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a2f902d5297e461c86c49431e4ed2414"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TenantUsagesTestJSON-861786107 Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: a2f902d5297e461c86c49431e4ed2414 Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TenantUsagesTestJSON-861786107 Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TenantUsagesTestJSON-861786107-project Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5ba2cd128dcb4c2cb2afd3f271e62e21 Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TenantUsagesTestJSON-861786107-project Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 could not be found. Nov 02 12:22:11.171685 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'fd378caa-481b-4ea2-a97e-e9c76bac12a5'} Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 could not be found. Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:11.173065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 could not be found. Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 could not be found. Nov 02 12:22:11.176809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:11.182581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] Returning 404 to user: Instance fd378caa-481b-4ea2-a97e-e9c76bac12a5 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:11.182581 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8bcfafed-05ef-4ef7-845a-989d5c1c372e tempest-TenantUsagesTestJSON-861786107 tempest-TenantUsagesTestJSON-861786107-project] 10.222.0.45 "GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5" status: 404 len: 111 microversion: 2.1 time: 0.035386 Nov 02 12:22:11.182581 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 338/672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:11 2022] GET /compute/v2.1/servers/fd378caa-481b-4ea2-a97e-e9c76bac12a5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:11.182581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:11.182581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:11.184763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.185326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.185942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.187264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.187264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.187718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.212523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:11.218519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:22:11.224167 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56cbfa02-a7da-4442-87dc-c2807c41c810 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1281 microversion: 2.1 time: 0.118073 Nov 02 12:22:11.238567 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 335/673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:11 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:11.250959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:11.251732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:11.266354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.268180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.270238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.271707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.272508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.273167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.372131 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f4bc532-bfb3-4897-92fa-5f517cdf0057 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 204 len: 0 microversion: 2.1 time: 0.199256 Nov 02 12:22:11.373234 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 339/674] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:22:11 2022] DELETE /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:11.387207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:11.387919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:11.405709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.406246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.406699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.407418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.408306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.408784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.500183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:11.514334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:11.521992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:11.524438 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-adc34a77-23ad-4c32-9aa4-69ab03b65b9f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.281804 Nov 02 12:22:11.528869 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 336/675] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:11 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:11.540883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:11.542019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:11.549534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.550198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.552830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.554160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.554631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.555094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.732708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:11.746014 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0478e204-8350-442a-821d-5851f0992c0a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1509 microversion: 2.1 time: 0.361489 Nov 02 12:22:11.768466 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 340/676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:11 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1509 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:11.774634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:11.781511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:11.797689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.798229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.798681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.799422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:11.799895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:11.800316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.877773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:11.890658 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ecc233c8-11f5-47d9-b8cb-26afed521235 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.360582 Nov 02 12:22:11.891250 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 337/677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:11 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:12.051033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:12.065137 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6024f154-af91-4a76-98f8-b6a807d955a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1480 microversion: 2.1 time: 0.295137 Nov 02 12:22:12.066399 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 341/678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:11 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1480 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:12.089016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d7a1fa7-5d05-49d4-af2a-f46d2a105305 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '.version_select at 0x7f228ea3adc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:12.093384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d7a1fa7-5d05-49d4-af2a-f46d2a105305 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.093882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d7a1fa7-5d05-49d4-af2a-f46d2a105305 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.094356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d7a1fa7-5d05-49d4-af2a-f46d2a105305 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.103615 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d7a1fa7-5d05-49d4-af2a-f46d2a105305 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 1549 microversion: 2.1 time: 0.018227 Nov 02 12:22:12.104753 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 338/679] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:22:12 2022] GET /compute/v2.1/os-migrations => generated 1549 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:12.119232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:12.119858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:12.126889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.127719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.128471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.129252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.129713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.130180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.132176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:12.132836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:12.139525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.140015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.140459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.141168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.142252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.142252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.354002 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c7d232cf-056e-4d7c-8200-844dfd872e1f tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1631 microversion: 2.1 time: 0.239238 Nov 02 12:22:12.366403 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 342/680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:12 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1631 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:12.386474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:12.387427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:12.394832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.395631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.396372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.397406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.398278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.398883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.403120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:12.418555 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0680efbd-8493-4df6-833b-d9619531c89b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1317 microversion: 2.1 time: 0.291967 Nov 02 12:22:12.424230 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 339/681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:12 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:12.456063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91feccde-3a22-4959-8956-2015f3b33849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Action: 'create', calling method: .version_select at 0x7f228eb0bca0>, body: {"keypair": {"name": "tempest-keypair-541728575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXMunAioFiwDk+4ctvJdLdSHG/imgIfRDSdZ5+HvouLWWeKTyWEWurFaZYCubE1TymjZCpZroZMAZ/oOPGavyd67t5MrjQBDCiC3g634PFrbTaxnKdgHhBzPQc++tlzWA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:12.491121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-91feccde-3a22-4959-8956-2015f3b33849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for project 3579208e4ca549d9a0cdb14af362384e. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:12.499550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-91feccde-3a22-4959-8956-2015f3b33849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for user 9f2ebf76beec4d3185c3c279868f8366 and project 3579208e4ca549d9a0cdb14af362384e. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:12.549301 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91feccde-3a22-4959-8956-2015f3b33849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122588 Nov 02 12:22:12.550340 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 340/682] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:22:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:12.565450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:12.566624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:12.582696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.584709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.585709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.587659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.588681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.589502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.611851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:12.622819 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-efc16d9c-35af-4ce4-b092-b2e387d196f7 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.254953 Nov 02 12:22:12.624145 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 343/683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:12 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:12.773309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:12.774184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:12.791832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.792332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.793001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.794281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.795214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.796056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.878569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:12.904442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:12.907866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:12.913897 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dfa9cc66-fd65-44b7-b9a5-5bebedf17c8d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.357559 Nov 02 12:22:12.918398 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 341/684] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:12 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:12.935873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:12.936494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:12.944507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.944988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.945431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.946874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.947357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.947823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.283650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:13.295018 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f6a0d539-a27e-47c0-b30b-942348299cf9 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1509 microversion: 2.1 time: 0.526191 Nov 02 12:22:13.295914 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 344/685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:12 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:13.335950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-faf1620d-e844-4eeb-841c-d5a5e33bf427 req-dc8ac059-c94d-4326-b17f-12d72ca014c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13c5d8d-ba99-4f40-a4a2-d7d5d463a237", "name": "network-vif-plugged", "status": "completed", "tag": "da686012-05f8-4fdf-b251-5cd7e4d3b039"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:13.356326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-faf1620d-e844-4eeb-841c-d5a5e33bf427 req-dc8ac059-c94d-4326-b17f-12d72ca014c8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.356991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-faf1620d-e844-4eeb-841c-d5a5e33bf427 req-dc8ac059-c94d-4326-b17f-12d72ca014c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.357498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-faf1620d-e844-4eeb-841c-d5a5e33bf427 req-dc8ac059-c94d-4326-b17f-12d72ca014c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.373512 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-faf1620d-e844-4eeb-841c-d5a5e33bf427 req-dc8ac059-c94d-4326-b17f-12d72ca014c8 service nova] Creating event network-vif-plugged:da686012-05f8-4fdf-b251-5cd7e4d3b039 for instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 on n-h1-855650-5 Nov 02 12:22:13.378908 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-faf1620d-e844-4eeb-841c-d5a5e33bf427 req-dc8ac059-c94d-4326-b17f-12d72ca014c8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064128 Nov 02 12:22:13.380132 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 345/686] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:13.444241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:13.447118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:13.448291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:13.455365 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9d82e5e-31bd-49a3-af15-3417aef2a374 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.535321 Nov 02 12:22:13.456259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.456760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.456966 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 342/687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:12 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:13.457780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.459714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.460348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.461091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.649239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:13.650274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:13.665308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.666500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.667287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.669083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.670126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.670561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.728007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:13.736853 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6fbb47a-a74b-45ed-89bb-44c7349c7a70 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1317 microversion: 2.1 time: 0.294815 Nov 02 12:22:13.754250 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 346/688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:13 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:13.943597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:13.944347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:13.958073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.959221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.959751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.960787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.962013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.963956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.994602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:14.003611 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b475dd6a-bca6-401f-8661-33a0e9a56223 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.361357 Nov 02 12:22:14.021998 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 343/689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:13 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:14.238091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:14.247277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:14.248762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:14.250248 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a75e49ce-7865-4fad-a671-09b71058ba72 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.311085 Nov 02 12:22:14.262437 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 347/690] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:13 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:14.330206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:14.331327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:14.343822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:14.347601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:14.348177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:14.349055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:14.350302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:14.353355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:14.480653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:14.481267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:14.483592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:14.493336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:14.494210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:14.494877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:14.495884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:14.496778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:14.498421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:14.630138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:14.651775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:14.673847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:14.685201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f85a6f3-f00c-460c-95ec-40dbff165a3a tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1509 microversion: 2.1 time: 0.359036 Nov 02 12:22:14.687125 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 344/691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:14 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:14.774380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:14.776159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:14.828550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:14.829058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:14.830254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:14.832624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:14.833275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:14.835183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.141839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:15.151704 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b5d7bd68-7502-4373-a0fc-14215c0896fc tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.674963 Nov 02 12:22:15.156397 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 348/692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:14 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:15.167546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-dd8f1e8f-05a9-482c-96e0-7e851cb33706 req-466c917f-769e-4894-9e9f-80a02676e93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a4639e-be33-4fdc-bd49-ba842ba07cf0", "tag": "2e74770e-7830-4b88-9a83-f09758a7a477"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:15.178522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd8f1e8f-05a9-482c-96e0-7e851cb33706 req-466c917f-769e-4894-9e9f-80a02676e93b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.178796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd8f1e8f-05a9-482c-96e0-7e851cb33706 req-466c917f-769e-4894-9e9f-80a02676e93b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.179413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd8f1e8f-05a9-482c-96e0-7e851cb33706 req-466c917f-769e-4894-9e9f-80a02676e93b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.194168 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-dd8f1e8f-05a9-482c-96e0-7e851cb33706 req-466c917f-769e-4894-9e9f-80a02676e93b service nova] Creating event network-changed:2e74770e-7830-4b88-9a83-f09758a7a477 for instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 on n-h2-855650-5 Nov 02 12:22:15.210755 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-dd8f1e8f-05a9-482c-96e0-7e851cb33706 req-466c917f-769e-4894-9e9f-80a02676e93b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052717 Nov 02 12:22:15.211683 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 349/693] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:15.218223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:15.219066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:15.226728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.227373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.227861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.228655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.229213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.229714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.397616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:15.407071 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-626ad228-cf3c-4925-86ab-570de67a7c4c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1317 microversion: 2.1 time: 0.639951 Nov 02 12:22:15.408421 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 345/694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:14 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:15.416350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:15.417242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:15.432274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.433156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.435230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.436524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.437126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.437444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.702063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:15.704836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:15.713536 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bdc6067d-43ff-4209-bc89-286e39796234 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.500336 Nov 02 12:22:15.714168 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 350/695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:15 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:15.719446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:15.720473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:15.729220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.730166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.732967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.734183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.734702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.735272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.778899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.779776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.780649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.781142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lazy-loading 'fault' on Instance uuid c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:15.903750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:15.907653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:15.920323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:15.925944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:15.931166 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f2c5315-6ddf-403c-ba4d-f0121ef18ab6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.520013 Nov 02 12:22:15.932177 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 346/696] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:15 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:15.945462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b0b12566f4173bce276f0dd8fe5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92830a9448754f3294124498e566bd7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:15.958860 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-37806238-645e-463b-857b-7dafdaf61945 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 200 len: 1305 microversion: 2.1 time: 0.243296 Nov 02 12:22:15.962296 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 351/697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:15 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 1305 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:16.176895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:16.178518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:16.186193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:16.186809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:16.187266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:16.187991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:16.188456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:16.188892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:16.438321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:16.439423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:16.453345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:16.459647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:16.463994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:16.467696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:16.468283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:16.470981 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6eb9e97-c02c-4ec1-8ab8-e511ad2b4b65 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.298069 Nov 02 12:22:16.471741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:16.472401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:16.490016 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 347/698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:16 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:16.645569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-717498855", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "88aa3408-37b9-415a-84a9-1aa8b9400b9d"}], "security_groups": [{"name": "tempest-securitygroup--893464310"}], "key_name": "tempest-keypair-541728575", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:16.661130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:16.681171 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2b367ff-b593-45ac-ae3b-e30cdb5ff632 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1466 microversion: 2.1 time: 0.248619 Nov 02 12:22:16.681850 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 352/699] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:16 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1466 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:16.726801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-681878916", "metadata": {"image_type": "test"}}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:16.731408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:16.743777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:16.745068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:16.746426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:16.748903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:16.750141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:16.751217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:16.821842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Getting quotas for project 0018d1abb96f47d78acb47c69ffd5348. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:16.833442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Getting quotas for user 592a24a9aa8c4229a3829ace625e3238 and project 0018d1abb96f47d78acb47c69ffd5348. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:16.921759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] validate_networks() for [('88aa3408-37b9-415a-84a9-1aa8b9400b9d', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:22:17.097233 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-304c288c-f1b1-428c-8bf7-c1dcec8a86b1 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "POST /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237/action" status: 202 len: 0 microversion: 2.1 time: 0.377455 Nov 02 12:22:17.098398 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 353/700] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:16 2022] POST /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 02 12:22:17.118033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:17.119085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:17.125908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:17.132801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:17.133290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:17.133725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:17.134455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:17.135129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:17.135926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:17.607782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:17.617598 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-514b6124-588f-4e95-95bd-5c234a3fa078 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.517497 Nov 02 12:22:17.618666 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 354/701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:17 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:17.624477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:17.625171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:17.633744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:17.634595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:17.634974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:17.636082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:17.636767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:17.637371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.005561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.016479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.018098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.020365 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3008cc1c-62c5-445f-9b62-33cd30bf9bbf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.400317 Nov 02 12:22:18.021869 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 355/702] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:17 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:18.027575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:18.028311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:18.035004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.035755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.036268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.037597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.038106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.038541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.054441 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] HTTP exception thrown: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Request method failure captured: Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 HTTP/1.1 Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmDX7R3C8-4ZEe6BQydLmogIX5ueRYGNkr6I24jpUqmxHtRfWGCOMFyUdG9S78RpYsSZY1-rCcdFp20HmqLopBqLUdUo7R5tN9vUFlavf-B9Bm7ZRZ5MrrkrqzdM-b8Q2ei5StSaVMFqlaTdyjM6_oTUdSGkk4EGav0hC-doMn0wliU Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:22:18.056140 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92830a9448754f3294124498e566bd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92830a9448754f3294124498e566bd7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 428b0b12566f4173bce276f0dd8fe5f8 Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.058093 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c60569df-ffab-45d8-9b9b-c29f4c2a3cf3'} Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:18.059614 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.061044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.062400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Returning 404 to user: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:18.063201 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb7f3797-eec6-4777-86a6-0396c529e5a8 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 404 len: 111 microversion: 2.1 time: 0.034612 Nov 02 12:22:18.063918 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 356/703] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:18 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:18.069295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97e8cc59-0e36-4144-b0b2-28bdcb69db62 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228edfaee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:18.117200 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97e8cc59-0e36-4144-b0b2-28bdcb69db62 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.052141 Nov 02 12:22:18.117781 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 357/704] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:18 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:18.122387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-11e8c76a-4be2-4a3e-a7eb-462976f4a61c req-b87debc1-001b-4d08-b9a9-6e12bf587838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60569df-ffab-45d8-9b9b-c29f4c2a3cf3", "name": "network-vif-deleted", "tag": "e8a5cb11-e922-4e31-83a6-5244ac066053"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:18.133079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-11e8c76a-4be2-4a3e-a7eb-462976f4a61c req-b87debc1-001b-4d08-b9a9-6e12bf587838 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.133664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-11e8c76a-4be2-4a3e-a7eb-462976f4a61c req-b87debc1-001b-4d08-b9a9-6e12bf587838 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.134031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-11e8c76a-4be2-4a3e-a7eb-462976f4a61c req-b87debc1-001b-4d08-b9a9-6e12bf587838 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.144823 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-11e8c76a-4be2-4a3e-a7eb-462976f4a61c req-b87debc1-001b-4d08-b9a9-6e12bf587838 service nova] Creating event network-vif-deleted:e8a5cb11-e922-4e31-83a6-5244ac066053 for instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 on n-h2-855650-5 Nov 02 12:22:18.151274 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-11e8c76a-4be2-4a3e-a7eb-462976f4a61c req-b87debc1-001b-4d08-b9a9-6e12bf587838 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032216 Nov 02 12:22:18.152162 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 358/705] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:18.157877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5c631e24-aa02-4859-9ac9-45a63ba1fb74 req-6f95e2f0-ea3e-4960-a103-bbbfb22c4afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d1cacf-fba6-4284-8771-3ece6797fa31", "name": "network-vif-plugged", "status": "completed", "tag": "a6889f29-1d1f-4865-99a7-33924dd0d866"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:18.169504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5c631e24-aa02-4859-9ac9-45a63ba1fb74 req-6f95e2f0-ea3e-4960-a103-bbbfb22c4afc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.170304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5c631e24-aa02-4859-9ac9-45a63ba1fb74 req-6f95e2f0-ea3e-4960-a103-bbbfb22c4afc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.171022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5c631e24-aa02-4859-9ac9-45a63ba1fb74 req-6f95e2f0-ea3e-4960-a103-bbbfb22c4afc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.182556 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5c631e24-aa02-4859-9ac9-45a63ba1fb74 req-6f95e2f0-ea3e-4960-a103-bbbfb22c4afc service nova] Creating event network-vif-plugged:a6889f29-1d1f-4865-99a7-33924dd0d866 for instance e6d1cacf-fba6-4284-8771-3ece6797fa31 on n-h1-855650-5 Nov 02 12:22:18.188222 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5c631e24-aa02-4859-9ac9-45a63ba1fb74 req-6f95e2f0-ea3e-4960-a103-bbbfb22c4afc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034864 Nov 02 12:22:18.189523 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 359/706] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:18.195550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:18.196273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:18.202695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.203189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.203632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.204346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.204804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.205235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.243098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:22:18.243931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:22:18.244732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:22:18.245478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:22:18.247053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:22:18.254573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=98,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:18.263716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.264467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.265066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.266014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.266649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.267105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.293725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for project 3579208e4ca549d9a0cdb14af362384e. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:18.299273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for user 9f2ebf76beec4d3185c3c279868f8366 and project 3579208e4ca549d9a0cdb14af362384e. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:18.316495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:22:18.321216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:22:18.399913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-359bf7cc-0973-4711-b5be-269463b4251c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.761967 Nov 02 12:22:18.400586 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 348/707] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:22:18.405709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1746765711", "metadata": {"image_type": "test"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:18.408529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:18.416587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.417093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.417546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.418531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.419006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.419443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.452060 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] HTTP exception thrown: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Request method failure captured: Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3/action HTTP/1.1 Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 112 Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDX7R3C8-4ZEe6BQydLmogIX5ueRYGNkr6I24jpUqmxHtRfWGCOMFyUdG9S78RpYsSZY1-rCcdFp20HmqLopBqLUdUo7R5tN9vUFlavf-B9Bm7ZRZ5MrrkrqzdM-b8Q2ei5StSaVMFqlaTdyjM6_oTUdSGkk4EGav0hC-doMn0wliU Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:22:18.457347 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92830a9448754f3294124498e566bd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92830a9448754f3294124498e566bd7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 428b0b12566f4173bce276f0dd8fe5f8 Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1746765711", "metadata": {"image_type": "test"}}} Nov 02 12:22:18.460363 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c60569df-ffab-45d8-9b9b-c29f4c2a3cf3', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1746765711', 'metadata': {'image_type': 'test'}}}} Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.461921 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.466973 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.483197 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.483197 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:18.483197 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:18.483197 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.483197 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.483197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Returning 404 to user: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:18.483197 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43b14d76-f99e-409e-94dc-78d9ee6a368e tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "POST /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3/action" status: 404 len: 111 microversion: 2.1 time: 0.067194 Nov 02 12:22:18.483197 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 349/708] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Nov 2 12:22:18 2022] POST /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:18.489447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-301ccbaf-f65c-47e4-a4c7-fdea880ae465 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:18.491394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-301ccbaf-f65c-47e4-a4c7-fdea880ae465 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:18.503521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.520341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59a410e4-df20-4498-b223-457ac10e53e3 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.329443 Nov 02 12:22:18.544777 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 360/709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:18 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:18.565182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ab58848-fcc9-4fee-a26a-de57a44ee752 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1337949294", "metadata": {"image_type": "test"}}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:18.567654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3ab58848-fcc9-4fee-a26a-de57a44ee752 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Failed to fetch instance by id tempest-invalid-1107847479 {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:22:18.568377 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3ab58848-fcc9-4fee-a26a-de57a44ee752 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] HTTP exception thrown: Instance tempest-invalid-1107847479 could not be found. Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ab58848-fcc9-4fee-a26a-de57a44ee752 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Request method failure captured: Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/tempest-invalid-1107847479/action HTTP/1.1 Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 112 Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmDX7R3C8-4ZEe6BQydLmogIX5ueRYGNkr6I24jpUqmxHtRfWGCOMFyUdG9S78RpYsSZY1-rCcdFp20HmqLopBqLUdUo7R5tN9vUFlavf-B9Bm7ZRZ5MrrkrqzdM-b8Q2ei5StSaVMFqlaTdyjM6_oTUdSGkk4EGav0hC-doMn0wliU Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:22:18.570058 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92830a9448754f3294124498e566bd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92830a9448754f3294124498e566bd7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 428b0b12566f4173bce276f0dd8fe5f8 Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1337949294", "metadata": {"image_type": "test"}}} Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:22:18.571496 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance tempest-invalid-1107847479 could not be found. Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'tempest-invalid-1107847479', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1337949294', 'metadata': {'image_type': 'test'}}}} Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1107847479 could not be found. Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:18.572431 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1107847479 could not be found. Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1107847479 could not be found. Nov 02 12:22:18.573622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.576715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ab58848-fcc9-4fee-a26a-de57a44ee752 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Returning 404 to user: Instance tempest-invalid-1107847479 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:18.577759 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ab58848-fcc9-4fee-a26a-de57a44ee752 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "POST /compute/v2.1/servers/tempest-invalid-1107847479/action" status: 404 len: 101 microversion: 2.1 time: 0.031922 Nov 02 12:22:18.578535 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 361/710] 10.222.0.45 () {60 vars in 1249 bytes} [Wed Nov 2 12:22:18 2022] POST /compute/v2.1/servers/tempest-invalid-1107847479/action => generated 101 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:18.603609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1713fe0c-4818-4a52-beff-5fef129122c6 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-73660692"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:18.607669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1713fe0c-4818-4a52-beff-5fef129122c6 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:22:18.617339 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1713fe0c-4818-4a52-beff-5fef129122c6 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1713fe0c-4818-4a52-beff-5fef129122c6 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Request method failure captured: Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 55 Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmDX7R3C8-4ZEe6BQydLmogIX5ueRYGNkr6I24jpUqmxHtRfWGCOMFyUdG9S78RpYsSZY1-rCcdFp20HmqLopBqLUdUo7R5tN9vUFlavf-B9Bm7ZRZ5MrrkrqzdM-b8Q2ei5StSaVMFqlaTdyjM6_oTUdSGkk4EGav0hC-doMn0wliU Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:22:18.621522 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92830a9448754f3294124498e566bd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92830a9448754f3294124498e566bd7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 428b0b12566f4173bce276f0dd8fe5f8 Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: {"createImage": {"name": "tempest-test-snap-73660692"}} Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:22:18.623018 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-73660692'}}} Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:18.623919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.625313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.629942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1713fe0c-4818-4a52-beff-5fef129122c6 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:18.632021 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1713fe0c-4818-4a52-beff-5fef129122c6 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.044456 Nov 02 12:22:18.635582 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 362/711] 10.222.0.45 () {60 vars in 1275 bytes} [Wed Nov 2 12:22:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:18.647012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:18.647990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:18.662687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.663574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.664949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.666794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.668232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.668992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.735375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-301ccbaf-f65c-47e4-a4c7-fdea880ae465 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.757565 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-301ccbaf-f65c-47e4-a4c7-fdea880ae465 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1233 microversion: 2.1 time: 0.278453 Nov 02 12:22:18.759461 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 350/712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:18 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1233 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:18.771680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d259c463-3d70-4e91-a651-0691083ade09 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1168205398"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:18.777037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d259c463-3d70-4e91-a651-0691083ade09 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:22:18.778045 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d259c463-3d70-4e91-a651-0691083ade09 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d259c463-3d70-4e91-a651-0691083ade09 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Request method failure captured: Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 57 Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDX7R3C8-4ZEe6BQydLmogIX5ueRYGNkr6I24jpUqmxHtRfWGCOMFyUdG9S78RpYsSZY1-rCcdFp20HmqLopBqLUdUo7R5tN9vUFlavf-B9Bm7ZRZ5MrrkrqzdM-b8Q2ei5StSaVMFqlaTdyjM6_oTUdSGkk4EGav0hC-doMn0wliU Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:22:18.781420 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92830a9448754f3294124498e566bd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92830a9448754f3294124498e566bd7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 428b0b12566f4173bce276f0dd8fe5f8 Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: {"createImage": {"name": "tempest-test-snap-1168205398"}} Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:22:18.782814 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1168205398'}}} Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:18.783681 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:22:18.784860 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.792932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d259c463-3d70-4e91-a651-0691083ade09 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:18.792932 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d259c463-3d70-4e91-a651-0691083ade09 tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.022320 Nov 02 12:22:18.803400 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 351/713] 10.222.0.45 () {60 vars in 1281 bytes} [Wed Nov 2 12:22:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:18.828082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:18.841681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:18.850448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.851107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.851686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.852494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.853053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.853577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.906871 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] HTTP exception thrown: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Request method failure captured: Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 HTTP/1.1 Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDX7R3C8-4ZEe6BQydLmogIX5ueRYGNkr6I24jpUqmxHtRfWGCOMFyUdG9S78RpYsSZY1-rCcdFp20HmqLopBqLUdUo7R5tN9vUFlavf-B9Bm7ZRZ5MrrkrqzdM-b8Q2ei5StSaVMFqlaTdyjM6_oTUdSGkk4EGav0hC-doMn0wliU Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:22:18.909612 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92830a9448754f3294124498e566bd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92830a9448754f3294124498e566bd7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 428b0b12566f4173bce276f0dd8fe5f8 Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.911553 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c60569df-ffab-45d8-9b9b-c29f4c2a3cf3'} Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:18.912585 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:18.914168 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:18.917804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Returning 404 to user: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:18.920827 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd844dd2-7e68-472a-9005-f766eadac5aa tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 404 len: 111 microversion: 2.1 time: 0.111950 Nov 02 12:22:18.929478 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 352/714] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:22:18 2022] DELETE /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:18.940866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:18.942815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] [instance: c60569df-ffab-45d8-9b9b-c29f4c2a3cf3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:18.960519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.961627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.964525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.965322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.967086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.970240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.971663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.980686 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e0b195a-d659-47d4-8699-1a4150d3d62e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.336087 Nov 02 12:22:18.989083 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 363/715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:18 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:19.015883 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] HTTP exception thrown: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Request method failure captured: Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 HTTP/1.1 Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDX7R3C8-4ZEe6BQydLmogIX5ueRYGNkr6I24jpUqmxHtRfWGCOMFyUdG9S78RpYsSZY1-rCcdFp20HmqLopBqLUdUo7R5tN9vUFlavf-B9Bm7ZRZ5MrrkrqzdM-b8Q2ei5StSaVMFqlaTdyjM6_oTUdSGkk4EGav0hC-doMn0wliU Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:22:19.017447 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92830a9448754f3294124498e566bd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92830a9448754f3294124498e566bd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92830a9448754f3294124498e566bd7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 92830a9448754f3294124498e566bd7a Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-144588260 Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 428b0b12566f4173bce276f0dd8fe5f8 Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesNegativeTestJSON-144588260-project Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:19.020023 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c60569df-ffab-45d8-9b9b-c29f4c2a3cf3'} Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:19.021647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. Nov 02 12:22:19.026709 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:19.030144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] Returning 404 to user: Instance c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:19.030144 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56f9645d-e671-49cd-a944-d69b295049de tempest-ImagesNegativeTestJSON-144588260 tempest-ImagesNegativeTestJSON-144588260-project] 10.222.0.45 "GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3" status: 404 len: 111 microversion: 2.1 time: 0.087822 Nov 02 12:22:19.030144 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 353/716] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:18 2022] GET /compute/v2.1/servers/c60569df-ffab-45d8-9b9b-c29f4c2a3cf3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:19.061399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:19.062313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:19.077533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.079892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.080719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:19.081721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.084083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.085780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:19.133773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a71010c-4599-4a9e-9b5d-5ba733629147 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ea3ad30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:19.203633 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a71010c-4599-4a9e-9b5d-5ba733629147 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.073951 Nov 02 12:22:19.204229 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 354/717] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:19 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:19.549209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:19.550326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:19.560177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.560996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.561715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:19.562708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.563386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.564032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.174443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.186391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.188012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.189735 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ee901253-3323-420a-9b98-663ab056430a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 1.143761 Nov 02 12:22:20.201989 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 364/718] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:19 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:20.201989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:20.201989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:20.202830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:20.203270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:20.203670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.204401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:20.204858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:20.205282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.344320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.353460 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6ee019a0-5d59-4cdf-9291-b34e52dc0a3d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1285 microversion: 2.1 time: 0.161601 Nov 02 12:22:20.369627 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 365/719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:20 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:20.369879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.370039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:20.370039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:20.370039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:20.370039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:20.370352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.370352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:20.370352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:20.370352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.375661 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18b38023-57f1-41dd-8761-70f83192a7ac tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1319 microversion: 2.1 time: 0.831562 Nov 02 12:22:20.376216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 355/720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:19 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1319 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:20.381429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1fe6cc3-5ed9-4a39-810f-2e7c837a9171 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228eb0bc10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:20.449893 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1fe6cc3-5ed9-4a39-810f-2e7c837a9171 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.072521 Nov 02 12:22:20.460309 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 356/721] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:20 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:20.818146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.826891 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0db4511c-2465-4b41-bfc2-09782217480e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.471326 Nov 02 12:22:20.827816 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 366/722] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:20 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:21.218406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:21.219116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:21.232711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.233487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.235123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.236906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.238768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.239437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.377628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:21.378398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:21.398358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.399142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.399604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.400595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.401054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.401523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.545692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:21.560157 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-397a0086-3438-4319-8a4b-7344302c04b1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1291 microversion: 2.1 time: 0.185988 Nov 02 12:22:21.573143 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 367/723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:21 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1291 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:21.583336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:21.584567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:21.592581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.593418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.594096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.595041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.595710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.596410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.609193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:21.620196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:21.628314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:21.633217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b41165ee-3c6a-450d-94f4-fb0b0e38ab95 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.418564 Nov 02 12:22:21.644092 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 357/724] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:21 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:21.647154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6171b6b-f037-45a1-837d-babfa324ee2c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ed3d280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:21.702004 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6171b6b-f037-45a1-837d-babfa324ee2c tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.066249 Nov 02 12:22:21.702605 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 358/725] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:21 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:21.833122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3668d66a-dc1a-46ff-a0eb-707ebfbf4c6e req-5f211365-d39e-4b8d-92e7-0293bf8e47a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb59ac2b-fb2c-4690-9a9e-9cb56f78155a", "name": "network-vif-unplugged", "status": "completed", "tag": "a4f98e06-82ae-4a12-b885-9551951ad05a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:21.849677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3668d66a-dc1a-46ff-a0eb-707ebfbf4c6e req-5f211365-d39e-4b8d-92e7-0293bf8e47a7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.850609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3668d66a-dc1a-46ff-a0eb-707ebfbf4c6e req-5f211365-d39e-4b8d-92e7-0293bf8e47a7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.851328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3668d66a-dc1a-46ff-a0eb-707ebfbf4c6e req-5f211365-d39e-4b8d-92e7-0293bf8e47a7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.874965 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3668d66a-dc1a-46ff-a0eb-707ebfbf4c6e req-5f211365-d39e-4b8d-92e7-0293bf8e47a7 service nova] Creating event network-vif-unplugged:a4f98e06-82ae-4a12-b885-9551951ad05a for instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a on n-h1-855650-5 Nov 02 12:22:21.882617 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3668d66a-dc1a-46ff-a0eb-707ebfbf4c6e req-5f211365-d39e-4b8d-92e7-0293bf8e47a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053296 Nov 02 12:22:21.884064 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 359/726] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:21.891497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:21.892406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:21.900656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.901420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.902112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.903047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.903670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.904556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.010187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:22.026218 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-51301bcc-d6ef-4c60-9ec6-30b32165683c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1469 microversion: 2.1 time: 0.451213 Nov 02 12:22:22.029911 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 368/727] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:21 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:22.060272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:22.062826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:22.091083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.091688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.092195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.092977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.093611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.094242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.121822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lazy-loading 'flavor' on Instance uuid e6d1cacf-fba6-4284-8771-3ece6797fa31 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:22.167653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:22.247962 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea53843a-64c1-46cf-9e75-f16f4d6d6b52 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31/action" status: 202 len: 0 microversion: 2.1 time: 0.193222 Nov 02 12:22:22.261247 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 369/728] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:22 2022] POST /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:22.267136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:22.268020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:22.279456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.280557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.281510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.282769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.283645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.284465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.347746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:22.361399 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22710b26-0a42-40a5-a037-d460fc1f5599 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.475169 Nov 02 12:22:22.364057 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 360/729] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:21 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:22.588496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:22.589235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:22.605456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.605992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.606456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.613798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.614603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.615813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.088049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.107062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42b58c51-6a3f-438f-afa9-98750d2057fa tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1358 microversion: 2.1 time: 0.522212 Nov 02 12:22:23.109162 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 361/730] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:22 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1358 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:23.117583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:23.118638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:23.132314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.134307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.135533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.136466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.139375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.140059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.141468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.148900 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-88eaedd4-1b51-462f-881e-76419a4ceb82 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1477 microversion: 2.1 time: 0.885728 Nov 02 12:22:23.166984 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 370/731] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:22 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1477 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:23.175779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e0628a35-fb29-41c1-825a-b188ec83e40a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228edd65e0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:23.245450 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e0628a35-fb29-41c1-825a-b188ec83e40a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.076195 Nov 02 12:22:23.245450 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 371/732] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:23 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:23.388258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:23.389202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:23.407947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.408773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.409394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.410341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.411252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.411940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.779051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.790177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.795131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.796596 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f5fa3df-fa6e-4452-9f97-6511f979c082 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.686208 Nov 02 12:22:23.810537 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 362/733] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:23 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:23.855462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.864761 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63d35afa-12e8-490d-b9df-31345f68bca5 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.480452 Nov 02 12:22:23.866130 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 372/734] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:23 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:23.905123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-de57a704-f0a4-4943-b581-b48ade00d758 req-7cab1ae1-ad1e-4a39-8cea-a6fb2e36b70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb59ac2b-fb2c-4690-9a9e-9cb56f78155a", "tag": "a4f98e06-82ae-4a12-b885-9551951ad05a"}, {"name": "network-changed", "server_uuid": "3ce3f9c6-de73-4a88-8cb8-a20198986ffb", "tag": "ced7ed63-2e97-4192-938d-c3e96e6d249f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:23.908304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-741d374c-246a-4454-9ddf-99790016eba4 req-2075e11e-febb-45e3-b530-c9d40569e610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13c5d8d-ba99-4f40-a4a2-d7d5d463a237", "name": "network-vif-plugged", "status": "completed", "tag": "da686012-05f8-4fdf-b251-5cd7e4d3b039"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:23.925645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de57a704-f0a4-4943-b581-b48ade00d758 req-7cab1ae1-ad1e-4a39-8cea-a6fb2e36b70a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.926522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de57a704-f0a4-4943-b581-b48ade00d758 req-7cab1ae1-ad1e-4a39-8cea-a6fb2e36b70a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.927219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de57a704-f0a4-4943-b581-b48ade00d758 req-7cab1ae1-ad1e-4a39-8cea-a6fb2e36b70a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.933337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-741d374c-246a-4454-9ddf-99790016eba4 req-2075e11e-febb-45e3-b530-c9d40569e610 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.937332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-741d374c-246a-4454-9ddf-99790016eba4 req-2075e11e-febb-45e3-b530-c9d40569e610 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.937787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-741d374c-246a-4454-9ddf-99790016eba4 req-2075e11e-febb-45e3-b530-c9d40569e610 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.955071 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-de57a704-f0a4-4943-b581-b48ade00d758 req-7cab1ae1-ad1e-4a39-8cea-a6fb2e36b70a service nova] Creating event network-changed:a4f98e06-82ae-4a12-b885-9551951ad05a for instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a on n-h1-855650-5 Nov 02 12:22:23.956054 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-de57a704-f0a4-4943-b581-b48ade00d758 req-7cab1ae1-ad1e-4a39-8cea-a6fb2e36b70a service nova] Creating event network-changed:ced7ed63-2e97-4192-938d-c3e96e6d249f for instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb on n-h2-855650-5 Nov 02 12:22:23.967584 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-de57a704-f0a4-4943-b581-b48ade00d758 req-7cab1ae1-ad1e-4a39-8cea-a6fb2e36b70a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068513 Nov 02 12:22:23.969129 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 363/735] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:23.970029 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-741d374c-246a-4454-9ddf-99790016eba4 req-2075e11e-febb-45e3-b530-c9d40569e610 service nova] Creating event network-vif-plugged:da686012-05f8-4fdf-b251-5cd7e4d3b039 for instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 on n-h1-855650-5 Nov 02 12:22:23.975991 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-741d374c-246a-4454-9ddf-99790016eba4 req-2075e11e-febb-45e3-b530-c9d40569e610 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072639 Nov 02 12:22:23.976884 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 373/736] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:24.134798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:24.136098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:24.151091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:24.154438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:24.156715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:24.157676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:24.162169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:24.162861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:24.186266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:24.188141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:24.223531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:24.224035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:24.225118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:24.225837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:24.226502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:24.227284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:24.894911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:24.904831 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-538ae064-7d8e-4058-9c86-b64ea98196c6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1358 microversion: 2.1 time: 0.776587 Nov 02 12:22:24.912301 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 364/737] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:24 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1358 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:24.922549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:24.927403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-524e9af3-6d2f-474d-879a-a55c5c192cec tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ea23940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:24.940708 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-762695e9-8630-41d8-9c6c-9da52d73d873 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1460 microversion: 2.1 time: 0.763628 Nov 02 12:22:24.941306 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 374/738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:24 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1460 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:24.947351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:24.947935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:24.964227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:24.964783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:24.965275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:24.966024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:24.968360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:24.968807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:25.009163 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-524e9af3-6d2f-474d-879a-a55c5c192cec tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.095365 Nov 02 12:22:25.010606 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 365/739] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:24 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:25.017852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:25.019406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:25.034034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:25.037348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:25.038264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:25.039301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:25.040555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:25.041246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:25.823831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:25.834898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:25.836388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:25.837713 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5f810f66-e7ef-4fad-8726-058b1cfb6ef6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.895386 Nov 02 12:22:25.841034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:25.850357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aabe6b83-c79a-4d28-9f42-d5ba9d85ed79 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.838279 Nov 02 12:22:25.854174 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 375/740] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:24 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:25.855407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 366/741] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:25 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:25.861586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:25.862628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:25.869700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:25.870469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:25.870913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:25.871793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:25.872257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:25.872686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:25.937640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:25.938416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:25.946506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:25.947137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:25.947725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:25.948572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:25.949146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:25.949636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.391753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:26.400507 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e846682c-629c-47da-a2c4-62b9385b52fc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1358 microversion: 2.1 time: 0.466650 Nov 02 12:22:26.401133 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 367/742] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:25 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1358 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:26.406339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca7ca94e-7131-47f3-80b2-c12c7fa85305 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228eb79700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:26.460670 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca7ca94e-7131-47f3-80b2-c12c7fa85305 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.058416 Nov 02 12:22:26.470417 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 368/743] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:26 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:26.477750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-705f0b94-6035-44de-9c2b-9118a7b9c471 req-be6e6f76-8f4c-49d9-881d-39472c07d6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a4639e-be33-4fdc-bd49-ba842ba07cf0", "name": "network-vif-plugged", "status": "completed", "tag": "2e74770e-7830-4b88-9a83-f09758a7a477"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:26.491910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-705f0b94-6035-44de-9c2b-9118a7b9c471 req-be6e6f76-8f4c-49d9-881d-39472c07d6ef service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.492455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-705f0b94-6035-44de-9c2b-9118a7b9c471 req-be6e6f76-8f4c-49d9-881d-39472c07d6ef service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.493123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-705f0b94-6035-44de-9c2b-9118a7b9c471 req-be6e6f76-8f4c-49d9-881d-39472c07d6ef service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.513843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-705f0b94-6035-44de-9c2b-9118a7b9c471 req-be6e6f76-8f4c-49d9-881d-39472c07d6ef service nova] Creating event network-vif-plugged:2e74770e-7830-4b88-9a83-f09758a7a477 for instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 on n-h2-855650-5 Nov 02 12:22:26.520134 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-705f0b94-6035-44de-9c2b-9118a7b9c471 req-be6e6f76-8f4c-49d9-881d-39472c07d6ef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048265 Nov 02 12:22:26.520885 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 369/744] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:26.800743 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fc0ad2fa-ba6d-43ba-8a71-bdbdff99b683 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1611 microversion: 2.1 time: 0.944894 Nov 02 12:22:26.801582 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 376/745] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:25 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1611 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:26.824422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34eb3765-c60a-40d0-b65a-460a8eafef5c tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:26.828469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34eb3765-c60a-40d0-b65a-460a8eafef5c tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.828955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34eb3765-c60a-40d0-b65a-460a8eafef5c tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.829387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34eb3765-c60a-40d0-b65a-460a8eafef5c tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.830317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34eb3765-c60a-40d0-b65a-460a8eafef5c tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.830766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34eb3765-c60a-40d0-b65a-460a8eafef5c tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.831350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34eb3765-c60a-40d0-b65a-460a8eafef5c tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.862026 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34eb3765-c60a-40d0-b65a-460a8eafef5c tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041502 Nov 02 12:22:26.862905 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 370/746] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 12:22:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:26.869202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:26.870074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:26.894046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.898681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.899893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.902630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.905197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855650-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:26.908048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.909236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.913701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:26.929235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.929894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.930406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.931560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.931560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.932086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.993504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Lazy-loading 'flavor' on Instance uuid e6d1cacf-fba6-4284-8771-3ece6797fa31 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:27.010563 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e6d1cacf-fba6-4284-8771-3ece6797fa31 while it is in vm_state suspended Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Request method failure captured: Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31/action HTTP/1.1 Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 97 Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDAMJ9mgQbbFFpF5h2cTqxIA8oqgzLIN5PqkdlLuTl0eAHms0le6g4Ki5D0htB4cydNX0m-zrbnV96E3FCBXrm09RxnEDAZaCN9fhTmOnrWJSEKR75XkhhKLOpexqQEwvCPfTdgOs3ajCUCsE0rwR9Udv-9sRYawSHD3FeYHz4mzmE Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d0d72316e75f4668bb30e957204bbb34 Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-LiveMigrationNegativeTest-1495823185 Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:22:27.012716 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0d72316e75f4668bb30e957204bbb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d0d72316e75f4668bb30e957204bbb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0d72316e75f4668bb30e957204bbb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d0d72316e75f4668bb30e957204bbb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-LiveMigrationNegativeTest-1495823185 Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d0d72316e75f4668bb30e957204bbb34 Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1495823185 Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-LiveMigrationNegativeTest-1495823185-project-admin Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: bb5d92bc8fe24e0abe931c591bdd7f97 Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-LiveMigrationNegativeTest-1495823185-project-admin Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: {"os-migrateLive": {"host": "n-h2-855650-5", "block_migration": true, "disk_over_commit": false}} Nov 02 12:22:27.014274 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'os-migrateLive' instance e6d1cacf-fba6-4284-8771-3ece6797fa31 while it is in vm_state suspended Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'e6d1cacf-fba6-4284-8771-3ece6797fa31', 'body': {'os-migrateLive': {'host': 'n-h2-855650-5', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 12:22:27.015276 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6d1cacf-fba6-4284-8771-3ece6797fa31 in vm_state suspended. Cannot live_migrate while the instance is in this state. Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:27.016580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e6d1cacf-fba6-4284-8771-3ece6797fa31 while it is in vm_state suspended Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e6d1cacf-fba6-4284-8771-3ece6797fa31 while it is in vm_state suspended Nov 02 12:22:27.017907 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:27.020529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e6d1cacf-fba6-4284-8771-3ece6797fa31 while it is in vm_state suspended {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:27.022320 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26b6b0da-c026-4cf6-8bf7-808fe1a294b9 tempest-LiveMigrationNegativeTest-1495823185 tempest-LiveMigrationNegativeTest-1495823185-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31/action" status: 409 len: 155 microversion: 2.1 time: 0.150039 Nov 02 12:22:27.025533 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 371/747] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:26 2022] POST /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31/action => generated 155 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:22:27.036546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:27.038900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:27.073729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:27.074456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:27.074923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:27.075666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:27.076128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:27.076623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:27.242412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:27.251727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:27.253184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:27.254484 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-afead698-0e6e-4202-9a4e-d0d9a813605b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.389662 Nov 02 12:22:27.255248 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 377/748] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:26 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:27.260525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:27.261328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:27.270318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:27.272204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:27.273004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:27.273960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:27.274718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:27.275362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:27.304581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:22:27.378683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:27.388753 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c70c958-774b-4277-a118-305a59449dab tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.361491 Nov 02 12:22:27.390129 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 372/749] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:27 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:27.423767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:27.426443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:27.436350 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ca8a553-e7c8-491b-b925-60093354532c tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 204 len: 0 microversion: 2.1 time: 0.178993 Nov 02 12:22:27.437606 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 378/750] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:22:27 2022] DELETE /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:27.438004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:27.439646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:27.440324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:27.441308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:27.442014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:27.442663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:27.448003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:27.449058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:27.456022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:27.456436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:27.456876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:27.457586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:27.458079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:27.458552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:27.757772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:27.767796 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c4147109-46c6-484e-bf27-1ff3d96187d8 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1466 microversion: 2.1 time: 0.324752 Nov 02 12:22:27.768506 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 379/751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:27 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1466 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:27.773657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05833759-9fea-4985-8419-a546125a3479 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f081160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:27.829910 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05833759-9fea-4985-8419-a546125a3479 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.060054 Nov 02 12:22:27.831037 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 380/752] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:27 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:27.867519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:27.879108 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9ee07dd-c4ed-4785-afe9-d9325324f1d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1358 microversion: 2.1 time: 0.459501 Nov 02 12:22:27.880126 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 373/753] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:27 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1358 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:27.991750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c011533-cc32-4ee1-818a-daf040890e36 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Action: 'create', calling method: .version_select at 0x7f228edb58b0>, body: {"pool": null} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:28.285445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:28.286521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:28.294480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:28.295286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:28.295920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:28.296755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:28.297323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:28.297829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:28.744484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=26 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:28.919038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:28.958868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:28.964108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:28.969865 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e31b3589-6cab-4acc-b466-0b25ca25382b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.688499 Nov 02 12:22:28.971982 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 374/754] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:28 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:22:28.981292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:28.982295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:28.995526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:28.996692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:28.997598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:28.999028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:29.001174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:29.002032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:29.278799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:29.293593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:29.300054 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-49c97b34-9e09-4eef-87d1-85e4c0c04c13 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1323 microversion: 2.1 time: 0.325721 Nov 02 12:22:29.302342 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 375/755] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:28 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:29.310081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:29.310962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:29.320307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:29.320818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:29.321573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:29.322725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:29.323209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:29.323653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:29.784859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:29.798070 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1405bc37-4001-48de-be2c-e9ac4f65e31e tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1466 microversion: 2.1 time: 0.493755 Nov 02 12:22:29.802020 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 376/756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:29 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1466 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:29.817915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-743a8e4a-cbaa-4cdf-84fc-0eb088ba49f4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ea991f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:29.915430 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-743a8e4a-cbaa-4cdf-84fc-0eb088ba49f4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.111157 Nov 02 12:22:29.925167 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 377/757] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:29 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:29.932355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:29.933009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:29.940109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:29.940865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:29.941471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:29.942440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:29.942906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:29.944062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:30.797159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:30.828000 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0bc6c8bf-9c12-4132-8f7d-8db1448e98f6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1358 microversion: 2.1 time: 0.901577 Nov 02 12:22:30.828627 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 378/758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:29 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1358 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:30.836376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:30.837312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:30.849301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:30.851084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:30.852209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:30.853469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:30.854327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:30.855097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:31.555603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:31.572813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:31.574580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:31.575829 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33e1ce73-53da-4550-b52e-3b24b8771d2d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.746164 Nov 02 12:22:31.576408 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 379/759] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:30 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:31.588114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:31.595034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:31.610829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:31.611422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:31.611880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:31.612625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:31.613096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:31.613566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:31.948809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:31.972675 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34c37617-75db-46af-af88-15730863b494 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 200 len: 1519 microversion: 2.1 time: 0.389069 Nov 02 12:22:31.973653 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 380/760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:31 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 1519 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:31.987275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:31.988831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:32.023861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.025366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.026080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.037936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.039313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.040382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.113402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.116759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.117509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.118775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lazy-loading 'fault' on Instance uuid e6d1cacf-fba6-4284-8771-3ece6797fa31 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:32.232876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:32.252537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a67f906d-182a-40e9-bd82-df7d40b80ede tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 200 len: 1309 microversion: 2.1 time: 0.275716 Nov 02 12:22:32.253695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 381/761] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:31 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:32.260469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02354892-3596-4d12-afc9-dee3e3306c54 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ebb1ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:32.382443 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02354892-3596-4d12-afc9-dee3e3306c54 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.112910 Nov 02 12:22:32.385134 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 382/762] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:32 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:32.473262 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c011533-cc32-4ee1-818a-daf040890e36 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.641173 Nov 02 12:22:32.474908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 381/763] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:22:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:32.499630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a90b49e3-15bc-4273-bb0f-d90fcf7c8d98 req-10c316e0-8439-4dc6-bee1-4df6de14f0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d1cacf-fba6-4284-8771-3ece6797fa31", "name": "network-vif-deleted", "tag": "a6889f29-1d1f-4865-99a7-33924dd0d866"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:32.541515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a90b49e3-15bc-4273-bb0f-d90fcf7c8d98 req-10c316e0-8439-4dc6-bee1-4df6de14f0db service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.542110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a90b49e3-15bc-4273-bb0f-d90fcf7c8d98 req-10c316e0-8439-4dc6-bee1-4df6de14f0db service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.542567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a90b49e3-15bc-4273-bb0f-d90fcf7c8d98 req-10c316e0-8439-4dc6-bee1-4df6de14f0db service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.590728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a90b49e3-15bc-4273-bb0f-d90fcf7c8d98 req-10c316e0-8439-4dc6-bee1-4df6de14f0db service nova] Creating event network-vif-deleted:a6889f29-1d1f-4865-99a7-33924dd0d866 for instance e6d1cacf-fba6-4284-8771-3ece6797fa31 on n-h1-855650-5 Nov 02 12:22:32.610785 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a90b49e3-15bc-4273-bb0f-d90fcf7c8d98 req-10c316e0-8439-4dc6-bee1-4df6de14f0db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133756 Nov 02 12:22:32.611980 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 382/764] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:32.640606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:32.641730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:32.653947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.654676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.655304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.656224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.657139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.657788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.811751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8fafcd7-4fd9-4f8c-842b-d31c6ae3d58a tempest-ListImagesTestJSON-1575474176 tempest-ListImagesTestJSON-1575474176-project] Calling method '.version_select at 0x7f228ebfc280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:32.899943 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8fafcd7-4fd9-4f8c-842b-d31c6ae3d58a tempest-ListImagesTestJSON-1575474176 tempest-ListImagesTestJSON-1575474176-project] 10.222.0.45 "GET /compute/v2.1/images/5a18a9e9-495a-4970-9f7b-124577e0709a" status: 200 len: 784 microversion: 2.1 time: 0.513161 Nov 02 12:22:32.914324 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 383/765] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:32 2022] GET /compute/v2.1/images/5a18a9e9-495a-4970-9f7b-124577e0709a => generated 784 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:32.920876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'action', calling method: .version_select at 0x7f22904bee50>, body: {"addFloatingIp": {"address": "172.25.4.174"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:32.924333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:32.924990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:32.931461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.932460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.933145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.934014 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5645fee9-39b3-4fd7-bb06-089157b54633 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1358 microversion: 2.1 time: 0.320385 Nov 02 12:22:32.934804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.934965 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 383/766] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:32 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:32.935631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.936174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.941145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d55fd53-f2ee-4a16-a292-b287528a151f tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Calling method '.version_select at 0x7f228ed69670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:33.073884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:22:33.074682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquired lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:22:33.292225 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d55fd53-f2ee-4a16-a292-b287528a151f tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/15b8919c-0875-4057-96e3-c1bd5dec7f8d" status: 200 len: 142 microversion: 2.1 time: 0.355222 Nov 02 12:22:33.292901 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 384/767] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:22:32 2022] GET /compute/v2.1/os-floating-ips/15b8919c-0875-4057-96e3-c1bd5dec7f8d => generated 142 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:33.297782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:33.298722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:33.317847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:33.318936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:33.321206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:33.322024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:33.322473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:33.322909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:33.712804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:33.725785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:33.728366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:33.729866 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-89031361-2d19-4fa4-bcb4-3636bda95ca2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1569 microversion: 2.25 time: 0.435946 Nov 02 12:22:33.730709 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 385/768] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:33 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1569 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:33.757825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b67d1239-0689-487a-831a-0a4d221bd83e tempest-ListImagesTestJSON-1575474176 tempest-ListImagesTestJSON-1575474176-project] Calling method '.version_select at 0x7f228ede6040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:33.919134 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b67d1239-0689-487a-831a-0a4d221bd83e tempest-ListImagesTestJSON-1575474176 tempest-ListImagesTestJSON-1575474176-project] 10.222.0.45 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.174598 Nov 02 12:22:33.920040 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 386/769] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Nov 2 12:22:33 2022] GET /compute/v2.1/images => generated 445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:33.942619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:33.943844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: e6d1cacf-fba6-4284-8771-3ece6797fa31] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:33.952040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:33.953030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:33.954079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:33.955055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:33.955736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:33.956428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:33.972406 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] HTTP exception thrown: Instance e6d1cacf-fba6-4284-8771-3ece6797fa31 could not be found. Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Request method failure captured: Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 HTTP/1.1 Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmC_K7ErBf6kcKMsIxmopavHBG-_qgk5-at6Q0Rqa1X3MiZ2cNeL7G1vA-fwGBrhnqyZsmokxM4Te1hKy2Zai7Yw3LgwKDs7oCPUqqLexKYESestlBONELnCdF6KPql7ba0BoCsHWj6EWFli9QiSA25AoZTIGmwrYnbqwksDeq8bILg Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 7999252f99d945058b53b83a4aa23fb0 Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-LiveMigrationNegativeTest-85597330 Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:22:33.975166 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7999252f99d945058b53b83a4aa23fb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7999252f99d945058b53b83a4aa23fb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7999252f99d945058b53b83a4aa23fb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7999252f99d945058b53b83a4aa23fb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-LiveMigrationNegativeTest-85597330 Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 7999252f99d945058b53b83a4aa23fb0 Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-85597330 Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-LiveMigrationNegativeTest-85597330-project Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a5d7acebd00d425d98eeb19124a5722d Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-LiveMigrationNegativeTest-85597330-project Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance e6d1cacf-fba6-4284-8771-3ece6797fa31 could not be found. Nov 02 12:22:33.976548 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'e6d1cacf-fba6-4284-8771-3ece6797fa31'} Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d1cacf-fba6-4284-8771-3ece6797fa31 could not be found. Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:33.977335 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d1cacf-fba6-4284-8771-3ece6797fa31 could not be found. Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d1cacf-fba6-4284-8771-3ece6797fa31 could not be found. Nov 02 12:22:33.978592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:33.981185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Returning 404 to user: Instance e6d1cacf-fba6-4284-8771-3ece6797fa31 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:33.982334 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d7134b56-1653-48da-bac0-96921b4c1a71 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31" status: 404 len: 111 microversion: 2.1 time: 0.060555 Nov 02 12:22:33.983488 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 387/770] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:33 2022] GET /compute/v2.1/servers/e6d1cacf-fba6-4284-8771-3ece6797fa31 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:33.989656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b913d740-c262-4867-83a0-d0823d74692b tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Calling method '.version_select at 0x7f228edb5160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:34.309784 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b913d740-c262-4867-83a0-d0823d74692b tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.324893 Nov 02 12:22:34.310821 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 388/771] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:22:33 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:34.324529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-43b6402a-2097-4a89-b761-223e80c196ef tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228edfa5e0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:34.408381 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-43b6402a-2097-4a89-b761-223e80c196ef tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.096295 Nov 02 12:22:34.409307 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 389/772] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:34 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:34.426294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-160859c8-8b5f-4b35-826f-3efe74c2c0fd req-5558618b-f29c-4fec-b32e-108486fbd0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce3f9c6-de73-4a88-8cb8-a20198986ffb", "name": "network-vif-plugged", "status": "completed", "tag": "ced7ed63-2e97-4192-938d-c3e96e6d249f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:34.438195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-160859c8-8b5f-4b35-826f-3efe74c2c0fd req-5558618b-f29c-4fec-b32e-108486fbd0b9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:34.439042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-160859c8-8b5f-4b35-826f-3efe74c2c0fd req-5558618b-f29c-4fec-b32e-108486fbd0b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:34.439657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-160859c8-8b5f-4b35-826f-3efe74c2c0fd req-5558618b-f29c-4fec-b32e-108486fbd0b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:34.497326 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-160859c8-8b5f-4b35-826f-3efe74c2c0fd req-5558618b-f29c-4fec-b32e-108486fbd0b9 service nova] Creating event network-vif-plugged:ced7ed63-2e97-4192-938d-c3e96e6d249f for instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb on n-h2-855650-5 Nov 02 12:22:34.578792 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-160859c8-8b5f-4b35-826f-3efe74c2c0fd req-5558618b-f29c-4fec-b32e-108486fbd0b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167468 Nov 02 12:22:34.579759 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 390/773] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:34.585818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41c3206f-c50e-477b-a42e-75cbc3b141cc tempest-ListImagesTestJSON-1575474176 tempest-ListImagesTestJSON-1575474176-project] Calling method '.version_select at 0x7f228edb5550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:34.660774 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41c3206f-c50e-477b-a42e-75cbc3b141cc tempest-ListImagesTestJSON-1575474176 tempest-ListImagesTestJSON-1575474176-project] 10.222.0.45 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.079881 Nov 02 12:22:34.661372 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 391/774] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:22:34 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:34.669866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:34.670947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:34.684588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:34.685310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:34.685920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:34.687032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:34.687685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:34.688275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:35.381461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:35.393262 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-632b72fd-2ffa-4ca6-a0da-eb2138b86d53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1358 microversion: 2.1 time: 0.726993 Nov 02 12:22:35.394824 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 392/775] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:34 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1358 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:35.407637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:35.408499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:35.418158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:35.419043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:35.419867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:35.421767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:35.422661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:35.423613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:35.473511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:22:35.512006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:35.674163 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7fd4579c-a837-4416-871e-28509d786231 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 204 len: 0 microversion: 2.1 time: 0.275565 Nov 02 12:22:35.674881 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 393/776] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:22:35 2022] DELETE /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:35.686567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d0ba08d-eff0-43c7-86ff-3af28e562055 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Calling method '.version_select at 0x7f228eeb9ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:36.191086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Building network info cache for instance {{(pid=120722) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:22:36.842889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:37.656039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Updating instance_info_cache with network_info: [{"id": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf", "address": "fa:16:3e:e3:75:5c", "network": {"id": "bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-899408719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82dbd88241604726a6c21297724cf95d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3dd63f67-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120722) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:22:37.679715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Releasing lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:22:37.680664 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-102e0a26-2f10-471f-9394-e3b4f045551b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action" status: 202 len: 0 microversion: 2.1 time: 4.764386 Nov 02 12:22:37.683557 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 384/777] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:32 2022] POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action => generated 0 bytes in 4767 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:22:37.700764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:37.701463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:37.710067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:37.710812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:37.711480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:37.712591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:37.713257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:37.713922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:37.910312 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d0ba08d-eff0-43c7-86ff-3af28e562055 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/15b8919c-0875-4057-96e3-c1bd5dec7f8d" status: 202 len: 0 microversion: 2.1 time: 2.233929 Nov 02 12:22:37.911225 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 394/778] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:22:35 2022] DELETE /compute/v2.1/os-floating-ips/15b8919c-0875-4057-96e3-c1bd5dec7f8d => generated 0 bytes in 2236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:37.919366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-443a9250-f7ce-4783-ba8d-ac6a73a85730 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ede6700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:37.947859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:37.963041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:37.965203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:37.971768 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-899bc402-cf72-4fdb-8f89-6bb19c9e0c6f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1544 microversion: 2.25 time: 0.283786 Nov 02 12:22:37.974214 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 385/779] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:37 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:37.988959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:37.991372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:38.011766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.013080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.013652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:38.014525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.015335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.018696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:38.026242 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-443a9250-f7ce-4783-ba8d-ac6a73a85730 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.112170 Nov 02 12:22:38.036270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 395/780] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:37 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:38.050725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-07ede42b-bebf-4256-93a3-14876e182b4e req-e70059ca-5a13-480a-bb30-3a1b680858c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d8ccfc-5664-420a-bf9d-841e82aa1ab1", "tag": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:38.072015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-07ede42b-bebf-4256-93a3-14876e182b4e req-e70059ca-5a13-480a-bb30-3a1b680858c2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.072937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-07ede42b-bebf-4256-93a3-14876e182b4e req-e70059ca-5a13-480a-bb30-3a1b680858c2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.073997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-07ede42b-bebf-4256-93a3-14876e182b4e req-e70059ca-5a13-480a-bb30-3a1b680858c2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:38.092091 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-07ede42b-bebf-4256-93a3-14876e182b4e req-e70059ca-5a13-480a-bb30-3a1b680858c2 service nova] Creating event network-changed:3dd63f67-75a2-455b-ae9d-2766c6a3eedf for instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 on n-h1-855650-5 Nov 02 12:22:38.109238 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-07ede42b-bebf-4256-93a3-14876e182b4e req-e70059ca-5a13-480a-bb30-3a1b680858c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071187 Nov 02 12:22:38.109884 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 396/781] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:38.128023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:38.128782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:38.158425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.158932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.159484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:38.160119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.161192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.163432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:38.202462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d7acebd00d425d98eeb19124a5722d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7999252f99d945058b53b83a4aa23fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:38.215029 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba273af5-ed86-442d-b641-b980ba2353d4 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 200 len: 1431 microversion: 2.1 time: 0.239377 Nov 02 12:22:38.215628 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 386/782] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:37 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 1431 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:38.438230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff79cbd9-ff6d-46fc-a042-f893a8c215d6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Action: 'create', calling method: .version_select at 0x7f228ec41430>, body: {"keypair": {"name": "tempest-keypair-507921046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn5OTYozj4oaRz8dichE4gz6EqQbycgvJC1K/LXwWuaJ/7yzCDJrPowLhaHjTGxnj/NNjGoD4KrZsXFPZvpiokZMOROZ5QctNQYY60KcPzkgH7vfGcicRyPEdl1akT4pA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:38.501504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:38.502638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ff79cbd9-ff6d-46fc-a042-f893a8c215d6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:38.527078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ff79cbd9-ff6d-46fc-a042-f893a8c215d6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for user 15a26431514a488fa0c96bb8ea2f3f4d and project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:38.533380 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e4521340-ca0c-46e9-a6fe-cfccd0dc2ef9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1542 microversion: 2.1 time: 0.416709 Nov 02 12:22:38.538374 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 397/783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:38 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1542 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:38.545764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'action', calling method: .version_select at 0x7f22904bfe50>, body: {"addFloatingIp": {"address": "172.25.4.174"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:38.556683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:38.567259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.567875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.569328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:38.572365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.572861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.573311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:38.611419 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff79cbd9-ff6d-46fc-a042-f893a8c215d6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.377400 Nov 02 12:22:38.612712 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 387/784] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:22:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:38.621231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a3ace91-307f-4ab0-a184-cd0c4ef0d631 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Action: 'create', calling method: .version_select at 0x7f228ea173a0>, body: {"pool": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:38.710697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "refresh_cache-84a4639e-be33-4fdc-bd49-ba842ba07cf0" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:22:38.711512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquired lock "refresh_cache-84a4639e-be33-4fdc-bd49-ba842ba07cf0" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:22:42.320576 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a3ace91-307f-4ab0-a184-cd0c4ef0d631 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.705327 Nov 02 12:22:42.321831 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 388/785] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:22:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:42.334489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e61aff44-2291-4cd6-9377-79645a809932 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '.version_select at 0x7f228ebfca60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:42.342568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e61aff44-2291-4cd6-9377-79645a809932 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:42.343128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e61aff44-2291-4cd6-9377-79645a809932 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:42.343581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e61aff44-2291-4cd6-9377-79645a809932 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:42.364369 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e61aff44-2291-4cd6-9377-79645a809932 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.041312 Nov 02 12:22:42.365006 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 389/786] 10.222.0.45 () {60 vars in 1184 bytes} [Wed Nov 2 12:22:42 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:42.380683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d549d7d2-8dee-42f4-97bf-60357db29b43 req-01638321-1716-42ba-a2cc-1a955af5d548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ced03fd-249c-44d2-b1a4-3ba8e35d0517", "name": "network-vif-deleted", "tag": "0a958d25-bdeb-4308-99ed-c7560ed66729"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:42.392667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d549d7d2-8dee-42f4-97bf-60357db29b43 req-01638321-1716-42ba-a2cc-1a955af5d548 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:42.393181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d549d7d2-8dee-42f4-97bf-60357db29b43 req-01638321-1716-42ba-a2cc-1a955af5d548 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:42.393631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d549d7d2-8dee-42f4-97bf-60357db29b43 req-01638321-1716-42ba-a2cc-1a955af5d548 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:42.407781 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d549d7d2-8dee-42f4-97bf-60357db29b43 req-01638321-1716-42ba-a2cc-1a955af5d548 service nova] Creating event network-vif-deleted:0a958d25-bdeb-4308-99ed-c7560ed66729 for instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 on n-h1-855650-5 Nov 02 12:22:42.414649 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d549d7d2-8dee-42f4-97bf-60357db29b43 req-01638321-1716-42ba-a2cc-1a955af5d548 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046564 Nov 02 12:22:42.415636 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 390/787] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:42.421506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:42.422933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:42.431599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:42.434322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:42.434792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:42.435534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:42.436017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:42.436455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:42.564567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3eb8855-bdf4-4fd1-94d9-19b8a6d9402d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147663 Nov 02 12:22:42.565944 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 391/788] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:22:42 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:42.572937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d97b5334-edb8-4948-83e7-e8af5753e095 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Calling method '.version_select at 0x7f228ec411f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:42.586435 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d97b5334-edb8-4948-83e7-e8af5753e095 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-507921046" status: 200 len: 496 microversion: 2.1 time: 0.019080 Nov 02 12:22:42.589349 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 392/789] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Nov 2 12:22:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-507921046 => generated 496 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:42.595458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46f7ed6c-bff1-46d0-b2d6-30b10516f0fa tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228edd7550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:42.658507 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46f7ed6c-bff1-46d0-b2d6-30b10516f0fa tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.066968 Nov 02 12:22:42.659107 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 393/790] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:42 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:42.681912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:42.687622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] [instance: 2ced03fd-249c-44d2-b1a4-3ba8e35d0517] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:42.704410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:42.708446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:42.710118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:42.711565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:42.714535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:42.715341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:42.768673 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] HTTP exception thrown: Instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 could not be found. Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Request method failure captured: Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 HTTP/1.1 Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmC_K7ErBf6kcKMsIxmopavHBG-_qgk5-at6Q0Rqa1X3MiZ2cNeL7G1vA-fwGBrhnqyZsmokxM4Te1hKy2Zai7Yw3LgwKDs7oCPUqqLexKYESestlBONELnCdF6KPql7ba0BoCsHWj6EWFli9QiSA25AoZTIGmwrYnbqwksDeq8bILg Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 7999252f99d945058b53b83a4aa23fb0 Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-LiveMigrationNegativeTest-85597330 Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:22:42.770860 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7999252f99d945058b53b83a4aa23fb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7999252f99d945058b53b83a4aa23fb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7999252f99d945058b53b83a4aa23fb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7999252f99d945058b53b83a4aa23fb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-LiveMigrationNegativeTest-85597330 Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 7999252f99d945058b53b83a4aa23fb0 Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-85597330 Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-LiveMigrationNegativeTest-85597330-project Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a5d7acebd00d425d98eeb19124a5722d Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-LiveMigrationNegativeTest-85597330-project Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 could not be found. Nov 02 12:22:42.772356 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2ced03fd-249c-44d2-b1a4-3ba8e35d0517'} Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 could not be found. Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:42.773127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 could not be found. Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 could not be found. Nov 02 12:22:42.774447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:42.777486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] Returning 404 to user: Instance 2ced03fd-249c-44d2-b1a4-3ba8e35d0517 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:42.778739 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-188cf91d-e03f-409b-a20f-6af26347c147 tempest-LiveMigrationNegativeTest-85597330 tempest-LiveMigrationNegativeTest-85597330-project] 10.222.0.45 "GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517" status: 404 len: 111 microversion: 2.1 time: 0.109762 Nov 02 12:22:42.782858 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 394/791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:42 2022] GET /compute/v2.1/servers/2ced03fd-249c-44d2-b1a4-3ba8e35d0517 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:42.807703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-447bccc4-f962-4df2-bd1b-352f15657b82 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Calling method '.version_select at 0x7f228ed0cee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:42.972428 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.network.neutron [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] re-assign floating IP 172.25.4.174 from instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 Nov 02 12:22:43.084261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Building network info cache for instance {{(pid=120723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:22:44.481990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Updating instance_info_cache with network_info: [{"id": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf", "address": "fa:16:3e:e3:75:5c", "network": {"id": "bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-899408719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82dbd88241604726a6c21297724cf95d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3dd63f67-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:22:44.506481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Building network info cache for instance {{(pid=120723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:22:45.323293 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-447bccc4-f962-4df2-bd1b-352f15657b82 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/008b259c-eee0-4400-85c3-b6c0f09c9b36" status: 202 len: 0 microversion: 2.1 time: 2.538892 Nov 02 12:22:45.324369 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 395/792] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:22:42 2022] DELETE /compute/v2.1/os-floating-ips/008b259c-eee0-4400-85c3-b6c0f09c9b36 => generated 0 bytes in 2540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:45.329959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:45.330912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:45.338795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:45.339716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:45.340394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:45.341382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:45.342094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:45.342813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:45.753944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid eb59ac2b-fb2c-4690-9a9e-9cb56f78155a {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:45.770724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eab9d057-169a-4e60-b5b1-e284b6f05067 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 2037 microversion: 2.25 time: 0.445228 Nov 02 12:22:45.782545 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 396/793] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:45 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 2037 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:45.807599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-97e59e75-ad1e-4fa6-81b9-8b13f4d445c1 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Calling method '.version_select at 0x7f228ec41e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:45.819936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:45.843730 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-97e59e75-ad1e-4fa6-81b9-8b13f4d445c1 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507921046" status: 202 len: 0 microversion: 2.1 time: 0.059671 Nov 02 12:22:45.845476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 397/794] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507921046 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:45.863053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1db30c58-d517-4d67-bdb5-1158037dbf44 req-8ff6a6a6-f71b-4937-bf2c-bd938e23e487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d8ccfc-5664-420a-bf9d-841e82aa1ab1", "tag": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:45.878926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1db30c58-d517-4d67-bdb5-1158037dbf44 req-8ff6a6a6-f71b-4937-bf2c-bd938e23e487 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:45.879736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1db30c58-d517-4d67-bdb5-1158037dbf44 req-8ff6a6a6-f71b-4937-bf2c-bd938e23e487 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:45.880595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1db30c58-d517-4d67-bdb5-1158037dbf44 req-8ff6a6a6-f71b-4937-bf2c-bd938e23e487 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:45.901545 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1db30c58-d517-4d67-bdb5-1158037dbf44 req-8ff6a6a6-f71b-4937-bf2c-bd938e23e487 service nova] Creating event network-changed:3dd63f67-75a2-455b-ae9d-2766c6a3eedf for instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 on n-h1-855650-5 Nov 02 12:22:45.915149 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1db30c58-d517-4d67-bdb5-1158037dbf44 req-8ff6a6a6-f71b-4937-bf2c-bd938e23e487 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060820 Nov 02 12:22:45.916625 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 398/795] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:45.924500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f820ad9-dd0b-4b30-86c2-48b724389b8a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ec55700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:45.997910 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f820ad9-dd0b-4b30-86c2-48b724389b8a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1421 microversion: 2.1 time: 0.078748 Nov 02 12:22:45.998897 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 399/796] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:45 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:46.006757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0964ee8c-6bcb-4481-a5cd-a1aa68235832 req-6add6b48-bdaa-4648-b839-df0c5d98dff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce3f9c6-de73-4a88-8cb8-a20198986ffb", "tag": "ced7ed63-2e97-4192-938d-c3e96e6d249f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:46.035639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0964ee8c-6bcb-4481-a5cd-a1aa68235832 req-6add6b48-bdaa-4648-b839-df0c5d98dff9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:46.036201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0964ee8c-6bcb-4481-a5cd-a1aa68235832 req-6add6b48-bdaa-4648-b839-df0c5d98dff9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:46.036639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0964ee8c-6bcb-4481-a5cd-a1aa68235832 req-6add6b48-bdaa-4648-b839-df0c5d98dff9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:46.072892 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0964ee8c-6bcb-4481-a5cd-a1aa68235832 req-6add6b48-bdaa-4648-b839-df0c5d98dff9 service nova] Creating event network-changed:ced7ed63-2e97-4192-938d-c3e96e6d249f for instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb on n-h2-855650-5 Nov 02 12:22:46.081063 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0964ee8c-6bcb-4481-a5cd-a1aa68235832 req-6add6b48-bdaa-4648-b839-df0c5d98dff9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080754 Nov 02 12:22:46.090083 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 400/797] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:46.096955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f65979d-024d-4d73-939c-e143cf212537 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Calling method '.version_select at 0x7f228ec550d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:46.269069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-3f65979d-024d-4d73-939c-e143cf212537 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 008b259c-eee0-4400-85c3-b6c0f09c9b36 could not be found", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:22:46.270766 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3f65979d-024d-4d73-939c-e143cf212537 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] HTTP exception thrown: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f65979d-024d-4d73-939c-e143cf212537 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Request method failure captured: Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-floating-ips/008b259c-eee0-4400-85c3-b6c0f09c9b36 HTTP/1.1 Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEDVx_-RHO-KrzM-Y9NZ3C6jackLzM55GObp9gHAm-_d-9VP8gVM5MeLbzjmYjc3do-FxkVkhocIlJRZfQm71mU5xy4VZCkwwM9DXEHpEy_OF4DBQ7vuuFrk8qmfv_TsJk0vb43I7VdtcXs_gIejr95_II9W7zBQ-FGcWv72fI_FMg Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: b2c30fa233a0444e8c06b78bb1d52492 Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FloatingIPsTestJSON-1306896048 Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:22:46.277497 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b2c30fa233a0444e8c06b78bb1d52492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b2c30fa233a0444e8c06b78bb1d52492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b2c30fa233a0444e8c06b78bb1d52492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b2c30fa233a0444e8c06b78bb1d52492"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FloatingIPsTestJSON-1306896048 Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: b2c30fa233a0444e8c06b78bb1d52492 Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1306896048 Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FloatingIPsTestJSON-1306896048-project Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 2546c26021cc49c8a59c8e18c530a5d2 Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FloatingIPsTestJSON-1306896048-project Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: exception: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '008b259c-eee0-4400-85c3-b6c0f09c9b36'} Nov 02 12:22:46.280261 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:22:46.281419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 008b259c-eee0-4400-85c3-b6c0f09c9b36 could not be found Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-956f75b4-26c1-494e-ae52-18bf95fae450'] Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36. Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:46.283668 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:46.285804 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:46.295223 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 Nov 02 12:22:46.295223 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.297468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f65979d-024d-4d73-939c-e143cf212537 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Returning 404 to user: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:46.298634 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f65979d-024d-4d73-939c-e143cf212537 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/008b259c-eee0-4400-85c3-b6c0f09c9b36" status: 404 len: 111 microversion: 2.1 time: 0.206344 Nov 02 12:22:46.302724 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 401/798] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:22:46 2022] GET /compute/v2.1/os-floating-ips/008b259c-eee0-4400-85c3-b6c0f09c9b36 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:46.309283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-422f4585-a961-47cf-a925-524bd01811a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Action: 'create', calling method: .version_select at 0x7f228ec41f70>, body: {"keypair": {"name": "tempest-keypair-416199290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGABZ6g68PAzYks7JqCh4H6k4T69eumKK1Ck+y0bmFzhNVDZkATtAeD67RyRWT2A2H+dcgNoQlng5+VrGf+ITSOQRq/FS7QlZszpYzbn+a+bgIG1N+2y9u7cVVB0u8yhvg=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:46.369372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-422f4585-a961-47cf-a925-524bd01811a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for project 61f9f821af56421c98639028cc700a64. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:46.376531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-422f4585-a961-47cf-a925-524bd01811a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for user a71d3feaad3148cc89c28cb18acf0cd0 and project 61f9f821af56421c98639028cc700a64. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:46.404304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Updating instance_info_cache with network_info: [{"id": "2e74770e-7830-4b88-9a83-f09758a7a477", "address": "fa:16:3e:38:89:c7", "network": {"id": "bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-899408719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82dbd88241604726a6c21297724cf95d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2e74770e-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:22:46.420511 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-422f4585-a961-47cf-a925-524bd01811a3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.116261 Nov 02 12:22:46.421799 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 402/799] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 12:22:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:22:46.430427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0431c2f-e615-488c-977a-2f0284668998 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Action: 'create', calling method: .version_select at 0x7f228ea17d30>, body: {"keypair": {"name": "tempest-keypair-149215264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqbch+sN5qkfL+ei9YtBJo4orDnuZtNz+WbAd/zUDudbp16eWfROZUsGARw18rjrpjUVnW1Bme008sETMQ4LQGtwa0LfNuuEhJPSfj6OjgV5OZQTNas+UTlplIkC7Mf9A=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:46.433754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Releasing lock "refresh_cache-84a4639e-be33-4fdc-bd49-ba842ba07cf0" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:22:46.435294 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e904869c-1bdf-4a4a-874e-9fcc074b6802 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0/action" status: 202 len: 0 microversion: 2.1 time: 7.893529 Nov 02 12:22:46.439880 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 398/800] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:38 2022] POST /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0/action => generated 0 bytes in 7900 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:22:46.446652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dca296b6-e6ce-4259-81e1-571a12955dd3 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Calling method '.version_select at 0x7f228eeb9040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:46.472727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-e0431c2f-e615-488c-977a-2f0284668998 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:46.480546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-e0431c2f-e615-488c-977a-2f0284668998 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for user 15a26431514a488fa0c96bb8ea2f3f4d and project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:46.519892 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0431c2f-e615-488c-977a-2f0284668998 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096299 Nov 02 12:22:46.523264 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 403/801] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:22:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:46.535511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'action', calling method: .version_select at 0x7f22904bedc0>, body: {"removeFloatingIp": {"address": "172.25.4.174"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:46.586951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-dca296b6-e6ce-4259-81e1-571a12955dd3 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 008b259c-eee0-4400-85c3-b6c0f09c9b36 could not be found", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:22:46.588079 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-dca296b6-e6ce-4259-81e1-571a12955dd3 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] HTTP exception thrown: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dca296b6-e6ce-4259-81e1-571a12955dd3 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Request method failure captured: Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-floating-ips/008b259c-eee0-4400-85c3-b6c0f09c9b36 HTTP/1.1 Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEDVx_-RHO-KrzM-Y9NZ3C6jackLzM55GObp9gHAm-_d-9VP8gVM5MeLbzjmYjc3do-FxkVkhocIlJRZfQm71mU5xy4VZCkwwM9DXEHpEy_OF4DBQ7vuuFrk8qmfv_TsJk0vb43I7VdtcXs_gIejr95_II9W7zBQ-FGcWv72fI_FMg Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: b2c30fa233a0444e8c06b78bb1d52492 Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FloatingIPsTestJSON-1306896048 Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:22:46.591447 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b2c30fa233a0444e8c06b78bb1d52492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b2c30fa233a0444e8c06b78bb1d52492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b2c30fa233a0444e8c06b78bb1d52492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b2c30fa233a0444e8c06b78bb1d52492"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FloatingIPsTestJSON-1306896048 Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: b2c30fa233a0444e8c06b78bb1d52492 Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1306896048 Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FloatingIPsTestJSON-1306896048-project Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 2546c26021cc49c8a59c8e18c530a5d2 Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FloatingIPsTestJSON-1306896048-project Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: exception: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '008b259c-eee0-4400-85c3-b6c0f09c9b36'} Nov 02 12:22:46.593050 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:22:46.594085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 008b259c-eee0-4400-85c3-b6c0f09c9b36 could not be found Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5fe6671-b4f4-4821-a8e3-47bbe6257e2e'] Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36. Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:46.595462 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:46.596713 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:46.598581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 Nov 02 12:22:46.598581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:46.599759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dca296b6-e6ce-4259-81e1-571a12955dd3 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] Returning 404 to user: Floating IP not found for ID 008b259c-eee0-4400-85c3-b6c0f09c9b36 {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:46.601387 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dca296b6-e6ce-4259-81e1-571a12955dd3 tempest-FloatingIPsTestJSON-1306896048 tempest-FloatingIPsTestJSON-1306896048-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/008b259c-eee0-4400-85c3-b6c0f09c9b36" status: 404 len: 111 microversion: 2.1 time: 0.159994 Nov 02 12:22:46.602793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 399/802] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:22:46 2022] DELETE /compute/v2.1/os-floating-ips/008b259c-eee0-4400-85c3-b6c0f09c9b36 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:46.623798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bde6758e-1047-4121-b599-5e3f6374e720 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Calling method '.version_select at 0x7f228ecf6e50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:46.657395 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bde6758e-1047-4121-b599-5e3f6374e720 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149215264" status: 202 len: 0 microversion: 2.1 time: 0.053349 Nov 02 12:22:46.658017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 400/803] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149215264 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:46.671183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e340df04-c3e2-4966-9fbb-c027343f4777 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Action: 'create', calling method: .version_select at 0x7f228edb5ee0>, body: {"keypair": {"name": "tempest-keypair-1595353838", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:46.713989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e340df04-c3e2-4966-9fbb-c027343f4777 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:46.731391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e340df04-c3e2-4966-9fbb-c027343f4777 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for user 15a26431514a488fa0c96bb8ea2f3f4d and project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:46.799741 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e340df04-c3e2-4966-9fbb-c027343f4777 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.135767 Nov 02 12:22:46.800360 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 401/804] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:22:46 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:46.811998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3b4ec072-731c-4145-bfbd-22ebf58cefb8 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Calling method '.version_select at 0x7f228ecff700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:46.853767 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3b4ec072-731c-4145-bfbd-22ebf58cefb8 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595353838" status: 202 len: 0 microversion: 2.1 time: 0.045351 Nov 02 12:22:46.861726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 402/805] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595353838 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:22:46.871029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6085758b-5a24-47f2-a243-5d42175370cd tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Action: 'create', calling method: .version_select at 0x7f228ed09f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-126926241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtwjYcT1GAUAq3vD99LxmkxK6mnBmcWuJWntRcsv4p/mFeqS2L05SYVr+MLIxMO4zirryXHognn4tKKUFP1Fpxoo9kOSjS7V4zn8Xq5hfLcr7KMVw0vPZ2PiUSUX1YYjg=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:46.903670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-6085758b-5a24-47f2-a243-5d42175370cd tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:46.907670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:46.914178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-6085758b-5a24-47f2-a243-5d42175370cd tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for user 15a26431514a488fa0c96bb8ea2f3f4d and project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:46.972509 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6085758b-5a24-47f2-a243-5d42175370cd tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.108067 Nov 02 12:22:46.983382 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 403/806] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:22:46 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:47.006066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e96cdffd-ac89-4e6b-a742-82463ab7182f tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Action: 'create', calling method: .version_select at 0x7f228ed07550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1481806770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXqXZ4dFTL+HC8hPB5tIsI9KhnwqVsaqkfdvwJIa/moiIeieaOQM6n55LLRoVBQ9biJCRfJuIB+hRU65OwGcvUG3lCksYjCTUuDUyxi/wGtHSIYmOiE8NZiQxuovWZG4A=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:47.057114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e96cdffd-ac89-4e6b-a742-82463ab7182f tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:47.068336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e96cdffd-ac89-4e6b-a742-82463ab7182f tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for user 15a26431514a488fa0c96bb8ea2f3f4d and project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:47.139413 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e96cdffd-ac89-4e6b-a742-82463ab7182f tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.152633 Nov 02 12:22:47.142359 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 404/807] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:22:46 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:47.148686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1145583-2e12-469f-a738-ddc8635a1f66 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ecff9d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:47.246318 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1145583-2e12-469f-a738-ddc8635a1f66 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1430 microversion: 2.1 time: 0.101842 Nov 02 12:22:47.251738 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 405/808] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:47 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1430 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:47.261104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-888b53e0-e8f6-41af-96de-c56db35618e2 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Action: 'create', calling method: .version_select at 0x7f228ecff160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1781594100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPy5LNp0FTKr/WtvNfAN6jHpaLoHwlGs+Yg0qifGKvnwedX9RgCHl4fKAdzeZGcbcBtTsdhO+K0q4j8EmAAJlz95Zu3d9x7llvSSUaS3T53k84+MqiIUFo0dqgG8Q853A=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:47.282438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-888b53e0-e8f6-41af-96de-c56db35618e2 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:47.290626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-888b53e0-e8f6-41af-96de-c56db35618e2 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Getting quotas for user 15a26431514a488fa0c96bb8ea2f3f4d and project d6975594eb0e4080b3a58bbe9faa3149. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:47.349518 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-888b53e0-e8f6-41af-96de-c56db35618e2 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.096444 Nov 02 12:22:47.351441 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 406/809] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:22:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:47.360188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-668178d1-254f-4b4f-92ef-38db9f34cb67 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ed00550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:47.436013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:47.441153 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-668178d1-254f-4b4f-92ef-38db9f34cb67 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 200 len: 1430 microversion: 2.1 time: 0.085052 Nov 02 12:22:47.442540 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 407/810] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:47 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 1430 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:47.455100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-155aca1d-902b-41f1-bcce-fba1377505a6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Calling method '.version_select at 0x7f228ecff3a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:47.460511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.461023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.461486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.462246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.462715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.463169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.469292 n-d-855650-5 devstack@n-api.service[120723]: WARNING oslo_db.sqlalchemy.utils [None req-155aca1d-902b-41f1-bcce-fba1377505a6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:22:47.485360 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-155aca1d-902b-41f1-bcce-fba1377505a6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.042023 Nov 02 12:22:47.489084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 408/811] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:22:47 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:47.497980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:47.498604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:47.513401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.513898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.514424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.518572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.519484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.520780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:48.089536 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] HTTP exception thrown: Floating IP 172.25.4.174 is not associated with instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1. Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Request method failure captured: Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action HTTP/1.1 Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 49 Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDL3yipteibOzBgtVYm33zA6n-m45w87Wokbj3JXJd83sSComT2MPhyVqNvzbjqGQn0NBRJUPab0BLzNs3SuqlgUy0quE6gJAB2uslSKYk6EVqqtzc2_oY9XKENADw8Ib8bgRKf1XAo13UmNUlGw-7gH_0CAvY_6Zy7MhAoTAdCdnQ Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 82dbd88241604726a6c21297724cf95d Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:22:48.091028 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/82dbd88241604726a6c21297724cf95d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/82dbd88241604726a6c21297724cf95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/82dbd88241604726a6c21297724cf95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_82dbd88241604726a6c21297724cf95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 82dbd88241604726a6c21297724cf95d Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FloatingIPsAssociationTestJSON-72573455-project Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c9fc9d8509544dcb8df90bdf49c60df6 Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-72573455-project Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: {"removeFloatingIp": {"address": "172.25.4.174"}} Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:22:48.092386 n-d-855650-5 devstack@n-api.service[120722]: exception: Floating IP 172.25.4.174 is not associated with instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1. Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '54d8ccfc-5664-420a-bf9d-841e82aa1ab1', 'body': {'removeFloatingIp': {'address': '172.25.4.174'}}} Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.174 is not associated with instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1. Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:48.093258 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.174 is not associated with instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1. Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Returning 409 to user: Floating IP 172.25.4.174 is not associated with instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-097d8d50-0ed2-4f54-b18b-47d58af00e02 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action" status: 409 len: 146 microversion: 2.1 time: 1.567187 Nov 02 12:22:48.094842 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 404/812] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:46 2022] POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action => generated 146 bytes in 1569 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:22:48.100556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c63d3a20-f673-480b-827e-389222fc7bc6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Calling method '.version_select at 0x7f228eb6f5e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:48.124927 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c63d3a20-f673-480b-827e-389222fc7bc6 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1781594100" status: 202 len: 0 microversion: 2.1 time: 0.030078 Nov 02 12:22:48.131002 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 405/813] 10.222.0.45 () {58 vars in 1278 bytes} [Wed Nov 2 12:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1781594100 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:48.136405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-910f3ab9-5566-4000-b1cc-2a140fa5a31c req-327d2ced-5b9e-40e6-a016-abbc71bac746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a4639e-be33-4fdc-bd49-ba842ba07cf0", "tag": "2e74770e-7830-4b88-9a83-f09758a7a477"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:48.148657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-910f3ab9-5566-4000-b1cc-2a140fa5a31c req-327d2ced-5b9e-40e6-a016-abbc71bac746 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:48.149456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-910f3ab9-5566-4000-b1cc-2a140fa5a31c req-327d2ced-5b9e-40e6-a016-abbc71bac746 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:48.150099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-910f3ab9-5566-4000-b1cc-2a140fa5a31c req-327d2ced-5b9e-40e6-a016-abbc71bac746 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:48.164066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-910f3ab9-5566-4000-b1cc-2a140fa5a31c req-327d2ced-5b9e-40e6-a016-abbc71bac746 service nova] Creating event network-changed:2e74770e-7830-4b88-9a83-f09758a7a477 for instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 on n-h2-855650-5 Nov 02 12:22:48.174280 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-910f3ab9-5566-4000-b1cc-2a140fa5a31c req-327d2ced-5b9e-40e6-a016-abbc71bac746 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041277 Nov 02 12:22:48.175454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 406/814] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:48.183989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.174"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:48.319510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:48.348731 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2cb0817-995f-44d2-88f9-e574a09abeba tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1479 microversion: 2.1 time: 0.858408 Nov 02 12:22:48.351360 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 409/815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:47 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1479 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:48.373059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-15acd779-caa6-4d25-808a-caaa7770aff8 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Calling method '.version_select at 0x7f228ecff280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:48.428642 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-15acd779-caa6-4d25-808a-caaa7770aff8 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1481806770" status: 202 len: 0 microversion: 2.1 time: 0.075814 Nov 02 12:22:48.429645 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 410/816] 10.222.0.45 () {58 vars in 1278 bytes} [Wed Nov 2 12:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1481806770 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:48.440112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19c16858-e42b-4a4b-8a97-708ee55a3e81 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] Calling method '.version_select at 0x7f228edc6940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:48.466810 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-19c16858-e42b-4a4b-8a97-708ee55a3e81 tempest-KeyPairsV2TestJSON-900428815 tempest-KeyPairsV2TestJSON-900428815-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-126926241" status: 202 len: 0 microversion: 2.1 time: 0.031496 Nov 02 12:22:48.472330 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 411/817] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-126926241 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:48.515345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:48.524538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:48.525040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:48.525495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:48.526259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:48.526730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:48.527163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:48.664883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9e900f85-16d4-4768-96b2-c77e4748abda tempest-NetworksTest-824921953 tempest-NetworksTest-824921953-project-admin] Calling method '.version_select at 0x7f228f022ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:49.060931 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9e900f85-16d4-4768-96b2-c77e4748abda tempest-NetworksTest-824921953 tempest-NetworksTest-824921953-project-admin] 10.222.0.45 "GET /compute/v2.1/os-networks" status: 200 len: 7442 microversion: 2.1 time: 0.587905 Nov 02 12:22:49.062053 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 412/818] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:22:48 2022] GET /compute/v2.1/os-networks => generated 7442 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:49.071165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9534b08a-f0c7-4b60-a062-a50d74415e3b tempest-NetworksTest-824921953 tempest-NetworksTest-824921953-project-admin] Calling method '.version_select at 0x7f228f015f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:49.144904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "refresh_cache-84a4639e-be33-4fdc-bd49-ba842ba07cf0" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:22:49.145708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquired lock "refresh_cache-84a4639e-be33-4fdc-bd49-ba842ba07cf0" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:22:49.337510 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9534b08a-f0c7-4b60-a062-a50d74415e3b tempest-NetworksTest-824921953 tempest-NetworksTest-824921953-project-admin] 10.222.0.45 "GET /compute/v2.1/os-networks/75b0e233-ff45-4a45-b17c-c024d18002bf" status: 200 len: 652 microversion: 2.1 time: 0.269548 Nov 02 12:22:49.339070 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 413/819] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:22:49 2022] GET /compute/v2.1/os-networks/75b0e233-ff45-4a45-b17c-c024d18002bf => generated 652 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:49.354535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1612ae05-ebf4-4fc4-9e58-b10c3d291624 tempest-NetworksTest-824921953 tempest-NetworksTest-824921953-project-admin] Calling method '.version_select at 0x7f228f0154c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:50.009618 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1612ae05-ebf4-4fc4-9e58-b10c3d291624 tempest-NetworksTest-824921953 tempest-NetworksTest-824921953-project-admin] 10.222.0.45 "GET /compute/v2.1/os-networks" status: 200 len: 7442 microversion: 2.1 time: 0.661785 Nov 02 12:22:50.018511 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 414/820] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:22:49 2022] GET /compute/v2.1/os-networks => generated 7442 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:50.022325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:50.022750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:50.029785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:50.030882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:50.031814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:50.033303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:50.034155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:50.035064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:50.380872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:50.413129 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0974bfdf-c3a4-48ac-9190-ab045f3c8f34 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1466 microversion: 2.1 time: 0.398363 Nov 02 12:22:50.414469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 415/821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:50 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1466 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:50.429752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1054869467", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a9f510fb-b50d-4af2-b983-5038fdf1b237"}], "security_groups": [{"name": "tempest-securitygroup--2072669164"}], "key_name": "tempest-keypair-416199290", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:50.761583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] validate_networks() for [('a9f510fb-b50d-4af2-b983-5038fdf1b237', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:22:51.254386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Building network info cache for instance {{(pid=120722) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:22:52.785448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:22:52.786199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:22:52.793290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:22:52.795207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:22:52.795687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:22:52.832995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:52.834603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:52.835848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:52.838158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:52.839528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:52.841748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:52.901614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for project 61f9f821af56421c98639028cc700a64. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:52.917364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for user a71d3feaad3148cc89c28cb18acf0cd0 and project 61f9f821af56421c98639028cc700a64. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:52.957115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:22:52.970110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:22:53.141238 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea34f31b-2aef-4658-bd44-62fe19469b76 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.724855 Nov 02 12:22:53.150747 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 416/822] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:22:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:22:53.158001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a021f7d5-6a72-4d45-b49b-186166154197 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f015f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:53.254837 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a021f7d5-6a72-4d45-b49b-186166154197 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/5a18a9e9-495a-4970-9f7b-124577e0709a" status: 200 len: 784 microversion: 2.1 time: 0.102571 Nov 02 12:22:53.255824 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 417/823] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:53 2022] GET /compute/v2.1/images/5a18a9e9-495a-4970-9f7b-124577e0709a => generated 784 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:53.262736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-84c2b57e-9eb5-4455-a889-a744f66e6263 req-6037f30b-f6dc-4980-af61-158cfc231ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a4639e-be33-4fdc-bd49-ba842ba07cf0", "tag": "2e74770e-7830-4b88-9a83-f09758a7a477"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:53.276771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-84c2b57e-9eb5-4455-a889-a744f66e6263 req-6037f30b-f6dc-4980-af61-158cfc231ed7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:53.278608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-84c2b57e-9eb5-4455-a889-a744f66e6263 req-6037f30b-f6dc-4980-af61-158cfc231ed7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:53.279532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-84c2b57e-9eb5-4455-a889-a744f66e6263 req-6037f30b-f6dc-4980-af61-158cfc231ed7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:53.295458 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-84c2b57e-9eb5-4455-a889-a744f66e6263 req-6037f30b-f6dc-4980-af61-158cfc231ed7 service nova] Creating event network-changed:2e74770e-7830-4b88-9a83-f09758a7a477 for instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 on n-h2-855650-5 Nov 02 12:22:53.301892 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-84c2b57e-9eb5-4455-a889-a744f66e6263 req-6037f30b-f6dc-4980-af61-158cfc231ed7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043949 Nov 02 12:22:53.304309 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 418/824] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:53.310933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e988b271-7eef-4fea-a55c-30ce0dd31865 req-aa29fe46-8111-429a-bae8-2f592719ab20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13c5d8d-ba99-4f40-a4a2-d7d5d463a237", "name": "network-vif-unplugged", "status": "completed", "tag": "da686012-05f8-4fdf-b251-5cd7e4d3b039"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:53.328872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e988b271-7eef-4fea-a55c-30ce0dd31865 req-aa29fe46-8111-429a-bae8-2f592719ab20 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:53.329998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e988b271-7eef-4fea-a55c-30ce0dd31865 req-aa29fe46-8111-429a-bae8-2f592719ab20 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:53.330935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e988b271-7eef-4fea-a55c-30ce0dd31865 req-aa29fe46-8111-429a-bae8-2f592719ab20 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:53.370661 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e988b271-7eef-4fea-a55c-30ce0dd31865 req-aa29fe46-8111-429a-bae8-2f592719ab20 service nova] Creating event network-vif-unplugged:da686012-05f8-4fdf-b251-5cd7e4d3b039 for instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 on n-h1-855650-5 Nov 02 12:22:53.385268 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e988b271-7eef-4fea-a55c-30ce0dd31865 req-aa29fe46-8111-429a-bae8-2f592719ab20 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078184 Nov 02 12:22:53.387747 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 419/825] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:53.399055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0c6c40ca-b614-4f12-b307-00e204bb3b24 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:53.401847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0c6c40ca-b614-4f12-b307-00e204bb3b24 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:53.546299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0c6c40ca-b614-4f12-b307-00e204bb3b24 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:53.564974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0c6c40ca-b614-4f12-b307-00e204bb3b24 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:53.568707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0c6c40ca-b614-4f12-b307-00e204bb3b24 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:53.575653 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0c6c40ca-b614-4f12-b307-00e204bb3b24 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1285 microversion: 2.25 time: 0.181490 Nov 02 12:22:53.576585 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 420/826] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:53 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:53.594357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa1d690f-ec0b-4ae9-a007-1a0b3cd99aff tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:53.608776 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa1d690f-ec0b-4ae9-a007-1a0b3cd99aff tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030523 Nov 02 12:22:53.614644 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 421/827] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:22:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:53.630177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-464adaf4-9039-40c9-9d45-94939b826a21 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ed09700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:53.765921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Updating instance_info_cache with network_info: [{"id": "2e74770e-7830-4b88-9a83-f09758a7a477", "address": "fa:16:3e:38:89:c7", "network": {"id": "bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-899408719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82dbd88241604726a6c21297724cf95d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2e74770e-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120722) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:22:53.812845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Releasing lock "refresh_cache-84a4639e-be33-4fdc-bd49-ba842ba07cf0" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:22:53.815175 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e323a79-c2be-4357-997b-f001cb796b2b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0/action" status: 202 len: 0 microversion: 2.1 time: 5.637824 Nov 02 12:22:53.817681 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 407/828] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:48 2022] POST /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0/action => generated 0 bytes in 5641 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:22:53.859575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:53.860662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:53.893001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:53.893550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:53.895113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:53.896132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:53.897300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:53.897820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:53.937632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:22:53.947049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:54.140541 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eaf49d09-736b-4549-83a4-5cd9b9995d32 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "DELETE /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 204 len: 0 microversion: 2.1 time: 0.316163 Nov 02 12:22:54.142598 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 408/829] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:22:53 2022] DELETE /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:54.168870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.174"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:54.181459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:54.202932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:54.206377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:54.207086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:54.210247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:54.212443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:54.213143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:54.301803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:22:54.304449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquired lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:22:55.159066 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-464adaf4-9039-40c9-9d45-94939b826a21 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "DELETE /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 204 len: 0 microversion: 2.1 time: 1.535642 Nov 02 12:22:55.165019 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 422/830] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:53 2022] DELETE /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 0 bytes in 1539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:55.170572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:55.175993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:55.189457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:55.190417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:55.191058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:55.191802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:55.192262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:55.192705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:55.523064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:55.542692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:55.545596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:55.550218 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1c66a7bc-c9f7-4746-b636-11b6578dff54 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1337 microversion: 2.25 time: 0.383586 Nov 02 12:22:55.557848 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 423/831] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:55 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1337 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:55.566995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68f272c5-f721-4751-ab6c-213151b62a11 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f0221f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:55.603224 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-68f272c5-f721-4751-ab6c-213151b62a11 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] HTTP exception thrown: Image not found. Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68f272c5-f721-4751-ab6c-213151b62a11 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Request method failure captured: Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af HTTP/1.1 Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmDlrBgkgc7Ouh7JnaPR8eBg9EqHoF6Sp6VFd3ofeSLbYotyShRamJLUuFPc1nleLI7JWZh5Wn0Mcxrz8Z1yIkaqPqdFP5NZb8BcRbX7Lm8rnfH6eDUR42y5sdCRjgtGuLOa1bnDChET-fFXXAz9sUtST0lL6SfIJsL04OdJzBFunzI Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0018d1abb96f47d78acb47c69ffd5348 Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:22:55.617514 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0018d1abb96f47d78acb47c69ffd5348 Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerTestJSON-127993795-project Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 592a24a9aa8c4229a3829ace625e3238 Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerTestJSON-127993795-project Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '945f387a-c139-4356-99b0-3f3dca88a4af'} Nov 02 12:22:55.619337 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:22:55.620260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 945f387a-c139-4356-99b0-3f3dca88a4af Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:22:55.621627 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 945f387a-c139-4356-99b0-3f3dca88a4af could not be found. Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:22:55.623029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.624201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68f272c5-f721-4751-ab6c-213151b62a11 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:55.627371 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-68f272c5-f721-4751-ab6c-213151b62a11 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 404 len: 62 microversion: 2.1 time: 0.068109 Nov 02 12:22:55.628531 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 424/832] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:55 2022] GET /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:22:55.655177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1125743839"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:55.679643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:55.702219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:55.702846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:55.705219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:55.707161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:55.708506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:55.709143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:56.304859 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d62f0d3a-1241-4f3d-8a72-56fecb9502d7 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "POST /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237/action" status: 202 len: 0 microversion: 2.1 time: 0.665790 Nov 02 12:22:56.324766 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 425/833] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:55 2022] POST /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 02 12:22:56.355499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97e932f4-fec5-4acb-87e4-f9a7522c4115 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228edc60d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:56.451788 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97e932f4-fec5-4acb-87e4-f9a7522c4115 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.101377 Nov 02 12:22:56.460332 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 426/834] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:56 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:56.489874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:56.589450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:56.590727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:56.605293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:56.610519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:56.613474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:56.615274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:56.624050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:56.624788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:56.794012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:56.821701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:56.825864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:56.836908 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-af532ab8-b12c-44ea-a9d0-6654725de7e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1343 microversion: 2.25 time: 0.244362 Nov 02 12:22:56.838354 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 427/835] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:56 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1343 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:22:57.140130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e9c2054-ce90-4f61-aa3d-9347e274963b tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Action: 'update', calling method: .version_select at 0x7f228edc6ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:57.358451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e9c2054-ce90-4f61-aa3d-9347e274963b tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:57.359115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e9c2054-ce90-4f61-aa3d-9347e274963b tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:57.361957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e9c2054-ce90-4f61-aa3d-9347e274963b tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:57.366682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e9c2054-ce90-4f61-aa3d-9347e274963b tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:57.367552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e9c2054-ce90-4f61-aa3d-9347e274963b tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:57.368099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e9c2054-ce90-4f61-aa3d-9347e274963b tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:57.509508 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4e9c2054-ce90-4f61-aa3d-9347e274963b tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/98a77cc469e64030b3835b4c8bf5a97e" status: 200 len: 240 microversion: 2.36 time: 0.668855 Nov 02 12:22:57.521370 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 428/836] 10.222.0.45 () {62 vars in 1303 bytes} [Wed Nov 2 12:22:56 2022] PUT /compute/v2.1/os-quota-sets/98a77cc469e64030b3835b4c8bf5a97e => generated 240 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:57.533908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-34fa45a1-9f6e-4f1a-933f-d70e844aebdf tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f29c670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:57.636322 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-34fa45a1-9f6e-4f1a-933f-d70e844aebdf tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.111815 Nov 02 12:22:57.639266 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 429/837] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:57 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:57.653368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f27a9bc-5140-4e30-80c3-747df1ff18e3 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Calling method '.version_select at 0x7f228ecff1f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:57.745025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f27a9bc-5140-4e30-80c3-747df1ff18e3 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:57.745789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f27a9bc-5140-4e30-80c3-747df1ff18e3 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:57.746416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f27a9bc-5140-4e30-80c3-747df1ff18e3 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:57.748059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f27a9bc-5140-4e30-80c3-747df1ff18e3 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:57.748926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f27a9bc-5140-4e30-80c3-747df1ff18e3 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:57.749529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f27a9bc-5140-4e30-80c3-747df1ff18e3 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:57.776455 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f27a9bc-5140-4e30-80c3-747df1ff18e3 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/98a77cc469e64030b3835b4c8bf5a97e/detail" status: 200 len: 672 microversion: 2.36 time: 0.135006 Nov 02 12:22:57.778028 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 430/838] 10.222.0.45 () {60 vars in 1304 bytes} [Wed Nov 2 12:22:57 2022] GET /compute/v2.1/os-quota-sets/98a77cc469e64030b3835b4c8bf5a97e/detail => generated 672 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:57.885548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:57.885957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:57.896173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:57.915333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:57.916140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:57.916766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:57.920930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:57.923006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:57.930613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:58.252121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Building network info cache for instance {{(pid=120722) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:22:58.306009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:58.325108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:58.326766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:58.328192 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-22d3c663-6656-47b3-b19a-dc405b06e20b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1343 microversion: 2.25 time: 0.447894 Nov 02 12:22:58.328980 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 431/839] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:57 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1343 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:22:58.351775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Action: 'update', calling method: .version_select at 0x7f228f29c4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:58.493416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:58.495595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:58.496137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:58.498003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:58.498510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:58.498961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:58.615898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:58.616576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:58.626709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:58.627721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:58.628450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:58.629118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:58.734161 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-394dffab-e424-403f-a29c-380ebbc2b391 tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/98a77cc469e64030b3835b4c8bf5a97e?user_id=895843de4adc408c9f74f3920173cf7f" status: 200 len: 240 microversion: 2.36 time: 0.403880 Nov 02 12:22:58.745251 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 432/840] 10.222.0.45 () {62 vars in 1384 bytes} [Wed Nov 2 12:22:58 2022] PUT /compute/v2.1/os-quota-sets/98a77cc469e64030b3835b4c8bf5a97e?user_id=895843de4adc408c9f74f3920173cf7f => generated 240 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:58.749207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-94745ccd-db18-49eb-a510-23f19948faf1 req-f9e4d4ae-1596-4ad2-9f19-4024ac1c20b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d8ccfc-5664-420a-bf9d-841e82aa1ab1", "tag": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:58.770251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-94745ccd-db18-49eb-a510-23f19948faf1 req-f9e4d4ae-1596-4ad2-9f19-4024ac1c20b0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:58.770831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-94745ccd-db18-49eb-a510-23f19948faf1 req-f9e4d4ae-1596-4ad2-9f19-4024ac1c20b0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:58.772080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-94745ccd-db18-49eb-a510-23f19948faf1 req-f9e4d4ae-1596-4ad2-9f19-4024ac1c20b0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:58.800603 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-94745ccd-db18-49eb-a510-23f19948faf1 req-f9e4d4ae-1596-4ad2-9f19-4024ac1c20b0 service nova] Creating event network-changed:3dd63f67-75a2-455b-ae9d-2766c6a3eedf for instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 on n-h1-855650-5 Nov 02 12:22:58.808981 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-94745ccd-db18-49eb-a510-23f19948faf1 req-f9e4d4ae-1596-4ad2-9f19-4024ac1c20b0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068496 Nov 02 12:22:58.811327 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 433/841] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:58.828402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5c90aab-2dcc-4d84-8588-646333b56c9f tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f0228b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:58.914316 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5c90aab-2dcc-4d84-8588-646333b56c9f tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.091459 Nov 02 12:22:58.926368 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 434/842] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:22:58 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:58.932299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-907762a8-f287-4301-ad75-8da06acef35f tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] Calling method '.version_select at 0x7f228f29c700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:59.083429 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-907762a8-f287-4301-ad75-8da06acef35f tempest-QuotasAdminTestV236-1712597363 tempest-QuotasAdminTestV236-1712597363-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/98a77cc469e64030b3835b4c8bf5a97e?user_id=895843de4adc408c9f74f3920173cf7f" status: 200 len: 282 microversion: 2.36 time: 0.155429 Nov 02 12:22:59.100710 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 435/843] 10.222.0.45 () {60 vars in 1364 bytes} [Wed Nov 2 12:22:58 2022] GET /compute/v2.1/os-quota-sets/98a77cc469e64030b3835b4c8bf5a97e?user_id=895843de4adc408c9f74f3920173cf7f => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:59.300301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-576a36a0-594f-4230-8332-a35cb5f86742 req-4517e8a6-cc78-4ce3-a584-1ddf13abe185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a4639e-be33-4fdc-bd49-ba842ba07cf0", "name": "network-vif-deleted", "tag": "2e74770e-7830-4b88-9a83-f09758a7a477"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:59.328103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-576a36a0-594f-4230-8332-a35cb5f86742 req-4517e8a6-cc78-4ce3-a584-1ddf13abe185 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:59.331172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-576a36a0-594f-4230-8332-a35cb5f86742 req-4517e8a6-cc78-4ce3-a584-1ddf13abe185 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:59.331831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-576a36a0-594f-4230-8332-a35cb5f86742 req-4517e8a6-cc78-4ce3-a584-1ddf13abe185 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:59.350417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:59.372419 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-576a36a0-594f-4230-8332-a35cb5f86742 req-4517e8a6-cc78-4ce3-a584-1ddf13abe185 service nova] Creating event network-vif-deleted:2e74770e-7830-4b88-9a83-f09758a7a477 for instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 on n-h2-855650-5 Nov 02 12:22:59.383503 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-576a36a0-594f-4230-8332-a35cb5f86742 req-4517e8a6-cc78-4ce3-a584-1ddf13abe185 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086814 Nov 02 12:22:59.385009 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 436/844] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:59.391389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:59.392116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:59.401841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:59.403529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:59.404931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:59.405920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:59.406457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:59.406916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:00.087256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:00.126509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:00.133654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:00.137362 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91fcac05-8e81-4c7c-b914-e65967652d2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 0.750944 Nov 02 12:23:00.142377 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 437/845] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:59 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:00.151466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Updating instance_info_cache with network_info: [{"id": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf", "address": "fa:16:3e:e3:75:5c", "network": {"id": "bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-899408719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82dbd88241604726a6c21297724cf95d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3dd63f67-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120722) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:23:00.191255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Releasing lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:23:00.191764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67668ed4-70bf-4328-8b8a-c46888f68dac tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f29c700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:00.195488 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-216f53ba-5e7e-4338-8971-b162962f0953 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action" status: 202 len: 0 microversion: 2.1 time: 6.040693 Nov 02 12:23:00.198491 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 409/846] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:54 2022] POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action => generated 0 bytes in 6047 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:23:00.238422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59706373-5526-4020-966e-be81cbaeb27d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '.version_select at 0x7f228eedb280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:00.304603 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67668ed4-70bf-4328-8b8a-c46888f68dac tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.158919 Nov 02 12:23:00.305832 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 438/847] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:00 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:00.723975 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59706373-5526-4020-966e-be81cbaeb27d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/bb77d6fd-125c-456b-8968-ded96f33abde" status: 200 len: 184 microversion: 2.1 time: 0.520356 Nov 02 12:23:00.725145 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 410/848] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:23:00 2022] GET /compute/v2.1/os-floating-ips/bb77d6fd-125c-456b-8968-ded96f33abde => generated 184 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:00.737360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Action: 'action', calling method: .version_select at 0x7f22904bfdc0>, body: {"removeFloatingIp": {"address": "172.25.4.174"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:01.074711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:01.085057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:01.085994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:01.086824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:01.089153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:01.090477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:01.091227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:01.171877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:01.172598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:01.190670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:01.191177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:01.191623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:01.192375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:01.192813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:01.193282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:02.250182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:02.260108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:02.267802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:02.269023 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5372349a-88a8-410f-9e90-fc0295731aae tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 1.104992 Nov 02 12:23:02.269602 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 411/849] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:01 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:02.290115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a89e273c-5cc7-4027-b1e3-81920365b952 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ed78700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:02.373025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:23:02.374787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquired lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:23:02.399487 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a89e273c-5cc7-4027-b1e3-81920365b952 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.125515 Nov 02 12:23:02.406235 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 412/850] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:02 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:03.015643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e4047186-90b6-4cc1-8d23-f80a5a297cc1 req-e2beab34-baa8-4b8a-b45f-609cefbf0ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf7c70a-03b4-456d-96c0-8e892183b1ac", "tag": "9264ba98-f8b6-4854-ae4f-4f7c06f5258d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:03.047807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e4047186-90b6-4cc1-8d23-f80a5a297cc1 req-e2beab34-baa8-4b8a-b45f-609cefbf0ca0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:03.048304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e4047186-90b6-4cc1-8d23-f80a5a297cc1 req-e2beab34-baa8-4b8a-b45f-609cefbf0ca0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:03.049146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e4047186-90b6-4cc1-8d23-f80a5a297cc1 req-e2beab34-baa8-4b8a-b45f-609cefbf0ca0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:03.070783 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e4047186-90b6-4cc1-8d23-f80a5a297cc1 req-e2beab34-baa8-4b8a-b45f-609cefbf0ca0 service nova] Creating event network-changed:9264ba98-f8b6-4854-ae4f-4f7c06f5258d for instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac on n-h1-855650-5 Nov 02 12:23:03.078932 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e4047186-90b6-4cc1-8d23-f80a5a297cc1 req-e2beab34-baa8-4b8a-b45f-609cefbf0ca0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068956 Nov 02 12:23:03.079501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 413/851] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:03.344663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:03.346176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:03.357021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:03.357826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:03.358509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:03.359434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:03.360069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:03.362658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:04.029662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:04.061864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:04.070835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:04.075429 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1680992f-4d96-4e42-a6a0-2d3d46772dfa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 0.743395 Nov 02 12:23:04.078569 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 414/852] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:03 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:04.091419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b5be3036-b421-4735-8e25-87f3851a3e67 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ed47c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:04.169553 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b5be3036-b421-4735-8e25-87f3851a3e67 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.087219 Nov 02 12:23:04.171740 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 415/853] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:04 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:04.182452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-06695af9-3ff6-46d5-a192-3fafd64a8b28 req-c8345fda-adf3-4c8f-a8d3-7129cb267585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13c5d8d-ba99-4f40-a4a2-d7d5d463a237", "name": "network-vif-plugged", "status": "completed", "tag": "da686012-05f8-4fdf-b251-5cd7e4d3b039"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:04.200044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-06695af9-3ff6-46d5-a192-3fafd64a8b28 req-c8345fda-adf3-4c8f-a8d3-7129cb267585 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:04.200726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-06695af9-3ff6-46d5-a192-3fafd64a8b28 req-c8345fda-adf3-4c8f-a8d3-7129cb267585 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:04.201499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-06695af9-3ff6-46d5-a192-3fafd64a8b28 req-c8345fda-adf3-4c8f-a8d3-7129cb267585 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:04.216590 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-06695af9-3ff6-46d5-a192-3fafd64a8b28 req-c8345fda-adf3-4c8f-a8d3-7129cb267585 service nova] Creating event network-vif-plugged:da686012-05f8-4fdf-b251-5cd7e4d3b039 for instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 on n-h1-855650-5 Nov 02 12:23:04.225762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-06695af9-3ff6-46d5-a192-3fafd64a8b28 req-c8345fda-adf3-4c8f-a8d3-7129cb267585 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050226 Nov 02 12:23:04.228343 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 416/854] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:04.741316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Building network info cache for instance {{(pid=120723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:23:05.106592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:05.107466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:05.128166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:05.128766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:05.129217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:05.129936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:05.130427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:05.131706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:06.080034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:06.103348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:06.107044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:06.111719 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5bf00fc8-efc9-4fc2-b4a8-fa7e5fcdff7c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 1.009140 Nov 02 12:23:06.113099 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 417/855] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:05 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:06.129621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d8c4148-098b-48ac-b464-8adcc625510d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ec7bb80>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:06.183421 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d8c4148-098b-48ac-b464-8adcc625510d tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.068945 Nov 02 12:23:06.185239 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 418/856] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:06 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:06.191024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-271e2929-58b8-4df9-b5b0-f072dac9f6cc req-66485e8f-9158-4073-afb3-7119f0564213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d8ccfc-5664-420a-bf9d-841e82aa1ab1", "tag": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:06.202746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-271e2929-58b8-4df9-b5b0-f072dac9f6cc req-66485e8f-9158-4073-afb3-7119f0564213 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:06.203534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-271e2929-58b8-4df9-b5b0-f072dac9f6cc req-66485e8f-9158-4073-afb3-7119f0564213 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:06.204252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-271e2929-58b8-4df9-b5b0-f072dac9f6cc req-66485e8f-9158-4073-afb3-7119f0564213 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:06.217566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-271e2929-58b8-4df9-b5b0-f072dac9f6cc req-66485e8f-9158-4073-afb3-7119f0564213 service nova] Creating event network-changed:3dd63f67-75a2-455b-ae9d-2766c6a3eedf for instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 on n-h1-855650-5 Nov 02 12:23:06.223989 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-271e2929-58b8-4df9-b5b0-f072dac9f6cc req-66485e8f-9158-4073-afb3-7119f0564213 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037047 Nov 02 12:23:06.225464 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 419/857] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:06.405909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-392259847", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:06.486180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:06.890049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Updating instance_info_cache with network_info: [{"id": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf", "address": "fa:16:3e:e3:75:5c", "network": {"id": "bb5a51cf-1a16-4f22-8557-d98ddaf1b7ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-899408719-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82dbd88241604726a6c21297724cf95d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3dd63f67-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:23:06.907912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Releasing lock "refresh_cache-54d8ccfc-5664-420a-bf9d-841e82aa1ab1" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:23:06.909232 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08de63b2-935f-48f7-a31c-d10109eaec3e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action" status: 202 len: 0 microversion: 2.1 time: 6.175888 Nov 02 12:23:06.911225 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 439/858] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:23:00 2022] POST /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1/action => generated 0 bytes in 6178 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:23:06.925998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:06.926766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:06.946021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:06.949184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:06.949789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:06.951207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:06.951207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:06.951590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:06.983659 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] HTTP exception thrown: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Request method failure captured: Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 HTTP/1.1 Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmDL3yipteibOzBgtVYm33zA6n-m45w87Wokbj3JXJd83sSComT2MPhyVqNvzbjqGQn0NBRJUPab0BLzNs3SuqlgUy0quE6gJAB2uslSKYk6EVqqtzc2_oY9XKENADw8Ib8bgRKf1XAo13UmNUlGw-7gH_0CAvY_6Zy7MhAoTAdCdnQ Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 82dbd88241604726a6c21297724cf95d Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:23:06.985809 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/82dbd88241604726a6c21297724cf95d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/82dbd88241604726a6c21297724cf95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/82dbd88241604726a6c21297724cf95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_82dbd88241604726a6c21297724cf95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 82dbd88241604726a6c21297724cf95d Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FloatingIPsAssociationTestJSON-72573455-project Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: c9fc9d8509544dcb8df90bdf49c60df6 Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-72573455-project Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:06.987775 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '84a4639e-be33-4fdc-bd49-ba842ba07cf0'} Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:06.988704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:06.990286 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:06.992878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Returning 404 to user: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:06.994183 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e2524b2-9714-479b-a7b4-68e8ba09df6b tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "DELETE /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 404 len: 111 microversion: 2.1 time: 0.074558 Nov 02 12:23:06.996004 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 440/859] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:23:06 2022] DELETE /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:23:07.008550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:07.014671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 84a4639e-be33-4fdc-bd49-ba842ba07cf0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:07.056331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:07.056538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:07.057433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.058845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:07.064501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:07.065158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.100601 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] HTTP exception thrown: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:07.103217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:07.103824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:07.104497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:07.105393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:07.106022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Request method failure captured: Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 HTTP/1.1 Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmDL3yipteibOzBgtVYm33zA6n-m45w87Wokbj3JXJd83sSComT2MPhyVqNvzbjqGQn0NBRJUPab0BLzNs3SuqlgUy0quE6gJAB2uslSKYk6EVqqtzc2_oY9XKENADw8Ib8bgRKf1XAo13UmNUlGw-7gH_0CAvY_6Zy7MhAoTAdCdnQ Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 82dbd88241604726a6c21297724cf95d Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:23:07.107295 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/82dbd88241604726a6c21297724cf95d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/82dbd88241604726a6c21297724cf95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/82dbd88241604726a6c21297724cf95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_82dbd88241604726a6c21297724cf95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 82dbd88241604726a6c21297724cf95d Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FloatingIPsAssociationTestJSON-72573455-project Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: c9fc9d8509544dcb8df90bdf49c60df6 Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-72573455-project Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:07.108931 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '84a4639e-be33-4fdc-bd49-ba842ba07cf0'} Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:07.109845 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. Nov 02 12:23:07.111667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:07.113712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Returning 404 to user: Instance 84a4639e-be33-4fdc-bd49-ba842ba07cf0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:07.118010 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-06d7fe77-aa3b-4242-bc94-435e63804d8d tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0" status: 404 len: 111 microversion: 2.1 time: 0.115844 Nov 02 12:23:07.122127 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 441/860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:07 2022] GET /compute/v2.1/servers/84a4639e-be33-4fdc-bd49-ba842ba07cf0 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:23:07.144516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0af1d3f5-4c12-496d-84b9-ddaf2574c779 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '.version_select at 0x7f228eff5040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:07.144872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:07.145449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:07.146526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.147885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:07.148363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:07.149416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.198892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:07.205887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:07.237952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:07.240726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:07.335581 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d722acec-fe93-48c1-aac5-01cba623154d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104749 Nov 02 12:23:07.336803 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 420/861] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:23:07.349226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:07.350707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:07.363787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:07.375571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:07.376928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.378840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:07.380316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:07.381957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.994310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:08.043664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:08.049226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:08.056520 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ab69fea-02fc-4958-8537-92820f0f2d3d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 0.718060 Nov 02 12:23:08.059249 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 421/862] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:07 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:08.089113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b5b22a5-177e-48ed-b86a-f2f4a6af5554 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ed3db80>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:08.244600 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2b5b22a5-177e-48ed-b86a-f2f4a6af5554 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.179109 Nov 02 12:23:08.245820 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 422/863] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:08 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:08.255724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96a171a8-7178-4d9e-9228-ceec3816847f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:08.257018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96a171a8-7178-4d9e-9228-ceec3816847f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:08.562243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-96a171a8-7178-4d9e-9228-ceec3816847f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:08.573957 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96a171a8-7178-4d9e-9228-ceec3816847f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1216 microversion: 2.1 time: 0.327471 Nov 02 12:23:08.574810 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 423/864] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:08 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1216 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:08.648706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=11 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:08.751367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0919f12-86b8-40d8-a171-3847500a1cbc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228ec7bf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1629356000", "description": "tempest-description-668146929"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:09.063670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=50 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:09.519551 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0919f12-86b8-40d8-a171-3847500a1cbc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.924176 Nov 02 12:23:09.520590 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 424/865] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:23:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:09.527299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:09.529160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:09.544716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:09.551696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:09.552351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:09.553349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:09.554068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:09.554702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:10.378486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:10.395574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:10.397582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:10.399392 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1dc4a665-b58d-422c-b8c5-4088228368e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 0.876681 Nov 02 12:23:10.400604 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 425/866] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:09 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:10.411591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6255e4c0-5e15-49f2-8382-df42b9a75dc0 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ea17af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:10.560610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6255e4c0-5e15-49f2-8382-df42b9a75dc0 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.158685 Nov 02 12:23:10.569759 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 426/867] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:10 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:10.576478 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0af1d3f5-4c12-496d-84b9-ddaf2574c779 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/bb77d6fd-125c-456b-8968-ded96f33abde" status: 202 len: 0 microversion: 2.1 time: 3.453042 Nov 02 12:23:10.577124 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 442/868] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:23:07 2022] DELETE /compute/v2.1/os-floating-ips/bb77d6fd-125c-456b-8968-ded96f33abde => generated 0 bytes in 3454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:23:10.582544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db690142-f3c1-4472-84c6-609c7ec1e4d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228ef41550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1917005051", "description": "tempest-description-1308218338"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:10.585058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:10.586149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:10.610797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:10.612799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:10.616487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:10.618604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:10.619570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:10.621852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:10.741535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:10.753318 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1c65e589-194e-4e34-8ef0-e6079822e6d4 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1274 microversion: 2.1 time: 0.174185 Nov 02 12:23:10.758410 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 443/869] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:10 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1274 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:10.769036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:10.769646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:10.782435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:10.782953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:10.783411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:10.784145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:10.786378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:10.789455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:10.854580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:23:10.989152 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db690142-f3c1-4472-84c6-609c7ec1e4d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.417646 Nov 02 12:23:10.990132 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 427/870] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:23:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:11.078911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2123475003", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "86e82b62-f8a5-43b1-9d6c-90b8370cab83"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:11.089876 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a0dfed1-c697-4e1b-a673-0f609e0530a1 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 204 len: 0 microversion: 2.1 time: 0.324276 Nov 02 12:23:11.094155 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 444/871] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:23:10 2022] DELETE /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:11.120184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:11.123407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:11.159230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] validate_networks() for [('86e82b62-f8a5-43b1-9d6c-90b8370cab83', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:11.170587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:11.171442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:11.174570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:11.175380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:11.175868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:11.189589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:11.642986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:11.670408 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52b0dc68-8d12-49e7-a8aa-708b6be8f8c8 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1524 microversion: 2.1 time: 0.573966 Nov 02 12:23:11.702444 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 445/872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:11 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1524 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:11.718628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:11.724832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:11.740112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:11.744749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:11.749836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:11.751366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:11.752106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:11.752817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.225245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:12.225757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:12.226742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:12.227468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:12.228065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:12.262639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.266328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.269889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.270768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.271259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.271755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.352140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Getting quotas for project cae93780b7f44bb295ed5c4160115d6a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:12.365425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.375557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Getting quotas for user eee9d7b075c540a3b9eb0c5bb7344dae and project cae93780b7f44bb295ed5c4160115d6a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:12.430749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.435249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.438226 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-346fb4d8-01b1-4fcd-8bea-7fa5d4574358 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 0.734451 Nov 02 12:23:12.444292 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 446/873] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:11 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:12.460541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:12.468177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd71c7f2-4212-4a4a-9d35-b4894e6cd556 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ecf6160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:12.472363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:12.590101 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd71c7f2-4212-4a4a-9d35-b4894e6cd556 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.144049 Nov 02 12:23:12.592353 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 447/874] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:12 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:12.603854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:12.606776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:12.609485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:12.627756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.630386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.634437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.635487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.636298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.637038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.667696 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07430474-6e12-4d8d-9bb4-8beb3a535f60 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.592726 Nov 02 12:23:12.671882 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 428/875] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:23:12.682837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ed885f0-329c-4e64-9678-ebae6ccbfbdd tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:12.686749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ed885f0-329c-4e64-9678-ebae6ccbfbdd tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:12.854660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.868398 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30362cac-cce9-477c-809c-4db5dfd7562d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1274 microversion: 2.1 time: 0.274725 Nov 02 12:23:12.876302 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 448/876] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:12 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1274 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:12.882860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:12.883405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:12.918618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.919361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.919874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.920652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.921174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.921637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.996724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ed885f0-329c-4e64-9678-ebae6ccbfbdd tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:13.005794 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ed885f0-329c-4e64-9678-ebae6ccbfbdd tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1216 microversion: 2.1 time: 0.328007 Nov 02 12:23:13.012145 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 429/877] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:12 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1216 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:13.346666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:13.363607 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-70c66573-e39c-4146-80bc-515a3457efc2 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1524 microversion: 2.1 time: 0.486370 Nov 02 12:23:13.364532 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 449/878] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:12 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1524 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:13.476344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:13.478796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:13.496454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.497664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.500302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:13.502010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.503798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.504439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:13.609921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e2849e63-0ab9-4eb0-b768-8ee980fb11bc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f022820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:13.749532 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e2849e63-0ab9-4eb0-b768-8ee980fb11bc tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.143397 Nov 02 12:23:13.753078 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 450/879] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:13 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:13.897918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:13.898879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:13.908847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.914670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.917556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:13.918764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.919553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.921443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.007170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:14.028557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:14.042881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:14.050158 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-54660210-6565-4172-a4e9-abf508b1d75c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 0.579701 Nov 02 12:23:14.056434 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 430/880] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:13 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:23:14.079709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-721748ca-510d-4e6d-9f82-12d9d0e1290f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:14.080907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-721748ca-510d-4e6d-9f82-12d9d0e1290f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:14.142263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:14.163599 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93cc5284-1b68-4eb1-8aea-189c80779669 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1274 microversion: 2.1 time: 0.270040 Nov 02 12:23:14.175866 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 451/881] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:13 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:14.239965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-721748ca-510d-4e6d-9f82-12d9d0e1290f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:14.252594 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-721748ca-510d-4e6d-9f82-12d9d0e1290f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1216 microversion: 2.1 time: 0.194687 Nov 02 12:23:14.271485 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 431/882] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:14 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:14.393684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:14.394842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:14.417117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:14.420489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:14.421617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.433439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:14.434510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:14.435145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.754701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:14.769538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9f652b9-0145-436a-8e23-9727f7305bf5 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228eb4edc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:14.815543 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8e801495-4c8d-44f6-b969-cb3e95364e7e tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1524 microversion: 2.1 time: 0.424222 Nov 02 12:23:14.816980 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 452/883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:14 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1524 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:14.923881 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9f652b9-0145-436a-8e23-9727f7305bf5 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.158174 Nov 02 12:23:14.927790 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 432/884] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:14 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:15.047792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-297fdaa2-276c-4615-89bb-0cef3d863c46 req-8195484b-132f-4366-abd7-c0f09e251b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf7c70a-03b4-456d-96c0-8e892183b1ac", "name": "network-vif-plugged", "status": "completed", "tag": "9264ba98-f8b6-4854-ae4f-4f7c06f5258d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:15.086777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:15.087413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:15.131142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:15.132488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:15.136784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-297fdaa2-276c-4615-89bb-0cef3d863c46 req-8195484b-132f-4366-abd7-c0f09e251b7d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:15.138308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:15.142529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-297fdaa2-276c-4615-89bb-0cef3d863c46 req-8195484b-132f-4366-abd7-c0f09e251b7d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:15.143707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:15.144676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-297fdaa2-276c-4615-89bb-0cef3d863c46 req-8195484b-132f-4366-abd7-c0f09e251b7d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:15.152265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:15.156284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:15.232241 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-297fdaa2-276c-4615-89bb-0cef3d863c46 req-8195484b-132f-4366-abd7-c0f09e251b7d service nova] Creating event network-vif-plugged:9264ba98-f8b6-4854-ae4f-4f7c06f5258d for instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac on n-h1-855650-5 Nov 02 12:23:15.251639 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-297fdaa2-276c-4615-89bb-0cef3d863c46 req-8195484b-132f-4366-abd7-c0f09e251b7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205162 Nov 02 12:23:15.252302 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 453/885] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:15.280072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:15.281116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:15.292472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:15.293241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:15.295772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:15.296784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:15.297422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:15.301273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:15.974173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:15.987845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:15.995218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:15.997143 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-47cf948e-7882-4f1f-b5d4-3e55b78ca1f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 0.915834 Nov 02 12:23:15.998376 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 433/886] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:15 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:16.022798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.023814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:16.039810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.041017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.041915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.043104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.048567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.049467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.110681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:16.129859 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a9c42fc-2370-440e-876f-9ad5ab2f341b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 0.873709 Nov 02 12:23:16.130951 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 454/887] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:15 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:16.150784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.153167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:16.172642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.173558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.174495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.175890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.176574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.177122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:16.177482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.189498 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07577524-9c1c-4f5f-90f1-990995cce5d2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1286 microversion: 2.1 time: 0.187321 Nov 02 12:23:16.190487 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 434/888] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:15 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1286 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:16.195530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aee0e08d-b536-4832-9bb0-56f9e4e21c65 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ea23550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.296031 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aee0e08d-b536-4832-9bb0-56f9e4e21c65 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.104273 Nov 02 12:23:16.296769 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 435/889] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:16 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:16.345012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:16.355701 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-369ed0d5-eca8-43fd-ba4b-9e97c6384353 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1482 microversion: 2.1 time: 0.216945 Nov 02 12:23:16.370009 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 455/890] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:16 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1482 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:16.540064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4234eb9f-999e-4e06-86f4-38a6865e9758 req-502e39ac-6157-404b-8400-d515f273c900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d8ccfc-5664-420a-bf9d-841e82aa1ab1", "name": "network-vif-deleted", "tag": "3dd63f67-75a2-455b-ae9d-2766c6a3eedf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:16.562943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4234eb9f-999e-4e06-86f4-38a6865e9758 req-502e39ac-6157-404b-8400-d515f273c900 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.565181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4234eb9f-999e-4e06-86f4-38a6865e9758 req-502e39ac-6157-404b-8400-d515f273c900 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.565723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4234eb9f-999e-4e06-86f4-38a6865e9758 req-502e39ac-6157-404b-8400-d515f273c900 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.583042 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4234eb9f-999e-4e06-86f4-38a6865e9758 req-502e39ac-6157-404b-8400-d515f273c900 service nova] Creating event network-vif-deleted:3dd63f67-75a2-455b-ae9d-2766c6a3eedf for instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 on n-h1-855650-5 Nov 02 12:23:16.592141 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4234eb9f-999e-4e06-86f4-38a6865e9758 req-502e39ac-6157-404b-8400-d515f273c900 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060699 Nov 02 12:23:16.593481 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 436/891] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:17.042973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:17.047426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:17.124973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:17.131210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:17.135638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:17.146540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:17.155411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:17.157290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:17.167276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:17.174892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:17.219186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:17.221770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:17.222825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:17.225716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:17.236055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:17.237356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:17.946507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:17.986037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:17.990198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:17.994399 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1bc9febc-eb9d-422d-ba2e-ee7e877588aa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1411 microversion: 2.25 time: 0.967885 Nov 02 12:23:17.998815 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 456/892] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:17 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1411 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:18.004082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:18.005084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:18.016988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:18.021174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:18.023020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:18.028799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:18.029471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:18.030111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:18.035417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:18.038962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:18.098423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f39d953b-3b62-4207-a09a-252db5a701e0 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 0.944180 Nov 02 12:23:18.108886 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 437/893] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:17 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:18.132274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-abfff110-7ffd-4220-8835-9aec7e04e5e0 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ea7a8b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:18.304448 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-abfff110-7ffd-4220-8835-9aec7e04e5e0 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.190481 Nov 02 12:23:18.308661 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 438/894] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:18 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:18.325249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:18.326745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:18.344941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:18.345946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:18.348778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:18.355577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:18.356441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:18.357616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:18.455551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:18.456577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:18.458370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:18.459485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lazy-loading 'fault' on Instance uuid 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:23:18.511590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:18.567222 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a4b4bcd-02ea-441a-a894-d1441c3a7768 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 0.566347 Nov 02 12:23:18.569484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 457/895] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:17 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:18.665689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9fc9d8509544dcb8df90bdf49c60df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dbd88241604726a6c21297724cf95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:18.700455 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b834e6af-88c2-4e0e-b719-2d4d5f919f96 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 200 len: 1313 microversion: 2.1 time: 0.389034 Nov 02 12:23:18.720404 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 439/896] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:18 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:18.726161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-594546073", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "1356286a-cad2-4a38-bd1d-50edbd66e87d"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:18.802723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] validate_networks() for [('1356286a-cad2-4a38-bd1d-50edbd66e87d', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:19.028256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:19.029945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:19.054571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.058147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.059554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.064110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.065057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.065768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.618337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:19.619748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:19.620401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:19.620974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:19.621614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:19.639405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.642389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.643228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.644898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.647778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.648433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.691327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:19.694796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Getting quotas for project 51edd9010e2640c7bc82c750d18d367b. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:19.696758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:19.701732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Getting quotas for user 68a5be7a432a4c3cb3233ed382622eca and project 51edd9010e2640c7bc82c750d18d367b. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:19.711282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:19.715091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:19.719303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:19.722015 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae950a4c-1001-4ea4-bb9f-4a8a23b0c6e7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1607 microversion: 2.25 time: 0.698306 Nov 02 12:23:19.724259 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 440/897] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:19 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1607 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:23:19.724583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:19.735026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:19.737997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:19.764318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.766731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.769059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.771190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.774415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.775309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.806971 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab8c598f-5a06-4b82-a850-0e3bf1358850 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234535 Nov 02 12:23:19.807663 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 458/898] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:23:19.821496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a43037e6-13ae-45b4-b9c0-22abab1ce3e1 req-25abdff2-3caa-4333-911b-99c31c3d5e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a61e28f-f3a1-4aea-be4b-4d12f85736ed", "tag": "7c1cf308-5949-4835-8ba5-fe201fbdf126"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:19.850436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a43037e6-13ae-45b4-b9c0-22abab1ce3e1 req-25abdff2-3caa-4333-911b-99c31c3d5e8a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.851078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a43037e6-13ae-45b4-b9c0-22abab1ce3e1 req-25abdff2-3caa-4333-911b-99c31c3d5e8a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.851575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a43037e6-13ae-45b4-b9c0-22abab1ce3e1 req-25abdff2-3caa-4333-911b-99c31c3d5e8a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.866535 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a43037e6-13ae-45b4-b9c0-22abab1ce3e1 req-25abdff2-3caa-4333-911b-99c31c3d5e8a service nova] Creating event network-changed:7c1cf308-5949-4835-8ba5-fe201fbdf126 for instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed on n-h1-855650-5 Nov 02 12:23:19.872211 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a43037e6-13ae-45b4-b9c0-22abab1ce3e1 req-25abdff2-3caa-4333-911b-99c31c3d5e8a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062304 Nov 02 12:23:19.873216 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 459/899] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:19.878934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de077a8c-b952-40fb-a2f8-8278d28ff783 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f29c430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:19.965020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de077a8c-b952-40fb-a2f8-8278d28ff783 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.090518 Nov 02 12:23:19.973030 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 460/900] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:19 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:19.977369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:19.978156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:19.990415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.993769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.994374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.995171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.995753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.996077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:20.138810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:20.154123 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38407251-5f18-4d14-85c1-6fd52f670f56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 0.428261 Nov 02 12:23:20.154816 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 441/901] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:19 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:20.171680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:20.172398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] [instance: 54d8ccfc-5664-420a-bf9d-841e82aa1ab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:20.192895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:20.193588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:20.194630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:20.195453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:20.201454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:20.202007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:20.238980 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] HTTP exception thrown: Instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 could not be found. Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Request method failure captured: Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 HTTP/1.1 Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDL3yipteibOzBgtVYm33zA6n-m45w87Wokbj3JXJd83sSComT2MPhyVqNvzbjqGQn0NBRJUPab0BLzNs3SuqlgUy0quE6gJAB2uslSKYk6EVqqtzc2_oY9XKENADw8Ib8bgRKf1XAo13UmNUlGw-7gH_0CAvY_6Zy7MhAoTAdCdnQ Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 82dbd88241604726a6c21297724cf95d Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:23:20.244279 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/82dbd88241604726a6c21297724cf95d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/82dbd88241604726a6c21297724cf95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/82dbd88241604726a6c21297724cf95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_82dbd88241604726a6c21297724cf95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 82dbd88241604726a6c21297724cf95d Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-72573455 Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FloatingIPsAssociationTestJSON-72573455-project Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c9fc9d8509544dcb8df90bdf49c60df6 Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-72573455-project Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 could not be found. Nov 02 12:23:20.246094 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '54d8ccfc-5664-420a-bf9d-841e82aa1ab1'} Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 could not be found. Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:20.246986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 could not be found. Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 could not be found. Nov 02 12:23:20.248648 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:20.250115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] Returning 404 to user: Instance 54d8ccfc-5664-420a-bf9d-841e82aa1ab1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:20.250115 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2c2440d5-fa5f-4b5a-886c-ad4c41d758f3 tempest-FloatingIPsAssociationTestJSON-72573455 tempest-FloatingIPsAssociationTestJSON-72573455-project] 10.222.0.45 "GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1" status: 404 len: 111 microversion: 2.1 time: 0.092245 Nov 02 12:23:20.253479 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 442/902] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:20 2022] GET /compute/v2.1/servers/54d8ccfc-5664-420a-bf9d-841e82aa1ab1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:23:20.266898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:20.267551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:20.281210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:20.281715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:20.282212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:20.282979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:20.283548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:20.283978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:20.382319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:20.396619 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-def4e493-0215-4564-83a1-754cd5202ffb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 0.422908 Nov 02 12:23:20.397487 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 461/903] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:19 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:20.414721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f6dfb624-cea8-49b2-817b-68fc076108e3 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:20.415343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f6dfb624-cea8-49b2-817b-68fc076108e3 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:20.530254 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c6e3a27-62e9-4ed1-82b0-46b26841ee8c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.275194 Nov 02 12:23:20.531145 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 443/904] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Nov 2 12:23:20 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:23:20.651016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f6dfb624-cea8-49b2-817b-68fc076108e3 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:20.659583 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f6dfb624-cea8-49b2-817b-68fc076108e3 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1231 microversion: 2.1 time: 0.258271 Nov 02 12:23:20.660252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 462/905] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:20 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1231 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:20.981216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6daf752c-e386-44f7-ae9e-0d584d24f219 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228eec7a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:21.089329 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6daf752c-e386-44f7-ae9e-0d584d24f219 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.112057 Nov 02 12:23:21.089936 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 444/906] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:20 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:21.193624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:21.194294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:21.209793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.214468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.214952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.215758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.216237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.216673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.424260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:21.430414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:21.444450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.446371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.447022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.447947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.453881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.454617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.788778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:21.804286 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-057d532d-31ce-4f3e-9cf4-7e491f50d927 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 0.624531 Nov 02 12:23:21.821592 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 463/907] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:21 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:21.831850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:21.833422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:21.839029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:21.843825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.845335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.846498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.849663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.850932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.852043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:22.031800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:22.042527 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-279757aa-9781-45f9-9502-1de175f2cf8a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1227 microversion: 2.1 time: 0.215610 Nov 02 12:23:22.044226 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 464/908] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:21 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1227 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:22.050805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f503ef6c-ab53-4418-91b3-6c0f4207e3ed req-301b2011-d72b-460a-a989-8f92e03ca476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb", "tag": "76e5447e-8752-4da2-956e-1aafb92c46c3"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:22.071805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f503ef6c-ab53-4418-91b3-6c0f4207e3ed req-301b2011-d72b-460a-a989-8f92e03ca476 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:22.072712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f503ef6c-ab53-4418-91b3-6c0f4207e3ed req-301b2011-d72b-460a-a989-8f92e03ca476 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:22.073395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f503ef6c-ab53-4418-91b3-6c0f4207e3ed req-301b2011-d72b-460a-a989-8f92e03ca476 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:22.092103 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f503ef6c-ab53-4418-91b3-6c0f4207e3ed req-301b2011-d72b-460a-a989-8f92e03ca476 service nova] Creating event network-changed:76e5447e-8752-4da2-956e-1aafb92c46c3 for instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb on n-h2-855650-5 Nov 02 12:23:22.101038 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f503ef6c-ab53-4418-91b3-6c0f4207e3ed req-301b2011-d72b-460a-a989-8f92e03ca476 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055006 Nov 02 12:23:22.107507 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 465/909] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:22.120189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7f742692-d4a3-4195-88f3-158c1c0e748b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ed09310>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:22.192329 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7f742692-d4a3-4195-88f3-158c1c0e748b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.081790 Nov 02 12:23:22.204228 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 466/910] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:22 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:22.297769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:22.436390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:22.452475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42850948-64ef-4f1c-aa16-9eebd3cad450 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 1.033480 Nov 02 12:23:22.471955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 445/911] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:21 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:22.831895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:22.833231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:22.841354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:22.841856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:22.842928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:22.844578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:22.845431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:22.846133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.074838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:23.075792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:23.084087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:23.089588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:23.090692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.091961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:23.092836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:23.094667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.287841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:23.298686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:23.307236 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d815c070-21b6-44c9-970c-d87fc6386a2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1227 microversion: 2.1 time: 0.239312 Nov 02 12:23:23.348335 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-26df3aee-6f14-4ddb-aa10-5578b50d6daf tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 0.520182 Nov 02 12:23:23.349067 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 446/912] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:23 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1227 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:23.353114 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 467/913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:22 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:23.356462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90018c24-d82d-4b9f-b6f3-c38923ed9b89 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ec554c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:23.468790 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90018c24-d82d-4b9f-b6f3-c38923ed9b89 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.116750 Nov 02 12:23:23.469919 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 447/914] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:23 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:23.481340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:23.482558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:23.495228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:23.501362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:23.502212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.503193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:23.504728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:23.505502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.860950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:23.892349 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5804638-6ccc-48a3-a3e7-da22c3ccae64 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 0.413617 Nov 02 12:23:23.895078 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 468/915] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:23 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:23.927707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f9ab082a-13c1-4f47-ae24-38d12a7c1d1e req-cd954fcc-d7e2-4b29-873a-c4bc0d49c344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf7c70a-03b4-456d-96c0-8e892183b1ac", "tag": "9264ba98-f8b6-4854-ae4f-4f7c06f5258d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:23.959834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9ab082a-13c1-4f47-ae24-38d12a7c1d1e req-cd954fcc-d7e2-4b29-873a-c4bc0d49c344 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:23.962533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9ab082a-13c1-4f47-ae24-38d12a7c1d1e req-cd954fcc-d7e2-4b29-873a-c4bc0d49c344 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:23.963380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9ab082a-13c1-4f47-ae24-38d12a7c1d1e req-cd954fcc-d7e2-4b29-873a-c4bc0d49c344 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.994203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f9ab082a-13c1-4f47-ae24-38d12a7c1d1e req-cd954fcc-d7e2-4b29-873a-c4bc0d49c344 service nova] Creating event network-changed:9264ba98-f8b6-4854-ae4f-4f7c06f5258d for instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac on n-h1-855650-5 Nov 02 12:23:24.007229 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f9ab082a-13c1-4f47-ae24-38d12a7c1d1e req-cd954fcc-d7e2-4b29-873a-c4bc0d49c344 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083561 Nov 02 12:23:24.018227 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 448/916] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:23:24.344688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:24.345760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:24.366481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:24.367301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:24.368394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:24.371906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:24.372615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:24.373229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:24.375034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:24.375960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:24.378172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=18 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:24.393983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:24.398732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:24.402596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:24.403534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:24.405217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:24.408022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:24.580805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:24.592736 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de434e20-ff7b-41e3-87d7-3b2658de5370 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1283 microversion: 2.1 time: 0.253964 Nov 02 12:23:24.596704 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 469/917] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:24 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:24.604605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5384fff2-f02e-4232-90ab-9bbaff854b33 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f022ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:24.690303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5384fff2-f02e-4232-90ab-9bbaff854b33 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.092168 Nov 02 12:23:24.690905 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 470/918] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:24 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:24.922920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:24.923992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:24.937185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:24.937688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:24.943070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:24.943300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:24.946618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:24.954087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:24.955037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:24.958801 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-618897c0-4d96-4da4-82c3-a9dcc110c415 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 0.584603 Nov 02 12:23:24.960792 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 449/919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:24 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:25.621088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:25.622696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:25.639461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:25.643442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:25.644015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:25.648667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:25.650943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:25.653277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:26.178453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:26.189307 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-062767f3-34d0-4810-9337-519bea194c75 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 1.271444 Nov 02 12:23:26.199403 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 471/920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:24 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:26.212080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93012f92-b390-457a-90b1-fa4e4d8dffa5 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ecf6f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:26.314136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:26.323454 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-022ec4e0-3162-497c-9662-037945f652f4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1289 microversion: 2.1 time: 0.708518 Nov 02 12:23:26.332382 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93012f92-b390-457a-90b1-fa4e4d8dffa5 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.131457 Nov 02 12:23:26.341895 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 472/921] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:26 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:26.347892 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 450/922] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:25 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1289 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:26.362517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:26.363664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:26.373268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:26.373913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:26.376641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:26.377515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:26.382799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:26.383413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:27.222094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:27.226795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:27.244803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:27.245601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:27.246249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:27.247176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:27.249640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:27.250369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:27.702411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:27.713881 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c427448-7a10-46d0-acc3-ee107dd07843 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 1.369822 Nov 02 12:23:27.714525 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 473/923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:26 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:27.724220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-663a5f21-09b7-4e53-b4b5-cedb3f1a1c98 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f0228b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:27.786094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-663a5f21-09b7-4e53-b4b5-cedb3f1a1c98 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.065559 Nov 02 12:23:27.786700 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 474/924] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:27 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:27.801428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:27.829103 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a059d260-f47e-4c6d-9099-db3f063e7014 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 0.611861 Nov 02 12:23:27.842666 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 451/925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:27 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:27.844225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:27.845502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:27.856800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:27.857295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:27.857738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:27.858778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:27.859491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:27.860184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:28.316803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:28.327197 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-77103b43-08c1-4485-998d-4cb9f8c29cdb tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.528965 Nov 02 12:23:28.328073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 475/926] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:27 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:28.742397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:28.744430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:28.751736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:28.752229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:28.752855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:28.753785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:28.754292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:28.754736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:28.804336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e0d8bae2-1829-425d-8cdb-785120a78326 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228f00eee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:28.859522 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e0d8bae2-1829-425d-8cdb-785120a78326 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.060624 Nov 02 12:23:28.860568 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 476/927] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:28 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:28.868319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:28.869378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:28.876649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:28.877525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:28.878277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:28.879287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:28.879998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:28.880685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:29.245849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:29.255493 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7a601cb-aad3-416d-a638-8efe4eaf2a78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 0.520100 Nov 02 12:23:29.256891 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 452/928] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:28 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:29.262740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c80c87ea-9ad8-48f7-b8ef-0dcd003aca34 req-dcd33c38-afe1-4039-bd60-464885db5dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a61e28f-f3a1-4aea-be4b-4d12f85736ed", "name": "network-vif-plugged", "status": "completed", "tag": "7c1cf308-5949-4835-8ba5-fe201fbdf126"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:29.274847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c80c87ea-9ad8-48f7-b8ef-0dcd003aca34 req-dcd33c38-afe1-4039-bd60-464885db5dc0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:29.278106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c80c87ea-9ad8-48f7-b8ef-0dcd003aca34 req-dcd33c38-afe1-4039-bd60-464885db5dc0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:29.278781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c80c87ea-9ad8-48f7-b8ef-0dcd003aca34 req-dcd33c38-afe1-4039-bd60-464885db5dc0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:29.294157 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c80c87ea-9ad8-48f7-b8ef-0dcd003aca34 req-dcd33c38-afe1-4039-bd60-464885db5dc0 service nova] Creating event network-vif-plugged:7c1cf308-5949-4835-8ba5-fe201fbdf126 for instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed on n-h1-855650-5 Nov 02 12:23:29.301563 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c80c87ea-9ad8-48f7-b8ef-0dcd003aca34 req-dcd33c38-afe1-4039-bd60-464885db5dc0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042989 Nov 02 12:23:29.302841 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 453/929] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:29.306053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:29.316598 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8acfd47d-070f-418c-aeb9-f8c9ceabe00b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 0.454471 Nov 02 12:23:29.328953 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 477/930] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:28 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:29.357870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:29.361047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:29.368580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:29.369471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:29.370187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:29.371279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:29.371988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:29.372638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:29.882576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:29.887258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-44ea1bb3-72a4-43e6-a615-e89bba1a58cf tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ecf6040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:29.905709 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0add15a7-cf9f-4941-8b4b-188eed3b4063 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.552773 Nov 02 12:23:29.910366 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 454/931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:29 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:29.925601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:29.999449 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-44ea1bb3-72a4-43e6-a615-e89bba1a58cf tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.117938 Nov 02 12:23:30.007795 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 478/932] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:29 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:30.282259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:30.284130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:30.284485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-441b5d42-e80f-41ac-92c0-5801eb00c2e4 req-a44c9998-bec1-493a-bc94-76b8925a1a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8aa0407-6ba6-41fb-ad9a-11a704f30da2", "tag": "b46029fb-9496-4ff8-86e1-c2b24a77ce4a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:30.308221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:30.314133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:30.319704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:30.321302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-441b5d42-e80f-41ac-92c0-5801eb00c2e4 req-a44c9998-bec1-493a-bc94-76b8925a1a92 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:30.322889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:30.326093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-441b5d42-e80f-41ac-92c0-5801eb00c2e4 req-a44c9998-bec1-493a-bc94-76b8925a1a92 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:30.327038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-441b5d42-e80f-41ac-92c0-5801eb00c2e4 req-a44c9998-bec1-493a-bc94-76b8925a1a92 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:30.327426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:30.328539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:30.386442 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-441b5d42-e80f-41ac-92c0-5801eb00c2e4 req-a44c9998-bec1-493a-bc94-76b8925a1a92 service nova] Creating event network-changed:b46029fb-9496-4ff8-86e1-c2b24a77ce4a for instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 on n-h1-855650-5 Nov 02 12:23:30.398850 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-441b5d42-e80f-41ac-92c0-5801eb00c2e4 req-a44c9998-bec1-493a-bc94-76b8925a1a92 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126806 Nov 02 12:23:30.406127 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 455/933] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:30.415636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:30.416747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:30.425738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:30.426744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:30.428232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:30.429414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:30.430232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:30.430940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:30.665826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:30.862395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:30.876442 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8597fc4b-16e3-4bba-ac2f-43530ebc6305 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1316 microversion: 2.1 time: 0.600913 Nov 02 12:23:30.890109 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 479/934] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:30 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:30.919152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:30.929069 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14f80926-1e78-499c-813b-11114fb668e7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 0.521188 Nov 02 12:23:30.929824 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 456/935] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:30 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:30.966212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:30.968580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:30.979939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:30.980632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:30.981091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:30.981876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:30.982385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:30.982855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.020516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1ec008eb-23b0-4c6e-aee0-9a07efb7386b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ea7a8b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:31.107062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1ec008eb-23b0-4c6e-aee0-9a07efb7386b tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1427 microversion: 2.1 time: 0.093962 Nov 02 12:23:31.108297 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 457/936] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:31 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:31.333011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ef9fd073-0899-4fa4-ae93-44a405692fc8 req-51c23ede-1564-43ce-938e-07002c041412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb", "name": "network-vif-plugged", "status": "completed", "tag": "76e5447e-8752-4da2-956e-1aafb92c46c3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:31.360300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ef9fd073-0899-4fa4-ae93-44a405692fc8 req-51c23ede-1564-43ce-938e-07002c041412 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.367029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ef9fd073-0899-4fa4-ae93-44a405692fc8 req-51c23ede-1564-43ce-938e-07002c041412 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.368753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ef9fd073-0899-4fa4-ae93-44a405692fc8 req-51c23ede-1564-43ce-938e-07002c041412 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.398819 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ef9fd073-0899-4fa4-ae93-44a405692fc8 req-51c23ede-1564-43ce-938e-07002c041412 service nova] Creating event network-vif-plugged:76e5447e-8752-4da2-956e-1aafb92c46c3 for instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb on n-h2-855650-5 Nov 02 12:23:31.407962 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ef9fd073-0899-4fa4-ae93-44a405692fc8 req-51c23ede-1564-43ce-938e-07002c041412 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078714 Nov 02 12:23:31.408971 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 458/937] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:31.846318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:31.856384 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1df77bf3-abc6-4922-baf5-2f718ab21646 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.903214 Nov 02 12:23:31.870411 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 480/938] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:30 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:31.923718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:31.926480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:31.941894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.942937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.943779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.945139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.946085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.947166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.969568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:31.971694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:31.983417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.984964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.986957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.988662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.989799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.990651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:32.423210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:32.432568 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4b214251-79b0-482a-90b4-f82c2b93d03b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1466 microversion: 2.1 time: 0.520836 Nov 02 12:23:32.433138 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 459/939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:31 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1466 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:32.444225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbc18439-bb06-4170-8af8-a27c33284e22 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228efa2670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:32.457308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:32.468753 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eeeacc67-9c86-4129-bc1e-94e4f3824cf9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 0.507939 Nov 02 12:23:32.469848 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 481/940] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:31 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:32.511815 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bbc18439-bb06-4170-8af8-a27c33284e22 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1436 microversion: 2.1 time: 0.077573 Nov 02 12:23:32.513101 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 460/941] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:32 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1436 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:32.528843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f93cd98-ab4e-4e47-a9bb-e16d1f596878 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ebfcca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:32.593333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:32.594216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:32.601578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:32.602066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f93cd98-ab4e-4e47-a9bb-e16d1f596878 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 200 len: 1436 microversion: 2.1 time: 0.078002 Nov 02 12:23:32.602902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:32.603415 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 461/942] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:23:32 2022] GET /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 1436 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:32.603967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:32.604761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:32.605287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:32.605783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:32.617850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:32.621738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:32.639513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:32.641217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:32.644743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:32.645629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:32.646237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:32.647030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.016344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:33.025512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bac7fbd0-f90f-45db-ba97-a11f16fb7e45 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1479 microversion: 2.1 time: 0.412119 Nov 02 12:23:33.030402 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 462/943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:32 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1479 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:33.047300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:33.047946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:33.055555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:33.056174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:33.056618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.057338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:33.057794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:33.058322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.237073 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c59af6d7-0afb-4f06-9c72-a409a39b3032 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1617 microversion: 2.1 time: 0.765914 Nov 02 12:23:33.238545 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 482/944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:32 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1617 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:33.264368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a22f76b2-23c9-47cf-8d03-79fe31935416 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Action: 'create', calling method: .version_select at 0x7f228ee9a280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-849999316", "policies": ["affinity"]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:33.268138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:33.278590 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9cab0b33-624b-4163-a07a-461f6c15043a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.245208 Nov 02 12:23:33.280084 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 463/945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:33 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:33.284436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a22f76b2-23c9-47cf-8d03-79fe31935416 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:33.291193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a22f76b2-23c9-47cf-8d03-79fe31935416 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:33.350376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a22f76b2-23c9-47cf-8d03-79fe31935416 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:33.355799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a22f76b2-23c9-47cf-8d03-79fe31935416 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:33.369412 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a22f76b2-23c9-47cf-8d03-79fe31935416 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.110665 Nov 02 12:23:33.370228 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 483/946] 10.222.0.45 () {60 vars in 1174 bytes} [Wed Nov 2 12:23:33 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:33.488238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-311418542", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d4cf0680-b6a6-41b9-ad6e-851beecaa04a"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:33.495197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:33.496124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:33.503133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:33.503857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:33.504446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.505353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:33.505802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:33.506943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.596780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:33.708578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:33.711097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:33.719840 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-76cca277-5479-452f-ad02-b17e8f81de28 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1316 microversion: 2.1 time: 0.228964 Nov 02 12:23:33.720626 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 484/947] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:33 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:33.857884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:33.858384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:33.858873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:33.859296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:33.859717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:33.889334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:33.889954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:33.890927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.892317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:33.893330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:33.894260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.913379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:33.919162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:33.934634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Going to run 2 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:33.937068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:33.984828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120722) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 12:23:34.004755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:34.010158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:34.050700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:34.051762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:34.058835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.059187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:34.059946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.060143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.060770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.061468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.062078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.070276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:34.080321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:34.104803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=6d19e5f5-bf7a-400e-a979-748822b5a92a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:34.194015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:34.204229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:34.281053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:34.292091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:34.295587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:34.305914 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a2931ba-e1ad-48de-9a0f-8e981178e8c3 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1466 microversion: 2.1 time: 0.259553 Nov 02 12:23:34.306614 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 485/948] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:34 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1466 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:34.312058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:34.312929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:34.323058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.323058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.323058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.323595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.323595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.323595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.384179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c5241248-adcd-4cc6-bb39-3e1ef484f4ae tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.899734 Nov 02 12:23:34.385210 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 464/949] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:23:34.391096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f1c4d6d-afd2-4355-bb1d-504783768d04 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ea7a5e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:34.509179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:34.519727 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2fb2f0e5-5077-4171-95f6-5c6434684fd6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.211133 Nov 02 12:23:34.521106 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 486/950] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:34 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:34.527929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:34.534784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:34.535994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Searching by: {'deleted': False, 'project_id': '74888962841648a7bfc8cd36cdf5526c'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:23:34.560024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.560927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.561663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.562859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.563959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.564767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.688879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:23:34.825918 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e0e8015-5256-4b3a-a8c6-0737a68b29dd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.302099 Nov 02 12:23:34.827124 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 487/951] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:23:34 2022] GET /compute/v2.1/servers => generated 1001 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:34.833912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:34.835278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:34.845246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.846044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.846253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.847076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.847538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.848560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.092385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:35.101134 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-155ca797-0bff-4578-ab4d-5c537f4a5626 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1505 microversion: 2.1 time: 0.272658 Nov 02 12:23:35.119580 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 488/952] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:34 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:35.125146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eddf953e-0e84-4bd6-963a-ea4f6dc0754d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:35.126087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eddf953e-0e84-4bd6-963a-ea4f6dc0754d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:35.211690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eddf953e-0e84-4bd6-963a-ea4f6dc0754d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:35.234597 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eddf953e-0e84-4bd6-963a-ea4f6dc0754d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1218 microversion: 2.1 time: 0.113227 Nov 02 12:23:35.242633 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 489/953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:35 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:35.266493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1629356000"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:35.267737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:35.285135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.288251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.289054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.289953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.290843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.291279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.354757 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f1c4d6d-afd2-4355-bb1d-504783768d04 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "DELETE /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9" status: 204 len: 0 microversion: 2.1 time: 0.967628 Nov 02 12:23:35.359749 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 465/954] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:34 2022] DELETE /compute/v2.1/images/0f568670-3466-44b0-8426-528a7f1869e9 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:35.368461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c338e888-603b-476a-9c39-165537863785 req-13b8c754-c27a-4a8b-9e80-f6d134f0b8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13c5d8d-ba99-4f40-a4a2-d7d5d463a237", "name": "network-vif-unplugged", "status": "completed", "tag": "da686012-05f8-4fdf-b251-5cd7e4d3b039"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:35.384755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c338e888-603b-476a-9c39-165537863785 req-13b8c754-c27a-4a8b-9e80-f6d134f0b8af service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.385508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c338e888-603b-476a-9c39-165537863785 req-13b8c754-c27a-4a8b-9e80-f6d134f0b8af service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.386179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c338e888-603b-476a-9c39-165537863785 req-13b8c754-c27a-4a8b-9e80-f6d134f0b8af service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.405401 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c338e888-603b-476a-9c39-165537863785 req-13b8c754-c27a-4a8b-9e80-f6d134f0b8af service nova] Creating event network-vif-unplugged:da686012-05f8-4fdf-b251-5cd7e4d3b039 for instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 on n-h1-855650-5 Nov 02 12:23:35.418144 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c338e888-603b-476a-9c39-165537863785 req-13b8c754-c27a-4a8b-9e80-f6d134f0b8af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056442 Nov 02 12:23:35.418744 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 466/955] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:35.436744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2cb63658-913c-41b3-b15e-cb1780fe6f00 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '.version_select at 0x7f228ebfa040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:35.487478 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-2cb63658-913c-41b3-b15e-cb1780fe6f00 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] HTTP exception thrown: Image not found. Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2cb63658-913c-41b3-b15e-cb1780fe6f00 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Request method failure captured: Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af HTTP/1.1 Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDlrBgkgc7Ouh7JnaPR8eBg9EqHoF6Sp6VFd3ofeSLbYotyShRamJLUuFPc1nleLI7JWZh5Wn0Mcxrz8Z1yIkaqPqdFP5NZb8BcRbX7Lm8rnfH6eDUR42y5sdCRjgtGuLOa1bnDChET-fFXXAz9sUtST0lL6SfIJsL04OdJzBFunzI Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0018d1abb96f47d78acb47c69ffd5348 Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:23:35.492076 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0018d1abb96f47d78acb47c69ffd5348 Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesOneServerTestJSON-127993795-project Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 592a24a9aa8c4229a3829ace625e3238 Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesOneServerTestJSON-127993795-project Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '945f387a-c139-4356-99b0-3f3dca88a4af'} Nov 02 12:23:35.493603 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 945f387a-c139-4356-99b0-3f3dca88a4af to delete Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:35.494550 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 945f387a-c139-4356-99b0-3f3dca88a4af could not be found. Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:35.495773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:23:35.496998 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:35.499895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2cb63658-913c-41b3-b15e-cb1780fe6f00 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:35.501231 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2cb63658-913c-41b3-b15e-cb1780fe6f00 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "DELETE /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af" status: 404 len: 62 microversion: 2.1 time: 0.075377 Nov 02 12:23:35.505551 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 467/956] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:35 2022] DELETE /compute/v2.1/images/945f387a-c139-4356-99b0-3f3dca88a4af => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:23:35.512988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:35.514382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:35.526725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.527591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.528244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.529816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.530534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.531181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.542336 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.network.security_group_api [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Adding security group a61de5c3-eace-46fe-8b7f-b0335dc07e3e to port 76e5447e-8752-4da2-956e-1aafb92c46c3 Nov 02 12:23:35.586468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:23:35.642947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:35.787714 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f10de73-ad8a-4d97-81d3-55205c2a2ab4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 204 len: 0 microversion: 2.1 time: 0.279788 Nov 02 12:23:35.793330 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 468/957] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:23:35 2022] DELETE /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:35.799856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:35.801743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:35.809082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.809588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.810071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.810785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.811239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.811661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.168648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:36.178210 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-065325cd-189a-4225-88cc-79be4ed2095f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.383188 Nov 02 12:23:36.194885 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 469/958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:35 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:36.200651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:36.202192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:36.210770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.211346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.211723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.212565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.212917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.213348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.294535 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-910bc6e0-f031-4ffa-998f-a059f9c6243c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb/action" status: 202 len: 0 microversion: 2.1 time: 1.048721 Nov 02 12:23:36.296057 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 490/959] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:23:35 2022] POST /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb/action => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:23:36.301873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:36.303664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:36.312938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.314017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.317463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.318729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.319458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.320251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.475596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:36.497364 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-12eae09c-66e2-4e04-b6a2-180371e08bfa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1214 microversion: 2.1 time: 0.199977 Nov 02 12:23:36.499478 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 491/960] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:36 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:36.505599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1917005051"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:36.506454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:36.520062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.520285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.520730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.521510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.526049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.526656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.691333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:36.712348 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-51e10c1d-e057-407f-a28b-0ab2ecb5f362 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1472 microversion: 2.1 time: 0.516186 Nov 02 12:23:36.715646 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 470/961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:36 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1472 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:36.741717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-af4bafa0-e230-49ad-8024-c191c60a8866 req-a03f17d0-ef01-4c23-b09c-b68d22786d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb", "tag": "76e5447e-8752-4da2-956e-1aafb92c46c3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:36.755350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-af4bafa0-e230-49ad-8024-c191c60a8866 req-a03f17d0-ef01-4c23-b09c-b68d22786d2b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.757186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-af4bafa0-e230-49ad-8024-c191c60a8866 req-a03f17d0-ef01-4c23-b09c-b68d22786d2b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.762288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-af4bafa0-e230-49ad-8024-c191c60a8866 req-a03f17d0-ef01-4c23-b09c-b68d22786d2b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.801287 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-af4bafa0-e230-49ad-8024-c191c60a8866 req-a03f17d0-ef01-4c23-b09c-b68d22786d2b service nova] Creating event network-changed:76e5447e-8752-4da2-956e-1aafb92c46c3 for instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb on n-h2-855650-5 Nov 02 12:23:36.807680 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-af4bafa0-e230-49ad-8024-c191c60a8866 req-a03f17d0-ef01-4c23-b09c-b68d22786d2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089506 Nov 02 12:23:36.808838 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 471/962] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:36.850380 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.network.security_group_api [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Adding security group 216e1c1a-5972-453f-b60a-0506517804ea to port 76e5447e-8752-4da2-956e-1aafb92c46c3 Nov 02 12:23:37.208434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:37.209534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:37.224463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.225922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.228703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.229885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.230608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.232202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.506399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:37.514422 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a0a2eba5-6505-4e2e-8ea0-2cdb8df19cb7 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.311770 Nov 02 12:23:37.515012 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 472/963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:37 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:37.531686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:37.532314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:37.548398 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48e6ff69-ca53-4d57-bf6f-86260c4b7adf tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb/action" status: 202 len: 0 microversion: 2.1 time: 1.047498 Nov 02 12:23:37.549020 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 492/964] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:23:36 2022] POST /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb/action => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:23:37.551853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.558383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:37.559134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:37.564801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.566531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.567307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.567796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.568317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.575531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.576037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.576482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.577214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.577676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.592443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.775933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:37.793620 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d8eeb8d1-6b79-482c-9dd9-0e24593c1c24 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1270 microversion: 2.1 time: 0.272367 Nov 02 12:23:37.794743 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 473/965] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:37 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1270 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:37.799909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:37.800896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:37.811152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.811758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.812271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.813063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.813613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.814468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.986660 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48e28daa-82c9-45e3-bfc5-867ac4dab0f1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.432623 Nov 02 12:23:37.988461 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 493/966] 10.222.0.45 () {58 vars in 1293 bytes} [Wed Nov 2 12:23:37 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb/os-security-groups => generated 1158 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:38.016875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-07a92dca-d1f8-4d69-b95f-9da5b1990171 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228f29c700>, body: {"security_group": {"name": " tempest-securitygroup -33455605 ", "description": "tempest-description-1637630762"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:38.018606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:38.047710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-49355809-fc6f-4323-a614-0c3f09dc9ed9 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1472 microversion: 2.1 time: 0.251672 Nov 02 12:23:38.069663 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 474/967] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:37 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:38.269694 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-07a92dca-d1f8-4d69-b95f-9da5b1990171 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.266400 Nov 02 12:23:38.282624 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 494/968] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:23:38 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:38.294910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ff64dd0-fbfd-4866-aa5e-861d51b4b87d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e8f3a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:38.452970 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ff64dd0-fbfd-4866-aa5e-861d51b4b87d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e" status: 200 len: 222 microversion: 2.1 time: 0.169765 Nov 02 12:23:38.454324 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 475/969] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:23:38 2022] GET /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e => generated 222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:38.468649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ae4a36d8-d2cb-4fb1-a39d-ff8cb70a321a tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228ed09af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:38.562556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:38.563614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:38.586763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:38.588026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:38.588672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:38.589573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:38.590255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:38.590852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:39.002787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:39.012347 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2415448-0579-41bc-91bd-32fcae7c7a37 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.474688 Nov 02 12:23:39.014647 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 476/970] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:38 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:39.047282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:39.050469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:39.065202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:39.065856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:39.067296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:39.068086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:39.068551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:39.068989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:39.245600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:39.263638 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88cab23c-7c03-4dce-9d8a-ab74cf1b9beb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1276 microversion: 2.1 time: 0.247478 Nov 02 12:23:39.269306 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 477/971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:39 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:39.279294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-952c5293-f26b-4638-9b53-acc1fae72e19 req-be0013cc-1ae7-44f3-b1e0-206d3dffab14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb", "tag": "76e5447e-8752-4da2-956e-1aafb92c46c3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:39.291191 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ae4a36d8-d2cb-4fb1-a39d-ff8cb70a321a tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e" status: 202 len: 0 microversion: 2.1 time: 0.827493 Nov 02 12:23:39.292101 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 495/972] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:23:38 2022] DELETE /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:23:39.299381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:39.300246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:39.302350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-952c5293-f26b-4638-9b53-acc1fae72e19 req-be0013cc-1ae7-44f3-b1e0-206d3dffab14 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:39.303357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-952c5293-f26b-4638-9b53-acc1fae72e19 req-be0013cc-1ae7-44f3-b1e0-206d3dffab14 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:39.304545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-952c5293-f26b-4638-9b53-acc1fae72e19 req-be0013cc-1ae7-44f3-b1e0-206d3dffab14 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:39.315420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:39.315920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:39.316747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:39.317625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:39.319540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:39.320151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:39.351540 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-952c5293-f26b-4638-9b53-acc1fae72e19 req-be0013cc-1ae7-44f3-b1e0-206d3dffab14 service nova] Creating event network-changed:76e5447e-8752-4da2-956e-1aafb92c46c3 for instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb on n-h2-855650-5 Nov 02 12:23:39.361894 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-952c5293-f26b-4638-9b53-acc1fae72e19 req-be0013cc-1ae7-44f3-b1e0-206d3dffab14 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087772 Nov 02 12:23:39.363618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 478/973] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:39.370816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c30df348-a479-4ad3-9ba1-c7ed00cda964 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228ed6daf0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:39.489865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-c30df348-a479-4ad3-9ba1-c7ed00cda964 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:23:39.490768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-c30df348-a479-4ad3-9ba1-c7ed00cda964 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:23:39.503538 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-c30df348-a479-4ad3-9ba1-c7ed00cda964 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:23:39.503538 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-0ff489c9-9db5-4497-98f2-f63da586b365'] Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c30df348-a479-4ad3-9ba1-c7ed00cda964 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e HTTP/1.1 Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:23:39.515934 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-0ff489c9-9db5-4497-98f2-f63da586b365'] Nov 02 12:23:39.517708 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9ef8614e-5b0e-4087-b675-92afe7b69a5e'} Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:39.518618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ff489c9-9db5-4497-98f2-f63da586b365'] Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:23:39.520063 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ff489c9-9db5-4497-98f2-f63da586b365'] Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ff489c9-9db5-4497-98f2-f63da586b365'] Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:39.521346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:39.523426 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:39.523426 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:39.523426 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:39.523426 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:39.523426 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:23:39.523426 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ff489c9-9db5-4497-98f2-f63da586b365'] Nov 02 12:23:39.523426 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:39.528373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c30df348-a479-4ad3-9ba1-c7ed00cda964 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:23:39.528373 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-0ff489c9-9db5-4497-98f2-f63da586b365'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:39.542072 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c30df348-a479-4ad3-9ba1-c7ed00cda964 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e" status: 404 len: 194 microversion: 2.1 time: 0.165464 Nov 02 12:23:39.555034 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 479/974] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:23:39 2022] GET /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e => generated 194 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:23:39.571734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-baeb67e3-f2d7-482f-ae2f-d98ae0d540c7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228e9045e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1763828522", "description": "tempest-description-1488958619"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:40.088530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592a24a9aa8c4229a3829ace625e3238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0018d1abb96f47d78acb47c69ffd5348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:40.117140 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ae59b5c7-cfb2-478b-9ddb-1de856e463b4 tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 200 len: 1472 microversion: 2.1 time: 0.822870 Nov 02 12:23:40.118319 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 496/975] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:39 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 1472 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:40.136021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:40.137068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:40.149077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:40.149578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:40.153164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:40.155441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:40.155941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:40.158947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:40.367065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-baeb67e3-f2d7-482f-ae2f-d98ae0d540c7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.802512 Nov 02 12:23:40.368081 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 480/976] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:23:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:40.375854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:40.376954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:40.388384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:40.389303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:40.391047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:40.392393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:40.393582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:40.394479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:40.764921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:40.778606 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6f09f15b-a5f5-47a7-83a1-b3032cb2ebf6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.657548 Nov 02 12:23:40.794671 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 497/977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:40 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:40.822220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0609cf50-aa97-465a-927b-02af0116bd31 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228eec41f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1503823741", "description": "tempest-description-459497919"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:41.096848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:41.106921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55a4fab6-55e1-4394-94ca-94d9fe29786a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1318 microversion: 2.1 time: 0.738026 Nov 02 12:23:41.112555 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 481/978] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:40 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1318 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:41.147077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:41.148031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] [instance: f13c5d8d-ba99-4f40-a4a2-d7d5d463a237] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:41.156852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.161127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.166304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.174852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.176398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.176995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.196899 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] HTTP exception thrown: Instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 could not be found. Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Request method failure captured: Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 HTTP/1.1 Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmDlrBgkgc7Ouh7JnaPR8eBg9EqHoF6Sp6VFd3ofeSLbYotyShRamJLUuFPc1nleLI7JWZh5Wn0Mcxrz8Z1yIkaqPqdFP5NZb8BcRbX7Lm8rnfH6eDUR42y5sdCRjgtGuLOa1bnDChET-fFXXAz9sUtST0lL6SfIJsL04OdJzBFunzI Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0018d1abb96f47d78acb47c69ffd5348 Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:23:41.198879 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0018d1abb96f47d78acb47c69ffd5348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0018d1abb96f47d78acb47c69ffd5348 Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-127993795 Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesOneServerTestJSON-127993795-project Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 592a24a9aa8c4229a3829ace625e3238 Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesOneServerTestJSON-127993795-project Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 could not be found. Nov 02 12:23:41.200272 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'f13c5d8d-ba99-4f40-a4a2-d7d5d463a237'} Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 could not be found. Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:41.201065 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 could not be found. Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 could not be found. Nov 02 12:23:41.202340 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:23:41.203492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] Returning 404 to user: Instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:41.203492 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1743cbfc-a621-4254-888d-74571db3336a tempest-ImagesOneServerTestJSON-127993795 tempest-ImagesOneServerTestJSON-127993795-project] 10.222.0.45 "GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237" status: 404 len: 111 microversion: 2.1 time: 0.061047 Nov 02 12:23:41.204506 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 482/979] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:41 2022] GET /compute/v2.1/servers/f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:23:41.394979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f1c9343b-8b95-4c7d-8c66-a6ffb5c3c54a req-08e7399b-cbbc-4f2a-a01c-5edf72d51ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13c5d8d-ba99-4f40-a4a2-d7d5d463a237", "name": "network-vif-deleted", "tag": "da686012-05f8-4fdf-b251-5cd7e4d3b039"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:41.413271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f1c9343b-8b95-4c7d-8c66-a6ffb5c3c54a req-08e7399b-cbbc-4f2a-a01c-5edf72d51ec9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.416142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f1c9343b-8b95-4c7d-8c66-a6ffb5c3c54a req-08e7399b-cbbc-4f2a-a01c-5edf72d51ec9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.416898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f1c9343b-8b95-4c7d-8c66-a6ffb5c3c54a req-08e7399b-cbbc-4f2a-a01c-5edf72d51ec9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.439004 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f1c9343b-8b95-4c7d-8c66-a6ffb5c3c54a req-08e7399b-cbbc-4f2a-a01c-5edf72d51ec9 service nova] Creating event network-vif-deleted:da686012-05f8-4fdf-b251-5cd7e4d3b039 for instance f13c5d8d-ba99-4f40-a4a2-d7d5d463a237 on n-h1-855650-5 Nov 02 12:23:41.449928 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f1c9343b-8b95-4c7d-8c66-a6ffb5c3c54a req-08e7399b-cbbc-4f2a-a01c-5edf72d51ec9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064376 Nov 02 12:23:41.452194 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 483/980] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:41.509067 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0609cf50-aa97-465a-927b-02af0116bd31 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.712640 Nov 02 12:23:41.509932 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 498/981] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:23:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:41.525776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da0b1997-de66-4eed-8697-27cdd287438e tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228e8b35e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2013148215", "description": "tempest-description-577980152"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:41.627862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:41.629948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:41.654093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.655121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.655971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.657360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.658235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.660416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.782400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:23:42.020661 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-19ee22a7-20c9-4260-9c2b-c194f18b997c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 204 len: 0 microversion: 2.1 time: 0.412459 Nov 02 12:23:42.021327 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 499/982] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:23:41 2022] DELETE /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:42.038675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:42.039935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:42.052379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.057925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.058574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.059265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.064081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.064554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.071676 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da0b1997-de66-4eed-8697-27cdd287438e tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.551811 Nov 02 12:23:42.072290 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 484/983] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:23:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:42.088030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-037e2de7-0c86-4fcd-a5be-e7aa73ebd28c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e8f3ee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:42.489436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:42.502702 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9db793b6-de7f-4717-9f34-e30c7d27b4ff tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.479449 Nov 02 12:23:42.517125 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 500/984] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:42 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:42.522685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:42.523682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:42.530311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.531038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.531653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.532376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.532840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.533271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.964619 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-037e2de7-0c86-4fcd-a5be-e7aa73ebd28c tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.883108 Nov 02 12:23:42.966481 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 485/985] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:23:42 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:42.973353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-163917277", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "182260224", "adminPass": "***", "networks": [{"uuid": "f1d02c46-05ef-4c49-8d45-8dbd809ddd5a"}], "security_groups": [{"name": "tempest-securitygroup--24862227"}], "key_name": "tempest-keypair-961828759", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:42.975030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:42.983645 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1fc3bd36-1746-4501-aad5-e3199897114c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1318 microversion: 2.1 time: 0.464885 Nov 02 12:23:42.988372 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 501/986] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:42 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:42.996830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-fb74e07d-649b-43d1-a74d-80e38fbafd6f req-10c1517c-7c86-44cc-bab3-ef04615e395e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aa0407-6ba6-41fb-ad9a-11a704f30da2", "name": "network-vif-plugged", "status": "completed", "tag": "b46029fb-9496-4ff8-86e1-c2b24a77ce4a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:43.015521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fb74e07d-649b-43d1-a74d-80e38fbafd6f req-10c1517c-7c86-44cc-bab3-ef04615e395e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:43.016001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fb74e07d-649b-43d1-a74d-80e38fbafd6f req-10c1517c-7c86-44cc-bab3-ef04615e395e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:43.016844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fb74e07d-649b-43d1-a74d-80e38fbafd6f req-10c1517c-7c86-44cc-bab3-ef04615e395e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:43.032741 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-fb74e07d-649b-43d1-a74d-80e38fbafd6f req-10c1517c-7c86-44cc-bab3-ef04615e395e service nova] Creating event network-vif-plugged:b46029fb-9496-4ff8-86e1-c2b24a77ce4a for instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 on n-h1-855650-5 Nov 02 12:23:43.039753 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-fb74e07d-649b-43d1-a74d-80e38fbafd6f req-10c1517c-7c86-44cc-bab3-ef04615e395e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049534 Nov 02 12:23:43.046912 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 502/987] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:43.053660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9656c9fe-543e-405d-8027-75def87ddffa req-17903ac5-9462-49cb-adff-80117735941e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d19e5f5-bf7a-400e-a979-748822b5a92a", "tag": "aedfadec-b75a-4177-b41e-f4101241d2f7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:43.065132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9656c9fe-543e-405d-8027-75def87ddffa req-17903ac5-9462-49cb-adff-80117735941e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:43.065620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9656c9fe-543e-405d-8027-75def87ddffa req-17903ac5-9462-49cb-adff-80117735941e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:43.066156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9656c9fe-543e-405d-8027-75def87ddffa req-17903ac5-9462-49cb-adff-80117735941e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:43.083784 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9656c9fe-543e-405d-8027-75def87ddffa req-17903ac5-9462-49cb-adff-80117735941e service nova] Creating event network-changed:aedfadec-b75a-4177-b41e-f4101241d2f7 for instance 6d19e5f5-bf7a-400e-a979-748822b5a92a on n-h2-855650-5 Nov 02 12:23:43.089540 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9656c9fe-543e-405d-8027-75def87ddffa req-17903ac5-9462-49cb-adff-80117735941e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040894 Nov 02 12:23:43.094216 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 503/988] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:43.100949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-10c07d9a-61c3-443c-a662-7888995ae0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228eec4940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:43.274901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] validate_networks() for [('f1d02c46-05ef-4c49-8d45-8dbd809ddd5a', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:43.907177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:43.916199 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-10c07d9a-61c3-443c-a662-7888995ae0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b" status: 202 len: 0 microversion: 2.1 time: 0.820637 Nov 02 12:23:43.916849 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 504/989] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:23:43 2022] DELETE /compute/v2.1/os-security-groups/d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:23:43.921743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:43.922510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:43.937579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:43.938480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:43.939632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:43.940827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:43.941666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:43.942600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:44.305679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=22 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:44.318468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:44.340057 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-38c98f1d-f23a-4360-9cb8-efce8810be4e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1331 microversion: 2.1 time: 0.421348 Nov 02 12:23:44.341437 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 505/990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:43 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1331 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:44.352465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d75a23af-f0dc-46d1-a339-b825dd149573 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228ede6700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:44.513308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:44.514686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:44.515445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:44.516004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:44.516577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:44.531547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-d75a23af-f0dc-46d1-a339-b825dd149573 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:23:44.532600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.security_group_api [None req-d75a23af-f0dc-46d1-a339-b825dd149573 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b not found {{(pid=120723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:23:44.533741 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d75a23af-f0dc-46d1-a339-b825dd149573 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:23:44.533741 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-8ef537aa-9bf2-45c2-acd2-1fb2b10d6ca3'] Nov 02 12:23:44.534358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:44.535226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:44.535899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:44.536883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:44.538302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:44.539028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d75a23af-f0dc-46d1-a339-b825dd149573 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-security-groups/d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b HTTP/1.1 Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:23:44.545403 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: exception: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-8ef537aa-9bf2-45c2-acd2-1fb2b10d6ca3'] Nov 02 12:23:44.547049 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'd1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b'} Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:44.547907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ef537aa-9bf2-45c2-acd2-1fb2b10d6ca3'] Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:23:44.549130 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ef537aa-9bf2-45c2-acd2-1fb2b10d6ca3'] Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ef537aa-9bf2-45c2-acd2-1fb2b10d6ca3'] Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.552449 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ef537aa-9bf2-45c2-acd2-1fb2b10d6ca3'] Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d75a23af-f0dc-46d1-a339-b825dd149573 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-8ef537aa-9bf2-45c2-acd2-1fb2b10d6ca3'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d75a23af-f0dc-46d1-a339-b825dd149573 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b" status: 404 len: 194 microversion: 2.1 time: 0.207399 Nov 02 12:23:44.556330 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 506/991] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:23:44 2022] GET /compute/v2.1/os-security-groups/d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b => generated 194 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:23:44.583324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:44.584479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:44.599097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Getting quotas for project f19f46a5675c4f028057725f509a1d50. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:44.602109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:44.608956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:44.609682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:44.610792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:44.611427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:44.612024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:44.613498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Getting quotas for user 20bdb026c50545849ac88f7c744cbf50 and project f19f46a5675c4f028057725f509a1d50. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:44.619875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:44.635040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:44.638359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:44.727505 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-944bee32-f9b9-407a-a024-e93046dfd6cc tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.759708 Nov 02 12:23:44.736206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 486/992] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:42 2022] POST /compute/v2.1/servers => generated 400 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:23:44.959999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:44.968567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:44.973381 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55f13ab4-8c2b-471a-991d-fb2a287e107e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1318 microversion: 2.1 time: 0.409960 Nov 02 12:23:44.987546 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 507/993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:44 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:44.987546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d3af979e-eda7-480e-b0ab-f560723a1bea tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228eed7670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:45.081777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3ffed49-24bc-413d-88a2-7c2247eb89cf tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Action: 'create', calling method: .version_select at 0x7f228e8b3dc0>, body: {"pool": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:45.216843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:45.554636 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d3af979e-eda7-480e-b0ab-f560723a1bea tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/be99ced5-98d5-4c59-a6f0-b53b11ffe007" status: 202 len: 0 microversion: 2.1 time: 0.578549 Nov 02 12:23:45.555629 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 508/994] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:23:44 2022] DELETE /compute/v2.1/os-security-groups/be99ced5-98d5-4c59-a6f0-b53b11ffe007 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:23:45.563800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:45.567615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:45.580349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:45.590653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:45.591154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:45.591601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:45.597226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:45.597722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:45.598196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:45.816685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:45.836958 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-228029a4-c5f6-4bf8-b864-7187ce0792a8 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1265 microversion: 2.1 time: 0.278863 Nov 02 12:23:45.837911 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 509/995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:45 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:45.852003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-291bb597-216e-4f76-b7cc-1506c7e42a05 req-5df08d7d-629c-40ae-9137-076343b49447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d96ede4-9bfa-4448-8891-fbe9566cdab1", "tag": "3dc52f47-b930-4470-b4aa-5fb00f9209ad"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:45.878053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-291bb597-216e-4f76-b7cc-1506c7e42a05 req-5df08d7d-629c-40ae-9137-076343b49447 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:45.887430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-291bb597-216e-4f76-b7cc-1506c7e42a05 req-5df08d7d-629c-40ae-9137-076343b49447 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:45.888373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-291bb597-216e-4f76-b7cc-1506c7e42a05 req-5df08d7d-629c-40ae-9137-076343b49447 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:45.907186 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-291bb597-216e-4f76-b7cc-1506c7e42a05 req-5df08d7d-629c-40ae-9137-076343b49447 service nova] Creating event network-changed:3dc52f47-b930-4470-b4aa-5fb00f9209ad for instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 on n-h2-855650-5 Nov 02 12:23:45.914711 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-291bb597-216e-4f76-b7cc-1506c7e42a05 req-5df08d7d-629c-40ae-9137-076343b49447 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073186 Nov 02 12:23:45.920804 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 510/996] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:45.930493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:45.931817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:45.951729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:45.952515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:45.958123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:45.959497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:45.960381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:45.961065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:46.956195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:46.982658 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-095fea78-f87a-43ce-9b77-a54136398b7a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1536 microversion: 2.1 time: 1.043431 Nov 02 12:23:46.983245 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 511/997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:45 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1536 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:47.000988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2095d441-9bdb-48ac-a677-af72f6fc3fa8 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228f1a1ca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:47.179770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-2095d441-9bdb-48ac-a677-af72f6fc3fa8 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:23:47.180920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.security_group_api [None req-2095d441-9bdb-48ac-a677-af72f6fc3fa8 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 not found {{(pid=120723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:23:47.182037 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-2095d441-9bdb-48ac-a677-af72f6fc3fa8 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:23:47.182037 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-c2e25234-eb36-418b-9de0-c0cdda3907a6'] Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2095d441-9bdb-48ac-a677-af72f6fc3fa8 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-security-groups/be99ced5-98d5-4c59-a6f0-b53b11ffe007 HTTP/1.1 Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:23:47.185231 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: exception: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-c2e25234-eb36-418b-9de0-c0cdda3907a6'] Nov 02 12:23:47.186673 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'be99ced5-98d5-4c59-a6f0-b53b11ffe007'} Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:47.187707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2e25234-eb36-418b-9de0-c0cdda3907a6'] Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:23:47.188974 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2e25234-eb36-418b-9de0-c0cdda3907a6'] Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2e25234-eb36-418b-9de0-c0cdda3907a6'] Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:47.192968 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:47.196311 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:47.196311 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:47.196311 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:47.196311 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:47.196311 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:23:47.196311 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2e25234-eb36-418b-9de0-c0cdda3907a6'] Nov 02 12:23:47.196311 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:47.199379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2095d441-9bdb-48ac-a677-af72f6fc3fa8 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:23:47.199379 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-c2e25234-eb36-418b-9de0-c0cdda3907a6'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:47.200802 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2095d441-9bdb-48ac-a677-af72f6fc3fa8 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/be99ced5-98d5-4c59-a6f0-b53b11ffe007" status: 404 len: 194 microversion: 2.1 time: 0.213768 Nov 02 12:23:47.201564 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 512/998] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:23:46 2022] GET /compute/v2.1/os-security-groups/be99ced5-98d5-4c59-a6f0-b53b11ffe007 => generated 194 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:23:47.211353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:47.216311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:47.233507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:47.236322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:47.238648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:47.239986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:47.243418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:47.244133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:47.757640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:47.773188 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3f11c472-0bf4-477e-bef0-4d4212c035e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1318 microversion: 2.1 time: 0.570252 Nov 02 12:23:47.773991 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 513/999] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:47 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:47.779889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:47.788139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:47.804516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:47.805272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:47.806319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:47.807774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:47.809430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:47.810205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:47.952653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:47.962334 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-250e5a13-e139-4167-9f6d-8b9cc9f95cc6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1319 microversion: 2.1 time: 0.187094 Nov 02 12:23:47.963587 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 514/1000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:47 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:47.969182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba2a6d2b-c0c9-4d21-a8bc-8ca64747ee14 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'create', calling method: .version_select at 0x7f228edb5700>, body: {"pool": "75b0e233-ff45-4a45-b17c-c024d18002bf"} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:49.470779 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e3ffed49-24bc-413d-88a2-7c2247eb89cf tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.732971 Nov 02 12:23:49.473044 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 487/1001] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:23:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:49.486148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ed9e7f4f-4ac8-41dc-923b-0cce1d4a6b30 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e966e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:50.125518 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ed9e7f4f-4ac8-41dc-923b-0cce1d4a6b30 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/449cfa3e-aac8-4d66-aa87-1304e5566e47" status: 202 len: 0 microversion: 2.1 time: 0.650969 Nov 02 12:23:50.130471 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 488/1002] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:23:49 2022] DELETE /compute/v2.1/os-security-groups/449cfa3e-aac8-4d66-aa87-1304e5566e47 => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:23:50.135144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-00bbc7fa-1306-48ce-9a4b-5515c88283ff req-89e1af49-491b-415c-b1ad-8d0ae7afb139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa17e49-fd4f-4121-932a-3d8aad79bab1", "name": "network-vif-deleted", "tag": "be3b893e-ad60-40bd-98b3-160fdc19a1fe"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:50.164749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00bbc7fa-1306-48ce-9a4b-5515c88283ff req-89e1af49-491b-415c-b1ad-8d0ae7afb139 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:50.165834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00bbc7fa-1306-48ce-9a4b-5515c88283ff req-89e1af49-491b-415c-b1ad-8d0ae7afb139 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:50.168496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00bbc7fa-1306-48ce-9a4b-5515c88283ff req-89e1af49-491b-415c-b1ad-8d0ae7afb139 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:50.199711 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-00bbc7fa-1306-48ce-9a4b-5515c88283ff req-89e1af49-491b-415c-b1ad-8d0ae7afb139 service nova] Creating event network-vif-deleted:be3b893e-ad60-40bd-98b3-160fdc19a1fe for instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 on n-h2-855650-5 Nov 02 12:23:50.211945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-00bbc7fa-1306-48ce-9a4b-5515c88283ff req-89e1af49-491b-415c-b1ad-8d0ae7afb139 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082342 Nov 02 12:23:50.215353 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 489/1003] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:50.226898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:50.227635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:50.242575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:50.243146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:50.243568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:50.247667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:50.248304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:50.250056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:50.818257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:50.828470 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2cfa3aec-c436-4153-af77-077cd023eb91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1318 microversion: 2.1 time: 0.611342 Nov 02 12:23:50.846241 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 490/1004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:50 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:50.852557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:50.853550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:50.861367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:50.862326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:50.863263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:50.864357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:50.865091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:50.865755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:51.232864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:51.258547 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0eb58c20-3dae-461f-8aee-721e0fd5d10e tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1385 microversion: 2.1 time: 0.409883 Nov 02 12:23:51.262454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 491/1005] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:50 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1385 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:51.280862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37ed5d72-c8e9-4695-b310-d13eebf5a516 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Action: 'create', calling method: .version_select at 0x7f228ed624c0>, body: {"pool": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:52.217250 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba2a6d2b-c0c9-4d21-a8bc-8ca64747ee14 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.252201 Nov 02 12:23:52.219207 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 515/1006] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:23:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:52.234111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7118749f-cf0c-4cd5-9f60-518497698b6b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228ed09b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-7118749f-cf0c-4cd5-9f60-518497698b6b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.security_group_api [None req-7118749f-cf0c-4cd5-9f60-518497698b6b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 not found {{(pid=120723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7118749f-cf0c-4cd5-9f60-518497698b6b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-3c8bed62-a2ad-41d4-990a-91531347f958'] Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7118749f-cf0c-4cd5-9f60-518497698b6b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-security-groups/449cfa3e-aac8-4d66-aa87-1304e5566e47 HTTP/1.1 Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:23:52.279376 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:23:52.281623 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: exception: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-3c8bed62-a2ad-41d4-990a-91531347f958'] Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '449cfa3e-aac8-4d66-aa87-1304e5566e47'} Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:52.283180 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c8bed62-a2ad-41d4-990a-91531347f958'] Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:52.284893 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c8bed62-a2ad-41d4-990a-91531347f958'] Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:23:52.286225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c8bed62-a2ad-41d4-990a-91531347f958'] Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c8bed62-a2ad-41d4-990a-91531347f958'] Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7118749f-cf0c-4cd5-9f60-518497698b6b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:23:52.288135 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-3c8bed62-a2ad-41d4-990a-91531347f958'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:52.289059 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7118749f-cf0c-4cd5-9f60-518497698b6b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/449cfa3e-aac8-4d66-aa87-1304e5566e47" status: 404 len: 194 microversion: 2.1 time: 0.051006 Nov 02 12:23:52.289059 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 516/1007] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:23:52 2022] GET /compute/v2.1/os-security-groups/449cfa3e-aac8-4d66-aa87-1304e5566e47 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:23:52.293381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:52.294166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:52.300606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:52.301111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:52.301556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:52.302308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:52.303370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:52.303809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:52.710142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:52.739216 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-866babd9-f185-4ac1-9fbc-63c9c6ebd269 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1318 microversion: 2.1 time: 0.450900 Nov 02 12:23:52.741416 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 517/1008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:52 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:52.755269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.179"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:52.758288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:52.766394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:52.767156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:52.767786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:52.768689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:52.769302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:52.769882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:52.803733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:23:52.804405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquired lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:23:54.568821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:54.625946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:54.939977 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37ed5d72-c8e9-4695-b310-d13eebf5a516 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.675680 Nov 02 12:23:54.949937 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 492/1009] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:23:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:55.016649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-132041131", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "4f15fe59-ad56-4fe4-bb95-1f56ed9444ee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:55.092181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] validate_networks() for [('4f15fe59-ad56-4fe4-bb95-1f56ed9444ee', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:55.272174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Building network info cache for instance {{(pid=120723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:23:55.911319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:55.912497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:55.912770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:55.913185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:55.913605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:55.923596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:55.924500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:55.925284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:55.926301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:55.927000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:55.927745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:55.948408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Getting quotas for project ec1d3a52fa334a5397b03d71086cfffc. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:55.954273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:55.955994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Getting quotas for user ead418d7f3f945b3a3ad7432805fd929 and project ec1d3a52fa334a5397b03d71086cfffc. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:55.974371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:55.977224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:56.041343 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6c9cb36-caf1-4804-86c7-dd9454206682 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094644 Nov 02 12:23:56.044983 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 493/1010] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:23:56.050553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:56.051472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:56.059251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:56.060052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:56.060697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:56.061646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:56.062384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:56.062988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:56.290507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:56.303559 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0eaffe90-e438-45d7-9e6f-954fb2cec9ca tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1385 microversion: 2.1 time: 0.256546 Nov 02 12:23:56.304890 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 494/1011] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:56 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1385 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:56.319008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d124757-a61b-4831-99ec-cd4f384338aa tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e8c1ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:56.324653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Updating instance_info_cache with network_info: [{"id": "b46029fb-9496-4ff8-86e1-c2b24a77ce4a", "address": "fa:16:3e:e8:26:02", "network": {"id": "1356286a-cad2-4a38-bd1d-50edbd66e87d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1636127923-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "51edd9010e2640c7bc82c750d18d367b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb46029fb-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:23:56.342221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Releasing lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:23:56.343069 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5bfda89b-83a1-4693-b059-6b33f50f57e2 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action" status: 202 len: 0 microversion: 2.1 time: 3.599896 Nov 02 12:23:56.347017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 518/1012] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:23:52 2022] POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action => generated 0 bytes in 3601 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:23:56.357515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-79d64bee-e530-4c9b-83d1-f328a36854f2 req-32f6aad5-a598-4655-86d1-54d981bf1400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1355556-3912-41a2-a733-92804b34fe22", "tag": "e648d659-81f5-4ea0-ae85-26b235829c65"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:56.377980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-79d64bee-e530-4c9b-83d1-f328a36854f2 req-32f6aad5-a598-4655-86d1-54d981bf1400 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:56.383030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-79d64bee-e530-4c9b-83d1-f328a36854f2 req-32f6aad5-a598-4655-86d1-54d981bf1400 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:56.383655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-79d64bee-e530-4c9b-83d1-f328a36854f2 req-32f6aad5-a598-4655-86d1-54d981bf1400 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:56.419641 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-79d64bee-e530-4c9b-83d1-f328a36854f2 req-32f6aad5-a598-4655-86d1-54d981bf1400 service nova] Creating event network-changed:e648d659-81f5-4ea0-ae85-26b235829c65 for instance b1355556-3912-41a2-a733-92804b34fe22 on n-h1-855650-5 Nov 02 12:23:56.425328 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-79d64bee-e530-4c9b-83d1-f328a36854f2 req-32f6aad5-a598-4655-86d1-54d981bf1400 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080138 Nov 02 12:23:56.425921 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 519/1013] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:56.431962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:56.432666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:56.446771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:56.447276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:56.447907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:56.448494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:56.449106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:56.449538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:56.666060 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d124757-a61b-4831-99ec-cd4f384338aa tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.358296 Nov 02 12:23:56.666663 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 495/1014] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:23:56 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:56.671794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-952e6ad8-38c9-4f9a-b670-087349e6d19b req-7c01dae9-d35d-43d5-a1a0-fa8b61e33db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d96ede4-9bfa-4448-8891-fbe9566cdab1", "name": "network-vif-plugged", "status": "completed", "tag": "3dc52f47-b930-4470-b4aa-5fb00f9209ad"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:56.691902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-952e6ad8-38c9-4f9a-b670-087349e6d19b req-7c01dae9-d35d-43d5-a1a0-fa8b61e33db4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:56.692406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-952e6ad8-38c9-4f9a-b670-087349e6d19b req-7c01dae9-d35d-43d5-a1a0-fa8b61e33db4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:56.693030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-952e6ad8-38c9-4f9a-b670-087349e6d19b req-7c01dae9-d35d-43d5-a1a0-fa8b61e33db4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:56.693697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:56.703434 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b4514ffd-c5fd-4e06-9b3d-69a5d1f3f341 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1318 microversion: 2.1 time: 0.276224 Nov 02 12:23:56.704025 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 520/1015] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:56 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:56.706469 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-952e6ad8-38c9-4f9a-b670-087349e6d19b req-7c01dae9-d35d-43d5-a1a0-fa8b61e33db4 service nova] Creating event network-vif-plugged:3dc52f47-b930-4470-b4aa-5fb00f9209ad for instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 on n-h2-855650-5 Nov 02 12:23:56.713924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-952e6ad8-38c9-4f9a-b670-087349e6d19b req-7c01dae9-d35d-43d5-a1a0-fa8b61e33db4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045981 Nov 02 12:23:56.715534 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 496/1016] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:56.719555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7863ecad-4e5f-4cfa-b56a-f7e7bfc0b067 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Action: 'create', calling method: .version_select at 0x7f228f097160>, body: {"pool": null} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:56.721359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8398fdc8-f7ad-40f2-a07b-f89ba7c56f00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:56.722295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8398fdc8-f7ad-40f2-a07b-f89ba7c56f00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:56.925890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8398fdc8-f7ad-40f2-a07b-f89ba7c56f00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:56.942021 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8398fdc8-f7ad-40f2-a07b-f89ba7c56f00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1224 microversion: 2.1 time: 0.224941 Nov 02 12:23:56.952189 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 497/1017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:56 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1224 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:56.957521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5581b40b-8bea-41d9-a87f-9e9a63bd209f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'create', calling method: .version_select at 0x7f228e8c6310>, body: {"pool": "75b0e233-ff45-4a45-b17c-c024d18002bf"} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:59.529996 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7863ecad-4e5f-4cfa-b56a-f7e7bfc0b067 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.821975 Nov 02 12:23:59.539795 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 521/1018] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:23:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:59.546085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84605892-c085-4b65-b80f-fd80b798aafe tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228f0350d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1446547409", "description": "tempest-description-412439109"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:59.871025 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84605892-c085-4b65-b80f-fd80b798aafe tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.330003 Nov 02 12:23:59.872002 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 522/1019] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:23:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:59.876973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:59.877711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:59.886287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.886783 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5581b40b-8bea-41d9-a87f-9e9a63bd209f tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.933145 Nov 02 12:23:59.887272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.887529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:59.888258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.888823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.889329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:59.894218 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 498/1020] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:23:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:59.900265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:59.900922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:59.907801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.908305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.908740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:59.909673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.910178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.910608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:00.119176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:00.125108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:00.136882 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d896bfe-c333-42ae-a0fa-1f6aae320c17 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1385 microversion: 2.1 time: 0.263246 Nov 02 12:24:00.137463 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 523/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:59 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1385 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:00.138227 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b30b552d-3b5d-416c-9e67-57ccd2ed345f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1467 microversion: 2.1 time: 0.242323 Nov 02 12:24:00.142176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:00.142991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:00.149714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:00.150500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:00.150928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:00.151636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:00.152087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:00.152514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:00.154501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 499/1022] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:59 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1467 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:00.161524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ffd0a72c-328f-447b-b950-f13e37df2588 req-65ccb5d9-e995-4a08-a3e5-5ce8a5eb05ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8aa0407-6ba6-41fb-ad9a-11a704f30da2", "tag": "b46029fb-9496-4ff8-86e1-c2b24a77ce4a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:00.174028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ffd0a72c-328f-447b-b950-f13e37df2588 req-65ccb5d9-e995-4a08-a3e5-5ce8a5eb05ad service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:00.174517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ffd0a72c-328f-447b-b950-f13e37df2588 req-65ccb5d9-e995-4a08-a3e5-5ce8a5eb05ad service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:00.174978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ffd0a72c-328f-447b-b950-f13e37df2588 req-65ccb5d9-e995-4a08-a3e5-5ce8a5eb05ad service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:00.190827 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ffd0a72c-328f-447b-b950-f13e37df2588 req-65ccb5d9-e995-4a08-a3e5-5ce8a5eb05ad service nova] Creating event network-changed:b46029fb-9496-4ff8-86e1-c2b24a77ce4a for instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 on n-h1-855650-5 Nov 02 12:24:00.197769 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ffd0a72c-328f-447b-b950-f13e37df2588 req-65ccb5d9-e995-4a08-a3e5-5ce8a5eb05ad service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041641 Nov 02 12:24:00.198741 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 500/1023] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:00.205639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-b6611d5b-3341-4060-9dde-5ef5045ab46b req-237cddfb-8942-4b72-bbf4-d24b1a702978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d19e5f5-bf7a-400e-a979-748822b5a92a", "name": "network-vif-plugged", "status": "completed", "tag": "aedfadec-b75a-4177-b41e-f4101241d2f7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:00.218432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b6611d5b-3341-4060-9dde-5ef5045ab46b req-237cddfb-8942-4b72-bbf4-d24b1a702978 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:00.218996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b6611d5b-3341-4060-9dde-5ef5045ab46b req-237cddfb-8942-4b72-bbf4-d24b1a702978 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:00.219980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b6611d5b-3341-4060-9dde-5ef5045ab46b req-237cddfb-8942-4b72-bbf4-d24b1a702978 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:00.240743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-b6611d5b-3341-4060-9dde-5ef5045ab46b req-237cddfb-8942-4b72-bbf4-d24b1a702978 service nova] Creating event network-vif-plugged:aedfadec-b75a-4177-b41e-f4101241d2f7 for instance 6d19e5f5-bf7a-400e-a979-748822b5a92a on n-h2-855650-5 Nov 02 12:24:00.247429 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-b6611d5b-3341-4060-9dde-5ef5045ab46b req-237cddfb-8942-4b72-bbf4-d24b1a702978 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046783 Nov 02 12:24:00.248576 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 501/1024] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:00.255898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a513439e-1fa2-45e3-80c7-37955b8d9811 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Action: 'create', calling method: .version_select at 0x7f228e8c7940>, body: {"pool": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:00.512641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:00.523556 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-594c2d1b-08f2-442b-8d43-858e52814ae3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1324 microversion: 2.1 time: 0.384856 Nov 02 12:24:00.524650 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 524/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:00 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:00.530033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-89a42ffd-2baf-49ba-8cfe-9b7d2eb4ddf5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228eb8a8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2111726417", "description": "tempest-description-898621763"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:01.050296 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-89a42ffd-2baf-49ba-8cfe-9b7d2eb4ddf5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.524335 Nov 02 12:24:01.050976 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 525/1026] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:24:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:01.057938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.64"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:01.060853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:01.070048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:01.070668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:01.071243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:01.072365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:01.072828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:01.073299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:01.107354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:24:01.108023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquired lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:24:01.844670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.64 (8a92627d-88ee-4dca-8bd4-54f69c6c0935) with port b46029fb-9496-4ff8-86e1-c2b24a77ce4a using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 75b0e233-ff45-4a45-b17c-c024d18002bf.", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:01.845994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Releasing lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:24:01.849406 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.64 (8a92627d-88ee-4dca-8bd4-54f69c6c0935) with port b46029fb-9496-4ff8-86e1-c2b24a77ce4a using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 75b0e233-ff45-4a45-b17c-c024d18002bf. Nov 02 12:24:01.849406 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-ca4eed99-9c83-44d6-a468-d678b7d08d38'] Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Request method failure captured: Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action HTTP/1.1 Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 45 Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmE19094bWEYEewU9wd8egHcCBV-fUvCtC4mj1sMbT9OgzVTF80xtZs0rUJummPIlC5C8ftEzy7bT2TIfRqNKx94q6kftpq639AL1V1q3PobAmMux0QLeznCUWzPtjldHPYElX4xyIVyH78lnIPCD2VOBuBkUjNRnwgvryK7YvmnF5c Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:01.855473 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 68a5be7a432a4c3cb3233ed382622eca Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: {"addFloatingIp": {"address": "172.25.4.64"}} Nov 02 12:24:01.856955 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: exception: Cannot associate floating IP 172.25.4.64 (8a92627d-88ee-4dca-8bd4-54f69c6c0935) with port b46029fb-9496-4ff8-86e1-c2b24a77ce4a using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 75b0e233-ff45-4a45-b17c-c024d18002bf. Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-ca4eed99-9c83-44d6-a468-d678b7d08d38'] Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c8aa0407-6ba6-41fb-ad9a-11a704f30da2', 'body': {'addFloatingIp': {'address': '172.25.4.64'}}} Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:01.857810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:01.859436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.64 (8a92627d-88ee-4dca-8bd4-54f69c6c0935) with port b46029fb-9496-4ff8-86e1-c2b24a77ce4a using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 75b0e233-ff45-4a45-b17c-c024d18002bf. Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca4eed99-9c83-44d6-a468-d678b7d08d38'] Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.64 (8a92627d-88ee-4dca-8bd4-54f69c6c0935) with port b46029fb-9496-4ff8-86e1-c2b24a77ce4a using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 75b0e233-ff45-4a45-b17c-c024d18002bf. Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca4eed99-9c83-44d6-a468-d678b7d08d38'] Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:01.860469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.64 (8a92627d-88ee-4dca-8bd4-54f69c6c0935) with port b46029fb-9496-4ff8-86e1-c2b24a77ce4a using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 75b0e233-ff45-4a45-b17c-c024d18002bf. Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca4eed99-9c83-44d6-a468-d678b7d08d38'] Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:01.862328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.64 (8a92627d-88ee-4dca-8bd4-54f69c6c0935) with port b46029fb-9496-4ff8-86e1-c2b24a77ce4a using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 75b0e233-ff45-4a45-b17c-c024d18002bf. Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca4eed99-9c83-44d6-a468-d678b7d08d38'] Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Returning 400 to user: Cannot associate floating IP 172.25.4.64 (8a92627d-88ee-4dca-8bd4-54f69c6c0935) with port b46029fb-9496-4ff8-86e1-c2b24a77ce4a using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 75b0e233-ff45-4a45-b17c-c024d18002bf. Nov 02 12:24:01.865104 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-ca4eed99-9c83-44d6-a468-d678b7d08d38'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:01.867702 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6db4f1f7-42a9-4294-ba06-d6cd22ac22d4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action" status: 400 len: 381 microversion: 2.1 time: 0.806949 Nov 02 12:24:01.867702 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 526/1027] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:01 2022] POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action => generated 381 bytes in 811 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:01.873819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:01.875150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:01.884612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:01.885121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:01.885798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:01.886685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:01.887246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:01.887848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.101584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:02.111730 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cfff881d-e293-4cc7-a2f3-795fce2727fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 200 len: 1318 microversion: 2.1 time: 0.247223 Nov 02 12:24:02.112896 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 527/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:01 2022] GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:02.118708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:02.119645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:02.126484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.127275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.127722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.128671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.129212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.129738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.317380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:02.326126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8755a72-d9c3-4147-9021-b04e633389c7 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1385 microversion: 2.1 time: 0.211603 Nov 02 12:24:02.334270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 528/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:02 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:02.334270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-48186391", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "86e82b62-f8a5-43b1-9d6c-90b8370cab83"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:02.394936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] validate_networks() for [('86e82b62-f8a5-43b1-9d6c-90b8370cab83', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:24:02.963477 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a513439e-1fa2-45e3-80c7-37955b8d9811 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.713443 Nov 02 12:24:02.964142 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 502/1030] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:24:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:02.968786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3aab1874-da8c-4f69-a460-a2ef5dde92d7 req-f58cb64d-db90-4930-9e6d-e665906423f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8", "tag": "1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:02.982801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3aab1874-da8c-4f69-a460-a2ef5dde92d7 req-f58cb64d-db90-4930-9e6d-e665906423f2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.983289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3aab1874-da8c-4f69-a460-a2ef5dde92d7 req-f58cb64d-db90-4930-9e6d-e665906423f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.983756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3aab1874-da8c-4f69-a460-a2ef5dde92d7 req-f58cb64d-db90-4930-9e6d-e665906423f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.986599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:02.998242 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3aab1874-da8c-4f69-a460-a2ef5dde92d7 req-f58cb64d-db90-4930-9e6d-e665906423f2 service nova] Creating event network-changed:1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5 for instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 on n-h1-855650-5 Nov 02 12:24:03.004218 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3aab1874-da8c-4f69-a460-a2ef5dde92d7 req-f58cb64d-db90-4930-9e6d-e665906423f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038766 Nov 02 12:24:03.004955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 503/1031] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:03.010827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:03.011541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:03.018953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.019427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.019798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.020540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.021001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.021923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.265754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:03.275038 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c00d165e-cc85-4996-9f6d-16d10ed98649 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1324 microversion: 2.1 time: 0.268608 Nov 02 12:24:03.276056 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 504/1032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:03 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:03.280604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f87d839-9af9-4303-8ec8-7d2114bcbb1c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '.version_select at 0x7f228e8d4430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:03.290125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:24:03.290883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:24:03.291402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:24:03.291805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:24:03.292247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:24:03.302086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.302883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.303392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.304128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.304943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.305371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.323349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Getting quotas for project cae93780b7f44bb295ed5c4160115d6a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:03.329369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Getting quotas for user eee9d7b075c540a3b9eb0c5bb7344dae and project cae93780b7f44bb295ed5c4160115d6a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:03.343764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:24:03.346399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:24:03.399718 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f0a5190-4321-4799-ac4c-b351f449f435 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071491 Nov 02 12:24:03.400469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 529/1033] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:24:03.404892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-8a662293-4daa-4cee-95d2-8083814b0e90 req-e021718c-f5c5-404e-81ba-75da221cbc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1355556-3912-41a2-a733-92804b34fe22", "name": "network-vif-plugged", "status": "completed", "tag": "e648d659-81f5-4ea0-ae85-26b235829c65"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:03.415881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8a662293-4daa-4cee-95d2-8083814b0e90 req-e021718c-f5c5-404e-81ba-75da221cbc07 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.416315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8a662293-4daa-4cee-95d2-8083814b0e90 req-e021718c-f5c5-404e-81ba-75da221cbc07 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.416747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8a662293-4daa-4cee-95d2-8083814b0e90 req-e021718c-f5c5-404e-81ba-75da221cbc07 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.429580 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-8a662293-4daa-4cee-95d2-8083814b0e90 req-e021718c-f5c5-404e-81ba-75da221cbc07 service nova] Creating event network-vif-plugged:e648d659-81f5-4ea0-ae85-26b235829c65 for instance b1355556-3912-41a2-a733-92804b34fe22 on n-h1-855650-5 Nov 02 12:24:03.434987 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-8a662293-4daa-4cee-95d2-8083814b0e90 req-e021718c-f5c5-404e-81ba-75da221cbc07 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Nov 02 12:24:03.435652 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 530/1034] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:03.441244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-672745b0-b38a-4831-b394-b4d043d03bdf tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Calling method '.version_select at 0x7f228ed09b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:03.774272 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-672745b0-b38a-4831-b394-b4d043d03bdf tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/36ebe58f-bb66-4ce2-8a0f-524f0f75eced" status: 200 len: 141 microversion: 2.1 time: 0.336929 Nov 02 12:24:03.779689 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 531/1035] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:24:03 2022] GET /compute/v2.1/os-floating-ips/36ebe58f-bb66-4ce2-8a0f-524f0f75eced => generated 141 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:03.780434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:03.781345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:03.788800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.789333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.790017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.790706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.791342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.792020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.013100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:04.023172 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8935fb2d-6ef9-440b-9c90-720bae91d45e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 200 len: 1467 microversion: 2.1 time: 0.246482 Nov 02 12:24:04.023813 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 532/1036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:03 2022] GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 1467 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:04.028638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:04.029258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:04.035471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.036212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.037395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.038571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.039388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.040326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.270513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:04.279718 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb459361-5be8-4e87-b822-cb0e4faca714 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1385 microversion: 2.1 time: 0.254872 Nov 02 12:24:04.280298 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 533/1037] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:04 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1385 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:04.284749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:04.285354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:04.291852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.293062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.293657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.294589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.295059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.295469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.315127 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f87d839-9af9-4303-8ec8-7d2114bcbb1c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/8a92627d-88ee-4dca-8bd4-54f69c6c0935" status: 202 len: 0 microversion: 2.1 time: 1.038356 Nov 02 12:24:04.315920 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 505/1038] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:03 2022] DELETE /compute/v2.1/os-floating-ips/8a92627d-88ee-4dca-8bd4-54f69c6c0935 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:04.317002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:04.321090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4dba0990-49ce-490d-bed2-e01c52f078cf tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Calling method '.version_select at 0x7f228e8cc4c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:04.415375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:04.424365 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df26f97a-e577-4daf-bfb8-32f20ad6aee2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1218 microversion: 2.1 time: 0.142879 Nov 02 12:24:04.425059 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 534/1039] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:04 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:04.429786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:04.435291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:04.436258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Searching by: {'reservation_id': 'r-g6dd5d9c', 'deleted': False, 'project_id': '74888962841648a7bfc8cd36cdf5526c'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:24:04.442656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.443156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.443578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.444308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.444971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.445182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.634193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:24:04.729538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:04.737504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.738381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.739013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.020762 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59790faf-17b5-40be-a760-85521119a4d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?reservation_id=r-g6dd5d9c" status: 200 len: 2927 microversion: 2.1 time: 0.594566 Nov 02 12:24:05.022151 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 535/1040] 10.222.0.45 () {58 vars in 1197 bytes} [Wed Nov 2 12:24:04 2022] GET /compute/v2.1/servers/detail?reservation_id=r-g6dd5d9c => generated 2927 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:05.032054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:05.034290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:05.047963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.049049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.049870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.050494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.050915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.051353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.257692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:05.270687 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d094be4-d8d3-4844-84e4-0540d912bf48 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1324 microversion: 2.1 time: 0.246523 Nov 02 12:24:05.271930 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 536/1041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:05 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:05.279083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.179"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:05.501014 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4dba0990-49ce-490d-bed2-e01c52f078cf tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/36ebe58f-bb66-4ce2-8a0f-524f0f75eced" status: 202 len: 0 microversion: 2.1 time: 1.183906 Nov 02 12:24:05.508608 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 506/1042] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:04 2022] DELETE /compute/v2.1/os-floating-ips/36ebe58f-bb66-4ce2-8a0f-524f0f75eced => generated 0 bytes in 1192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:05.514042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3dc0769-483e-4b23-8995-d931f552d16a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:05.529875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:05.532433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.server_groups [None req-e3dc0769-483e-4b23-8995-d931f552d16a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Querying cell 65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) for 2 instances {{(pid=120722) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:24:05.533727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dc0769-483e-4b23-8995-d931f552d16a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.534411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dc0769-483e-4b23-8995-d931f552d16a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.534851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dc0769-483e-4b23-8995-d931f552d16a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.541472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.542574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.543210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.545330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.546243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.546616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.568477 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e3dc0769-483e-4b23-8995-d931f552d16a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/d4cf0680-b6a6-41b9-ad6e-851beecaa04a" status: 200 len: 265 microversion: 2.1 time: 0.057653 Nov 02 12:24:05.568962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 507/1043] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:05 2022] GET /compute/v2.1/os-server-groups/d4cf0680-b6a6-41b9-ad6e-851beecaa04a => generated 265 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:05.582748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:05.584669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:05.596085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.596977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.597753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.599164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.599965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.600769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.830272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:05.841341 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a0e6dc6-7927-44b8-bba1-67c0a7fe4745 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1385 microversion: 2.1 time: 0.269841 Nov 02 12:24:05.842072 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 508/1044] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:05 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:05.851180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:05.851180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:05.851605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:24:05.851605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquired lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:24:05.854924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.855442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.855876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.856628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.857146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.857817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.938262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:05.945082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:05.953241 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8bc527b-3fdf-4be6-8183-41238df55772 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1266 microversion: 2.1 time: 0.110097 Nov 02 12:24:05.953851 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 509/1045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:05 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:05.958363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e34353eb-a4ff-4892-a135-f6bbd5db12a1 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Calling method '.version_select at 0x7f228e8b3f70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:06.246562 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e34353eb-a4ff-4892-a135-f6bbd5db12a1 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.291569 Nov 02 12:24:06.247387 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 510/1046] 10.222.0.45 () {58 vars in 1164 bytes} [Wed Nov 2 12:24:05 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:24:06.257660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:06.258302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:06.265368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.265865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.266337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.267060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.267523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.267953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.820854 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-573e86e4-223e-4b08-9cb9-23474df06a1f tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1618 microversion: 2.1 time: 0.566711 Nov 02 12:24:06.831986 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 511/1047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:06 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1618 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:06.831986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e301005-d27e-4805-acc7-3df798d22819 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Calling method '.version_select at 0x7f228e8b3e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:06.939263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:07.199348 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e301005-d27e-4805-acc7-3df798d22819 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.376283 Nov 02 12:24:07.201007 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 512/1048] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:24:06 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:07.207853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:07.209764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:07.219747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.220615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.221159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.222004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.222590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.224824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.373184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Building network info cache for instance {{(pid=120723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:24:07.517322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:07.534612 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96f53e75-b3dc-4ac1-8e9f-8eb37b75605f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1324 microversion: 2.1 time: 0.331041 Nov 02 12:24:07.536896 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 513/1049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:07 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:07.549699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:07.553928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:07.568646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.569298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.569892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.570929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.571557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.572469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.854056 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6bc94159-76be-4b1c-b821-b59391089645 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 200 len: 1618 microversion: 2.1 time: 0.313458 Nov 02 12:24:07.872259 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 514/1050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:07 2022] GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 1618 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:07.886130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:07.886811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:07.908780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.910237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.911756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.915664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.916592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.917496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.247182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:08.262191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad4fe4ac-14f9-422a-8dbc-86b5fc77520c tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1584 microversion: 2.1 time: 0.385307 Nov 02 12:24:08.264023 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 515/1051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:07 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1584 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:08.279424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:08.280151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:08.288837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.290962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.291647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.294014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.294711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.308341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.450461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Updating instance_info_cache with network_info: [{"id": "b46029fb-9496-4ff8-86e1-c2b24a77ce4a", "address": "fa:16:3e:e8:26:02", "network": {"id": "1356286a-cad2-4a38-bd1d-50edbd66e87d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1636127923-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "51edd9010e2640c7bc82c750d18d367b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb46029fb-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:24:08.473446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Releasing lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:24:08.477416 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0182fc6d-6e8c-4297-9786-e7236633c55a tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action" status: 202 len: 0 microversion: 2.1 time: 3.201050 Nov 02 12:24:08.478119 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 537/1052] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:05 2022] POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action => generated 0 bytes in 3206 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:24:08.490401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94c75e4e-34ef-4519-937c-660e2ec74fd5 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Calling method '.version_select at 0x7f228edd6280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:08.519607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:08.530758 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e390ea6-5410-44e5-b632-45febf511eec tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1314 microversion: 2.1 time: 0.265116 Nov 02 12:24:08.532089 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 516/1053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:08 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:08.540182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0f37c36e-0b6b-49f2-a259-5470d6a08de0 req-6c6d7ccd-41ed-43f9-a36c-e7a106ecb5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8aa0407-6ba6-41fb-ad9a-11a704f30da2", "tag": "b46029fb-9496-4ff8-86e1-c2b24a77ce4a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:08.561053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0f37c36e-0b6b-49f2-a259-5470d6a08de0 req-6c6d7ccd-41ed-43f9-a36c-e7a106ecb5f7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.561898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0f37c36e-0b6b-49f2-a259-5470d6a08de0 req-6c6d7ccd-41ed-43f9-a36c-e7a106ecb5f7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.562483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0f37c36e-0b6b-49f2-a259-5470d6a08de0 req-6c6d7ccd-41ed-43f9-a36c-e7a106ecb5f7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.589007 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0f37c36e-0b6b-49f2-a259-5470d6a08de0 req-6c6d7ccd-41ed-43f9-a36c-e7a106ecb5f7 service nova] Creating event network-changed:b46029fb-9496-4ff8-86e1-c2b24a77ce4a for instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 on n-h1-855650-5 Nov 02 12:24:08.597478 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0f37c36e-0b6b-49f2-a259-5470d6a08de0 req-6c6d7ccd-41ed-43f9-a36c-e7a106ecb5f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063518 Nov 02 12:24:08.598424 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 517/1054] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:08.605144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-604a6c3b-56d6-441c-ad6c-4bc17e991b42 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Action: 'create', calling method: .version_select at 0x7f228ebaadc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1793023778", "policies": ["anti-affinity"]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:08.625656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-604a6c3b-56d6-441c-ad6c-4bc17e991b42 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:08.632644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-604a6c3b-56d6-441c-ad6c-4bc17e991b42 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:08.700972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-604a6c3b-56d6-441c-ad6c-4bc17e991b42 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:08.711125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-604a6c3b-56d6-441c-ad6c-4bc17e991b42 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:08.729579 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-604a6c3b-56d6-441c-ad6c-4bc17e991b42 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.129072 Nov 02 12:24:08.749196 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 518/1055] 10.222.0.45 () {60 vars in 1174 bytes} [Wed Nov 2 12:24:08 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:08.765013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-869a28b8-ef77-4522-9078-cd6521cf0f71 req-1984ec5c-9871-456f-99ae-b4e82b853c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8", "name": "network-vif-plugged", "status": "completed", "tag": "1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:08.777556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-869a28b8-ef77-4522-9078-cd6521cf0f71 req-1984ec5c-9871-456f-99ae-b4e82b853c5d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.778187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-869a28b8-ef77-4522-9078-cd6521cf0f71 req-1984ec5c-9871-456f-99ae-b4e82b853c5d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.778705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-869a28b8-ef77-4522-9078-cd6521cf0f71 req-1984ec5c-9871-456f-99ae-b4e82b853c5d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.796898 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-869a28b8-ef77-4522-9078-cd6521cf0f71 req-1984ec5c-9871-456f-99ae-b4e82b853c5d service nova] Creating event network-vif-plugged:1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5 for instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 on n-h1-855650-5 Nov 02 12:24:08.805989 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-869a28b8-ef77-4522-9078-cd6521cf0f71 req-1984ec5c-9871-456f-99ae-b4e82b853c5d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053909 Nov 02 12:24:08.809280 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 519/1056] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:08.824490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:08.828525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:08.845101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.847367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.847834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.848582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.849046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.849641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:09.061921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8aacb2c9-f6dd-4ead-a788-368aea250303 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250049 Nov 02 12:24:09.063722 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 520/1057] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:24:08 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:09.070310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09b720d4-046c-4dfa-914a-1c704ca5657e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '.version_select at 0x7f228e904550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:10.144453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94c75e4e-34ef-4519-937c-660e2ec74fd5 tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/3f9ae907-c17f-4ca0-a566-8ef543fc9904" status: 202 len: 0 microversion: 2.1 time: 1.664504 Nov 02 12:24:10.149135 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 538/1058] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:08 2022] DELETE /compute/v2.1/os-floating-ips/3f9ae907-c17f-4ca0-a566-8ef543fc9904 => generated 0 bytes in 1670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:10.154347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:10.155236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:10.162667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.163765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.164315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.165931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.166656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.167311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.474207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:10.484579 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-178a7178-096b-4e43-8940-ce0dedd23d20 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1324 microversion: 2.1 time: 0.333917 Nov 02 12:24:10.494084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 539/1059] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:10 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:10.494587 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-09b720d4-046c-4dfa-914a-1c704ca5657e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/19bb3fd8-f3ba-47b4-8eb6-6fd9e07a4308" status: 202 len: 0 microversion: 2.1 time: 1.423450 Nov 02 12:24:10.494587 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 521/1060] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:09 2022] DELETE /compute/v2.1/os-floating-ips/19bb3fd8-f3ba-47b4-8eb6-6fd9e07a4308 => generated 0 bytes in 1429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:10.499254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-61058b6f-c14f-452b-a2df-481c859fd9f7 req-dba746bc-8ff7-4e0d-9d07-a029b4ebade2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994aa7a2-dbbd-41dc-bdd1-49e5e6318005", "tag": "3ae95e90-bb11-4958-b325-f9048a140fc5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:10.501142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1536524197", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "93914208-75e9-41bb-8f4f-12cfd960a6a6"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:10.518976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61058b6f-c14f-452b-a2df-481c859fd9f7 req-dba746bc-8ff7-4e0d-9d07-a029b4ebade2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.520330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61058b6f-c14f-452b-a2df-481c859fd9f7 req-dba746bc-8ff7-4e0d-9d07-a029b4ebade2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.520778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61058b6f-c14f-452b-a2df-481c859fd9f7 req-dba746bc-8ff7-4e0d-9d07-a029b4ebade2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.544125 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-61058b6f-c14f-452b-a2df-481c859fd9f7 req-dba746bc-8ff7-4e0d-9d07-a029b4ebade2 service nova] Creating event network-changed:3ae95e90-bb11-4958-b325-f9048a140fc5 for instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 on n-h1-855650-5 Nov 02 12:24:10.554385 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-61058b6f-c14f-452b-a2df-481c859fd9f7 req-dba746bc-8ff7-4e0d-9d07-a029b4ebade2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058278 Nov 02 12:24:10.556484 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 522/1061] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:10.572687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:10.573001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:24:10.574561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:10.592320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.593653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.594783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.596442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.597851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.598862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.205882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:11.216003 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca17fa2d-e31e-4e19-ba17-50f2702a9abb tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1314 microversion: 2.1 time: 0.656822 Nov 02 12:24:11.216625 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 523/1062] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:10 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:11.221687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4ac674a-6eaf-4701-93fe-0e8cdf7becdc tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Calling method '.version_select at 0x7f228e8d4670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:11.409670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:24:11.410804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:24:11.411566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:24:11.412743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:24:11.413396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:24:11.445764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.446689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.448564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.449579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.450244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.450828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.470662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:11.476851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:11.490529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Going to run 2 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:24:11.493263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:24:11.539561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120723) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 12:24:11.565043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:11.571796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:11.625231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:11.631956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:11.633568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:11.654894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=69c61b8e-abe2-496b-812b-3690bb907ce5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:24:11.723503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:11.729746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:11.781689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:11.794639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'server_group_members'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:11.840128 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-88fe5ff2-ab77-48a7-85f1-37fdb961648f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.353179 Nov 02 12:24:11.841290 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 540/1063] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:24:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 1355 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:24:11.846417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0520e78c-3dd3-4eba-93db-6c1567594b63 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0520e78c-3dd3-4eba-93db-6c1567594b63 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Request method failure captured: Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action HTTP/1.1 Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 34 Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmE19094bWEYEewU9wd8egHcCBV-fUvCtC4mj1sMbT9OgzVTF80xtZs0rUJummPIlC5C8ftEzy7bT2TIfRqNKx94q6kftpq639AL1V1q3PobAmMux0QLeznCUWzPtjldHPYElX4xyIVyH78lnIPCD2VOBuBkUjNRnwgvryK7YvmnF5c Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:11.854569 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 68a5be7a432a4c3cb3233ed382622eca Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: {"addFloatingIp": {"address": ""}} Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:24:11.856341 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c8aa0407-6ba6-41fb-ad9a-11a704f30da2', 'body': {'addFloatingIp': {'address': ''}}} Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi '' Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:11.857332 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:24:11.859420 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:24:11.860810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 12:24:11.860810 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:11.860810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0520e78c-3dd3-4eba-93db-6c1567594b63 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:11.860810 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0520e78c-3dd3-4eba-93db-6c1567594b63 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action" status: 400 len: 142 microversion: 2.1 time: 0.013727 Nov 02 12:24:11.861875 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 541/1064] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:11 2022] POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:11.867484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:11.868108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:11.876641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.877039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.877415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.878515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.878967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.879390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.139494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:12.150508 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02856419-f8fb-417a-977f-480f7ab86b8b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1584 microversion: 2.1 time: 0.287752 Nov 02 12:24:12.154090 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 542/1065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:11 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1584 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:12.160099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:12.160890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:12.189482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.191263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.192115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.194060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.194894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.195887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.448630 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4ac674a-6eaf-4701-93fe-0e8cdf7becdc tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/7bba1c99-e720-4015-976f-ebdbee603ccc" status: 202 len: 0 microversion: 2.1 time: 1.230838 Nov 02 12:24:12.452316 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 524/1066] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:11 2022] DELETE /compute/v2.1/os-floating-ips/7bba1c99-e720-4015-976f-ebdbee603ccc => generated 0 bytes in 1235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:12.457404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:12.468448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:12.469268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Searching by: {'deleted': False, 'project_id': '74888962841648a7bfc8cd36cdf5526c'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:24:12.492016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.492802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.493426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.494411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.495046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.495776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.527151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:12.552847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e312672-8db8-4922-b94f-6252eb3747fb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.397142 Nov 02 12:24:12.554064 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 543/1067] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:12 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:12.561627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:12.573777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:12.586099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.586832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.587281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.587993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.588445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.589062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.601943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:24:12.626286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:24:12.626692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquired lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:24:12.706647 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9b8acea-de39-456c-858c-910170d4a49d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.253171 Nov 02 12:24:12.707257 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 525/1068] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:24:12 2022] GET /compute/v2.1/servers => generated 1663 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:12.712778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:12.713447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:12.720464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.721003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.721454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.722200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.722847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.723480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.776572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Releasing lock "refresh_cache-c8aa0407-6ba6-41fb-ad9a-11a704f30da2" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:24:12.777087 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] HTTP exception thrown: floating IP not found Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Request method failure captured: Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action HTTP/1.1 Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 41 Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmE19094bWEYEewU9wd8egHcCBV-fUvCtC4mj1sMbT9OgzVTF80xtZs0rUJummPIlC5C8ftEzy7bT2TIfRqNKx94q6kftpq639AL1V1q3PobAmMux0QLeznCUWzPtjldHPYElX4xyIVyH78lnIPCD2VOBuBkUjNRnwgvryK7YvmnF5c Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:12.778718 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 68a5be7a432a4c3cb3233ed382622eca Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: {"addFloatingIp": {"address": "0.0.0.0"}} Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:24:12.780314 n-d-855650-5 devstack@n-api.service[120723]: exception: floating IP not found Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c8aa0407-6ba6-41fb-ad9a-11a704f30da2', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:12.781194 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Nov 02 12:24:12.783143 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:12.785156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Returning 404 to user: floating IP not found {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:12.785156 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-74df78dd-c354-4bfc-a839-277887416a26 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action" status: 404 len: 67 microversion: 2.1 time: 0.224917 Nov 02 12:24:12.785156 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 544/1069] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:12 2022] POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action => generated 67 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:12.789070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98fa1585-ffc7-4416-aeb2-8456b781836e tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] Calling method '.version_select at 0x7f228eac83a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:13.062074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:13.080952 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7284af3c-8d95-4da0-9b1d-4faba0c46e29 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1314 microversion: 2.1 time: 0.372616 Nov 02 12:24:13.091007 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 526/1070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:12 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:13.096193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:13.096840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:13.105761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.106492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.106954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.107673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.108137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.108584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.367441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:13.376021 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0b413321-d2ad-4f10-a37b-6a63b7c963b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.283618 Nov 02 12:24:13.382172 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 527/1071] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:13 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:13.388105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9f11e3c0-bf23-40ba-ab33-af72024284ca req-950037e3-1fe6-4b62-bd13-46d2eb7096b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1355556-3912-41a2-a733-92804b34fe22", "tag": "e648d659-81f5-4ea0-ae85-26b235829c65"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:13.399008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9f11e3c0-bf23-40ba-ab33-af72024284ca req-950037e3-1fe6-4b62-bd13-46d2eb7096b8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.399585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9f11e3c0-bf23-40ba-ab33-af72024284ca req-950037e3-1fe6-4b62-bd13-46d2eb7096b8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.400235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9f11e3c0-bf23-40ba-ab33-af72024284ca req-950037e3-1fe6-4b62-bd13-46d2eb7096b8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.412564 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9f11e3c0-bf23-40ba-ab33-af72024284ca req-950037e3-1fe6-4b62-bd13-46d2eb7096b8 service nova] Creating event network-changed:e648d659-81f5-4ea0-ae85-26b235829c65 for instance b1355556-3912-41a2-a733-92804b34fe22 on n-h1-855650-5 Nov 02 12:24:13.418224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9f11e3c0-bf23-40ba-ab33-af72024284ca req-950037e3-1fe6-4b62-bd13-46d2eb7096b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040169 Nov 02 12:24:13.418821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 528/1072] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:13.424255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:13.424942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:13.432018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.432228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.432543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.433392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.433940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.434451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.580371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:13.606025 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1458c3a4-9b7d-477f-973c-99a0bd66054f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1271 microversion: 2.1 time: 0.184833 Nov 02 12:24:13.611089 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 529/1073] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:13 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:13.625726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6cd0ba38-abd5-4562-a407-ee0c8733ee2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:13.732711 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-6cd0ba38-abd5-4562-a407-ee0c8733ee2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6cd0ba38-abd5-4562-a407-ee0c8733ee2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Request method failure captured: Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action HTTP/1.1 Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 44 Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmE19094bWEYEewU9wd8egHcCBV-fUvCtC4mj1sMbT9OgzVTF80xtZs0rUJummPIlC5C8ftEzy7bT2TIfRqNKx94q6kftpq639AL1V1q3PobAmMux0QLeznCUWzPtjldHPYElX4xyIVyH78lnIPCD2VOBuBkUjNRnwgvryK7YvmnF5c Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:13.734700 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 68a5be7a432a4c3cb3233ed382622eca Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: {"removeFloatingIp": {"address": "0.0.0.0"}} Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:13.736236 n-d-855650-5 devstack@n-api.service[120722]: exception: Floating IP not found for address 0.0.0.0. Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c8aa0407-6ba6-41fb-ad9a-11a704f30da2', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:13.737068 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Nov 02 12:24:13.739185 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.741045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6cd0ba38-abd5-4562-a407-ee0c8733ee2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:13.741045 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6cd0ba38-abd5-4562-a407-ee0c8733ee2c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action" status: 404 len: 88 microversion: 2.1 time: 0.123970 Nov 02 12:24:13.741045 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 530/1074] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:13 2022] POST /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2/action => generated 88 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:13.747589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22129774-1838-4f77-95f1-d1c4f2840b72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-558575006", "metadata": {"": ""}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22129774-1838-4f77-95f1-d1c4f2840b72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action HTTP/1.1 Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 106 Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:13.759320 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-558575006", "metadata": {"": ""}}} Nov 02 12:24:13.761150 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-558575006', 'metadata': {'': ''}}}} Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'': ''} Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:13.762177 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.764854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:13.767977 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:13.767977 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:13.767977 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:24:13.767977 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:24:13.767977 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 12:24:13.767977 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:13.771699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22129774-1838-4f77-95f1-d1c4f2840b72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:13.772873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22129774-1838-4f77-95f1-d1c4f2840b72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action" status: 400 len: 170 microversion: 2.1 time: 0.034904 Nov 02 12:24:13.773682 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 531/1075] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Nov 2 12:24:13 2022] POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action => generated 170 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:13.780857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:13.782078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:13.791709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.792596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.793252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.795815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.796570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.797421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.839839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:13.861571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:24:14.003423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f815ae7-fee4-4860-b776-cbc3836d1c50 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 204 len: 0 microversion: 2.1 time: 0.227782 Nov 02 12:24:14.004722 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 532/1076] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:24:13 2022] DELETE /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:24:14.030202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.033056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.039074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:14.044686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.045501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.046192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.047160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.047872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.048522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.156473 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98fa1585-ffc7-4416-aeb2-8456b781836e tempest-FloatingIPDetailsTestJSON-1491058906 tempest-FloatingIPDetailsTestJSON-1491058906-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/4e7e816e-55f3-4483-ab1f-269c0998b0d5" status: 202 len: 0 microversion: 2.1 time: 1.374651 Nov 02 12:24:14.157072 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 545/1077] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:12 2022] DELETE /compute/v2.1/os-floating-ips/4e7e816e-55f3-4483-ab1f-269c0998b0d5 => generated 0 bytes in 1376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:14.163116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.163716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.171626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.172192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.172645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.173359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.173815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.174280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.265761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.279586 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a725952-387e-4204-b717-b6a6cc0f342f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.273290 Nov 02 12:24:14.296387 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 533/1078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:14.308607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.309243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.343081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.343194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.343561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.347711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.348325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.348800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.427976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.445768 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-edbf9b29-e20e-42ef-9ce5-19ab785edbb4 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1542 microversion: 2.1 time: 0.287591 Nov 02 12:24:14.447075 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 546/1079] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1542 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:14.454774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.456351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.465361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.466055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.466765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.467718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.468419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.469061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.568402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.587283 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab89da39-e35d-4b0b-a42c-f2fbbad5a09f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1314 microversion: 2.1 time: 0.287383 Nov 02 12:24:14.600850 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 534/1080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:14.635202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.635955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.642843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.643002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.643487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.644045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.644838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.645526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.646268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.652692 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4b29052a-85ca-4b08-9716-1d75608f48c1 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.204026 Nov 02 12:24:14.653478 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 547/1081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:14.682328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b71339e4-4a3f-465e-90d6-909932e8f9dc tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-3514150", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b71339e4-4a3f-465e-90d6-909932e8f9dc tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action HTTP/1.1 Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 616 Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:14.690376 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:14.692355 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:14.693179 n-d-855650-5 devstack@n-api.service[120723]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-3514150", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Nov 02 12:24:14.693179 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:24:14.693179 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-3514150', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 12:24:14.693502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:14.694340 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:14.695578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:14.696548 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:14.696548 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:14.696548 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:24:14.696548 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:24:14.696548 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 12:24:14.696548 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:14.698284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b71339e4-4a3f-465e-90d6-909932e8f9dc tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:14.699628 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b71339e4-4a3f-465e-90d6-909932e8f9dc tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action" status: 400 len: 938 microversion: 2.1 time: 0.026246 Nov 02 12:24:14.700695 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 548/1082] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Nov 2 12:24:14 2022] POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action => generated 938 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:14.708873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.709601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.716586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.717073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.717505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.718419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.719089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.719745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.726067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.735822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6723c5c4-a56a-455b-beea-c93f475f499c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1277 microversion: 2.1 time: 0.104373 Nov 02 12:24:14.738642 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 535/1083] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:14.917036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.926733 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c76e1da5-dc49-41a4-8c7b-e84acfbfd70a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.221533 Nov 02 12:24:14.927822 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 549/1084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:14.951789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.952404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.959581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.960124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.960629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.961471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.962103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.962528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.100662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:15.108397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67281cb2-fa24-400e-a1ec-b5ed85959a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.160476 Nov 02 12:24:15.108985 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 536/1085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:15.131884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c14b2e0-e0a7-4ae6-b202-17a4f7154006 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c14b2e0-e0a7-4ae6-b202-17a4f7154006 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action HTTP/1.1 Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 285 Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:15.135632 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:15.137423 n-d-855650-5 devstack@n-api.service[120723]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:24:15.138226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:24:15.139132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:24:15.141054 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:24:15.142070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:24:15.142070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:15.142070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c14b2e0-e0a7-4ae6-b202-17a4f7154006 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:15.142070 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c14b2e0-e0a7-4ae6-b202-17a4f7154006 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action" status: 400 len: 619 microversion: 2.1 time: 0.009809 Nov 02 12:24:15.142441 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 550/1086] 10.222.0.45 () {60 vars in 1279 bytes} [Wed Nov 2 12:24:15 2022] POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:15.146639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:15.147248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:15.153363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.153851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.154327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.155075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.155531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.155954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.328815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:15.338653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c450a6d1-9eff-4f96-a57a-8cd2b6de7ebe tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.195796 Nov 02 12:24:15.354184 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 537/1087] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:15 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:15.373120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:15.373865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:15.383365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.384303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.385014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.387608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.389720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.390511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.469783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:15.470437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:15.480219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.481217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.483281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.484567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.485858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.486502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.612054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:15.623351 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08ff63b0-d1da-46b2-9b93-32ce045b68b9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.256530 Nov 02 12:24:15.639528 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 551/1088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:15 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:15.652253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:15.653290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:15.662670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.663876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.664982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.666084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.666936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.667612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.676303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:15.685255 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-efbd365f-e2b3-44f9-a7a3-97da4ca43bd9 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1542 microversion: 2.1 time: 0.219429 Nov 02 12:24:15.685860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 538/1089] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:15 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1542 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:15.702094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1389308978"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:15.705648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:15.712895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.713467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.713995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.714867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.715343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.715800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.890519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:15.902609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02ecf6ac-6b45-4253-b72c-3bb8f29395d4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1314 microversion: 2.1 time: 0.261314 Nov 02 12:24:15.919283 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 552/1090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:15 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:15.930867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-bccae381-93bc-4c56-bc04-c84cd528455c req-198a617d-d30c-47d0-ac4c-dc04942aa9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994aa7a2-dbbd-41dc-bdd1-49e5e6318005", "name": "network-vif-plugged", "status": "completed", "tag": "3ae95e90-bb11-4958-b325-f9048a140fc5"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:15.943558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bccae381-93bc-4c56-bc04-c84cd528455c req-198a617d-d30c-47d0-ac4c-dc04942aa9ac service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.945757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bccae381-93bc-4c56-bc04-c84cd528455c req-198a617d-d30c-47d0-ac4c-dc04942aa9ac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.946632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bccae381-93bc-4c56-bc04-c84cd528455c req-198a617d-d30c-47d0-ac4c-dc04942aa9ac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.964814 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-bccae381-93bc-4c56-bc04-c84cd528455c req-198a617d-d30c-47d0-ac4c-dc04942aa9ac service nova] Creating event network-vif-plugged:3ae95e90-bb11-4958-b325-f9048a140fc5 for instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 on n-h1-855650-5 Nov 02 12:24:15.972277 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-bccae381-93bc-4c56-bc04-c84cd528455c req-198a617d-d30c-47d0-ac4c-dc04942aa9ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051480 Nov 02 12:24:15.973713 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 553/1091] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:15.980157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:15.981361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:15.988276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.988658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.988878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.000176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.000613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.001064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.037804 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3489dba9-b6b8-47cd-b985-361a544f9b93 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action" status: 202 len: 0 microversion: 2.1 time: 0.348401 Nov 02 12:24:16.038524 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 539/1092] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:15 2022] POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:24:16.051919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-268957392"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:16.055140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:16.067322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.068261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.068949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.069674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.070556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.070891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.159554 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Cannot 'createImage' instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 while it is in task_state image_snapshot_pending Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action HTTP/1.1 Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 84 Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:16.161072 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-268957392"}} Nov 02 12:24:16.163082 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'createImage' instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 while it is in task_state image_snapshot_pending Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-268957392'}}} Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:16.163929 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 while it is in task_state image_snapshot_pending Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 while it is in task_state image_snapshot_pending Nov 02 12:24:16.165634 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:16.167593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 409 to user: Cannot 'createImage' instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 while it is in task_state image_snapshot_pending {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:16.168654 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b86aac64-4b20-439b-8140-fae6aab85ba0 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action" status: 409 len: 167 microversion: 2.1 time: 0.121392 Nov 02 12:24:16.173296 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 540/1093] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:16 2022] POST /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8/action => generated 167 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:16.184449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbdc676d-6bfe-4b9c-8e01-24f55ef9c272 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '.version_select at 0x7f228e730ee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:16.320196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:16.337826 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a025c1a7-156c-49fd-9edf-ecf464533a81 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.363720 Nov 02 12:24:16.349106 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 554/1094] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:15 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:16.422849 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bbdc676d-6bfe-4b9c-8e01-24f55ef9c272 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/images/ef4197de-3f4e-4f81-9ac4-4c27798d51bb" status: 204 len: 0 microversion: 2.1 time: 0.244096 Nov 02 12:24:16.423505 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 541/1095] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:16 2022] DELETE /compute/v2.1/images/ef4197de-3f4e-4f81-9ac4-4c27798d51bb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:24:16.443721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:16.445223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:16.462629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.466196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.478624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.479590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.480503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.481300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.710733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:16.712035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:16.721436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.722299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.723518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.724570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.725210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.725809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:17.032633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:17.043215 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-910f8474-d83b-494d-825b-a06a3007b1e3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1532 microversion: 2.1 time: 0.615102 Nov 02 12:24:17.044173 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 555/1096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:16 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1532 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:17.049763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:17.050702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:17.063297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:17.064627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:17.065100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:17.065836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:17.066539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:17.067227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:17.085244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:17.159030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:17.170211 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84df025b-a8a1-4d3e-9970-ea58b662f01e tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1542 microversion: 2.1 time: 0.465008 Nov 02 12:24:17.171442 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 542/1097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:16 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1542 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:17.288378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:17.301774 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09f8b23f-bdb4-4b71-8b61-620a249f365d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1314 microversion: 2.1 time: 0.256029 Nov 02 12:24:17.304790 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 556/1098] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:17 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:17.380049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:17.381240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:17.388792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:17.389627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:17.390512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:17.391588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:17.392481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:17.393284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:17.527850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-4062fd27-fccd-4866-a26e-958ac6ca3c44 req-db17482a-869a-4d96-8f23-a56e9895d46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aa0407-6ba6-41fb-ad9a-11a704f30da2", "name": "network-vif-deleted", "tag": "b46029fb-9496-4ff8-86e1-c2b24a77ce4a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:17.541598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4062fd27-fccd-4866-a26e-958ac6ca3c44 req-db17482a-869a-4d96-8f23-a56e9895d46d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:17.542495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4062fd27-fccd-4866-a26e-958ac6ca3c44 req-db17482a-869a-4d96-8f23-a56e9895d46d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:17.543362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4062fd27-fccd-4866-a26e-958ac6ca3c44 req-db17482a-869a-4d96-8f23-a56e9895d46d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:17.557527 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4062fd27-fccd-4866-a26e-958ac6ca3c44 req-db17482a-869a-4d96-8f23-a56e9895d46d service nova] Creating event network-vif-deleted:b46029fb-9496-4ff8-86e1-c2b24a77ce4a for instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 on n-h1-855650-5 Nov 02 12:24:17.564037 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-4062fd27-fccd-4866-a26e-958ac6ca3c44 req-db17482a-869a-4d96-8f23-a56e9895d46d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040016 Nov 02 12:24:17.565116 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 557/1099] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:18.043265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:18.054853 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dab4e47e-251e-486f-b8e2-7888cfd62605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.678844 Nov 02 12:24:18.069434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:18.070855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:18.074801 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 543/1100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:17 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:18.088633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.095333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.096160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.097142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.097832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.098564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.195202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:18.196096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:18.210806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.211596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.212224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.218564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.218564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.219268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.533472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:18.545028 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dfac6d75-7f35-40a4-b866-4525d80fbd57 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1316 microversion: 2.1 time: 0.353990 Nov 02 12:24:18.545717 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 544/1101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:18 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:18.555146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ead42778-8f50-41e8-9be3-d360e8f7a015 req-831039a5-1c6e-4b5d-8739-a4bc10de1dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c534487-5ba6-4b04-a624-3a76d2874220", "tag": "c6a80797-54bf-4134-9413-9d2c79830f2c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:18.578974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ead42778-8f50-41e8-9be3-d360e8f7a015 req-831039a5-1c6e-4b5d-8739-a4bc10de1dd2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.579492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ead42778-8f50-41e8-9be3-d360e8f7a015 req-831039a5-1c6e-4b5d-8739-a4bc10de1dd2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.579926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ead42778-8f50-41e8-9be3-d360e8f7a015 req-831039a5-1c6e-4b5d-8739-a4bc10de1dd2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.622277 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ead42778-8f50-41e8-9be3-d360e8f7a015 req-831039a5-1c6e-4b5d-8739-a4bc10de1dd2 service nova] Creating event network-changed:c6a80797-54bf-4134-9413-9d2c79830f2c for instance 0c534487-5ba6-4b04-a624-3a76d2874220 on n-h2-855650-5 Nov 02 12:24:18.628983 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ead42778-8f50-41e8-9be3-d360e8f7a015 req-831039a5-1c6e-4b5d-8739-a4bc10de1dd2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081798 Nov 02 12:24:18.630926 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 545/1102] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:18.636684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:18.637890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:18.645834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.646697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.647645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.648546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.649157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.649725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.723375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:18.969214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:18.980595 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4630ae3a-0c3e-4de3-b7b3-7f97fddba20c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1532 microversion: 2.1 time: 0.915612 Nov 02 12:24:18.996012 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 558/1103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:18 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1532 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:19.087483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:19.088128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:19.101391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.102082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.102712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.104522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.106206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.106931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.291363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:19.302756 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-452c25f0-870d-48ae-a614-ef215e40b216 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1314 microversion: 2.1 time: 0.670329 Nov 02 12:24:19.307876 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 546/1104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:18 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:19.418743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:19.428826 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b2bb9e7d-3af4-4f52-a4b5-2ceee4104a80 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.345662 Nov 02 12:24:19.429435 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 559/1105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:19 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:19.572067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:19.572852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:19.593264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.595559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.596833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.597622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.598130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.598502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.653112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.654955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.655554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.656273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lazy-loading 'fault' on Instance uuid c8aa0407-6ba6-41fb-ad9a-11a704f30da2 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:19.659896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:19.725365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a5be7a432a4c3cb3233ed382622eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51edd9010e2640c7bc82c750d18d367b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:19.737499 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d71c29b-f9ad-4df5-b7be-55756059a8e6 tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 200 len: 1321 microversion: 2.1 time: 0.169745 Nov 02 12:24:19.751030 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 547/1106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:19 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:20.026900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:20.028587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:20.051081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.053277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.054288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.055255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.058828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.060298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.344020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:20.345531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:20.353936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.354645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.355392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.356193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.357674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.358340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.478373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:20.488227 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b66ca9fd-ca85-4a8b-abae-a7fe0df252c3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1538 microversion: 2.1 time: 0.473083 Nov 02 12:24:20.488689 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 560/1107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:20 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1538 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:20.493928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:20.494452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:20.500520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.501011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.501451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.502184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.502644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.503513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.743548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:20.752537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7852b8dc-0f03-4bd5-8383-c20f6be3d326 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1503 microversion: 2.1 time: 0.423072 Nov 02 12:24:20.753505 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 548/1108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:20 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:20.766850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:20.767333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] [instance: c8aa0407-6ba6-41fb-ad9a-11a704f30da2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:20.775583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.776083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.776553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.777344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.777807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.778259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.794476 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] HTTP exception thrown: Instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 could not be found. Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Request method failure captured: Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 HTTP/1.1 Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmE19094bWEYEewU9wd8egHcCBV-fUvCtC4mj1sMbT9OgzVTF80xtZs0rUJummPIlC5C8ftEzy7bT2TIfRqNKx94q6kftpq639AL1V1q3PobAmMux0QLeznCUWzPtjldHPYElX4xyIVyH78lnIPCD2VOBuBkUjNRnwgvryK7YvmnF5c Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:20.796146 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51edd9010e2640c7bc82c750d18d367b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 51edd9010e2640c7bc82c750d18d367b Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269 Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 68a5be7a432a4c3cb3233ed382622eca Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:24:20.798011 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 could not be found. Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c8aa0407-6ba6-41fb-ad9a-11a704f30da2'} Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 could not be found. Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:20.798720 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 could not be found. Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 could not be found. Nov 02 12:24:20.800107 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:20.801697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] Returning 404 to user: Instance c8aa0407-6ba6-41fb-ad9a-11a704f30da2 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:20.801697 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-45afe597-ffa5-4b58-a1b4-d70dcbc7b37c tempest-FloatingIPsAssociationNegativeTestJSON-690472269 tempest-FloatingIPsAssociationNegativeTestJSON-690472269-project] 10.222.0.45 "GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2" status: 404 len: 111 microversion: 2.1 time: 0.037942 Nov 02 12:24:20.801697 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 549/1109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:20 2022] GET /compute/v2.1/servers/c8aa0407-6ba6-41fb-ad9a-11a704f30da2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:24:20.805775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1446547409"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:20.806350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:20.813240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.814128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.814772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.815812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.816682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.817286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.840492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:20.849464 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1655ccb0-b5fe-41aa-939d-5f7cc124f8e3 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.359333 Nov 02 12:24:20.863791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 561/1110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:20 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:20.961913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9328176a-241d-4df0-baec-f1dcf006f671 req-229fa586-0849-477d-909d-3e20c5891463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c61b8e-abe2-496b-812b-3690bb907ce5", "tag": "2090fc2c-d631-486e-bc08-e2ca6dfb0526"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:20.979929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9328176a-241d-4df0-baec-f1dcf006f671 req-229fa586-0849-477d-909d-3e20c5891463 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:20.980664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9328176a-241d-4df0-baec-f1dcf006f671 req-229fa586-0849-477d-909d-3e20c5891463 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:20.981298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9328176a-241d-4df0-baec-f1dcf006f671 req-229fa586-0849-477d-909d-3e20c5891463 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:20.996070 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9328176a-241d-4df0-baec-f1dcf006f671 req-229fa586-0849-477d-909d-3e20c5891463 service nova] Creating event network-changed:2090fc2c-d631-486e-bc08-e2ca6dfb0526 for instance 69c61b8e-abe2-496b-812b-3690bb907ce5 on n-h1-855650-5 Nov 02 12:24:21.004548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9328176a-241d-4df0-baec-f1dcf006f671 req-229fa586-0849-477d-909d-3e20c5891463 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046110 Nov 02 12:24:21.005273 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 562/1111] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:24:21.066813 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.network.security_group_api [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Adding security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 to port 3ae95e90-bb11-4958-b325-f9048a140fc5 Nov 02 12:24:21.511222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:21.517370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:21.519143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:21.528379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:21.529212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:21.529765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:21.530647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:21.531437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:21.532140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:21.799345 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d76fff04-91d1-4575-9b04-dd42033c0996 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005/action" status: 202 len: 0 microversion: 2.1 time: 1.000091 Nov 02 12:24:21.806892 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 550/1112] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:20 2022] POST /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005/action => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:21.813390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7401f097-1460-4f87-ab09-d815f11499f2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e7a1430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:21.816558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=30 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:21.853642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:21.872732 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20b36262-a633-4bd1-949c-6f78ae8e5cda tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1538 microversion: 2.1 time: 0.359108 Nov 02 12:24:21.891090 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 563/1113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:21 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1538 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:21.891090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:21.891090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:21.903187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:21.903872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:21.906935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:21.907969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:21.908691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:21.909550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.154628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-7401f097-1460-4f87-ab09-d815f11499f2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 in use.", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:22.155379 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-7401f097-1460-4f87-ab09-d815f11499f2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security Group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 in use. Nov 02 12:24:22.155379 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-051c5f47-6dc0-476a-a846-d32cbe7bde2a'] Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7401f097-1460-4f87-ab09-d815f11499f2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 HTTP/1.1 Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:22.157767 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: exception: Security Group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 in use. Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-051c5f47-6dc0-476a-a846-d32cbe7bde2a'] Nov 02 12:24:22.159455 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4acde31a-6a9c-4f9e-ba69-107d2d6c60e2'} Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:22.160424 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 in use. Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-051c5f47-6dc0-476a-a846-d32cbe7bde2a'] Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 in use. Nov 02 12:24:22.162408 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-051c5f47-6dc0-476a-a846-d32cbe7bde2a'] Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 in use. Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-051c5f47-6dc0-476a-a846-d32cbe7bde2a'] Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:22.163844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:22.165758 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:22.165758 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:22.165758 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:22.165758 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 in use. Nov 02 12:24:22.165758 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-051c5f47-6dc0-476a-a846-d32cbe7bde2a'] Nov 02 12:24:22.165758 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:22.165758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7401f097-1460-4f87-ab09-d815f11499f2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 400 to user: Security Group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 in use. Nov 02 12:24:22.165758 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-051c5f47-6dc0-476a-a846-d32cbe7bde2a'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:22.167573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7401f097-1460-4f87-ab09-d815f11499f2 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/4acde31a-6a9c-4f9e-ba69-107d2d6c60e2" status: 400 len: 185 microversion: 2.1 time: 0.359267 Nov 02 12:24:22.172336 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 551/1114] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:21 2022] DELETE /compute/v2.1/os-security-groups/4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 => generated 185 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:22.179650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:22.182437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:22.191189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.193178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.194354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.196444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.197395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.198286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.198675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:22.208433 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-db347193-ba2f-4c32-a0e3-27ff5017d21b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.331912 Nov 02 12:24:22.228039 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 564/1115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:21 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:22.325841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30100555-c1bb-4789-90e7-7b818ffa27d0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005/action" status: 202 len: 0 microversion: 2.1 time: 0.150719 Nov 02 12:24:22.333014 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 552/1116] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:22 2022] POST /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:22.337860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:22.338935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:22.346863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.347640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.348256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.349903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.350746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.351179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.666234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:22.682035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93d84351-b94e-4dd3-b4b1-ffdbea63c3b1 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1574 microversion: 2.1 time: 0.343679 Nov 02 12:24:22.682711 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 565/1117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:22 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1574 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:22.746735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:22.752909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-37e9bc6a-e5b1-40ae-9382-ddc96f43e3e2 req-54d518b0-7235-4803-9933-f7649fbae345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8", "name": "network-vif-plugged", "status": "completed", "tag": "1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:22.773448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-37e9bc6a-e5b1-40ae-9382-ddc96f43e3e2 req-54d518b0-7235-4803-9933-f7649fbae345 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.774536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-37e9bc6a-e5b1-40ae-9382-ddc96f43e3e2 req-54d518b0-7235-4803-9933-f7649fbae345 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.775314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-37e9bc6a-e5b1-40ae-9382-ddc96f43e3e2 req-54d518b0-7235-4803-9933-f7649fbae345 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.799205 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-37e9bc6a-e5b1-40ae-9382-ddc96f43e3e2 req-54d518b0-7235-4803-9933-f7649fbae345 service nova] Creating event network-vif-plugged:1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5 for instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 on n-h1-855650-5 Nov 02 12:24:22.812179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-37e9bc6a-e5b1-40ae-9382-ddc96f43e3e2 req-54d518b0-7235-4803-9933-f7649fbae345 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066980 Nov 02 12:24:22.814008 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 553/1118] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:22.905791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:22.906461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:22.918417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.918944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.919399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.920141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.920709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.921184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:23.051209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0920134a-27ae-4295-923c-5e370a2f1f5c req-5174dae3-eae8-4350-aaf8-6e5229594aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994aa7a2-dbbd-41dc-bdd1-49e5e6318005", "tag": "3ae95e90-bb11-4958-b325-f9048a140fc5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:23.066901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0920134a-27ae-4295-923c-5e370a2f1f5c req-5174dae3-eae8-4350-aaf8-6e5229594aea service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:23.068280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0920134a-27ae-4295-923c-5e370a2f1f5c req-5174dae3-eae8-4350-aaf8-6e5229594aea service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:23.069370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0920134a-27ae-4295-923c-5e370a2f1f5c req-5174dae3-eae8-4350-aaf8-6e5229594aea service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:23.088678 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0920134a-27ae-4295-923c-5e370a2f1f5c req-5174dae3-eae8-4350-aaf8-6e5229594aea service nova] Creating event network-changed:3ae95e90-bb11-4958-b325-f9048a140fc5 for instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 on n-h1-855650-5 Nov 02 12:24:23.098916 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0920134a-27ae-4295-923c-5e370a2f1f5c req-5174dae3-eae8-4350-aaf8-6e5229594aea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053528 Nov 02 12:24:23.101365 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 554/1119] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:23.133115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:23.145332 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-abaacfe5-a08e-41b0-91ec-79ab7db28ae7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1538 microversion: 2.1 time: 0.250331 Nov 02 12:24:23.148058 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 566/1120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:22 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1538 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:23.232573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:23.233640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:23.245601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:23.246150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:23.246601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:23.247606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:23.248087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:23.249009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:23.473611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:23.491702 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-636c9311-b2fe-4a04-87c2-c3f4a4e0abfc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.263576 Nov 02 12:24:23.492733 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 555/1121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:23 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:23.710367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:23.716194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:23.735882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:23.746117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:23.747657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:23.749660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:23.750347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:23.750984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.102742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:24.116584 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4fc44dcd-834c-4561-a259-1e22d834259b tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1574 microversion: 2.1 time: 0.411150 Nov 02 12:24:24.117484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 567/1122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:23 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1574 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:24.171963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:24.174007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:24.191376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.193942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.195921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.197030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.198587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.199973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.519444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:24.520064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:24.527339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.527837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.528270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.529200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.529653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.530118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.734577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:24.753066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92cc9683-0dad-4aa4-b64a-da7e9103a403 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1538 microversion: 2.1 time: 0.584727 Nov 02 12:24:24.766261 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 556/1123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:24 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1538 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:24.798016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:24.811763 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-adb33b02-430f-40f3-990f-b2a5c0035e36 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.296597 Nov 02 12:24:24.812721 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 568/1124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:24 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:25.145075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.145784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:25.151901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.152397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.152867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.153568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.154043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.154529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.355479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:25.366704 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46137303-2aa9-4133-8dab-82e25cb834c9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1574 microversion: 2.1 time: 0.225409 Nov 02 12:24:25.378941 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 557/1125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1574 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:25.701377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4de920c7-bb6b-44a1-8377-1b495a082e8c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eb8a160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.760093 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4de920c7-bb6b-44a1-8377-1b495a082e8c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/32b5e181-6e39-4a5a-b97f-77cccaf01534" status: 200 len: 662 microversion: 2.1 time: 0.065561 Nov 02 12:24:25.761216 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 569/1126] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/images/32b5e181-6e39-4a5a-b97f-77cccaf01534 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:25.777876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de3f4c0c-46f5-47e2-8ec1-d587bc5fb1bc tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e76e5e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.781486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.796717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:25.811335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.811335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.811335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.812351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.812351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.814266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.837150 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de3f4c0c-46f5-47e2-8ec1-d587bc5fb1bc tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/32b5e181-6e39-4a5a-b97f-77cccaf01534" status: 200 len: 662 microversion: 2.1 time: 0.065881 Nov 02 12:24:25.843364 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 558/1127] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/images/32b5e181-6e39-4a5a-b97f-77cccaf01534 => generated 662 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:25.849552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.850363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:25.862572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.863098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.863736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.864962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.865619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.866250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:26.404557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:26.412724 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d45e99a-4742-43c5-a692-e17fa236d19a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1538 microversion: 2.1 time: 0.636064 Nov 02 12:24:26.413413 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 570/1128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1538 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:26.418825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:26.419441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:26.426140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:26.428638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:26.429425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:26.430736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:26.430829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:26.431263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:26.443844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:26.456750 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-890777b7-8247-466b-abe9-f478129bdd8f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.617581 Nov 02 12:24:26.457411 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 559/1129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:26.474915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:26.475674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:26.483444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:26.483931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:26.484364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:26.485324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:26.485990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:26.486509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:26.933939 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60c76939-12f2-4ca1-af9d-e0c9dd33a105 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1812 microversion: 2.1 time: 0.519002 Nov 02 12:24:26.935141 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 571/1130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:26 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1812 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:26.941143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:26.950400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef8cd670-1c22-4551-b1f4-cfe59dd32110 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1574 microversion: 2.1 time: 0.479913 Nov 02 12:24:26.951204 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 560/1131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:26 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1574 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:26.974409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c494cd72-460d-4c5c-99ef-a8e1464451ff tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:26.983685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c494cd72-460d-4c5c-99ef-a8e1464451ff tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:26.984348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c494cd72-460d-4c5c-99ef-a8e1464451ff tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:26.985220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c494cd72-460d-4c5c-99ef-a8e1464451ff tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:26.986247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c494cd72-460d-4c5c-99ef-a8e1464451ff tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:26.988418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c494cd72-460d-4c5c-99ef-a8e1464451ff tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:26.989677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c494cd72-460d-4c5c-99ef-a8e1464451ff tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:27.030452 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c494cd72-460d-4c5c-99ef-a8e1464451ff tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.076337 Nov 02 12:24:27.032305 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 572/1132] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 12:24:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:24:27.439630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:27.441700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:27.454528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:27.455946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:27.456726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:27.457640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:27.458329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:27.458949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:27.481280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:27.482858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:27.494836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:27.501187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:27.501924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:27.502921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:27.504912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:27.507258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:27.811051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:27.829296 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cef2d2e-7be2-4b34-888e-fb33087d41c4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1533 microversion: 2.1 time: 0.389317 Nov 02 12:24:27.836585 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 561/1133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:27 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1533 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:27.842536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:27.852012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4eb7f288-02b3-415b-ab99-d77beb615c3a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e730310>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:27.861453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eaa7e00d-c35f-4b0d-bcca-4c7fe4f62d56 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.384867 Nov 02 12:24:27.862253 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 573/1134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:27 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:27.970528 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4eb7f288-02b3-415b-ab99-d77beb615c3a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/27823842-9032-4294-afd1-80f1e7cefc2b" status: 200 len: 662 microversion: 2.1 time: 0.132151 Nov 02 12:24:27.978782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:27.980516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:27.990407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 562/1135] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:24:27 2022] GET /compute/v2.1/images/27823842-9032-4294-afd1-80f1e7cefc2b => generated 662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:27.992253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:27.992755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:27.998299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7009c267-cad2-49de-b9d2-36c14bc8b250 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e911160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:27.998613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:27.998613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:27.998613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:28.000831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:28.059214 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7009c267-cad2-49de-b9d2-36c14bc8b250 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/27823842-9032-4294-afd1-80f1e7cefc2b" status: 200 len: 662 microversion: 2.1 time: 0.067540 Nov 02 12:24:28.059704 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 563/1136] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:24:27 2022] GET /compute/v2.1/images/27823842-9032-4294-afd1-80f1e7cefc2b => generated 662 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:28.173889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fc668e7a-8fba-4abf-aeb4-4525d0f9a7d7 req-e92cac41-4f2b-42ee-9c51-b1d44ff67717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c534487-5ba6-4b04-a624-3a76d2874220", "name": "network-vif-plugged", "status": "completed", "tag": "c6a80797-54bf-4134-9413-9d2c79830f2c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:28.193167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc668e7a-8fba-4abf-aeb4-4525d0f9a7d7 req-e92cac41-4f2b-42ee-9c51-b1d44ff67717 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:28.195635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc668e7a-8fba-4abf-aeb4-4525d0f9a7d7 req-e92cac41-4f2b-42ee-9c51-b1d44ff67717 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:28.196309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc668e7a-8fba-4abf-aeb4-4525d0f9a7d7 req-e92cac41-4f2b-42ee-9c51-b1d44ff67717 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:28.229229 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fc668e7a-8fba-4abf-aeb4-4525d0f9a7d7 req-e92cac41-4f2b-42ee-9c51-b1d44ff67717 service nova] Creating event network-vif-plugged:c6a80797-54bf-4134-9413-9d2c79830f2c for instance 0c534487-5ba6-4b04-a624-3a76d2874220 on n-h2-855650-5 Nov 02 12:24:28.236270 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fc668e7a-8fba-4abf-aeb4-4525d0f9a7d7 req-e92cac41-4f2b-42ee-9c51-b1d44ff67717 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066078 Nov 02 12:24:28.237606 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 564/1137] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:24:28.394493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:28.404771 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0e25fccb-e6c2-4ccc-b3cc-3f84f8dbf324 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1574 microversion: 2.1 time: 0.432008 Nov 02 12:24:28.405359 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 574/1138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:27 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1574 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:28.743296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0441028f-f10c-4b32-8486-6aca1ce83cf4 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Calling method '.version_select at 0x7f228e730310>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:28.764414 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0441028f-f10c-4b32-8486-6aca1ce83cf4 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] HTTP exception thrown: Image not found. Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0441028f-f10c-4b32-8486-6aca1ce83cf4 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Request method failure captured: Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/images/d8e871b4-d088-4a11-8c44-190381f72392/metadata/os_distro HTTP/1.1 Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmF8XSWiD_zrbowY57bmSZrWHDTQvyO3bnhiMsaevUGo_GkfNxv6rpsvYF9-BAECjnH6BFkCRQU1DLH-0Lm5rA1eey3kgsHrr-0g6-0Z5z3A-bxfzlzsNlypyfenTXozO3bPRa4hkwOKvA3j2WGpO6r90s-CSWmxUx3d7M8Mrphfq-k Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:28.766842 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1331ee57db0346398eb7e27ae29ab795 Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'image_id': 'd8e871b4-d088-4a11-8c44-190381f72392', 'id': 'os_distro'} Nov 02 12:24:28.768514 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:28.773989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d8e871b4-d088-4a11-8c44-190381f72392 Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:28.775498 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8e871b4-d088-4a11-8c44-190381f72392 could not be found. Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:28.776978 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.778402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0441028f-f10c-4b32-8486-6aca1ce83cf4 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:28.779958 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0441028f-f10c-4b32-8486-6aca1ce83cf4 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] 10.222.0.45 "DELETE /compute/v2.1/images/d8e871b4-d088-4a11-8c44-190381f72392/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.174668 Nov 02 12:24:28.779958 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 565/1139] 10.222.0.45 () {58 vars in 1293 bytes} [Wed Nov 2 12:24:28 2022] DELETE /compute/v2.1/images/d8e871b4-d088-4a11-8c44-190381f72392/metadata/os_distro => generated 62 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:28.780146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4f78dfa-2461-4677-83bc-3edb5af1280a tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Calling method '.version_select at 0x7f228ea30b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:28.803612 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-b4f78dfa-2461-4677-83bc-3edb5af1280a tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] HTTP exception thrown: Image not found. Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4f78dfa-2461-4677-83bc-3edb5af1280a tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Request method failure captured: Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/images/a11b22db-9fd6-45d4-9e42-7bbd7b263476/metadata/os_version HTTP/1.1 Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmF8XSWiD_zrbowY57bmSZrWHDTQvyO3bnhiMsaevUGo_GkfNxv6rpsvYF9-BAECjnH6BFkCRQU1DLH-0Lm5rA1eey3kgsHrr-0g6-0Z5z3A-bxfzlzsNlypyfenTXozO3bPRa4hkwOKvA3j2WGpO6r90s-CSWmxUx3d7M8Mrphfq-k Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:28.806036 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 1331ee57db0346398eb7e27ae29ab795 Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'image_id': 'a11b22db-9fd6-45d4-9e42-7bbd7b263476', 'id': 'os_version'} Nov 02 12:24:28.807481 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:28.808325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a11b22db-9fd6-45d4-9e42-7bbd7b263476 Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:28.810160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a11b22db-9fd6-45d4-9e42-7bbd7b263476 could not be found. Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:28.812573 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.814086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4f78dfa-2461-4677-83bc-3edb5af1280a tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:28.815403 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b4f78dfa-2461-4677-83bc-3edb5af1280a tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] 10.222.0.45 "GET /compute/v2.1/images/a11b22db-9fd6-45d4-9e42-7bbd7b263476/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.032478 Nov 02 12:24:28.815403 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 575/1140] 10.222.0.45 () {58 vars in 1293 bytes} [Wed Nov 2 12:24:28 2022] GET /compute/v2.1/images/a11b22db-9fd6-45d4-9e42-7bbd7b263476/metadata/os_version => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:28.819577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c36f5cb-b60b-434b-a726-75bab6c96f31 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Calling method '.version_select at 0x7f228e8c6280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:28.844076 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3c36f5cb-b60b-434b-a726-75bab6c96f31 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] HTTP exception thrown: Image not found. Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c36f5cb-b60b-434b-a726-75bab6c96f31 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Request method failure captured: Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/images/581c3bad-308c-4a3e-99c4-abb140e27431/metadata HTTP/1.1 Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmF8XSWiD_zrbowY57bmSZrWHDTQvyO3bnhiMsaevUGo_GkfNxv6rpsvYF9-BAECjnH6BFkCRQU1DLH-0Lm5rA1eey3kgsHrr-0g6-0Z5z3A-bxfzlzsNlypyfenTXozO3bPRa4hkwOKvA3j2WGpO6r90s-CSWmxUx3d7M8Mrphfq-k Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:28.846173 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1331ee57db0346398eb7e27ae29ab795 Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'image_id': '581c3bad-308c-4a3e-99c4-abb140e27431'} Nov 02 12:24:28.847821 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:28.849297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 581c3bad-308c-4a3e-99c4-abb140e27431 Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:28.850650 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 581c3bad-308c-4a3e-99c4-abb140e27431 could not be found. Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:28.852031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.853413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c36f5cb-b60b-434b-a726-75bab6c96f31 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:28.854791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c36f5cb-b60b-434b-a726-75bab6c96f31 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] 10.222.0.45 "GET /compute/v2.1/images/581c3bad-308c-4a3e-99c4-abb140e27431/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032726 Nov 02 12:24:28.854791 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 566/1141] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:24:28 2022] GET /compute/v2.1/images/581c3bad-308c-4a3e-99c4-abb140e27431/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:28.860971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:28.861229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:28.863075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5017dc7d-352e-4bbe-896d-e545b5ea78f9 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Action: 'update_all', calling method: .version_select at 0x7f228e730550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:28.874082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:28.874689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:28.875356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:28.876286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:28.876813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:28.877493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:28.889728 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5017dc7d-352e-4bbe-896d-e545b5ea78f9 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] HTTP exception thrown: Image not found. Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5017dc7d-352e-4bbe-896d-e545b5ea78f9 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Request method failure captured: Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/images/6dedfc31-c507-4439-8d68-3a530f6134da/metadata HTTP/1.1 Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 57 Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmF8XSWiD_zrbowY57bmSZrWHDTQvyO3bnhiMsaevUGo_GkfNxv6rpsvYF9-BAECjnH6BFkCRQU1DLH-0Lm5rA1eey3kgsHrr-0g6-0Z5z3A-bxfzlzsNlypyfenTXozO3bPRa4hkwOKvA3j2WGpO6r90s-CSWmxUx3d7M8Mrphfq-k Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:28.892608 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1331ee57db0346398eb7e27ae29ab795 Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:24:28.894312 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'image_id': '6dedfc31-c507-4439-8d68-3a530f6134da', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:28.895300 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6dedfc31-c507-4439-8d68-3a530f6134da Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:28.902954 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6dedfc31-c507-4439-8d68-3a530f6134da could not be found. Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:28.905132 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:24:28.906958 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:28.909311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5017dc7d-352e-4bbe-896d-e545b5ea78f9 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:28.909311 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5017dc7d-352e-4bbe-896d-e545b5ea78f9 tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] 10.222.0.45 "PUT /compute/v2.1/images/6dedfc31-c507-4439-8d68-3a530f6134da/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036096 Nov 02 12:24:28.909311 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 567/1142] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:24:28 2022] PUT /compute/v2.1/images/6dedfc31-c507-4439-8d68-3a530f6134da/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:28.909311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:28.909311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:28.911765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:28.912311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:28.912752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:28.913466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:28.914310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:28.915998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:29.117825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:29.126652 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6442fc96-b5c3-4aab-85ca-5572a5a5b0e5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1520 microversion: 2.1 time: 0.270529 Nov 02 12:24:29.127530 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 576/1143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:28 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:29.131898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:29.133254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68820167-7207-4739-ad87-9b167c81ab8d tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Action: 'update', calling method: .version_select at 0x7f228eb90d30>, body: {"meta": {"os_distro": "alt"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:29.152808 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99ca353e-fb9f-468f-9179-a8477fb23605 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.255248 Nov 02 12:24:29.153937 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 568/1144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:28 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-68820167-7207-4739-ad87-9b167c81ab8d tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] HTTP exception thrown: Image not found. Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68820167-7207-4739-ad87-9b167c81ab8d tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Request method failure captured: Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/images/ab5ec027-8bfd-4ee8-bc1b-f62a09497a76/metadata/os_distro HTTP/1.1 Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 30 Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmF8XSWiD_zrbowY57bmSZrWHDTQvyO3bnhiMsaevUGo_GkfNxv6rpsvYF9-BAECjnH6BFkCRQU1DLH-0Lm5rA1eey3kgsHrr-0g6-0Z5z3A-bxfzlzsNlypyfenTXozO3bPRa4hkwOKvA3j2WGpO6r90s-CSWmxUx3d7M8Mrphfq-k Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:29.166314 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 1331ee57db0346398eb7e27ae29ab795 Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: {"meta": {"os_distro": "alt"}} Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:24:29.168258 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'image_id': 'ab5ec027-8bfd-4ee8-bc1b-f62a09497a76', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:29.169308 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ab5ec027-8bfd-4ee8-bc1b-f62a09497a76 Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:29.175670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab5ec027-8bfd-4ee8-bc1b-f62a09497a76 could not be found. Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:29.178382 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:24:29.180723 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.182323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68820167-7207-4739-ad87-9b167c81ab8d tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:29.182323 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-68820167-7207-4739-ad87-9b167c81ab8d tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] 10.222.0.45 "PUT /compute/v2.1/images/ab5ec027-8bfd-4ee8-bc1b-f62a09497a76/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.038615 Nov 02 12:24:29.182323 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 577/1145] 10.222.0.45 () {60 vars in 1310 bytes} [Wed Nov 2 12:24:29 2022] PUT /compute/v2.1/images/ab5ec027-8bfd-4ee8-bc1b-f62a09497a76/metadata/os_distro => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:29.182323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:29.182323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:29.187973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:29.188246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-012c4094-eae9-4ba7-9d75-49e4e532155c tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Action: 'create', calling method: .version_select at 0x7f228e776820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:29.188466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:29.188909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:29.190179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:29.190808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:29.191246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:29.194103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:29.219064 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-012c4094-eae9-4ba7-9d75-49e4e532155c tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] HTTP exception thrown: Image not found. Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-012c4094-eae9-4ba7-9d75-49e4e532155c tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Request method failure captured: Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/images/cbe2d1a0-0bdf-4789-bcd0-7b2c3f6e5a8d/metadata HTTP/1.1 Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 57 Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmF8XSWiD_zrbowY57bmSZrWHDTQvyO3bnhiMsaevUGo_GkfNxv6rpsvYF9-BAECjnH6BFkCRQU1DLH-0Lm5rA1eey3kgsHrr-0g6-0Z5z3A-bxfzlzsNlypyfenTXozO3bPRa4hkwOKvA3j2WGpO6r90s-CSWmxUx3d7M8Mrphfq-k Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:29.222034 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1dcd5d02edc74e328e645d2b3a73b66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1dcd5d02edc74e328e645d2b3a73b66a Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-619272807 Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1331ee57db0346398eb7e27ae29ab795 Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-619272807-project Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:24:29.223396 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'image_id': 'cbe2d1a0-0bdf-4789-bcd0-7b2c3f6e5a8d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:29.224842 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cbe2d1a0-0bdf-4789-bcd0-7b2c3f6e5a8d Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:24:29.226314 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cbe2d1a0-0bdf-4789-bcd0-7b2c3f6e5a8d could not be found. Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:29.227875 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:24:29.229241 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:29.231884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-012c4094-eae9-4ba7-9d75-49e4e532155c tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:29.231884 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-012c4094-eae9-4ba7-9d75-49e4e532155c tempest-ImagesMetadataNegativeTestJSON-619272807 tempest-ImagesMetadataNegativeTestJSON-619272807-project] 10.222.0.45 "POST /compute/v2.1/images/cbe2d1a0-0bdf-4789-bcd0-7b2c3f6e5a8d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039050 Nov 02 12:24:29.231884 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 569/1146] 10.222.0.45 () {60 vars in 1281 bytes} [Wed Nov 2 12:24:29 2022] POST /compute/v2.1/images/cbe2d1a0-0bdf-4789-bcd0-7b2c3f6e5a8d/metadata => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:24:29.246252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:24:29.354417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:29.359965 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39436268-acb9-448e-805e-2a313a3f89c5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 204 len: 0 microversion: 2.1 time: 0.184886 Nov 02 12:24:29.360866 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 578/1147] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:24:29 2022] DELETE /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:24:29.370493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:29.371657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:29.380371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:29.381633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:29.382188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:29.383692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:29.384911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:29.385821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:29.432095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:29.433328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:29.445494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:29.451634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:29.454350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:29.455348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:29.455967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:29.456831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:29.688985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:29.698228 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1fcfd7c5-c259-4e1d-8575-6bdf5e87a111 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1526 microversion: 2.1 time: 0.332214 Nov 02 12:24:29.714227 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 570/1148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:29 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1526 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:29.772845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:29.781031 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0e83755-e905-4e94-8565-6a654be54a21 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1579 microversion: 2.1 time: 0.353411 Nov 02 12:24:29.783588 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 579/1149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:29 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1579 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:29.975449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-689cb564-be49-4a12-90c7-f5aac64d8bdb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e7a1040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:30.022570 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-689cb564-be49-4a12-90c7-f5aac64d8bdb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/26b50a75-a175-4aa1-a075-7bf8b73148fc" status: 200 len: 661 microversion: 2.1 time: 0.051443 Nov 02 12:24:30.023701 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 571/1150] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:24:29 2022] GET /compute/v2.1/images/26b50a75-a175-4aa1-a075-7bf8b73148fc => generated 661 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:30.038211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e2ba9a00-6c8a-4ca7-97cd-19ff22506f86 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eaa8ca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:30.090328 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e2ba9a00-6c8a-4ca7-97cd-19ff22506f86 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/26b50a75-a175-4aa1-a075-7bf8b73148fc" status: 200 len: 661 microversion: 2.1 time: 0.057023 Nov 02 12:24:30.090920 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 580/1151] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:24:30 2022] GET /compute/v2.1/images/26b50a75-a175-4aa1-a075-7bf8b73148fc => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:30.100938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1060be9-0b01-40fc-97a7-261291549000", "device": "/dev/xvdb"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:30.105180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:30.118851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.119323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.119821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.120591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.121231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.121877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.181476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:30.182242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:30.194672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.196389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.199076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.201583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.206219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.207537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.411966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:30.421849 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c01d886-7c00-461c-9af0-b35abf4ad652 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1319 microversion: 2.1 time: 0.244813 Nov 02 12:24:30.422836 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 581/1152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:30 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:30.428915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1572498874", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:30.496357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:24:30.779977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:24:30.780722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:24:30.781305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:24:30.781959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:24:30.782979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:24:30.796555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.797527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.797948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.798810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.799530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.800056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.823447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Getting quotas for project 0f82ade518194e1fa8dae47f66e67d8e. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:30.829464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Getting quotas for user 51ab461132054e449ec6556e3eaa3d48 and project 0f82ade518194e1fa8dae47f66e67d8e. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:30.844263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:24:30.846969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:24:30.858583 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf678dbb-e401-4df7-8d70-9d60b88430af tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "POST /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763355 Nov 02 12:24:30.859520 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 572/1153] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:24:30 2022] POST /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:30.867054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1a9e4351-8b27-4cb9-8614-f9bb9d41fecc req-76430efb-893e-4798-9561-07f94d18ed97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c61b8e-abe2-496b-812b-3690bb907ce5", "name": "network-vif-plugged", "status": "completed", "tag": "2090fc2c-d631-486e-bc08-e2ca6dfb0526"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:30.877741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1a9e4351-8b27-4cb9-8614-f9bb9d41fecc req-76430efb-893e-4798-9561-07f94d18ed97 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.878508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1a9e4351-8b27-4cb9-8614-f9bb9d41fecc req-76430efb-893e-4798-9561-07f94d18ed97 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.879002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1a9e4351-8b27-4cb9-8614-f9bb9d41fecc req-76430efb-893e-4798-9561-07f94d18ed97 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.894914 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1a9e4351-8b27-4cb9-8614-f9bb9d41fecc req-76430efb-893e-4798-9561-07f94d18ed97 service nova] Creating event network-vif-plugged:2090fc2c-d631-486e-bc08-e2ca6dfb0526 for instance 69c61b8e-abe2-496b-812b-3690bb907ce5 on n-h1-855650-5 Nov 02 12:24:30.900618 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1a9e4351-8b27-4cb9-8614-f9bb9d41fecc req-76430efb-893e-4798-9561-07f94d18ed97 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039389 Nov 02 12:24:30.901712 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 573/1154] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:30.909116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:30.910072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:30.918671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.919219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.919367 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bce82e6b-ecf0-4417-a0a9-6634ebdafc13 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492743 Nov 02 12:24:30.919669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.919965 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 582/1155] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:24:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:24:30.931390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.931390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.931390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.932973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:30.934496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:30.941657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.943286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.943757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.944462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:30.944922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:30.945474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:30.967462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:31.170528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:31.181482 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dde33f5c-e759-49d4-a635-3f925ac5ee70 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1526 microversion: 2.1 time: 0.277166 Nov 02 12:24:31.181482 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 574/1156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:30 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1526 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:31.204490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-784327701", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:31.234098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:31.245756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1616ef25-8a96-400a-a5ab-8457930d23d5 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1572 microversion: 2.1 time: 0.320749 Nov 02 12:24:31.246905 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 583/1157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:30 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1572 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:31.271902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2111726417"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:31.273535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:31.288072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:31.288585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:31.289429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:31.292957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:31.294532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:31.295164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:31.296869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:24:32.056572 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.network.security_group_api [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Adding security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 to port 3ae95e90-bb11-4958-b325-f9048a140fc5 Nov 02 12:24:32.146261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:24:32.147503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:24:32.148288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:24:32.148941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:24:32.149594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:24:32.160745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.162152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.163181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:32.164424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.165414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.166090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:32.194061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Getting quotas for project 0f82ade518194e1fa8dae47f66e67d8e. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:32.204231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Getting quotas for user 51ab461132054e449ec6556e3eaa3d48 and project 0f82ade518194e1fa8dae47f66e67d8e. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:32.221371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:24:32.226011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:24:32.299444 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c4684ef5-2c01-4087-a982-b3423156c830 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114674 Nov 02 12:24:32.300677 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 575/1158] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:24:32.308557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:32.309457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:32.318927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.319682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.320312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:32.321177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.321977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.322772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:32.758692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:32.772679 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89c4dd29-39e2-4e3f-88f4-f0161dbf86e5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1469 microversion: 2.1 time: 0.469628 Nov 02 12:24:32.773297 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 576/1159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:32 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1469 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:32.781081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:32.781947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:32.789950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.790813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.791389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:32.792001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.792541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.793332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.049104 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c384414-9eac-46d0-9750-2260ab647cb9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005/action" status: 202 len: 0 microversion: 2.1 time: 1.783025 Nov 02 12:24:33.050433 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 584/1160] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:31 2022] POST /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005/action => generated 0 bytes in 1785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:24:33.056202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:33.056950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:33.071871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.074920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.075647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.080241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.080863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.081412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.343222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:33.385699 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4be66b45-49dd-43b6-9de6-9a6f6a7823eb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1221 microversion: 2.1 time: 0.326589 Nov 02 12:24:33.401262 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 585/1161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:33 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1221 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:33.419183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:33.425693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:33.445153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.445830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.447576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.448430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.448901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.449333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.712703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:33.740609 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae62cde6-6da2-43c9-af76-08ab7c5bb9ce tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1526 microversion: 2.1 time: 0.965894 Nov 02 12:24:33.756621 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 577/1162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:32 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1526 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:33.772130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e97e88f2-4280-4b7e-b4ed-d1de35f854a9 req-bf9c3647-b31f-4474-82b0-27509ce79d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8", "name": "network-vif-unplugged", "status": "completed", "tag": "1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:33.786004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e97e88f2-4280-4b7e-b4ed-d1de35f854a9 req-bf9c3647-b31f-4474-82b0-27509ce79d77 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.786733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e97e88f2-4280-4b7e-b4ed-d1de35f854a9 req-bf9c3647-b31f-4474-82b0-27509ce79d77 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.787386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e97e88f2-4280-4b7e-b4ed-d1de35f854a9 req-bf9c3647-b31f-4474-82b0-27509ce79d77 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.800364 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e97e88f2-4280-4b7e-b4ed-d1de35f854a9 req-bf9c3647-b31f-4474-82b0-27509ce79d77 service nova] Creating event network-vif-unplugged:1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5 for instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 on n-h1-855650-5 Nov 02 12:24:33.806997 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e97e88f2-4280-4b7e-b4ed-d1de35f854a9 req-bf9c3647-b31f-4474-82b0-27509ce79d77 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042242 Nov 02 12:24:33.808160 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 578/1163] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:33.815198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93fad586-c513-4290-b8f6-959dfcbe6668 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e6c0a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:34.258652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:34.279170 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4e3fadea-3f8a-483f-9831-ce8d803f714a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 200 len: 1319 microversion: 2.1 time: 0.876492 Nov 02 12:24:34.293258 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 586/1164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:33 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 1319 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:34.309256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ea24b81d-406e-462a-8cd6-ad3f7a02b566 req-89644dd5-95fa-45f6-b5fe-09f60968e7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994aa7a2-dbbd-41dc-bdd1-49e5e6318005", "tag": "3ae95e90-bb11-4958-b325-f9048a140fc5"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:34.313826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-93fad586-c513-4290-b8f6-959dfcbe6668 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 in use.", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:34.314568 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-93fad586-c513-4290-b8f6-959dfcbe6668 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security Group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 in use. Nov 02 12:24:34.314568 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-6d94c704-0c1f-4c8f-a906-475aad8da10d'] Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93fad586-c513-4290-b8f6-959dfcbe6668 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/8f6ae074-c68e-4fe6-b0b8-457c83183d96 HTTP/1.1 Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:34.316504 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: exception: Security Group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 in use. Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-6d94c704-0c1f-4c8f-a906-475aad8da10d'] Nov 02 12:24:34.318893 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '8f6ae074-c68e-4fe6-b0b8-457c83183d96'} Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:34.319939 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 in use. Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d94c704-0c1f-4c8f-a906-475aad8da10d'] Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 in use. Nov 02 12:24:34.321383 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d94c704-0c1f-4c8f-a906-475aad8da10d'] Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 in use. Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d94c704-0c1f-4c8f-a906-475aad8da10d'] Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:34.322817 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:34.324356 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:34.324356 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:34.324356 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:34.324356 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 in use. Nov 02 12:24:34.324356 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d94c704-0c1f-4c8f-a906-475aad8da10d'] Nov 02 12:24:34.324356 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:34.327456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea24b81d-406e-462a-8cd6-ad3f7a02b566 req-89644dd5-95fa-45f6-b5fe-09f60968e7b9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.328186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea24b81d-406e-462a-8cd6-ad3f7a02b566 req-89644dd5-95fa-45f6-b5fe-09f60968e7b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.328786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea24b81d-406e-462a-8cd6-ad3f7a02b566 req-89644dd5-95fa-45f6-b5fe-09f60968e7b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.340721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93fad586-c513-4290-b8f6-959dfcbe6668 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 400 to user: Security Group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 in use. Nov 02 12:24:34.340721 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-6d94c704-0c1f-4c8f-a906-475aad8da10d'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:34.341641 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-93fad586-c513-4290-b8f6-959dfcbe6668 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/8f6ae074-c68e-4fe6-b0b8-457c83183d96" status: 400 len: 185 microversion: 2.1 time: 0.531935 Nov 02 12:24:34.342507 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 579/1165] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:33 2022] DELETE /compute/v2.1/os-security-groups/8f6ae074-c68e-4fe6-b0b8-457c83183d96 => generated 185 bytes in 533 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:34.350501 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ea24b81d-406e-462a-8cd6-ad3f7a02b566 req-89644dd5-95fa-45f6-b5fe-09f60968e7b9 service nova] Creating event network-changed:3ae95e90-bb11-4958-b325-f9048a140fc5 for instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 on n-h1-855650-5 Nov 02 12:24:34.354681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:34.358906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:34.363436 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ea24b81d-406e-462a-8cd6-ad3f7a02b566 req-89644dd5-95fa-45f6-b5fe-09f60968e7b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067763 Nov 02 12:24:34.368545 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 587/1166] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:34.390823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.393835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.394457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.398229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.398944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.399603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.411432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:34.412252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:34.429699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.430254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.430706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.431564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.432028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.432462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.471589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:24:34.552805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:34.577910 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-438c6791-d99e-46e1-93bb-a9aec992e55f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1213 microversion: 2.1 time: 0.172331 Nov 02 12:24:34.578712 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 588/1167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:34 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:34.630898 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-759b41bc-c00c-449c-9761-d2bae0218be7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 204 len: 0 microversion: 2.1 time: 0.281912 Nov 02 12:24:34.632363 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 580/1168] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:24:34 2022] DELETE /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:24:34.644637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:34.648723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:34.668572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.671369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.672124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.673085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.676120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.677084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.773342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:34.775006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:34.787616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.788607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.789344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.790570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.791339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.792057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.834509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.835270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.835880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.836508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lazy-loading 'fault' on Instance uuid 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:34.910810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:34.927400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b5e7646-62bc-4c77-8e95-fb768a936756 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1314 microversion: 2.1 time: 0.158033 Nov 02 12:24:34.928228 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 581/1169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:34 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:35.035254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:35.052085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0997147e-e698-40de-9358-3964f947b19f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1647 microversion: 2.1 time: 0.415414 Nov 02 12:24:35.052925 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 589/1170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:34 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1647 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:35.312988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:35.313887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:35.315862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:35.347676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.348088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.348603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.349854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.350428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.350858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.597133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:35.605599 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78ce6c54-575c-41ac-86e0-c1f563005058 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 200 len: 1468 microversion: 2.1 time: 0.296332 Nov 02 12:24:35.606482 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 582/1171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:35 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:35.607491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:35.609651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:35.619884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.620652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.621283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.622197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.622818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.623412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.631818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:35.637103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:35.641458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Searching by: {'reservation_id': 'r-janstavs', 'deleted': False, 'project_id': '74888962841648a7bfc8cd36cdf5526c'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:24:35.647822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.648578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.649180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.650128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.650762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.651375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.775465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:24:35.815154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:35.826213 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e468a9b-9d35-451e-b0a5-abadca5d79af tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1269 microversion: 2.1 time: 0.225265 Nov 02 12:24:35.826801 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 590/1172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:35 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:35.866482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:35.874287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.881203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.881950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.958747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:35.959631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:35.978066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.978574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.979018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.979731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.980187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.980616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.049319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:36.050225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:36.053011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.053469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lazy-loading 'fault' on Instance uuid 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:36.325333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:36.338838 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-461da423-630b-4657-b0ee-703fad8d745a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1314 microversion: 2.1 time: 0.384190 Nov 02 12:24:36.339908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 591/1173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:35 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:36.358405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:36.359031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:36.373676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:36.374172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:36.374616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.376019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:36.376811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:36.377399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.686353 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-16152e7a-3bd7-4eaa-a12c-cb2f6b796b1a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?reservation_id=r-janstavs" status: 200 len: 2930 microversion: 2.1 time: 1.058738 Nov 02 12:24:36.688020 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 583/1174] 10.222.0.45 () {58 vars in 1197 bytes} [Wed Nov 2 12:24:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-janstavs => generated 2930 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:36.693539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-29980ad3-03c4-4829-bda9-4a4cd09f9166 req-57fdc56d-0849-46ae-98eb-29bf87db7cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8", "name": "network-vif-deleted", "tag": "1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:36.704412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-29980ad3-03c4-4829-bda9-4a4cd09f9166 req-57fdc56d-0849-46ae-98eb-29bf87db7cc0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:36.706895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-29980ad3-03c4-4829-bda9-4a4cd09f9166 req-57fdc56d-0849-46ae-98eb-29bf87db7cc0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:36.707558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-29980ad3-03c4-4829-bda9-4a4cd09f9166 req-57fdc56d-0849-46ae-98eb-29bf87db7cc0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.718989 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-29980ad3-03c4-4829-bda9-4a4cd09f9166 req-57fdc56d-0849-46ae-98eb-29bf87db7cc0 service nova] Creating event network-vif-deleted:1b8436c9-f4a1-4bf0-8e01-ea7abaf59df5 for instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 on n-h1-855650-5 Nov 02 12:24:36.725453 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-29980ad3-03c4-4829-bda9-4a4cd09f9166 req-57fdc56d-0849-46ae-98eb-29bf87db7cc0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035888 Nov 02 12:24:36.727481 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 584/1175] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:36.738662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-774fe202-2f4d-4773-942a-04bf5024ff2a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:36.758248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.server_groups [None req-774fe202-2f4d-4773-942a-04bf5024ff2a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Querying cell 65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) for 2 instances {{(pid=120722) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:24:36.759221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-774fe202-2f4d-4773-942a-04bf5024ff2a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:36.759887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-774fe202-2f4d-4773-942a-04bf5024ff2a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:36.760482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-774fe202-2f4d-4773-942a-04bf5024ff2a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.783512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-774fe202-2f4d-4773-942a-04bf5024ff2a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/93914208-75e9-41bb-8f4f-12cfd960a6a6" status: 200 len: 271 microversion: 2.1 time: 0.053361 Nov 02 12:24:36.785155 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 585/1176] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:36 2022] GET /compute/v2.1/os-server-groups/93914208-75e9-41bb-8f4f-12cfd960a6a6 => generated 271 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:36.797287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:36.798337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:36.811370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:36.812200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:36.812909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.814028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:36.815503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:36.816355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.940044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:36.956601 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3edfd149-8f6b-437e-ae42-8d43842be305 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1647 microversion: 2.1 time: 0.615664 Nov 02 12:24:36.957694 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 592/1177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:36 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1647 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:36.994231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:36.997642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:37.029834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.030525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.031365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.033142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.034548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.035197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.431111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:37.453119 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd846a83-bcc0-4682-99e4-e4d42112a9b6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1269 microversion: 2.1 time: 0.488094 Nov 02 12:24:37.455565 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 593/1178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:36 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1269 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:37.477224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:37.477879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:37.504044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.504570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.505054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.510529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.511284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.511851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.574684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.575184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.575813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.576947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lazy-loading 'fault' on Instance uuid 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:37.629919 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba64d7c5-8893-472d-a48f-306912496103 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 200 len: 1620 microversion: 2.1 time: 0.833659 Nov 02 12:24:37.631283 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 586/1179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:36 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 1620 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:37.670815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:37.671435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:37.684945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.686822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.693904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.695927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.696763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.697381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.944144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:37.957880 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67451abc-9cda-4f1e-8c60-444b55296000 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 200 len: 1314 microversion: 2.1 time: 0.498653 Nov 02 12:24:37.959344 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 594/1180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:37 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:38.000536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:38.001347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:38.013920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:38.015351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:38.019736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:38.021414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:38.026366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:38.030103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:38.068383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:38.127240 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-00b6e37a-81f2-4fe5-8c0b-fd2ab546a923 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 200 len: 1619 microversion: 2.1 time: 0.474918 Nov 02 12:24:38.133744 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 587/1181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:37 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 1619 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:38.362904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1959801893", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8a61e28f-f3a1-4aea-be4b-4d12f85736ed"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:38.496886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:24:39.593718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:39.606848 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e7c528d-8e33-4790-a2be-dddd6c7d5ca7 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 200 len: 1647 microversion: 2.1 time: 1.621796 Nov 02 12:24:39.632151 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 595/1182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:37 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 1647 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:39.637812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:39.645408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:39.666708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:39.667363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:39.667909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:39.668758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:39.669319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:39.670428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:39.790613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:24:39.791063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:24:39.791636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:24:39.792150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:24:39.792819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:24:39.817319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:39.818432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:39.820605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:39.821559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:39.823050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:39.835858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:39.889750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:39.905945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:39.936984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:24:39.944520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:24:40.039741 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3e5b6f5-bf84-47df-b81b-4e5bf92ccc7e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682393 Nov 02 12:24:40.046859 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 588/1183] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:24:40.352757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:40.355838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-50042f68-ab32-4b4b-b3aa-1d9927275695 req-3dc767fe-80bb-4cd9-80f4-3fb98f9bb6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994aa7a2-dbbd-41dc-bdd1-49e5e6318005", "name": "network-vif-deleted", "tag": "3ae95e90-bb11-4958-b325-f9048a140fc5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:40.374201 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c5e8c76-e675-47e2-9df8-898b732678b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1317 microversion: 2.1 time: 0.737062 Nov 02 12:24:40.375464 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 596/1184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:39 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:40.384757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:40.385461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:40.394538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-50042f68-ab32-4b4b-b3aa-1d9927275695 req-3dc767fe-80bb-4cd9-80f4-3fb98f9bb6a1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.396084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.396878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-50042f68-ab32-4b4b-b3aa-1d9927275695 req-3dc767fe-80bb-4cd9-80f4-3fb98f9bb6a1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.397100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.397535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-50042f68-ab32-4b4b-b3aa-1d9927275695 req-3dc767fe-80bb-4cd9-80f4-3fb98f9bb6a1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.397994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.399040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.399707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.400542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.418008 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-50042f68-ab32-4b4b-b3aa-1d9927275695 req-3dc767fe-80bb-4cd9-80f4-3fb98f9bb6a1 service nova] Creating event network-vif-deleted:3ae95e90-bb11-4958-b325-f9048a140fc5 for instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 on n-h1-855650-5 Nov 02 12:24:40.420275 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 HTTP/1.1 Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:40.422276 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:24:40.423771 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8'} Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:40.424633 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:24:40.425932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.427516 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-50042f68-ab32-4b4b-b3aa-1d9927275695 req-3dc767fe-80bb-4cd9-80f4-3fb98f9bb6a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374818 Nov 02 12:24:40.427516 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 589/1185] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:40.429346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:40.430424 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a65c60b3-0b69-47e0-9b72-ab2f1452839e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 404 len: 111 microversion: 2.1 time: 0.052553 Nov 02 12:24:40.431349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 597/1186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:40 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:40.445225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f55cb23c-b90b-4aff-ba98-71f2a28bb5cc tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'create', calling method: .version_select at 0x7f228eb8a430>, body: {"keypair": {"name": "tempest-keypair-1372772041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1bTwi3zxaG73tZEAgoRU+fUcoTuwPF3cZ/PtBgX9JKLjcOw5PExomz1rigBelgk9TZiFOdx0TsHbkzw7eruba+yiO47qJ+TrnYZLjKliBzEgUs7zNew/p7Le/hhve+/Q=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:40.449750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-00e3537f-7d9b-4fdb-b43f-7b4c67fc8f6b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:40.451787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-00e3537f-7d9b-4fdb-b43f-7b4c67fc8f6b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:40.465184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-f55cb23c-b90b-4aff-ba98-71f2a28bb5cc tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Getting quotas for project ec1d3a52fa334a5397b03d71086cfffc. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:40.471925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-f55cb23c-b90b-4aff-ba98-71f2a28bb5cc tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Getting quotas for user ead418d7f3f945b3a3ad7432805fd929 and project ec1d3a52fa334a5397b03d71086cfffc. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:40.506143 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f55cb23c-b90b-4aff-ba98-71f2a28bb5cc tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065843 Nov 02 12:24:40.507291 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 598/1187] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:24:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:40.579139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-00e3537f-7d9b-4fdb-b43f-7b4c67fc8f6b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:40.594164 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-00e3537f-7d9b-4fdb-b43f-7b4c67fc8f6b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1217 microversion: 2.1 time: 0.167705 Nov 02 12:24:40.601383 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 590/1188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:40 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:40.636736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:40.637335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:40.651997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.652736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.653335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.654293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.654908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.655515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.686859 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 HTTP/1.1 Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:40.688446 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:40.690130 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '994aa7a2-dbbd-41dc-bdd1-49e5e6318005'} Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:40.691058 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:40.694578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.697263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:40.697263 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2828b1b7-810a-4800-acf8-715d67865891 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 404 len: 111 microversion: 2.1 time: 0.057061 Nov 02 12:24:40.697263 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 599/1189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:40 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:40.704419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b2429de-0929-4e70-9f8f-3c2cb4e51856 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e73a700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:41.346188 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8b2429de-0929-4e70-9f8f-3c2cb4e51856 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/4acde31a-6a9c-4f9e-ba69-107d2d6c60e2" status: 202 len: 0 microversion: 2.1 time: 0.646614 Nov 02 12:24:41.357917 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 591/1190] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:40 2022] DELETE /compute/v2.1/os-security-groups/4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:41.366412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb676ef6-b8de-4b7a-a591-07abcba8fbee tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228eac8820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:41.372346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:41.405400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:41.407754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:41.432571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.433523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.434212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:41.435935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.436341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.436690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:41.887024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:41.902996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-09141073-d1c5-41dd-980e-5ebeaa0e9423 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1317 microversion: 2.1 time: 0.506514 Nov 02 12:24:41.904278 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 592/1191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:41 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:41.921179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:41.924373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:41.935002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.936642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.938060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:41.942515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.943480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.944280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:42.090520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:42.100760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb7e6b40-c9be-49a0-bc5e-0164a1a62f06 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1269 microversion: 2.1 time: 0.195198 Nov 02 12:24:42.116616 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb676ef6-b8de-4b7a-a591-07abcba8fbee tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/8f6ae074-c68e-4fe6-b0b8-457c83183d96" status: 202 len: 0 microversion: 2.1 time: 0.753185 Nov 02 12:24:42.116616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 600/1192] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:41 2022] DELETE /compute/v2.1/os-security-groups/8f6ae074-c68e-4fe6-b0b8-457c83183d96 => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:42.118395 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 593/1193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:41 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1269 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:42.127147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e47586d1-41c0-48b1-b0da-6246fba96278 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'create', calling method: .version_select at 0x7f228ed09310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-449943052", "description": "tempest-description-1925740115"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:42.543853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8780f945-7db3-4bed-9696-fc656a6cf267 req-5c3e1e4b-b734-4c49-8872-4bb5f6508032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd0838ca-34c6-4d78-8d26-ce67982c4c7b", "tag": "68072907-6547-4e2b-8fb7-0c95d853ce3e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:42.577019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8780f945-7db3-4bed-9696-fc656a6cf267 req-5c3e1e4b-b734-4c49-8872-4bb5f6508032 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:42.577019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8780f945-7db3-4bed-9696-fc656a6cf267 req-5c3e1e4b-b734-4c49-8872-4bb5f6508032 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:42.577019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8780f945-7db3-4bed-9696-fc656a6cf267 req-5c3e1e4b-b734-4c49-8872-4bb5f6508032 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:42.616724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8780f945-7db3-4bed-9696-fc656a6cf267 req-5c3e1e4b-b734-4c49-8872-4bb5f6508032 service nova] Creating event network-changed:68072907-6547-4e2b-8fb7-0c95d853ce3e for instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b on n-h1-855650-5 Nov 02 12:24:42.635619 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8780f945-7db3-4bed-9696-fc656a6cf267 req-5c3e1e4b-b734-4c49-8872-4bb5f6508032 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096095 Nov 02 12:24:42.636974 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 594/1194] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:42.641336 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e47586d1-41c0-48b1-b0da-6246fba96278 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.518456 Nov 02 12:24:42.654293 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 601/1195] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:24:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:42.663019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0e3164f3-6c19-4290-af02-687217286da0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Action: 'update', calling method: .version_select at 0x7f228e9feaf0>, body: {"security_group": {"name": "tempest-sg-hth-1526546842", "description": "tempest-description-hth-1804751030"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:42.815965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f5ae034-ccb3-4ea2-b9d6-d92c40405e8d tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e5e3d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-326849505", "description": "tempest-description-2041053900"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:43.092079 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0e3164f3-6c19-4290-af02-687217286da0 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "PUT /compute/v2.1/os-security-groups/1cb6b972-d50d-4847-a26d-a469b05215bb" status: 200 len: 218 microversion: 2.1 time: 0.435598 Nov 02 12:24:43.093042 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 602/1196] 10.222.0.45 () {60 vars in 1290 bytes} [Wed Nov 2 12:24:42 2022] PUT /compute/v2.1/os-security-groups/1cb6b972-d50d-4847-a26d-a469b05215bb => generated 218 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:43.097783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:43.098942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:43.120999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:43.127151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:43.129294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:43.131810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:43.132822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:43.134424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:43.347343 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f5ae034-ccb3-4ea2-b9d6-d92c40405e8d tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.708606 Nov 02 12:24:43.362193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 595/1197] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:24:42 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:43.370428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-72583de3-1e27-4368-8fcc-68faeb0fb5aa tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e5d3e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:43.471367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:43.487229 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6249c18c-acd2-423f-859c-f547dbddbbc1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1317 microversion: 2.1 time: 0.392208 Nov 02 12:24:43.489933 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 603/1198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:43 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:43.497296 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-72583de3-1e27-4368-8fcc-68faeb0fb5aa tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/1cb6b972-d50d-4847-a26d-a469b05215bb" status: 200 len: 218 microversion: 2.1 time: 0.133654 Nov 02 12:24:43.498037 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 596/1199] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:24:43 2022] GET /compute/v2.1/os-security-groups/1cb6b972-d50d-4847-a26d-a469b05215bb => generated 218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:43.504535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a37eea81-e885-4548-b972-f4a81497bd14 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e57c5e0>, body: {"security_group_rule": {"parent_group_id": "f051948c-f770-405a-9b9a-1aaf21509758", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:43.510607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:43.512821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:43.531398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:43.533178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:43.533930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:43.545043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:43.548100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:43.550774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:44.018468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:44.051240 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9da350ba-4b85-4cd0-804a-611701df1c9d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.558566 Nov 02 12:24:44.054300 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 604/1200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:43 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:44.065364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d8f9d305-8b00-40af-853e-86f4eee35470 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228ea304c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:44.610972 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a37eea81-e885-4548-b972-f4a81497bd14 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.110471 Nov 02 12:24:44.612353 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 597/1201] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:24:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:44.618040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c8d35c12-192d-4014-b972-dfbe2393adbb req-936a1cf3-8894-4c74-9d5f-3ff9417317f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f4ff71-fa75-4ac9-9661-ebb7bbc3995f", "tag": "9d585ce4-7020-4e3d-b408-02a183917027"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:44.646849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c8d35c12-192d-4014-b972-dfbe2393adbb req-936a1cf3-8894-4c74-9d5f-3ff9417317f2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:44.647370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c8d35c12-192d-4014-b972-dfbe2393adbb req-936a1cf3-8894-4c74-9d5f-3ff9417317f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:44.651620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c8d35c12-192d-4014-b972-dfbe2393adbb req-936a1cf3-8894-4c74-9d5f-3ff9417317f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:44.669810 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c8d35c12-192d-4014-b972-dfbe2393adbb req-936a1cf3-8894-4c74-9d5f-3ff9417317f2 service nova] Creating event network-changed:9d585ce4-7020-4e3d-b408-02a183917027 for instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f on n-h1-855650-5 Nov 02 12:24:44.676304 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c8d35c12-192d-4014-b972-dfbe2393adbb req-936a1cf3-8894-4c74-9d5f-3ff9417317f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062228 Nov 02 12:24:44.678148 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 598/1202] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:44.686626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-757958028", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:44.776780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] validate_networks() for [('4f15fe59-ad56-4fe4-bb95-1f56ed9444ee', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:24:44.789270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d8f9d305-8b00-40af-853e-86f4eee35470 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/1cb6b972-d50d-4847-a26d-a469b05215bb" status: 202 len: 0 microversion: 2.1 time: 0.733579 Nov 02 12:24:44.793051 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 605/1203] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:44 2022] DELETE /compute/v2.1/os-security-groups/1cb6b972-d50d-4847-a26d-a469b05215bb => generated 0 bytes in 735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:44.799114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:44.799740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:44.817497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:44.817497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:44.817497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:44.817497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:44.817897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:44.817897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.028850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:45.050183 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9e8416d-cadf-45b1-af02-21edc54bdb33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1317 microversion: 2.1 time: 0.256904 Nov 02 12:24:45.058064 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 606/1204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:44 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:45.063815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03772350-6e2e-4853-ab37-bade453709a3 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228ea1caf0>, body: {"security_group_rule": {"parent_group_id": "f051948c-f770-405a-9b9a-1aaf21509758", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:45.163427 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-03772350-6e2e-4853-ab37-bade453709a3 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] HTTP exception thrown: This rule already exists in group f051948c-f770-405a-9b9a-1aaf21509758 Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03772350-6e2e-4853-ab37-bade453709a3 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Request method failure captured: Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 138 Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmGKS9WqR68QFFTyaK3T4wZ0arCjMCWPhcRYuafGpHZ3Q9RfxM9f405Ym2Nzlp_KR1K24czIjvJLoM6p0Jfb9-9TybOW8swbqcxGj5UYxyRIMr12l5T_v7Wut59bbKLSdogAxy-P0n7H0bsVhsSg3vfwyjVLhkDAKPCSwhUgSDHPSz4 Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:45.164956 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: e98209a44527492fa46c9650d6f72a14 Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: {"security_group_rule": {"parent_group_id": "f051948c-f770-405a-9b9a-1aaf21509758", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 12:24:45.166709 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: exception: This rule already exists in group f051948c-f770-405a-9b9a-1aaf21509758 Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f051948c-f770-405a-9b9a-1aaf21509758', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f051948c-f770-405a-9b9a-1aaf21509758 Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:45.167560 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f051948c-f770-405a-9b9a-1aaf21509758 Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f051948c-f770-405a-9b9a-1aaf21509758 Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.168822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03772350-6e2e-4853-ab37-bade453709a3 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Returning 400 to user: This rule already exists in group f051948c-f770-405a-9b9a-1aaf21509758 {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:45.169755 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-03772350-6e2e-4853-ab37-bade453709a3 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.107275 Nov 02 12:24:45.170890 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 607/1205] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:24:45 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:45.175753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:45.177555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:45.184819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.185326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.185772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.186653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.187125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.187680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.208755 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 HTTP/1.1 Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:45.210315 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.211701 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '994aa7a2-dbbd-41dc-bdd1-49e5e6318005'} Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:45.212502 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.213728 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.216349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:45.216349 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c9e59f99-d017-4fb7-9f0d-b5d18fc79e3d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 404 len: 111 microversion: 2.1 time: 0.040719 Nov 02 12:24:45.216349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 608/1206] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:24:45 2022] DELETE /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:45.221659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a49c7cb9-daa5-4e0d-9216-41c616e27e61 req-1e162fe7-250c-4636-a61e-4325cdf297f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02bc114f-5d4a-4561-9ae3-8f7a44456697", "tag": "49237042-1850-4e28-9305-32b5a2880647"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:45.238572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a49c7cb9-daa5-4e0d-9216-41c616e27e61 req-1e162fe7-250c-4636-a61e-4325cdf297f7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.239709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a49c7cb9-daa5-4e0d-9216-41c616e27e61 req-1e162fe7-250c-4636-a61e-4325cdf297f7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.240162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a49c7cb9-daa5-4e0d-9216-41c616e27e61 req-1e162fe7-250c-4636-a61e-4325cdf297f7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.254038 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a49c7cb9-daa5-4e0d-9216-41c616e27e61 req-1e162fe7-250c-4636-a61e-4325cdf297f7 service nova] Creating event network-changed:49237042-1850-4e28-9305-32b5a2880647 for instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 on n-h2-855650-5 Nov 02 12:24:45.260275 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a49c7cb9-daa5-4e0d-9216-41c616e27e61 req-1e162fe7-250c-4636-a61e-4325cdf297f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045109 Nov 02 12:24:45.260886 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 609/1207] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:45.266117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:45.266834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:45.273656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.274200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.274649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.275375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.275838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.276275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.384884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:24:45.385535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:24:45.386148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:24:45.386805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:24:45.387286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:24:45.397365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.398318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.399109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.400145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.400840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.401525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.421811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Getting quotas for project ec1d3a52fa334a5397b03d71086cfffc. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:45.428131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Getting quotas for user ead418d7f3f945b3a3ad7432805fd929 and project ec1d3a52fa334a5397b03d71086cfffc. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:45.450267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:45.454609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:24:45.457299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:24:45.458938 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-90c83d73-81ca-4ce3-90aa-509a572241aa tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.196855 Nov 02 12:24:45.469993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 610/1208] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:45 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:45.476248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f885ae2-bb51-4d51-8975-b4b5f8c47319 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Calling method '.version_select at 0x7f228eb90dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:45.508048 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-81659701-b4a4-4501-bec3-b56c21ac12e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.827947 Nov 02 12:24:45.509949 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 599/1209] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:24:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:24:45.515846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:45.516724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 994aa7a2-dbbd-41dc-bdd1-49e5e6318005] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:45.525676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.526468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.527145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.528849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:45.529853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:45.530584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:45.552348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:45.554436 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 HTTP/1.1 Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:45.556328 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.558064 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '994aa7a2-dbbd-41dc-bdd1-49e5e6318005'} Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:45.558965 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. Nov 02 12:24:45.560252 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.563505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Instance 994aa7a2-dbbd-41dc-bdd1-49e5e6318005 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:45.564603 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c1327460-b225-4d55-ba67-9c443f65d879 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005" status: 404 len: 111 microversion: 2.1 time: 0.053339 Nov 02 12:24:45.568858 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 600/1210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:45 2022] GET /compute/v2.1/servers/994aa7a2-dbbd-41dc-bdd1-49e5e6318005 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:45.575850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-744d93f7-5c87-4e47-9f8c-94887e9ef1e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:45.577585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-744d93f7-5c87-4e47-9f8c-94887e9ef1e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:45.732083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-744d93f7-5c87-4e47-9f8c-94887e9ef1e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:45.743923 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-744d93f7-5c87-4e47-9f8c-94887e9ef1e9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1224 microversion: 2.1 time: 0.172228 Nov 02 12:24:45.745078 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 601/1211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:45 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1224 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:45.750385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43065a02-bf99-4866-a6aa-6968ff691018 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e587ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:45.824297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-43065a02-bf99-4866-a6aa-6968ff691018 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:45.825666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-43065a02-bf99-4866-a6aa-6968ff691018 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:24:45.826914 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-43065a02-bf99-4866-a6aa-6968ff691018 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 does not exist Nov 02 12:24:45.826914 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-edd82870-bf3b-483d-87b9-5c695337982b'] Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43065a02-bf99-4866-a6aa-6968ff691018 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/8f6ae074-c68e-4fe6-b0b8-457c83183d96 HTTP/1.1 Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:45.833557 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 does not exist Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-edd82870-bf3b-483d-87b9-5c695337982b'] Nov 02 12:24:45.835040 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '8f6ae074-c68e-4fe6-b0b8-457c83183d96'} Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.835959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 does not exist Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-edd82870-bf3b-483d-87b9-5c695337982b'] Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:24:45.837791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 does not exist Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-edd82870-bf3b-483d-87b9-5c695337982b'] Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 does not exist Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-edd82870-bf3b-483d-87b9-5c695337982b'] Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.839479 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 does not exist Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-edd82870-bf3b-483d-87b9-5c695337982b'] Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43065a02-bf99-4866-a6aa-6968ff691018 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group 8f6ae074-c68e-4fe6-b0b8-457c83183d96 does not exist Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-edd82870-bf3b-483d-87b9-5c695337982b'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43065a02-bf99-4866-a6aa-6968ff691018 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/8f6ae074-c68e-4fe6-b0b8-457c83183d96" status: 404 len: 194 microversion: 2.1 time: 0.088904 Nov 02 12:24:45.842350 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 602/1212] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:45 2022] DELETE /compute/v2.1/os-security-groups/8f6ae074-c68e-4fe6-b0b8-457c83183d96 => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:45.846426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-72b5dffd-4692-4a06-8539-12be34d6d153 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e5814c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:45.953013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-72b5dffd-4692-4a06-8539-12be34d6d153 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:45.954359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-72b5dffd-4692-4a06-8539-12be34d6d153 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:24:45.955525 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-72b5dffd-4692-4a06-8539-12be34d6d153 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 does not exist Nov 02 12:24:45.955525 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-c3e51e70-3755-4dbe-b01b-2e7efaebb0e2'] Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-72b5dffd-4692-4a06-8539-12be34d6d153 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 HTTP/1.1 Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:45.958682 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 does not exist Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-c3e51e70-3755-4dbe-b01b-2e7efaebb0e2'] Nov 02 12:24:45.960129 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4acde31a-6a9c-4f9e-ba69-107d2d6c60e2'} Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.960952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 does not exist Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3e51e70-3755-4dbe-b01b-2e7efaebb0e2'] Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:24:45.963000 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 does not exist Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3e51e70-3755-4dbe-b01b-2e7efaebb0e2'] Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 does not exist Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3e51e70-3755-4dbe-b01b-2e7efaebb0e2'] Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.965360 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 does not exist Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3e51e70-3755-4dbe-b01b-2e7efaebb0e2'] Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-72b5dffd-4692-4a06-8539-12be34d6d153 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group 4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 does not exist Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-c3e51e70-3755-4dbe-b01b-2e7efaebb0e2'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-72b5dffd-4692-4a06-8539-12be34d6d153 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/4acde31a-6a9c-4f9e-ba69-107d2d6c60e2" status: 404 len: 194 microversion: 2.1 time: 0.118567 Nov 02 12:24:45.968495 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 603/1213] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:45 2022] DELETE /compute/v2.1/os-security-groups/4acde31a-6a9c-4f9e-ba69-107d2d6c60e2 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:24:45.989943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ddecdd45-1933-4fc2-b7e3-b5eaae4d0b55 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e57cee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:46.035310 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f885ae2-bb51-4d51-8975-b4b5f8c47319 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-group-rules/0df579f5-a1d0-437c-a8a3-7132c3cd30e9" status: 202 len: 0 microversion: 2.1 time: 0.574718 Nov 02 12:24:46.036543 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 611/1214] 10.222.0.45 () {58 vars in 1287 bytes} [Wed Nov 2 12:24:45 2022] DELETE /compute/v2.1/os-security-group-rules/0df579f5-a1d0-437c-a8a3-7132c3cd30e9 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:46.051242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-ddecdd45-1933-4fc2-b7e3-b5eaae4d0b55 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:46.053217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-ddecdd45-1933-4fc2-b7e3-b5eaae4d0b55 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:24:46.054043 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-ddecdd45-1933-4fc2-b7e3-b5eaae4d0b55 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:24:46.054043 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-87a8bd7e-81d4-4841-9cb0-0e52a845019c'] Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ddecdd45-1933-4fc2-b7e3-b5eaae4d0b55 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/449cfa3e-aac8-4d66-aa87-1304e5566e47 HTTP/1.1 Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:46.058190 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-87a8bd7e-81d4-4841-9cb0-0e52a845019c'] Nov 02 12:24:46.059617 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '449cfa3e-aac8-4d66-aa87-1304e5566e47'} Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.060507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87a8bd7e-81d4-4841-9cb0-0e52a845019c'] Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:24:46.064420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87a8bd7e-81d4-4841-9cb0-0e52a845019c'] Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87a8bd7e-81d4-4841-9cb0-0e52a845019c'] Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.068605 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87a8bd7e-81d4-4841-9cb0-0e52a845019c'] Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ddecdd45-1933-4fc2-b7e3-b5eaae4d0b55 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group 449cfa3e-aac8-4d66-aa87-1304e5566e47 does not exist Nov 02 12:24:46.071751 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-87a8bd7e-81d4-4841-9cb0-0e52a845019c'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:46.073697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69306fc5-50a4-4859-b006-abdd89576d1f tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228ea4d280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1305711919", "description": "tempest-description-1382184908"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:46.073926 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ddecdd45-1933-4fc2-b7e3-b5eaae4d0b55 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/449cfa3e-aac8-4d66-aa87-1304e5566e47" status: 404 len: 194 microversion: 2.1 time: 0.076304 Nov 02 12:24:46.073926 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 604/1215] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:45 2022] DELETE /compute/v2.1/os-security-groups/449cfa3e-aac8-4d66-aa87-1304e5566e47 => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:46.080489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d35ae6b5-fc43-4e12-a3bb-6591ef6c6819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228eedbdc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:46.155935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-d35ae6b5-fc43-4e12-a3bb-6591ef6c6819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:46.158844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-d35ae6b5-fc43-4e12-a3bb-6591ef6c6819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:24:46.159414 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d35ae6b5-fc43-4e12-a3bb-6591ef6c6819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:24:46.159414 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-51d8494c-d0c2-4367-b900-c3aadde9a65c'] Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d35ae6b5-fc43-4e12-a3bb-6591ef6c6819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/be99ced5-98d5-4c59-a6f0-b53b11ffe007 HTTP/1.1 Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:46.164272 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-51d8494c-d0c2-4367-b900-c3aadde9a65c'] Nov 02 12:24:46.166009 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'be99ced5-98d5-4c59-a6f0-b53b11ffe007'} Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.167618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51d8494c-d0c2-4367-b900-c3aadde9a65c'] Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:24:46.169627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51d8494c-d0c2-4367-b900-c3aadde9a65c'] Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51d8494c-d0c2-4367-b900-c3aadde9a65c'] Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.172153 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51d8494c-d0c2-4367-b900-c3aadde9a65c'] Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d35ae6b5-fc43-4e12-a3bb-6591ef6c6819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group be99ced5-98d5-4c59-a6f0-b53b11ffe007 does not exist Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-51d8494c-d0c2-4367-b900-c3aadde9a65c'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d35ae6b5-fc43-4e12-a3bb-6591ef6c6819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/be99ced5-98d5-4c59-a6f0-b53b11ffe007" status: 404 len: 194 microversion: 2.1 time: 0.096843 Nov 02 12:24:46.174085 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 605/1216] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:46 2022] DELETE /compute/v2.1/os-security-groups/be99ced5-98d5-4c59-a6f0-b53b11ffe007 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:46.177368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:46.178404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:46.185803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:46.186356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:46.186808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:46.187531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:46.188059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:46.188655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:46.593670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:46.615012 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-943f1fee-c848-496e-b4bf-ff363a5cc678 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1317 microversion: 2.1 time: 0.446312 Nov 02 12:24:46.616652 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 606/1217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:46 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:46.633185 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69306fc5-50a4-4859-b006-abdd89576d1f tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.590448 Nov 02 12:24:46.633949 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 612/1218] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:24:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:46.638175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dac190ed-a299-40b2-b2b2-65905c20729d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e581280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:46.643370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:46.644153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:46.652583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:46.653100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:46.654543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:46.655310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:46.655741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:46.656333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:46.680340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-dac190ed-a299-40b2-b2b2-65905c20729d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:46.681104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-dac190ed-a299-40b2-b2b2-65905c20729d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:24:46.681578 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-dac190ed-a299-40b2-b2b2-65905c20729d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:24:46.681578 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-927eb04b-bc46-499d-a528-405ab1853dd5'] Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dac190ed-a299-40b2-b2b2-65905c20729d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b HTTP/1.1 Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:46.685222 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-927eb04b-bc46-499d-a528-405ab1853dd5'] Nov 02 12:24:46.686805 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'd1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b'} Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.687800 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-927eb04b-bc46-499d-a528-405ab1853dd5'] Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:24:46.690193 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-927eb04b-bc46-499d-a528-405ab1853dd5'] Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-927eb04b-bc46-499d-a528-405ab1853dd5'] Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.692674 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-927eb04b-bc46-499d-a528-405ab1853dd5'] Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dac190ed-a299-40b2-b2b2-65905c20729d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b does not exist Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-927eb04b-bc46-499d-a528-405ab1853dd5'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dac190ed-a299-40b2-b2b2-65905c20729d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b" status: 404 len: 194 microversion: 2.1 time: 0.069196 Nov 02 12:24:46.694762 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 607/1219] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:46 2022] DELETE /compute/v2.1/os-security-groups/d1a8bd24-3ff1-425b-8f4c-6dea97c3dc2b => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:46.696995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80a96518-ef79-4bcb-8a6e-4f957b94b9ff tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e635550>, body: {"security_group_rule": {"parent_group_id": "a767af2d-fd87-423a-8e8b-99e9c0693980", "ip_protocol": "tcp", "from_port": 1732123349, "to_port": 22}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:46.796260 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-80a96518-ef79-4bcb-8a6e-4f957b94b9ff tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] HTTP exception thrown: Invalid port range 1732123349:22. Former value cannot be greater than the later Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80a96518-ef79-4bcb-8a6e-4f957b94b9ff tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Request method failure captured: Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 146 Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmGKS9WqR68QFFTyaK3T4wZ0arCjMCWPhcRYuafGpHZ3Q9RfxM9f405Ym2Nzlp_KR1K24czIjvJLoM6p0Jfb9-9TybOW8swbqcxGj5UYxyRIMr12l5T_v7Wut59bbKLSdogAxy-P0n7H0bsVhsSg3vfwyjVLhkDAKPCSwhUgSDHPSz4 Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:46.799945 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e98209a44527492fa46c9650d6f72a14 Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: {"security_group_rule": {"parent_group_id": "a767af2d-fd87-423a-8e8b-99e9c0693980", "ip_protocol": "tcp", "from_port": 1732123349, "to_port": 22}} Nov 02 12:24:46.802169 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid port range 1732123349:22. Former value cannot be greater than the later Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a767af2d-fd87-423a-8e8b-99e9c0693980', 'ip_protocol': 'tcp', 'from_port': 1732123349, 'to_port': 22}}} Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1732123349:22. Former value cannot be greater than the later Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.803089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1732123349:22. Former value cannot be greater than the later Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1732123349:22. Former value cannot be greater than the later Nov 02 12:24:46.808989 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.810747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80a96518-ef79-4bcb-8a6e-4f957b94b9ff tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Returning 400 to user: Invalid port range 1732123349:22. Former value cannot be greater than the later {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:46.810747 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80a96518-ef79-4bcb-8a6e-4f957b94b9ff tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.111458 Nov 02 12:24:46.810747 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 608/1220] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:24:46 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:46.812173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5204878c-9930-48f1-b4ca-b2287eba4819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e635dc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:46.844339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:46.844892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-5204878c-9930-48f1-b4ca-b2287eba4819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:46.845715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-5204878c-9930-48f1-b4ca-b2287eba4819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Neutron security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:24:46.846477 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5204878c-9930-48f1-b4ca-b2287eba4819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:24:46.846477 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-3ffa31e1-be87-4f50-ba3f-3778b72eee24'] Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5204878c-9930-48f1-b4ca-b2287eba4819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e HTTP/1.1 Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:46.848933 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-3ffa31e1-be87-4f50-ba3f-3778b72eee24'] Nov 02 12:24:46.850633 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9ef8614e-5b0e-4087-b675-92afe7b69a5e'} Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.851629 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ffa31e1-be87-4f50-ba3f-3778b72eee24'] Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:24:46.853246 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ffa31e1-be87-4f50-ba3f-3778b72eee24'] Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ffa31e1-be87-4f50-ba3f-3778b72eee24'] Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.854705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ffa31e1-be87-4f50-ba3f-3778b72eee24'] Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5204878c-9930-48f1-b4ca-b2287eba4819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Security group 9ef8614e-5b0e-4087-b675-92afe7b69a5e does not exist Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-3ffa31e1-be87-4f50-ba3f-3778b72eee24'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:46.856301 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5204878c-9930-48f1-b4ca-b2287eba4819 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e" status: 404 len: 194 microversion: 2.1 time: 0.046438 Nov 02 12:24:46.857152 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94733ef2-a3ab-4cce-9a82-e4d25a7a5479 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.217223 Nov 02 12:24:46.857618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 609/1221] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:46 2022] DELETE /compute/v2.1/os-security-groups/9ef8614e-5b0e-4087-b675-92afe7b69a5e => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:46.862238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:46.862873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:46.868634 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 613/1222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:46 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:46.870345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:46.870831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:46.871264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:46.871974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:46.872405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:46.872823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:46.874528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23f7212a-55f3-42b1-b7f5-baabe2bb9744 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228eaa8ca0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-889929737", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:46.876550 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-23f7212a-55f3-42b1-b7f5-baabe2bb9744 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] HTTP exception thrown: Security group id should be uuid Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23f7212a-55f3-42b1-b7f5-baabe2bb9744 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Request method failure captured: Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 130 Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmGKS9WqR68QFFTyaK3T4wZ0arCjMCWPhcRYuafGpHZ3Q9RfxM9f405Ym2Nzlp_KR1K24czIjvJLoM6p0Jfb9-9TybOW8swbqcxGj5UYxyRIMr12l5T_v7Wut59bbKLSdogAxy-P0n7H0bsVhsSg3vfwyjVLhkDAKPCSwhUgSDHPSz4 Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:46.878289 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: e98209a44527492fa46c9650d6f72a14 Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-889929737", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:24:46.879998 n-d-855650-5 devstack@n-api.service[120723]: exception: Security group id should be uuid Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-889929737', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:46.881028 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:46.882619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23f7212a-55f3-42b1-b7f5-baabe2bb9744 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Returning 400 to user: Security group id should be uuid {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:46.884575 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-23f7212a-55f3-42b1-b7f5-baabe2bb9744 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.012999 Nov 02 12:24:46.885504 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 614/1223] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:24:46 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:46.893880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:46.894493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:46.908024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:46.908705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:46.909159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:46.909987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:46.910459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:46.911406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:46.941503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:24:46.949369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:46.957876 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6307646-3bf1-4cbc-8053-c511eb0ececa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1276 microversion: 2.1 time: 0.099157 Nov 02 12:24:46.958435 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 610/1224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:46 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:46.963400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1912c3b0-047b-465f-8653-2c845ce8e8f1 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e581160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1014060013", "description": "tempest-description-1257545024"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:47.031736 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-996ea6a7-fd7f-4ed4-93ba-4594c80419f3 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 204 len: 0 microversion: 2.1 time: 0.144431 Nov 02 12:24:47.034567 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 615/1225] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:24:46 2022] DELETE /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:24:47.045181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:47.047085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:47.056907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:47.057407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:47.057862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:47.058614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:47.059359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:47.060003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:47.147364 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1912c3b0-047b-465f-8653-2c845ce8e8f1 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.187568 Nov 02 12:24:47.147957 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 611/1226] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:24:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:47.168396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-547c8543-b8a1-4afd-8666-b79f2a5f184b tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e581550>, body: {"security_group_rule": {"parent_group_id": "a0a36a31-397c-4fd7-967c-431cb4b24f29", "ip_protocol": "tempest-999-1140542962", "from_port": 22, "to_port": 22}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:47.249887 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-547c8543-b8a1-4afd-8666-b79f2a5f184b tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] HTTP exception thrown: Invalid IP protocol tempest-999-1140542962. Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-547c8543-b8a1-4afd-8666-b79f2a5f184b tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Request method failure captured: Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 157 Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmGKS9WqR68QFFTyaK3T4wZ0arCjMCWPhcRYuafGpHZ3Q9RfxM9f405Ym2Nzlp_KR1K24czIjvJLoM6p0Jfb9-9TybOW8swbqcxGj5UYxyRIMr12l5T_v7Wut59bbKLSdogAxy-P0n7H0bsVhsSg3vfwyjVLhkDAKPCSwhUgSDHPSz4 Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:47.251500 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e98209a44527492fa46c9650d6f72a14 Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: {"security_group_rule": {"parent_group_id": "a0a36a31-397c-4fd7-967c-431cb4b24f29", "ip_protocol": "tempest-999-1140542962", "from_port": 22, "to_port": 22}} Nov 02 12:24:47.253152 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid IP protocol tempest-999-1140542962. Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a0a36a31-397c-4fd7-967c-431cb4b24f29', 'ip_protocol': 'tempest-999-1140542962', 'from_port': 22, 'to_port': 22}}} Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1140542962. Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.254052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1140542962. Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1140542962. Nov 02 12:24:47.255484 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.258021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-547c8543-b8a1-4afd-8666-b79f2a5f184b tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Returning 400 to user: Invalid IP protocol tempest-999-1140542962. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:47.258021 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-547c8543-b8a1-4afd-8666-b79f2a5f184b tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.088779 Nov 02 12:24:47.258021 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 612/1227] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:24:47 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:47.262786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-026c0853-4483-4fe7-ac59-9cadfb3f0600 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e5e3700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-950545192", "description": "tempest-description-347328762"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:47.288463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:47.296773 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4aa26a77-945f-46cf-a9ab-0ef41e8355b4 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1649 microversion: 2.1 time: 0.257204 Nov 02 12:24:47.297349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 616/1228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:47 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1649 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:47.421995 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-026c0853-4483-4fe7-ac59-9cadfb3f0600 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.162712 Nov 02 12:24:47.423328 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 613/1229] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:24:47 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:47.435890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba45ed24-6735-49f7-b65b-6a0e269730cf tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228ea681f0>, body: {"security_group_rule": {"parent_group_id": "b5dec220-8f1e-455f-94f4-701b32534fe1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:47.485253 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-ba45ed24-6735-49f7-b65b-6a0e269730cf tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba45ed24-6735-49f7-b65b-6a0e269730cf tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Request method failure captured: Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 138 Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmGKS9WqR68QFFTyaK3T4wZ0arCjMCWPhcRYuafGpHZ3Q9RfxM9f405Ym2Nzlp_KR1K24czIjvJLoM6p0Jfb9-9TybOW8swbqcxGj5UYxyRIMr12l5T_v7Wut59bbKLSdogAxy-P0n7H0bsVhsSg3vfwyjVLhkDAKPCSwhUgSDHPSz4 Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:47.487021 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: e98209a44527492fa46c9650d6f72a14 Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: {"security_group_rule": {"parent_group_id": "b5dec220-8f1e-455f-94f4-701b32534fe1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 02 12:24:47.488672 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b5dec220-8f1e-455f-94f4-701b32534fe1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.489538 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:24:47.492402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.493842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba45ed24-6735-49f7-b65b-6a0e269730cf tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:47.493842 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba45ed24-6735-49f7-b65b-6a0e269730cf tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.056717 Nov 02 12:24:47.493842 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 617/1230] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:24:47 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:47.498250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e252890-42a9-4f8d-b721-498c7744168b tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e66c940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1088203965", "description": "tempest-description-1269580064"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:47.643539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:47.644226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:47.652041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:47.652498 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0e252890-42a9-4f8d-b721-498c7744168b tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.157971 Nov 02 12:24:47.652633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:47.652982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:47.653375 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 614/1231] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:24:47 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:47.658607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:47.659229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:47.659546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:47.666424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15d6e8f9-ca73-48e6-a173-6872f8b4bf2e tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e5e34c0>, body: {"security_group_rule": {"parent_group_id": "37ea3896-63ca-4ef0-8f5b-1b22f6316c62", "ip_protocol": "tcp", "from_port": 22, "to_port": 1539850432}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:47.756645 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-15d6e8f9-ca73-48e6-a173-6872f8b4bf2e tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] HTTP exception thrown: Invalid port range 22:1539850432. Valid TCP ports should be between 1-65535 Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15d6e8f9-ca73-48e6-a173-6872f8b4bf2e tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Request method failure captured: Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 146 Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmGKS9WqR68QFFTyaK3T4wZ0arCjMCWPhcRYuafGpHZ3Q9RfxM9f405Ym2Nzlp_KR1K24czIjvJLoM6p0Jfb9-9TybOW8swbqcxGj5UYxyRIMr12l5T_v7Wut59bbKLSdogAxy-P0n7H0bsVhsSg3vfwyjVLhkDAKPCSwhUgSDHPSz4 Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:47.758483 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e98209a44527492fa46c9650d6f72a14 Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: {"security_group_rule": {"parent_group_id": "37ea3896-63ca-4ef0-8f5b-1b22f6316c62", "ip_protocol": "tcp", "from_port": 22, "to_port": 1539850432}} Nov 02 12:24:47.760250 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid port range 22:1539850432. Valid TCP ports should be between 1-65535 Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'security_group_rule': {'parent_group_id': '37ea3896-63ca-4ef0-8f5b-1b22f6316c62', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1539850432}}} Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1539850432. Valid TCP ports should be between 1-65535 Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.761575 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1539850432. Valid TCP ports should be between 1-65535 Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1539850432. Valid TCP ports should be between 1-65535 Nov 02 12:24:47.763666 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.765993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15d6e8f9-ca73-48e6-a173-6872f8b4bf2e tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Returning 400 to user: Invalid port range 22:1539850432. Valid TCP ports should be between 1-65535 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:47.765993 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15d6e8f9-ca73-48e6-a173-6872f8b4bf2e tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.097797 Nov 02 12:24:47.765993 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 615/1232] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:24:47 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:24:47.770151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2fe01270-2a00-4175-9b89-2e408a06cec0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Action: 'create', calling method: .version_select at 0x7f228e6e19d0>, body: {"security_group_rule": {"parent_group_id": "5c9deb98-b0c5-4767-ac65-07b261b6df72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:47.806754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-2fe01270-2a00-4175-9b89-2e408a06cec0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:47.807354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-2fe01270-2a00-4175-9b89-2e408a06cec0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Neutron security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:24:47.807857 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-2fe01270-2a00-4175-9b89-2e408a06cec0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] HTTP exception thrown: Security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 does not exist Nov 02 12:24:47.807857 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-7ea90391-dd6d-481e-830b-0169de2a3521'] Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2fe01270-2a00-4175-9b89-2e408a06cec0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Request method failure captured: Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 138 Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmGKS9WqR68QFFTyaK3T4wZ0arCjMCWPhcRYuafGpHZ3Q9RfxM9f405Ym2Nzlp_KR1K24czIjvJLoM6p0Jfb9-9TybOW8swbqcxGj5UYxyRIMr12l5T_v7Wut59bbKLSdogAxy-P0n7H0bsVhsSg3vfwyjVLhkDAKPCSwhUgSDHPSz4 Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:47.809708 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e98209a44527492fa46c9650d6f72a14 Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: {"security_group_rule": {"parent_group_id": "5c9deb98-b0c5-4767-ac65-07b261b6df72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 12:24:47.811399 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 does not exist Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-7ea90391-dd6d-481e-830b-0169de2a3521'] Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5c9deb98-b0c5-4767-ac65-07b261b6df72', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:47.816431 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 does not exist Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ea90391-dd6d-481e-830b-0169de2a3521'] Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 02 12:24:47.818463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 does not exist Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ea90391-dd6d-481e-830b-0169de2a3521'] Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 does not exist Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ea90391-dd6d-481e-830b-0169de2a3521'] Nov 02 12:24:47.819914 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 does not exist Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ea90391-dd6d-481e-830b-0169de2a3521'] Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2fe01270-2a00-4175-9b89-2e408a06cec0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Returning 404 to user: Security group 5c9deb98-b0c5-4767-ac65-07b261b6df72 does not exist Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-7ea90391-dd6d-481e-830b-0169de2a3521'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:47.821261 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2fe01270-2a00-4175-9b89-2e408a06cec0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.044947 Nov 02 12:24:47.822293 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 616/1233] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:24:47 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:24:47.822293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d05a8fd2-db15-4666-ad8a-d1226a89e405 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Calling method '.version_select at 0x7f228e6e1d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:47.847097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:47.850865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-d05a8fd2-db15-4666-ad8a-d1226a89e405 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:24:47.851682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-d05a8fd2-db15-4666-ad8a-d1226a89e405 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Neutron security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 not found {{(pid=120722) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 02 12:24:47.852340 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d05a8fd2-db15-4666-ad8a-d1226a89e405 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] HTTP exception thrown: Security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 does not exist Nov 02 12:24:47.852340 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-c6f2a4ff-f720-4c03-8061-6473ff220eb0'] Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d05a8fd2-db15-4666-ad8a-d1226a89e405 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Request method failure captured: Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-group-rules/648d0c1f-557a-46d4-846d-5d6a69a1c332 HTTP/1.1 Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmGKS9WqR68QFFTyaK3T4wZ0arCjMCWPhcRYuafGpHZ3Q9RfxM9f405Ym2Nzlp_KR1K24czIjvJLoM6p0Jfb9-9TybOW8swbqcxGj5UYxyRIMr12l5T_v7Wut59bbKLSdogAxy-P0n7H0bsVhsSg3vfwyjVLhkDAKPCSwhUgSDHPSz4 Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:24:47.854282 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d73e7b1a3d5421e97b48116e9e6ae23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0d73e7b1a3d5421e97b48116e9e6ae23 Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886 Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e98209a44527492fa46c9650d6f72a14 Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-653441886-project Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 does not exist Nov 02 12:24:47.855961 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-c6f2a4ff-f720-4c03-8061-6473ff220eb0'] Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '648d0c1f-557a-46d4-846d-5d6a69a1c332'} Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.856814 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 does not exist Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6f2a4ff-f720-4c03-8061-6473ff220eb0'] Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 02 12:24:47.858062 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 does not exist Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6f2a4ff-f720-4c03-8061-6473ff220eb0'] Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 does not exist Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6f2a4ff-f720-4c03-8061-6473ff220eb0'] Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.859279 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 does not exist Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6f2a4ff-f720-4c03-8061-6473ff220eb0'] Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d05a8fd2-db15-4666-ad8a-d1226a89e405 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Returning 404 to user: Security group rule 648d0c1f-557a-46d4-846d-5d6a69a1c332 does not exist Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-c6f2a4ff-f720-4c03-8061-6473ff220eb0'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:47.860579 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d05a8fd2-db15-4666-ad8a-d1226a89e405 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-group-rules/648d0c1f-557a-46d4-846d-5d6a69a1c332" status: 404 len: 199 microversion: 2.1 time: 0.038934 Nov 02 12:24:47.861470 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c550d89-b8a4-4177-a8d9-69921e37293c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1317 microversion: 2.1 time: 0.217509 Nov 02 12:24:47.861576 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 617/1234] 10.222.0.45 () {58 vars in 1287 bytes} [Wed Nov 2 12:24:47 2022] DELETE /compute/v2.1/os-security-group-rules/648d0c1f-557a-46d4-846d-5d6a69a1c332 => generated 199 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:47.861667 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 618/1235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:47 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:47.866885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1b6417c-94be-4492-ba3e-f3789254abfc tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Calling method '.version_select at 0x7f228e5e3430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:47.876990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:47.877613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:47.886653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:47.887510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:47.887979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:47.888701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:47.889356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:47.889801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:48.096510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:48.104207 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-707434be-1f11-444d-8cbf-b55776751fd8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.231438 Nov 02 12:24:48.105342 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 619/1236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:47 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:48.111510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:48.112123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:48.119410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:48.121327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.121815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.122286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:48.122987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.123428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.124052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:48.136812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1b6417c-94be-4492-ba3e-f3789254abfc tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/37ea3896-63ca-4ef0-8f5b-1b22f6316c62" status: 202 len: 0 microversion: 2.1 time: 0.274318 Nov 02 12:24:48.137554 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 618/1237] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:47 2022] DELETE /compute/v2.1/os-security-groups/37ea3896-63ca-4ef0-8f5b-1b22f6316c62 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:48.148241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a90c3d2-fc18-4eda-9a78-c767050d2cb0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Calling method '.version_select at 0x7f228e66cb80>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:48.203531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:48.211537 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7848dd2f-f77d-4874-8843-11aeb3537d75 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1276 microversion: 2.1 time: 0.104895 Nov 02 12:24:48.212139 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 620/1238] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:48 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:48.319862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:48.320395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:48.326644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.327356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.327992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:48.328858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.329486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.330133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:48.354829 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a90c3d2-fc18-4eda-9a78-c767050d2cb0 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/b5dec220-8f1e-455f-94f4-701b32534fe1" status: 202 len: 0 microversion: 2.1 time: 0.212914 Nov 02 12:24:48.355749 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 619/1239] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:48 2022] DELETE /compute/v2.1/os-security-groups/b5dec220-8f1e-455f-94f4-701b32534fe1 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:48.363724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e934da5f-d629-4e9b-8933-5795352f5759 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Calling method '.version_select at 0x7f228e6e1670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:48.557078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:48.570838 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39133d0f-4fdf-4e70-9ecf-4b746c179a24 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1649 microversion: 2.1 time: 0.254829 Nov 02 12:24:48.571712 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 621/1240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:48 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1649 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:48.647521 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e934da5f-d629-4e9b-8933-5795352f5759 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/a0a36a31-397c-4fd7-967c-431cb4b24f29" status: 202 len: 0 microversion: 2.1 time: 0.287547 Nov 02 12:24:48.648466 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 620/1241] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:48 2022] DELETE /compute/v2.1/os-security-groups/a0a36a31-397c-4fd7-967c-431cb4b24f29 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:24:48.658114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eef91f20-d423-4c32-b535-788dff5510d5 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Calling method '.version_select at 0x7f228e9b4670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:48.855210 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eef91f20-d423-4c32-b535-788dff5510d5 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/a767af2d-fd87-423a-8e8b-99e9c0693980" status: 202 len: 0 microversion: 2.1 time: 0.201872 Nov 02 12:24:48.856323 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 622/1242] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:48 2022] DELETE /compute/v2.1/os-security-groups/a767af2d-fd87-423a-8e8b-99e9c0693980 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:48.865028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a6980b3-330c-4894-b552-dc15fe2c2965 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] Calling method '.version_select at 0x7f228eb8a160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:48.908411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4f4a857d-ccce-4f74-9221-956d6576d147 req-5e0670c0-45cb-461c-aa4b-aa3d10d74552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0838ca-34c6-4d78-8d26-ce67982c4c7b", "name": "network-vif-plugged", "status": "completed", "tag": "68072907-6547-4e2b-8fb7-0c95d853ce3e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:48.920148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4f4a857d-ccce-4f74-9221-956d6576d147 req-5e0670c0-45cb-461c-aa4b-aa3d10d74552 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.920634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4f4a857d-ccce-4f74-9221-956d6576d147 req-5e0670c0-45cb-461c-aa4b-aa3d10d74552 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.921232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4f4a857d-ccce-4f74-9221-956d6576d147 req-5e0670c0-45cb-461c-aa4b-aa3d10d74552 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:48.934181 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4f4a857d-ccce-4f74-9221-956d6576d147 req-5e0670c0-45cb-461c-aa4b-aa3d10d74552 service nova] Creating event network-vif-plugged:68072907-6547-4e2b-8fb7-0c95d853ce3e for instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b on n-h1-855650-5 Nov 02 12:24:48.939467 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4f4a857d-ccce-4f74-9221-956d6576d147 req-5e0670c0-45cb-461c-aa4b-aa3d10d74552 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105580 Nov 02 12:24:48.940163 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 621/1243] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:24:48.946593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:48.947382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:48.953908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.954549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.954995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:48.955706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.956184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.956703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.146825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:49.151541 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a6980b3-330c-4894-b552-dc15fe2c2965 tempest-SecurityGroupRulesNegativeTestJSON-653441886 tempest-SecurityGroupRulesNegativeTestJSON-653441886-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/f051948c-f770-405a-9b9a-1aaf21509758" status: 202 len: 0 microversion: 2.1 time: 0.290929 Nov 02 12:24:49.153721 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 623/1244] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:48 2022] DELETE /compute/v2.1/os-security-groups/f051948c-f770-405a-9b9a-1aaf21509758 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:24:49.178389 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8765592f-ce95-4f30-b28e-e31c0dbf3302 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1317 microversion: 2.1 time: 0.236741 Nov 02 12:24:49.178996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 622/1245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:48 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:49.180327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:49.181355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:49.186211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:49.194215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:49.204128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.205115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.206256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.207258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.207588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.208915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.209820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.219195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.220549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.238222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.241126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.241779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.524614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid 9bf7c70a-03b4-456d-96c0-8e892183b1ac {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:49.538454 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-824b094b-df43-4df7-a246-6a646f6ea2f7 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 2344 microversion: 2.25 time: 0.355693 Nov 02 12:24:49.539158 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 623/1246] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:24:49 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 2344 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:24:49.543307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:49.545801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:49.555668 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-71faafa6-caa4-4b47-82b8-1347fda2131f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.400162 Nov 02 12:24:49.559333 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 624/1247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:49 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:49.570120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:49.570120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:49.573952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.574477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.574910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.575604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.576057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.576471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.580509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6dd2320f-6769-44f6-ba21-c9698314aeb6 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:49.584457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dd2320f-6769-44f6-ba21-c9698314aeb6 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.584947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dd2320f-6769-44f6-ba21-c9698314aeb6 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.585620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dd2320f-6769-44f6-ba21-c9698314aeb6 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.586384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dd2320f-6769-44f6-ba21-c9698314aeb6 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.586845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dd2320f-6769-44f6-ba21-c9698314aeb6 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.587265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dd2320f-6769-44f6-ba21-c9698314aeb6 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.612847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6dd2320f-6769-44f6-ba21-c9698314aeb6 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041277 Nov 02 12:24:49.613455 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 625/1248] 10.222.0.45 () {60 vars in 1217 bytes} [Wed Nov 2 12:24:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:24:49.619252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:49.620204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:49.642831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.643888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.645167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.646806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:49.647458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:49.648058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.652893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:49.664803 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a307ce60-2263-4c83-8b5a-f036e54e3eb2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1276 microversion: 2.1 time: 0.124337 Nov 02 12:24:49.666001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 624/1249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:49 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:49.833503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:49.842855 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-901aaa1d-5e1d-4af1-a492-d3e8e498e67f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1649 microversion: 2.1 time: 0.227043 Nov 02 12:24:49.843584 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 626/1250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:49 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1649 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:50.211970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:50.216632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:50.228236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:50.229051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:50.230060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:50.231004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:50.231989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:50.243698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:50.446963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:50.456093 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ce24402c-970e-447e-a72e-7ef8c551193f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1317 microversion: 2.1 time: 0.251788 Nov 02 12:24:50.457286 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 625/1251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:50 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:50.585921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:50.587438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:50.589743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:50.596477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:50.597274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:50.597750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:50.599015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:50.599482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:50.599920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:50.688685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:50.689668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:50.698406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:50.699292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:50.700009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:50.700965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:50.701633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:50.702343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:50.826216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:50.836610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc6ac82f-0250-4b15-9a9a-f02a5b8e0de5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1284 microversion: 2.1 time: 0.152394 Nov 02 12:24:50.837207 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 626/1252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:50 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:50.869763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:50.871211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:50.883730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:50.886385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:50.890003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:50.891457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:50.892112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:50.892753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:50.997154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:51.011436 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d6531b8-f833-4500-98a4-0dd3be0f70db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.429303 Nov 02 12:24:51.012543 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 627/1253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:50 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:51.215367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:51.225275 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c272721c-226f-4129-b693-0821c684c0cc tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1649 microversion: 2.1 time: 0.361602 Nov 02 12:24:51.226208 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 627/1254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:50 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1649 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:51.482065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:51.483006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:51.491850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:51.492621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:51.493251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:51.494194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:51.495483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:51.496196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:51.784052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:51.816157 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a073a473-2d3b-4529-ae11-8252f30369c3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1467 microversion: 2.1 time: 0.337412 Nov 02 12:24:51.830061 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 628/1255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:51 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1467 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:51.842890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:51.843508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:51.856083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:51.859242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:51.859810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:51.860574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:51.861086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:51.861500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:51.862571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:51.863397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:51.876318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:51.878628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:51.881606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:51.882730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:51.885217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:51.886708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:52.118997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:52.130822 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7a683f16-8064-41a1-a161-8be2e5651b94 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1282 microversion: 2.1 time: 0.274330 Nov 02 12:24:52.132581 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 629/1256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:51 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:52.141205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:52.144266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:52.161727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:52.163611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:52.164298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:52.166409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:52.168192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:52.171171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:52.237196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:52.249636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea88653f-6ba1-49e2-a6ce-83dfdfcdbada tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1318 microversion: 2.1 time: 0.410806 Nov 02 12:24:52.250571 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 628/1257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:51 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:52.255235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:52.269206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:52.275934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:52.276429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:52.277058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:52.277939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:52.278577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:52.288347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:52.590797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:52.600717 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2dbce521-3c0c-4a84-8164-197fe84eac6e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.466522 Nov 02 12:24:52.601566 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 630/1258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:52 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:52.612983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f719200-5c04-4a88-a398-b151b55c1fe6", "device": "/dev/xvdb"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:52.617736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:52.625004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:52.626623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:52.626623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:52.628797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:52.629278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:52.630320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:52.726736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:52.736654 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b99e19a3-1589-4f7e-8d85-87fba316e457 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1649 microversion: 2.1 time: 0.484456 Nov 02 12:24:52.737353 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 629/1259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:52 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1649 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:53.159925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:53.160574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:53.164753 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bf1297c0-16bc-4307-948f-7306557c1583 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "POST /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.544930 Nov 02 12:24:53.167334 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 631/1260] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Nov 2 12:24:52 2022] POST /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:24:53.175715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.176779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.177431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.178562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.179666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.180258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.274934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:53.275819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:53.293632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.294462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.295149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.296083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.296757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.297417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.652977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:53.662234 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c68141c8-e883-48ec-97ea-8171074ccd5c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.507945 Nov 02 12:24:53.665003 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 630/1261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:53 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:53.670402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:53.671197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:53.678100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.678845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.679542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.680518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.681126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.681702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.840376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:53.866677 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-461d4e67-20b4-4d28-b6d3-3e126ba91bae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1318 microversion: 2.1 time: 0.596848 Nov 02 12:24:53.872715 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 632/1262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:53 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:53.893402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:53.894040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:53.907986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.908715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.909328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.910310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.912035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.912937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:54.298803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:54.314297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-09669df1-5d14-49d4-92ab-8ed2afaadc3b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.641655 Nov 02 12:24:54.329650 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 631/1263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:53 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:54.342750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:54.343883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:54.376504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:54.377388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:54.378113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:54.379184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:54.379948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:54.380609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:54.913560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:54.927375 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-828e4317-6894-4df2-8eb5-e055aa182e9f tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1649 microversion: 2.1 time: 1.037835 Nov 02 12:24:54.927975 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 633/1264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:53 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1649 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:54.939592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:54.940529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:54.957259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:54.958361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:54.958970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:54.959909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:54.960582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:54.961167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.024422 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e04f1897-a4a0-4b5e-b645-fea374c468dc tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1858 microversion: 2.1 time: 0.692614 Nov 02 12:24:55.028990 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 632/1265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:54 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1858 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:55.044496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-45ab1af5-7041-42e0-a02a-179ef83fbe9c req-ebd1d9ee-8fc3-47c7-b663-9420986fe465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f4ff71-fa75-4ac9-9661-ebb7bbc3995f", "name": "network-vif-plugged", "status": "completed", "tag": "9d585ce4-7020-4e3d-b408-02a183917027"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:55.058436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-45ab1af5-7041-42e0-a02a-179ef83fbe9c req-ebd1d9ee-8fc3-47c7-b663-9420986fe465 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.058930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-45ab1af5-7041-42e0-a02a-179ef83fbe9c req-ebd1d9ee-8fc3-47c7-b663-9420986fe465 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.059441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-45ab1af5-7041-42e0-a02a-179ef83fbe9c req-ebd1d9ee-8fc3-47c7-b663-9420986fe465 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.076211 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-45ab1af5-7041-42e0-a02a-179ef83fbe9c req-ebd1d9ee-8fc3-47c7-b663-9420986fe465 service nova] Creating event network-vif-plugged:9d585ce4-7020-4e3d-b408-02a183917027 for instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f on n-h1-855650-5 Nov 02 12:24:55.082742 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-45ab1af5-7041-42e0-a02a-179ef83fbe9c req-ebd1d9ee-8fc3-47c7-b663-9420986fe465 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052370 Nov 02 12:24:55.083695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 633/1266] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:55.091098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:55.091804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:55.100415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.100914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.101353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.102317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.102724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.103150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.259403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:55.274788 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91a09179-3245-4ee6-a479-1f31d78ca0fa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.345344 Nov 02 12:24:55.277436 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 634/1267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:54 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:55.304367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-855650-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:55.307069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:55.313544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.314087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.314539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.315357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.315772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.316200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.368908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lazy-loading 'flavor' on Instance uuid 3ce3f9c6-de73-4a88-8cb8-a20198986ffb {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:55.385922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Going to try to live migrate instance to n-h1-855650-5 {{(pid=120723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:24:55.412333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:55.436751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:55.449302 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b266cd7-608b-4de3-a111-3ded9c5cfd33 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1318 microversion: 2.1 time: 0.362859 Nov 02 12:24:55.463808 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 634/1268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:55 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:55.474340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:55.475356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:55.490684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:55.497850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.498712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.499362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.500441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.501180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.501893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.737784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=24 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:55.878711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:55.889002 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e36cdfe-6c97-4f98-b8e2-1f8a7403d5f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.423758 Nov 02 12:24:55.890323 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 635/1269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:55 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:55.896163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f0bab665-714a-48fd-8ac1-6f8571b39861 req-130c9e2f-5b9d-4580-932f-83ce9c4c2f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f1c9deb-57fd-4e6f-99ab-2b38d0265349", "tag": "0e224186-7075-402e-bcba-bb782ace3e07"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:55.906496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f0bab665-714a-48fd-8ac1-6f8571b39861 req-130c9e2f-5b9d-4580-932f-83ce9c4c2f38 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.907376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f0bab665-714a-48fd-8ac1-6f8571b39861 req-130c9e2f-5b9d-4580-932f-83ce9c4c2f38 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.908029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f0bab665-714a-48fd-8ac1-6f8571b39861 req-130c9e2f-5b9d-4580-932f-83ce9c4c2f38 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.946354 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f0bab665-714a-48fd-8ac1-6f8571b39861 req-130c9e2f-5b9d-4580-932f-83ce9c4c2f38 service nova] Creating event network-changed:0e224186-7075-402e-bcba-bb782ace3e07 for instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 on n-h1-855650-5 Nov 02 12:24:55.956312 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f0bab665-714a-48fd-8ac1-6f8571b39861 req-130c9e2f-5b9d-4580-932f-83ce9c4c2f38 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064459 Nov 02 12:24:55.956916 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 636/1270] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:55.963244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:55.964909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:55.974307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.974799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.975420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:55.976147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:55.976597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:55.977029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.008214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:56.146107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:56.168414 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5de679ff-245b-48b7-a6a3-3da9a51e8425 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1469 microversion: 2.1 time: 0.208756 Nov 02 12:24:56.172786 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 637/1271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:55 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1469 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:56.179381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e9982496-e3e2-44fd-85af-f80c390c9c59 req-1fb6eaf1-34f0-4375-aced-a3b7377ac1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb", "name": "network-vif-deleted", "tag": "76e5447e-8752-4da2-956e-1aafb92c46c3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:56.190711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e9982496-e3e2-44fd-85af-f80c390c9c59 req-1fb6eaf1-34f0-4375-aced-a3b7377ac1f1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.191463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e9982496-e3e2-44fd-85af-f80c390c9c59 req-1fb6eaf1-34f0-4375-aced-a3b7377ac1f1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.192739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e9982496-e3e2-44fd-85af-f80c390c9c59 req-1fb6eaf1-34f0-4375-aced-a3b7377ac1f1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.235610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e9982496-e3e2-44fd-85af-f80c390c9c59 req-1fb6eaf1-34f0-4375-aced-a3b7377ac1f1 service nova] Creating event network-vif-deleted:76e5447e-8752-4da2-956e-1aafb92c46c3 for instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb on n-h2-855650-5 Nov 02 12:24:56.244639 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e9982496-e3e2-44fd-85af-f80c390c9c59 req-1fb6eaf1-34f0-4375-aced-a3b7377ac1f1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070299 Nov 02 12:24:56.246544 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 638/1272] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:56.304445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:56.305157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:56.311898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.312952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.313407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.314157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.314621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.315049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.613793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:56.623136 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4c1d649c-cd04-4aef-a619-4153c4fc2b4c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.323798 Nov 02 12:24:56.627345 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 639/1273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:56 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:56.635404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:56.641804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:56.660406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.661136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.661680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.662777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.663470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.664159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.916164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:56.931565 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e422f72-b1ed-4a7d-8eae-be8ae92fa81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1318 microversion: 2.1 time: 0.302223 Nov 02 12:24:56.932325 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 640/1274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:56 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:56.937798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:56.938449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:56.945330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.945808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.946282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.946994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.947435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.948051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:57.224259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:57.237095 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f415c702-13e6-46dd-b3af-d4df45380727 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.301956 Nov 02 12:24:57.237695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 641/1275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:56 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:57.244626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-76992aed-f937-4faa-a044-cb65212cfcaa req-cfd4d7b9-adad-4e57-a2f6-c4957159ec4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02bc114f-5d4a-4561-9ae3-8f7a44456697", "name": "network-vif-plugged", "status": "completed", "tag": "49237042-1850-4e28-9305-32b5a2880647"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:57.271065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76992aed-f937-4faa-a044-cb65212cfcaa req-cfd4d7b9-adad-4e57-a2f6-c4957159ec4f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:57.271553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76992aed-f937-4faa-a044-cb65212cfcaa req-cfd4d7b9-adad-4e57-a2f6-c4957159ec4f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:57.272137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76992aed-f937-4faa-a044-cb65212cfcaa req-cfd4d7b9-adad-4e57-a2f6-c4957159ec4f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:57.309699 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-76992aed-f937-4faa-a044-cb65212cfcaa req-cfd4d7b9-adad-4e57-a2f6-c4957159ec4f service nova] Creating event network-vif-plugged:49237042-1850-4e28-9305-32b5a2880647 for instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 on n-h2-855650-5 Nov 02 12:24:57.317417 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-76992aed-f937-4faa-a044-cb65212cfcaa req-cfd4d7b9-adad-4e57-a2f6-c4957159ec4f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075712 Nov 02 12:24:57.318384 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 642/1276] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:57.330499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:57.339751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:57.343240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:57.343751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:57.344211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:57.344953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:57.345419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:57.345848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:57.419916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:57.420408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:57.420847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:57.421304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lazy-loading 'fault' on Instance uuid 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:57.595798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee9d7b075c540a3b9eb0c5bb7344dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae93780b7f44bb295ed5c4160115d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:57.614687 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de6a540b-f8e5-4f6e-a11e-8ecd4ce40f43 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 200 len: 1306 microversion: 2.1 time: 0.295004 Nov 02 12:24:57.615600 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 643/1277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:57 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 1306 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:57.652769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:57.653382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:57.666406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:57.667104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:57.667561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:57.668304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:57.669093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:57.671121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:57.957250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:57.979843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d7aa0ad-7c5c-41ac-a308-1e78c3a0c13b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.330502 Nov 02 12:24:57.998395 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 644/1278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:57 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:58.002008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:58.003414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:58.017541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:58.023581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:58.024761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.027282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:58.028811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:58.032147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.343626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:58.356826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-76f10d97-2f1d-42e3-a022-eabf06e0d457 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1468 microversion: 2.1 time: 0.364277 Nov 02 12:24:58.357630 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 645/1279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:57 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1468 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:58.376825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:58.377367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:58.396495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:58.397116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:58.397899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.399179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:58.400359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:58.400533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.685714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:58.702078 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6dbb38ae-9c43-4c0e-8be4-34af50242882 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1317 microversion: 2.1 time: 0.338442 Nov 02 12:24:58.708853 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 646/1280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:58 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:58.717911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2069686252"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:58.721258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:58.729645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:58.730514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:58.731019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.731793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:58.732481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:58.732864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.859236 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-260c9b43-ceb1-4f25-a7ca-89e91d0d363a tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/action" status: 202 len: 0 microversion: 2.1 time: 3.561319 Nov 02 12:24:58.863153 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 635/1281] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:55 2022] POST /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/action => generated 0 bytes in 3564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:58.868584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:58.869211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] [instance: 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:58.879719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:58.880614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:58.881315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.882873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:58.883557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:58.884160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.920147 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] HTTP exception thrown: Instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb could not be found. Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Request method failure captured: Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb HTTP/1.1 Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEsXtIzuwZ2D8cVWaFXdB-Keuuz492tsidyNJ8xgpXVmWLdAp31hYsZrliUbQTOlcicF7fVvhW8KmtySuMN_th3a8bXFMiGZ_bgSBr0fUpveOcro-HW-KW_t1xLZewd9KGoxvwUzT2g1PvUciQuH0bQqNkM3-G2nmEaPlpd-PaTlUE Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:24:58.923777 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cae93780b7f44bb295ed5c4160115d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: cae93780b7f44bb295ed5c4160115d6a Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1160013786 Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: eee9d7b075c540a3b9eb0c5bb7344dae Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupsTestJSON-1160013786-project Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb could not be found. Nov 02 12:24:58.925570 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb'} Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb could not be found. Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:58.927251 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb could not be found. Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb could not be found. Nov 02 12:24:58.929736 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:24:58.931818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Returning 404 to user: Instance 956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:58.931818 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-31e40990-c3cb-49ce-95ea-a1dc55b1a0b6 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb" status: 404 len: 111 microversion: 2.1 time: 0.066395 Nov 02 12:24:58.931818 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 636/1282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:58 2022] GET /compute/v2.1/servers/956393f6-3c9a-4b7b-9b3a-bbf2d583b7bb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:59.080932 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af7061a1-cc9e-49a2-977f-92d147d6a79a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "POST /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f/action" status: 202 len: 0 microversion: 2.1 time: 0.369817 Nov 02 12:24:59.083924 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 647/1283] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:58 2022] POST /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:24:59.093677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8a5325d-265d-46ba-b06d-bbc5c8fe99e9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e57c790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:59.202181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:59.202818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:59.220233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:59.220744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:59.221193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:59.221911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:59.222411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:59.222843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:59.480342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:59.493343 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8a5325d-265d-46ba-b06d-bbc5c8fe99e9 tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/216e1c1a-5972-453f-b60a-0506517804ea" status: 202 len: 0 microversion: 2.1 time: 0.406660 Nov 02 12:24:59.494005 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 648/1284] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:59 2022] DELETE /compute/v2.1/os-security-groups/216e1c1a-5972-453f-b60a-0506517804ea => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:59.495800 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78b6cf85-3fa3-4565-9053-ff8e2ea6b510 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.562881 Nov 02 12:24:59.496758 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 637/1285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:58 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:59.499783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:59.500620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:59.503665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82cc1c56-bbb5-4510-a6b6-277c2f897b96 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e9950d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:59.516746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:59.517250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:59.517718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:59.519150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:59.519666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:59.520137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:59.579017 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-82cc1c56-bbb5-4510-a6b6-277c2f897b96 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.081014 Nov 02 12:24:59.580494 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 638/1286] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:24:59 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:59.613899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:59.625684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0bb34fdc-2952-4abd-bbac-ad8b8055d10d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] Calling method '.version_select at 0x7f228e96a5e0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:59.880192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:59.895441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c7a197f-0f61-4f3d-aab0-040d8e61291e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.400062 Nov 02 12:24:59.896045 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 649/1287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:59 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:59.909953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:59.910958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:59.926714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:59.927215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:59.927857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:59.928781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:59.935787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:59.936541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:00.100756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0bb34fdc-2952-4abd-bbac-ad8b8055d10d tempest-SecurityGroupsTestJSON-1160013786 tempest-SecurityGroupsTestJSON-1160013786-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/a61de5c3-eace-46fe-8b7f-b0335dc07e3e" status: 202 len: 0 microversion: 2.1 time: 0.518762 Nov 02 12:25:00.102208 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 639/1288] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:24:59 2022] DELETE /compute/v2.1/os-security-groups/a61de5c3-eace-46fe-8b7f-b0335dc07e3e => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:25:00.284433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:00.296142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-93089892-911f-4a6e-bea3-10edc850acbb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1467 microversion: 2.1 time: 0.398749 Nov 02 12:25:00.297480 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 650/1289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:59 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1467 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:00.324356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:00.324983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:00.358290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:00.369690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:00.373046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:00.377865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:00.378396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:00.378834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:00.535213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:00.536476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:00.574351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:00.575093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:00.575541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:00.576291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:00.594350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:00.595989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:00.982360 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-db40ae4c-cf2a-4b4a-a33e-b564200532de tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1618 microversion: 2.1 time: 0.662751 Nov 02 12:25:00.984161 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 640/1290] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:00 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1618 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:00.991052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b4ece7b-ee48-429e-a239-c2a7c69306f5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e995430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:01.070447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:01.115428 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc7b7fa4-abec-4a21-9c34-c5ed784136ca tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.570766 Nov 02 12:25:01.138160 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 651/1291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:00 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:01.150396 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b4ece7b-ee48-429e-a239-c2a7c69306f5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.164576 Nov 02 12:25:01.151961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:01.153616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:01.154087 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 641/1292] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:00 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:01.174388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2016353146", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8a61e28f-f3a1-4aea-be4b-4d12f85736ed"]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:01.178880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:01.180855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:01.184673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:01.186932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:01.188522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:01.189538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:01.299082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:25:01.913483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:01.927791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba173944-554c-4ab6-abef-a3de19e7efe8 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.787876 Nov 02 12:25:01.931623 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 652/1293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:01 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:02.145360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:02.146896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:02.157521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:02.162395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:02.168379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:02.169521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:02.170672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:02.177190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:02.324811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:25:02.325292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:25:02.325684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:25:02.326121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:25:02.326540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:25:02.349921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:02.350591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:02.351225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:02.352167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:02.352785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:02.353388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:02.378574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:02.386368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:02.418604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:25:02.423697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:25:02.552085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea8c6fbe-1479-4023-9880-d97417e5307c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.395973 Nov 02 12:25:02.553297 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 642/1294] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:25:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:25:02.563742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-89461f4e-ef12-4739-8fd8-985126b63907 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8ed700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:02.651505 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-89461f4e-ef12-4739-8fd8-985126b63907 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.097065 Nov 02 12:25:02.653611 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 643/1295] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:02 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:02.670736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e98b1860-0041-4c84-b10c-2577a4c7f81b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:02.671563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e98b1860-0041-4c84-b10c-2577a4c7f81b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:03.292109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e98b1860-0041-4c84-b10c-2577a4c7f81b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:03.305922 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e98b1860-0041-4c84-b10c-2577a4c7f81b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1217 microversion: 2.1 time: 0.650126 Nov 02 12:25:03.309920 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 644/1296] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:02 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1217 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:03.323781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:03.344362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:03.363664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:03.364597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:03.365870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:03.366960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:03.368090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:03.369327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:03.400166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:03.454954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:03.502337 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e08e006-384b-47aa-826d-55603f514849 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 1.361338 Nov 02 12:25:03.510364 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 653/1297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:02 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:03.681253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71701fa8-6a4e-421d-aa70-78c0738e6bd8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e66c550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:03.789147 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71701fa8-6a4e-421d-aa70-78c0738e6bd8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.120845 Nov 02 12:25:03.790805 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 654/1298] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:03 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:04.336304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:04.337334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:04.354960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:04.356507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:04.358624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:04.359992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:04.362417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:04.363161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:04.403004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:04.408034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:04.420761 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1b413f29-3687-493a-8e82-cae8f6e8a2df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 1.108758 Nov 02 12:25:04.432532 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 645/1299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:03 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:04.550162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:04.550764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:04.567986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:04.573444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:04.573954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:04.574733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:04.577781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:04.579678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:04.774602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:04.790256 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d7675953-cfc9-4af0-8d8c-1afe09901be7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1269 microversion: 2.1 time: 0.459591 Nov 02 12:25:04.798705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 655/1300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:04 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1269 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:04.813332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-23581229-fe79-4462-944f-5bc508431d5a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eedb790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:04.897043 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-23581229-fe79-4462-944f-5bc508431d5a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.092838 Nov 02 12:25:04.906662 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 656/1301] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:04 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:05.216860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:05.240934 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2723367f-4ee6-4a66-a436-3e50c1d71fd5 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.699699 Nov 02 12:25:05.257235 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 646/1302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:04 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:05.476018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:05.482455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:05.496528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:05.498317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:05.499067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:05.501738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:05.503417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:05.504121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:05.828559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:05.830034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:05.838312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:05.839295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:05.840410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:05.844299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:05.844852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:05.845570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:06.034550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:06.046577 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfea7df9-6517-4753-bd93-132afb2e7904 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.594637 Nov 02 12:25:06.054436 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 657/1303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:05 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:06.074935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e228b94-d2e0-4f44-9514-ee4114ec4827 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e6e1550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:06.180193 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e228b94-d2e0-4f44-9514-ee4114ec4827 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.124210 Nov 02 12:25:06.181110 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 658/1304] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:06 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:06.232538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:06.251952 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-73c06c97-8b03-4d4a-be4a-c6cc80a67179 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1275 microversion: 2.1 time: 0.440016 Nov 02 12:25:06.253335 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 647/1305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:05 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1275 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:06.273849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:06.274817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:06.284787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:06.290963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:06.293737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:06.294811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:06.297278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:06.297936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:06.667750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:06.682407 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1fef3cf6-793c-4a7a-9303-a84b717a42a9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.413347 Nov 02 12:25:06.685681 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 659/1306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:06 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:07.079885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:07.080655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:07.114604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.115174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.115633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.116582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.117065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.117501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.196131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2186a37d-401f-4d3a-9496-54e7787a0a89 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e66c4c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:07.273108 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2186a37d-401f-4d3a-9496-54e7787a0a89 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.080912 Nov 02 12:25:07.274855 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 660/1307] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:07 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:07.288260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:07.289137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:07.311820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.312578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.313311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.315997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.317044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.317916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.445190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:07.462265 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4c528fd9-e916-4358-ab80-a8ee810cee78 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1275 microversion: 2.1 time: 0.178292 Nov 02 12:25:07.463016 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 661/1308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:07 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:07.640862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:07.658871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1803c994-dd6c-4c7d-b643-7c4a6f62f107 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.585580 Nov 02 12:25:07.662857 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 648/1309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:07 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:07.716728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:07.717666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:07.730714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.731541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.734249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.735138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.737021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.737726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:08.051318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:08.074724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9edb11f5-fe85-4b95-9073-552097d9f3f9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.361046 Nov 02 12:25:08.077846 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 662/1310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:07 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:08.293468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08f4f5d2-381a-4641-9af3-7e06fc139c4e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e978280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:08.344345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7828d619-9886-4a7e-933a-793410bd0358 req-7fd8b67e-cf05-4554-b1ff-7600b4b9a36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1c9deb-57fd-4e6f-99ab-2b38d0265349", "name": "network-vif-plugged", "status": "completed", "tag": "0e224186-7075-402e-bcba-bb782ace3e07"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:08.368898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7828d619-9886-4a7e-933a-793410bd0358 req-7fd8b67e-cf05-4554-b1ff-7600b4b9a36a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:08.369392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7828d619-9886-4a7e-933a-793410bd0358 req-7fd8b67e-cf05-4554-b1ff-7600b4b9a36a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:08.375133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7828d619-9886-4a7e-933a-793410bd0358 req-7fd8b67e-cf05-4554-b1ff-7600b4b9a36a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:08.421843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7828d619-9886-4a7e-933a-793410bd0358 req-7fd8b67e-cf05-4554-b1ff-7600b4b9a36a service nova] Creating event network-vif-plugged:0e224186-7075-402e-bcba-bb782ace3e07 for instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 on n-h1-855650-5 Nov 02 12:25:08.424611 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08f4f5d2-381a-4641-9af3-7e06fc139c4e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.138381 Nov 02 12:25:08.433814 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 649/1311] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:08 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:08.438606 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7828d619-9886-4a7e-933a-793410bd0358 req-7fd8b67e-cf05-4554-b1ff-7600b4b9a36a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097728 Nov 02 12:25:08.443229 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 663/1312] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:08.489570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:08.490939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:08.499437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:08.500193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:08.500847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:08.501803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:08.503341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:08.504272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:08.774455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e080ed9-af58-4e88-a9cc-5582148a76cb tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Action: 'create', calling method: .version_select at 0x7f228e513b80>, body: {"keypair": {"name": "tempest-keypair-800847278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCiHInTMvpsRvrxNP3ysnqgThWWzMgeb8F2cb/OQmcgAWmKFjq6p1pjgEtm26RmpGDcJTNVbJE5AYjx+QbYvhbSLn1W8M9ujFIFasAskSCt5xCETdENlz0V9pUQSLGJNQ=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:08.821762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6e080ed9-af58-4e88-a9cc-5582148a76cb tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Getting quotas for project c380c0d895194a59a3bc3cced29e022a. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:08.838442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6e080ed9-af58-4e88-a9cc-5582148a76cb tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Getting quotas for user 472cce6768a84038add872ae224bc616 and project c380c0d895194a59a3bc3cced29e022a. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:08.904020 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e080ed9-af58-4e88-a9cc-5582148a76cb tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.257476 Nov 02 12:25:08.905454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 664/1313] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:25:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:08.920716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:08.921833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:08.943832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:08.944355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:08.944784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:08.945650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:08.950081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:08.950589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:09.079656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:09.092934 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-afca3ad3-488d-44f5-b387-0c30898479a5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 0.609029 Nov 02 12:25:09.112598 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 650/1314] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:08 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:09.125856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:09.131944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:09.150058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:09.151066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:09.151738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:09.153535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:09.154337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:09.155037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:09.909355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:09.921371 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f13955a2-de3e-46f5-8cf0-637fdbd89354 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 1.014285 Nov 02 12:25:09.924801 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 665/1315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:08 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:09.939582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-567cf680-9174-48f6-add7-3b31615d726c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e520310>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:10.005103 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-567cf680-9174-48f6-add7-3b31615d726c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.077437 Nov 02 12:25:10.007306 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 666/1316] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:09 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:10.026622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:10.052997 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f211ec3-c0fd-438c-9742-b975184f0939 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.937942 Nov 02 12:25:10.066008 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 651/1317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:09 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:10.125695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:10.126793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:10.138928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.139999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.140561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.141466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.142118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.143039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.315740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:10.328264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b4fec121-3824-4c66-a8ee-9997d3d73971 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 0.207537 Nov 02 12:25:10.329635 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 667/1318] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:10 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:10.594329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:10.595379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:10.602924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.614705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.615325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.616341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.617041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.617710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.803716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2517afd5-cfc5-4aea-b529-e4fa777a8ffa req-80f43a7f-f52d-433f-81d7-b830edf30020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5abefed7-326a-4db8-838a-b79ed58b9eb5", "tag": "837b8282-2bdd-44eb-b98d-dddc8d815fdd"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:10.831532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2517afd5-cfc5-4aea-b529-e4fa777a8ffa req-80f43a7f-f52d-433f-81d7-b830edf30020 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.833029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2517afd5-cfc5-4aea-b529-e4fa777a8ffa req-80f43a7f-f52d-433f-81d7-b830edf30020 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.833693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2517afd5-cfc5-4aea-b529-e4fa777a8ffa req-80f43a7f-f52d-433f-81d7-b830edf30020 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.863308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid 9bf7c70a-03b4-456d-96c0-8e892183b1ac {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:25:10.881656 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2517afd5-cfc5-4aea-b529-e4fa777a8ffa req-80f43a7f-f52d-433f-81d7-b830edf30020 service nova] Creating event network-changed:837b8282-2bdd-44eb-b98d-dddc8d815fdd for instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 on n-h2-855650-5 Nov 02 12:25:10.900471 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2517afd5-cfc5-4aea-b529-e4fa777a8ffa req-80f43a7f-f52d-433f-81d7-b830edf30020 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100894 Nov 02 12:25:10.901477 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5fdc43ea-11e0-4132-a3b4-de1272deae42 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 2422 microversion: 2.25 time: 0.311064 Nov 02 12:25:10.902133 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 668/1319] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:10.918004 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 652/1320] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:10 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 2422 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:10.939825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855650-5", "block_migration": "auto"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:10.943849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:10.952125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:10.953515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:10.966022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.966300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.966934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.967488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.967982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.968682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.968843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.969212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.969633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.970631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.974899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.975817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:11.024172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'flavor' on Instance uuid 9bf7c70a-03b4-456d-96c0-8e892183b1ac {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:25:11.050060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Going to try to live migrate instance to n-h2-855650-5 {{(pid=120722) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:25:11.811098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:11.820018 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f4cd46c1-f70d-4097-81e9-86d5bcc4f136 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1324 microversion: 2.1 time: 0.872451 Nov 02 12:25:11.827483 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 653/1321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:10 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1324 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:11.844781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97535b8f-727d-475d-8ff8-006a32cbf14a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e992f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:11.969489 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97535b8f-727d-475d-8ff8-006a32cbf14a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.140516 Nov 02 12:25:11.986278 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 654/1322] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:11 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:11.993080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:11.997050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:12.005641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:12.006467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:12.007087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:12.008038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:12.008678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:12.009284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:12.368187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:13.298698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:13.371375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:13.421524 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-88bf4497-0dee-4b86-ba59-abf054e3efe9 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 1.413546 Nov 02 12:25:13.426701 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 655/1323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:11 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:13.445941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:13.449723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:13.458085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.458853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.459572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:13.460467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.461075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.462066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:13.868969 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39070315-358f-4be8-b946-2f0b76407df4 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/action" status: 202 len: 0 microversion: 2.25 time: 2.935783 Nov 02 12:25:13.870665 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 669/1324] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:25:10 2022] POST /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/action => generated 0 bytes in 2938 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:25:13.876740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-52243b4f-1476-4d47-839b-ddfc792a37de req-35029fb2-8fbc-4bd1-884b-680e2421c9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f4ff71-fa75-4ac9-9661-ebb7bbc3995f", "name": "network-vif-plugged", "status": "completed", "tag": "9d585ce4-7020-4e3d-b408-02a183917027"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:13.908794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-52243b4f-1476-4d47-839b-ddfc792a37de req-35029fb2-8fbc-4bd1-884b-680e2421c9b9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.909570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-52243b4f-1476-4d47-839b-ddfc792a37de req-35029fb2-8fbc-4bd1-884b-680e2421c9b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.911076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-52243b4f-1476-4d47-839b-ddfc792a37de req-35029fb2-8fbc-4bd1-884b-680e2421c9b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:13.955692 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-52243b4f-1476-4d47-839b-ddfc792a37de req-35029fb2-8fbc-4bd1-884b-680e2421c9b9 service nova] Creating event network-vif-plugged:9d585ce4-7020-4e3d-b408-02a183917027 for instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f on n-h1-855650-5 Nov 02 12:25:13.970072 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-52243b4f-1476-4d47-839b-ddfc792a37de req-35029fb2-8fbc-4bd1-884b-680e2421c9b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095736 Nov 02 12:25:13.976757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:13.986573 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ebbd12c-5ad6-4e7e-be4b-4b5aee25971d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 0.555910 Nov 02 12:25:13.987184 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 670/1325] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:13.989469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 656/1326] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:13 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:14.002331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c325f467-7d23-4f2b-af1b-56fd1bcf6d30 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e996af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:14.003420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:14.004701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:14.032888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.034260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.034915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.036691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.037553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.038519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.132364 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c325f467-7d23-4f2b-af1b-56fd1bcf6d30 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.130760 Nov 02 12:25:14.147671 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 657/1327] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:13 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:14.157488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:14.158147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:14.172616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.173121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.173571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.174327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.174787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.175216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.531455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:14.543170 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc300088-f296-482d-870e-cb26f9919b29 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1520 microversion: 2.1 time: 0.554546 Nov 02 12:25:14.548113 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 671/1328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:13 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1520 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:14.559375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:14.560221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:14.581824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.582530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.584021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.585458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.586613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.590604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.677416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:14.699296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:14.720667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:14.724054 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0e51e103-9d33-4c7c-937b-f5ef68a082dd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.573427 Nov 02 12:25:14.726414 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 658/1329] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:14 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:14.746811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:14.748044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:14.758405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.759172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.759816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.760876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.761504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.762222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.942121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:14.958246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c3cf570-81a4-4aba-8760-692481a561e2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.408652 Nov 02 12:25:14.974777 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 672/1330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:14 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:14.987052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "ab73f5aa-9eb4-42bf-8fd9-88aa3a32797e"}], "security_groups": [{"name": "tempest-securitygroup--1008488758"}], "key_name": "tempest-keypair-800847278", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:15.063833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:15.078168 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-71f4b326-d032-48e2-9e60-9f322ceb520d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1520 microversion: 2.1 time: 0.347589 Nov 02 12:25:15.079287 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 659/1331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:14 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:15.085054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:15.085914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:15.093332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.094152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.094792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.095692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.096321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.097265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.194080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] validate_networks() for [('ab73f5aa-9eb4-42bf-8fd9-88aa3a32797e', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:25:15.343044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:15.352927 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-695604a1-3ab0-4bb7-b37b-131453c7e285 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 0.272313 Nov 02 12:25:15.370524 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 660/1332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:15 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:15.377268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1565425036"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:15.380520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:15.387604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.388458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.389144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.390555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.391234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.391881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.763045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:25:15.763968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:25:15.764598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:25:15.765164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:25:15.765766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:25:15.786992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.787792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.788524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.789662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.790332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.791471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.813132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Getting quotas for project c380c0d895194a59a3bc3cced29e022a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:15.820455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Getting quotas for user 472cce6768a84038add872ae224bc616 and project c380c0d895194a59a3bc3cced29e022a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:15.832324 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6896b02f-7723-407b-9904-b10aefbbbdab tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349/action" status: 202 len: 0 microversion: 2.1 time: 0.459805 Nov 02 12:25:15.833510 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 661/1333] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:25:15 2022] POST /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:25:15.839358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30a808d4-f84e-4417-8f0f-31e3b7ab9442 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e994820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:15.844776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:25:15.848720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:25:15.932226 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30a808d4-f84e-4417-8f0f-31e3b7ab9442 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.097127 Nov 02 12:25:15.954180 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ee8030cd-630a-4cc4-a438-df1d2842d943 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.975252 Nov 02 12:25:15.954827 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 662/1334] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:15 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:15.957228 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 673/1335] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:25:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:25:15.963275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:15.964058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:15.975128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43583f02-a9e3-4b96-8e2a-cc1f70654f71 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '.version_select at 0x7f228e5e3c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:15.982500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.982993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.983432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.984147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.006082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.007038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:16.295304 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43583f02-a9e3-4b96-8e2a-cc1f70654f71 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/images/8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f" status: 204 len: 0 microversion: 2.1 time: 0.336616 Nov 02 12:25:16.301630 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 674/1336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:15 2022] DELETE /compute/v2.1/images/8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:25:16.309026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1705337b-99fb-451d-b028-758f62fa01b1 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:16.310265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1705337b-99fb-451d-b028-758f62fa01b1 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:16.366913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:16.387461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:16.391978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:16.394815 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6bb6180c-fe43-479c-9fde-91656d85e190 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.437717 Nov 02 12:25:16.399060 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 663/1337] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:15 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:16.414742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:16.415751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:16.433449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.434372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.435018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:16.436911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.439398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.439398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:16.469000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1705337b-99fb-451d-b028-758f62fa01b1 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:16.476520 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1705337b-99fb-451d-b028-758f62fa01b1 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1225 microversion: 2.1 time: 0.172863 Nov 02 12:25:16.479147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:16.482310 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 675/1338] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:16 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1225 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:16.497523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a670fe47-1613-43b7-a25b-10983a5f1062 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '.version_select at 0x7f228e5e3670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:16.547951 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a670fe47-1613-43b7-a25b-10983a5f1062 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Image not found. Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a670fe47-1613-43b7-a25b-10983a5f1062 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/images/8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f HTTP/1.1 Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:25:16.550169 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f'} Nov 02 12:25:16.551773 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:25:16.552690 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:25:16.554562 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f could not be found. Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:25:16.556438 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:16.558748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a670fe47-1613-43b7-a25b-10983a5f1062 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:16.560786 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a670fe47-1613-43b7-a25b-10983a5f1062 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/images/8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f" status: 404 len: 62 microversion: 2.1 time: 0.068285 Nov 02 12:25:16.560786 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 676/1339] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:16 2022] GET /compute/v2.1/images/8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:25:16.565403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:16.568352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:16.583536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:16.596890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.597502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.598469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:16.599244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.599757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.600186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:16.880564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:16.894311 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-324aead4-fd40-499d-ac38-2676488af655 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.492610 Nov 02 12:25:16.898593 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 664/1340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:16 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:16.911024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:16.913271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:16.938951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.939377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.939822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:16.940539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.940982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.941934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.058242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.090061 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4963a2af-32e8-40db-a0ef-62c1c870d864 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 0.533201 Nov 02 12:25:17.091316 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 677/1341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:16 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:17.115981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-203cb7ec-b68e-40db-828f-cc8ea28dc38e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e548820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:17.230103 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-203cb7ec-b68e-40db-828f-cc8ea28dc38e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.134304 Nov 02 12:25:17.232587 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 678/1342] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:17 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:17.437414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:17.438354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:17.465630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.466428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.467063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.468099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.468724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.469473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.571038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.585719 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ddf84f09-7124-44ab-81da-eff3ea65b104 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1532 microversion: 2.1 time: 0.682720 Nov 02 12:25:17.590493 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 665/1343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:16 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1532 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:17.596949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:17.598280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:17.624057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.625992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.627734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.628465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.628978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.629416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.812685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.827931 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-22186fb9-49d4-44a8-a7b0-fc2484f44378 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1277 microversion: 2.1 time: 0.236377 Nov 02 12:25:17.832439 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 666/1344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:17 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:17.897112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.913665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.927103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:17.929108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:17.933505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.940859 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9120bb47-11ec-410f-8b16-fcf0c21ba10c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.513528 Nov 02 12:25:17.942142 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 679/1345] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:17 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:17.947711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.948450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.949086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.950261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.950876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.951654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.118265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:18.119895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:18.156100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.159306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.162036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.162978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.172194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:18.179718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.182210 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6f84b96-5a5d-445c-aacf-6da7a00c0aae tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.260661 Nov 02 12:25:18.183524 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 667/1346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:17 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:18.184167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.251283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81e6c44e-6482-40ff-8c15-91af5d37f11b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e992b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:18.360081 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-81e6c44e-6482-40ff-8c15-91af5d37f11b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.115496 Nov 02 12:25:18.360671 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 668/1347] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:18 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:18.464339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:18.473578 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3b334a8-ae48-4fc1-91c3-362d3dbda4e1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 0.362838 Nov 02 12:25:18.475061 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 680/1348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:18 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:18.622118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:18.622517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:18.640510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:18.642677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.643170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.643629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.644879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.645612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.645754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.865295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:18.872135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:18.882536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.883151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.883593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.890787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.892850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.894850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.943905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:18.958795 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-68e2eab0-243a-48bd-849f-4e88dbcd94d2 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1532 microversion: 2.1 time: 0.344421 Nov 02 12:25:18.966147 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 669/1349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:18 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1532 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:18.982679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:18.985502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:19.020459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.021386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.024312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:19.025643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.028226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.029258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:19.084283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:19.087384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:19.098682 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-351df061-c242-463d-b567-f5b0cc69867d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1277 microversion: 2.1 time: 0.243481 Nov 02 12:25:19.126853 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 681/1350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:18 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:19.211483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:19.212099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:19.227194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.229995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.230720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:19.234179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.235359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.237496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:19.722595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:19.743667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:19.745702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:19.746996 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c1606161-9384-41b9-81f1-0d1b77ec14b2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.778333 Nov 02 12:25:19.752844 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 670/1351] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:18 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:19.765374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a0e1015-6b42-4d5a-9ace-ffa65f8b5bf2 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e9923a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:19.796066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:19.806337 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e3e6c3f-365c-4d16-a107-ad9f812fe127 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.599547 Nov 02 12:25:19.813055 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 682/1352] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:19 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:19.830561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:19.831629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:19.846441 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a0e1015-6b42-4d5a-9ace-ffa65f8b5bf2 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.091366 Nov 02 12:25:19.847031 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 671/1353] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:19 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:19.859021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.859811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.860265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:19.860998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.861462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.861895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:19.984887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:19.986198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:19.995057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.999916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:20.003275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:20.008139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:20.019116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:20.019913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:20.521428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:20.574326 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4b6abfd3-f443-4491-8770-1793741a12eb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1538 microversion: 2.1 time: 0.561314 Nov 02 12:25:20.575901 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 672/1354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:19 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1538 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:20.609115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:20.610366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:20.671525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:20.672299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:20.672981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:20.680645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:20.689104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:20.690187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:20.855586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:20.864960 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b9998c40-76c2-41c3-819f-e8782c080f7d tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1283 microversion: 2.1 time: 0.287463 Nov 02 12:25:20.874523 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 673/1355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:20 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1283 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:20.879755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:20.880634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:20.892772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:20.896848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:20.897695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:20.906121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:20.906874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:20.907610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:21.027836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:21.041732 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c6edffa-7ee0-49eb-aa09-a7986742f815 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 1.227272 Nov 02 12:25:21.054012 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 683/1356] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:19 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:21.055570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:21.058441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:21.080733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:21.081568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:21.082868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:21.087105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:21.088251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:21.090662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:21.188422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:21.199419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:21.209355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:21.210381 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-70340603-f30b-4964-8088-f63f8a020529 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.334496 Nov 02 12:25:21.211091 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 674/1357] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:20 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:21.232026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19d7825b-a8b5-424c-bc28-59cd4d7d5251 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e996f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:21.301204 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-19d7825b-a8b5-424c-bc28-59cd4d7d5251 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.088393 Nov 02 12:25:21.303778 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 675/1358] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:21 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:21.605581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:21.606535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:21.620309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:21.625192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:21.625700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:21.629550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:21.630112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:21.630568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:21.707025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:21.717058 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7cf80860-2dc2-4952-a768-5441982bb5df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.671036 Nov 02 12:25:21.722132 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 684/1359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:21 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:21.909816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:21.910547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:21.918863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:21.922491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:21.923088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:21.925056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:21.926415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:21.927219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.157397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:22.171130 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3fa3cbe6-67fb-473a-bcde-965d8b99737e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1538 microversion: 2.1 time: 0.569650 Nov 02 12:25:22.178844 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 676/1360] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:21 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1538 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:22.192816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:22.194578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:22.203615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.206262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.207484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.210071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.210801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.212861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.268702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:22.281120 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fa3ccb6-0d11-46ef-ac92-f3b109f000a5 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.376173 Nov 02 12:25:22.285697 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 685/1361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:21 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:22.297124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:22.302624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:22.315285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.316527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.318818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.320072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.324383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.325137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.627195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:22.638884 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-42a8197c-ab54-4f7f-99f6-20e850da63d8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 0.458448 Nov 02 12:25:22.640411 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 677/1362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:22 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:22.648463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cbb74298-65af-47ea-bac2-c4bb89747907 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e995670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:22.728766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cbb74298-65af-47ea-bac2-c4bb89747907 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.087278 Nov 02 12:25:22.736981 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 678/1363] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:22 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:22.758133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:22.758877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:22.790289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.791183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.793705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.797845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.799139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.803304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.827351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:22.855208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:22.860383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:22.865812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1ab848a-d140-4405-8517-f885bb039cbe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.578405 Nov 02 12:25:22.873994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 686/1364] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:22 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:22.896671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-74941354-2ca6-4b55-8867-271c4ab147d1 req-fba06aff-ff21-487e-ac3e-e18d681e55f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abefed7-326a-4db8-838a-b79ed58b9eb5", "name": "network-vif-plugged", "status": "completed", "tag": "837b8282-2bdd-44eb-b98d-dddc8d815fdd"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:22.938366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-74941354-2ca6-4b55-8867-271c4ab147d1 req-fba06aff-ff21-487e-ac3e-e18d681e55f8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.938871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-74941354-2ca6-4b55-8867-271c4ab147d1 req-fba06aff-ff21-487e-ac3e-e18d681e55f8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.939320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-74941354-2ca6-4b55-8867-271c4ab147d1 req-fba06aff-ff21-487e-ac3e-e18d681e55f8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.967475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-74941354-2ca6-4b55-8867-271c4ab147d1 req-fba06aff-ff21-487e-ac3e-e18d681e55f8 service nova] Creating event network-vif-plugged:837b8282-2bdd-44eb-b98d-dddc8d815fdd for instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 on n-h2-855650-5 Nov 02 12:25:22.979979 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-74941354-2ca6-4b55-8867-271c4ab147d1 req-fba06aff-ff21-487e-ac3e-e18d681e55f8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100667 Nov 02 12:25:22.984982 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 687/1365] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:23.198163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:23.199144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:23.216566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:23.221407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:23.230320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:23.234286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:23.234977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:23.235630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:23.874028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:23.884899 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-beed5ab5-eaee-400d-906c-55ce3fb40ea4 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1538 microversion: 2.1 time: 0.692222 Nov 02 12:25:23.889624 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 688/1366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:23 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1538 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:23.923884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:23.929696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:23.961906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:23.965158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:23.968771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:23.971763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:23.973374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:23.974096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.081218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:24.098453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64bb5b8e-b8c4-4454-8256-ca5f9721be89 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 1.347109 Nov 02 12:25:24.109989 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 679/1367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:22 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:24.119238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:24.120931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:24.136008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.136522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.136973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.140722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.141230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.141685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.680138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:24.698531 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-581ab9fb-bd77-4db3-b9e0-b9e71fc2108f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1317 microversion: 2.1 time: 0.596395 Nov 02 12:25:24.699458 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 680/1368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:24 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:24.713697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-644ee53c-97e4-43c9-925e-69a80223f1d4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e994040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:24.736173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:24.755191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2660dcf0-336e-4972-8617-2bce09446228 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.862691 Nov 02 12:25:24.755800 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 689/1369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:23 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:24.779347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:24.780266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:24.791291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.791895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.792440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.793044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.793501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.793927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.806688 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-644ee53c-97e4-43c9-925e-69a80223f1d4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.105056 Nov 02 12:25:24.807282 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 681/1370] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:24 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:24.834160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-cdb25064-4be8-49ba-a972-69fad32ba1d1 req-c01c202e-2503-42aa-8912-d8e980fbfe23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce3f9c6-de73-4a88-8cb8-a20198986ffb", "name": "network-vif-unplugged", "status": "completed", "tag": "ced7ed63-2e97-4192-938d-c3e96e6d249f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:24.849107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cdb25064-4be8-49ba-a972-69fad32ba1d1 req-c01c202e-2503-42aa-8912-d8e980fbfe23 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.854286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cdb25064-4be8-49ba-a972-69fad32ba1d1 req-c01c202e-2503-42aa-8912-d8e980fbfe23 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.855005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cdb25064-4be8-49ba-a972-69fad32ba1d1 req-c01c202e-2503-42aa-8912-d8e980fbfe23 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.884128 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-cdb25064-4be8-49ba-a972-69fad32ba1d1 req-c01c202e-2503-42aa-8912-d8e980fbfe23 service nova] Creating event network-vif-unplugged:ced7ed63-2e97-4192-938d-c3e96e6d249f for instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb on n-h2-855650-5 Nov 02 12:25:24.906485 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-cdb25064-4be8-49ba-a972-69fad32ba1d1 req-c01c202e-2503-42aa-8912-d8e980fbfe23 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097572 Nov 02 12:25:24.907653 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 682/1371] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:24.913161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:24.919680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:24.942540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.944681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.946613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.954729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.958453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.963752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:25.614579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:25.624488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:25.626065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:25.627313 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bab9ab80-7c41-43a7-a209-2910f5bc2f87 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.870363 Nov 02 12:25:25.631499 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 690/1372] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:24 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:25.639635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:25.640266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:25.663877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:25.664694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:25.665320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:25.666513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:25.667146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:25.667926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:25.803000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:25.853902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:25.879267 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-79708392-acb4-40fd-a29c-d559b8f2dd1b tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1538 microversion: 2.1 time: 0.969583 Nov 02 12:25:25.886308 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 683/1373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:24 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1538 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:26.199175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:26.214129 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eabe7454-50c4-431f-aeeb-7178b7d7abe2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.581431 Nov 02 12:25:26.215367 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 691/1374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:25 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:26.226635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:26.227546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:26.254654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:26.256557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:26.258630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:26.259574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:26.260998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:26.262453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:26.329496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-777d9c37-c138-4183-9159-09ec20ad3ca7 req-0cf721ad-22f8-4744-b9c7-2a7adae7a57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d49e5e-9685-40ff-8809-82f6164edf54", "tag": "f9b01e21-de84-46e4-b5e7-8f2972efa454"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:26.358978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-777d9c37-c138-4183-9159-09ec20ad3ca7 req-0cf721ad-22f8-4744-b9c7-2a7adae7a57c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:26.360696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-777d9c37-c138-4183-9159-09ec20ad3ca7 req-0cf721ad-22f8-4744-b9c7-2a7adae7a57c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:26.362068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-777d9c37-c138-4183-9159-09ec20ad3ca7 req-0cf721ad-22f8-4744-b9c7-2a7adae7a57c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:26.391571 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-777d9c37-c138-4183-9159-09ec20ad3ca7 req-0cf721ad-22f8-4744-b9c7-2a7adae7a57c service nova] Creating event network-changed:f9b01e21-de84-46e4-b5e7-8f2972efa454 for instance 24d49e5e-9685-40ff-8809-82f6164edf54 on n-h1-855650-5 Nov 02 12:25:26.406566 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-777d9c37-c138-4183-9159-09ec20ad3ca7 req-0cf721ad-22f8-4744-b9c7-2a7adae7a57c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.518442 Nov 02 12:25:26.409127 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 684/1375] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:26.429453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:26.433033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:26.451120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:26.452626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:26.453870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:26.456688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:26.457379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:26.458652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:26.482790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:27.689274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:27.702916 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39783b6a-69d8-46e0-bc50-0a92989ab95e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1467 microversion: 2.1 time: 1.486222 Nov 02 12:25:27.706293 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 692/1376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:26 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1467 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:27.717065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f65a461-63de-40b0-8808-f7cd1e3e3595 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e5e3c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:27.733958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:27.751680 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-86834358-3fe4-4631-b8f7-8ae98fe01e07 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 1.335022 Nov 02 12:25:27.752288 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 685/1377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:26 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:27.763272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0d241671-de75-4157-8005-256bd9a5373e req-19a4cd7c-4408-4f1c-98b2-e0d24a17acb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1c9deb-57fd-4e6f-99ab-2b38d0265349", "name": "network-vif-plugged", "status": "completed", "tag": "0e224186-7075-402e-bcba-bb782ace3e07"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:27.789006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0d241671-de75-4157-8005-256bd9a5373e req-19a4cd7c-4408-4f1c-98b2-e0d24a17acb3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:27.790859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0d241671-de75-4157-8005-256bd9a5373e req-19a4cd7c-4408-4f1c-98b2-e0d24a17acb3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:27.792134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0d241671-de75-4157-8005-256bd9a5373e req-19a4cd7c-4408-4f1c-98b2-e0d24a17acb3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:27.802513 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f65a461-63de-40b0-8808-f7cd1e3e3595 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.093967 Nov 02 12:25:27.803009 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 693/1378] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:27 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:27.815297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:27.817553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:27.829292 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0d241671-de75-4157-8005-256bd9a5373e req-19a4cd7c-4408-4f1c-98b2-e0d24a17acb3 service nova] Creating event network-vif-plugged:0e224186-7075-402e-bcba-bb782ace3e07 for instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 on n-h1-855650-5 Nov 02 12:25:27.833913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:27.834441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:27.834884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:27.836914 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0d241671-de75-4157-8005-256bd9a5373e req-19a4cd7c-4408-4f1c-98b2-e0d24a17acb3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083400 Nov 02 12:25:27.837564 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 686/1379] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:27.841545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:27.842724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:27.843391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:27.851205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:27.852329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:27.863353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:27.864433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:27.865938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:27.868779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:27.871771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:27.872521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.183153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:28.189911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:28.196429 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-40573ff3-6a15-40a9-855a-5e24784d2efb tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1520 microversion: 2.1 time: 0.355876 Nov 02 12:25:28.199336 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 687/1380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:27 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:28.275688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:28.285669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:28.292518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:28.299003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8aaf9801-0d3d-43c3-9eb7-7b5213ea5d95 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Calling method '.version_select at 0x7f228e9049d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:28.301110 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b268206d-50bc-4b46-9d94-d03a1ee67566 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.493938 Nov 02 12:25:28.301826 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 694/1381] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:27 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:28.310931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-effddafc-b013-4b32-ab45-8f71d1754896 req-c0b66a91-00dc-4d32-8541-0086663ab76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce3f9c6-de73-4a88-8cb8-a20198986ffb", "tag": "ced7ed63-2e97-4192-938d-c3e96e6d249f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:28.347107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-effddafc-b013-4b32-ab45-8f71d1754896 req-c0b66a91-00dc-4d32-8541-0086663ab76d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.349115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-effddafc-b013-4b32-ab45-8f71d1754896 req-c0b66a91-00dc-4d32-8541-0086663ab76d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.349838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-effddafc-b013-4b32-ab45-8f71d1754896 req-c0b66a91-00dc-4d32-8541-0086663ab76d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.351510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-8aaf9801-0d3d-43c3-9eb7-7b5213ea5d95 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3accad6a-d137-4d3b-a15f-246f0b113986 does not exist", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:25:28.352323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.security_group_api [None req-8aaf9801-0d3d-43c3-9eb7-7b5213ea5d95 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Neutron security group 3accad6a-d137-4d3b-a15f-246f0b113986 not found {{(pid=120723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:25:28.352891 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8aaf9801-0d3d-43c3-9eb7-7b5213ea5d95 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] HTTP exception thrown: Security group 3accad6a-d137-4d3b-a15f-246f0b113986 does not exist Nov 02 12:25:28.352891 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-1d7d12fb-19cb-47ca-ba4c-766ac68e288d'] Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8aaf9801-0d3d-43c3-9eb7-7b5213ea5d95 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Request method failure captured: Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-security-groups/3accad6a-d137-4d3b-a15f-246f0b113986 HTTP/1.1 Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmG2Lv2bKuK7iPtommf8Rio5BYa1qVTEtsGk4p7GU5LcRe8SnVgFkr8r-P4DCHnivhCgu0hKO2sPPIiYhb_pEovecpKZ79GIa86HQAeKFK9Alz8ZEQkGbwVJp7jJ7BnEcmMGKH_7Kv3acURMD6rSb4pkSVzBbvfjpMh7PBOy5QQyjBg Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 51064f089867495b9742ee5939ac1a6d Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:25:28.355737 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51064f089867495b9742ee5939ac1a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 51064f089867495b9742ee5939ac1a6d Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupsNegativeTestJSON-1062422838-project Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: e702fdd73f6f4070bb64a3488296d798 Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838-project Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: exception: Security group 3accad6a-d137-4d3b-a15f-246f0b113986 does not exist Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-1d7d12fb-19cb-47ca-ba4c-766ac68e288d'] Nov 02 12:25:28.357496 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3accad6a-d137-4d3b-a15f-246f0b113986'} Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:28.358721 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3accad6a-d137-4d3b-a15f-246f0b113986 does not exist Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7d12fb-19cb-47ca-ba4c-766ac68e288d'] Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:25:28.361864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3accad6a-d137-4d3b-a15f-246f0b113986 does not exist Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7d12fb-19cb-47ca-ba4c-766ac68e288d'] Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3accad6a-d137-4d3b-a15f-246f0b113986 does not exist Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7d12fb-19cb-47ca-ba4c-766ac68e288d'] Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:28.364008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3accad6a-d137-4d3b-a15f-246f0b113986 does not exist Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7d12fb-19cb-47ca-ba4c-766ac68e288d'] Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8aaf9801-0d3d-43c3-9eb7-7b5213ea5d95 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Returning 404 to user: Security group 3accad6a-d137-4d3b-a15f-246f0b113986 does not exist Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-1d7d12fb-19cb-47ca-ba4c-766ac68e288d'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8aaf9801-0d3d-43c3-9eb7-7b5213ea5d95 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/3accad6a-d137-4d3b-a15f-246f0b113986" status: 404 len: 194 microversion: 2.1 time: 0.156695 Nov 02 12:25:28.366926 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 688/1382] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:25:28 2022] DELETE /compute/v2.1/os-security-groups/3accad6a-d137-4d3b-a15f-246f0b113986 => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:25:28.372501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:28.373425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:28.381401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.381904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.382392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.383121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.383581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.384015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.393801 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-effddafc-b013-4b32-ab45-8f71d1754896 req-c0b66a91-00dc-4d32-8541-0086663ab76d service nova] Creating event network-changed:ced7ed63-2e97-4192-938d-c3e96e6d249f for instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb on n-h2-855650-5 Nov 02 12:25:28.399331 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-effddafc-b013-4b32-ab45-8f71d1754896 req-c0b66a91-00dc-4d32-8541-0086663ab76d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096065 Nov 02 12:25:28.402921 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 695/1383] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:28.409730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:28.411877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:28.419021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.419762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.420441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.422437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.423275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.423875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.835937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:28.848936 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-884aa642-664c-4a59-996a-8da4eda2c9ba tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1618 microversion: 2.1 time: 0.444487 Nov 02 12:25:28.849611 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1fbc085c-a871-4dcf-a94d-e78664484831 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.485121 Nov 02 12:25:28.850255 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 689/1384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:28 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:28.863816 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 696/1385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:28 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1618 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:28.866774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:28.867566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:28.878005 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-671f0bdc-edda-4dc5-be6c-146e8274ca32 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.012675 Nov 02 12:25:28.879275 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 697/1386] 10.222.0.45 () {58 vars in 1164 bytes} [Wed Nov 2 12:25:28 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:25:28.884080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.889305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.889862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.890688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.891163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.891595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.899246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:28.900045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:28.934954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.935604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.936059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.936808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:28.937285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:28.937701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.978632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:25:29.198462 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-da121f57-313e-40f9-b8d2-000d7591f459 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 204 len: 0 microversion: 2.1 time: 0.346752 Nov 02 12:25:29.199827 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 690/1387] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:25:28 2022] DELETE /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:25:29.209240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cebae3c4-8ca3-4070-8d87-9d38598fa182 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e978ca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:29.307546 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cebae3c4-8ca3-4070-8d87-9d38598fa182 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.105432 Nov 02 12:25:29.309441 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 691/1388] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:29 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:29.328907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2085306-0353-4964-a964-9bbf985b1d01 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Calling method '.version_select at 0x7f228e904ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:29.400783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:29.416355 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f26219e7-8861-49fe-87a7-02daa03188ec tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.535364 Nov 02 12:25:29.427254 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 698/1389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:28 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:29.445901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-760425894", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8a61e28f-f3a1-4aea-be4b-4d12f85736ed"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:29.543369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:25:29.648868 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2085306-0353-4964-a964-9bbf985b1d01 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.323850 Nov 02 12:25:29.649855 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 692/1390] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:25:29 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:29.655033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:29.655682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:29.667248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:29.672934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:29.673706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:29.674844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:29.675620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:29.676287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:29.945397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:29.958591 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ef7fe2b7-9c88-40e7-a4d9-b4e88be4feed tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1526 microversion: 2.1 time: 0.307415 Nov 02 12:25:29.961566 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 693/1391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:29 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1526 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:29.988363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:25:29.988832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:25:29.989252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:25:29.989665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:25:29.990152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:25:30.009006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:30.009504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:30.009941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:30.010699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:30.011156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:30.011580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:30.056804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:30.072421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Getting quotas for user 7c91481067cd4be881f75d33b56ee431 and project 74888962841648a7bfc8cd36cdf5526c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:30.090268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:25:30.093260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:25:30.119301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:30.121449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:30.138868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:30.140043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:30.140828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:30.141880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:30.142465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:30.143139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:30.164220 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aaaec9cd-739a-436c-9db0-22d176611ca6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735705 Nov 02 12:25:30.171643 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 699/1392] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:25:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:25:30.177040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-590d9db2-790f-421d-bfe4-8ea9b0489028 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Calling method '.version_select at 0x7f228e524a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:30.482737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-590d9db2-790f-421d-bfe4-8ea9b0489028 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:25:30.484023 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-590d9db2-790f-421d-bfe4-8ea9b0489028 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 02 12:25:30.484023 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-4a95b9ae-e23c-437c-ad88-b7aec38c5798'] Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-590d9db2-790f-421d-bfe4-8ea9b0489028 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Request method failure captured: Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/8566f003-bfac-42b3-9b33-3b55952430a7 HTTP/1.1 Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmG2Lv2bKuK7iPtommf8Rio5BYa1qVTEtsGk4p7GU5LcRe8SnVgFkr8r-P4DCHnivhCgu0hKO2sPPIiYhb_pEovecpKZ79GIa86HQAeKFK9Alz8ZEQkGbwVJp7jJ7BnEcmMGKH_7Kv3acURMD6rSb4pkSVzBbvfjpMh7PBOy5QQyjBg Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 51064f089867495b9742ee5939ac1a6d Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:25:30.486848 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51064f089867495b9742ee5939ac1a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 51064f089867495b9742ee5939ac1a6d Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsNegativeTestJSON-1062422838-project Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e702fdd73f6f4070bb64a3488296d798 Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838-project Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: exception: Insufficient rights for removing default security group. Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-4a95b9ae-e23c-437c-ad88-b7aec38c5798'] Nov 02 12:25:30.488973 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '8566f003-bfac-42b3-9b33-3b55952430a7'} Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:30.489886 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a95b9ae-e23c-437c-ad88-b7aec38c5798'] Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 02 12:25:30.491181 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a95b9ae-e23c-437c-ad88-b7aec38c5798'] Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a95b9ae-e23c-437c-ad88-b7aec38c5798'] Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:30.492422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:30.493813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:30.493813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:30.493813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:30.493813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 02 12:25:30.493813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a95b9ae-e23c-437c-ad88-b7aec38c5798'] Nov 02 12:25:30.493813 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:30.497569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-590d9db2-790f-421d-bfe4-8ea9b0489028 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 02 12:25:30.497569 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-4a95b9ae-e23c-437c-ad88-b7aec38c5798'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:30.498738 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-590d9db2-790f-421d-bfe4-8ea9b0489028 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/8566f003-bfac-42b3-9b33-3b55952430a7" status: 400 len: 182 microversion: 2.1 time: 0.326145 Nov 02 12:25:30.500102 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 700/1393] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:25:30 2022] DELETE /compute/v2.1/os-security-groups/8566f003-bfac-42b3-9b33-3b55952430a7 => generated 182 bytes in 328 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:25:30.509156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:30.518364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:30.524430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:30.542744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:30.546823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:30.548405 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c49202c2-71f2-4fb6-8811-55ac71880f7f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.584333 Nov 02 12:25:30.552211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:30.552959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:30.567098 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 694/1394] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:29 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:30.568705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:30.577515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:30.583362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:30.584063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:30.587735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36ad8e33-ad21-497b-b36f-6b115f2b4825 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:30.590600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36ad8e33-ad21-497b-b36f-6b115f2b4825 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:30.723806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36ad8e33-ad21-497b-b36f-6b115f2b4825 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:30.741336 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36ad8e33-ad21-497b-b36f-6b115f2b4825 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1216 microversion: 2.1 time: 0.161784 Nov 02 12:25:30.745554 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 695/1395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:30 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:30.760029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-217c78e8-fddd-439e-b168-83563fcbd0d2 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e978af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:30.869992 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-217c78e8-fddd-439e-b168-83563fcbd0d2 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.122627 Nov 02 12:25:30.871911 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 696/1396] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:30 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:30.880269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:30.881090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:30.895176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:30.896598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:30.897133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:30.898212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:30.898718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:30.899156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:30.981387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:30.991305 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e6350ca-fdc5-48a1-953d-b609e1330427 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.489834 Nov 02 12:25:30.993143 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 701/1397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:30 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:31.008166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12c671f0-27d4-471f-9c86-ce53d2ba5461 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Calling method '.version_select at 0x7f228e5409d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:31.055387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-12c671f0-27d4-471f-9c86-ce53d2ba5461 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:25:31.055991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-12c671f0-27d4-471f-9c86-ce53d2ba5461 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Neutron security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:25:31.056492 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-12c671f0-27d4-471f-9c86-ce53d2ba5461 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] HTTP exception thrown: Security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 does not exist Nov 02 12:25:31.056492 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-157e1ec6-252d-4ba5-a7b0-c17c35a171d2'] Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12c671f0-27d4-471f-9c86-ce53d2ba5461 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Request method failure captured: Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-security-groups/2e18ab52-8851-41d2-b966-5e6c3abe0711 HTTP/1.1 Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmG2Lv2bKuK7iPtommf8Rio5BYa1qVTEtsGk4p7GU5LcRe8SnVgFkr8r-P4DCHnivhCgu0hKO2sPPIiYhb_pEovecpKZ79GIa86HQAeKFK9Alz8ZEQkGbwVJp7jJ7BnEcmMGKH_7Kv3acURMD6rSb4pkSVzBbvfjpMh7PBOy5QQyjBg Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 51064f089867495b9742ee5939ac1a6d Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:25:31.058365 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51064f089867495b9742ee5939ac1a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 51064f089867495b9742ee5939ac1a6d Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupsNegativeTestJSON-1062422838-project Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e702fdd73f6f4070bb64a3488296d798 Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838-project Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 does not exist Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-157e1ec6-252d-4ba5-a7b0-c17c35a171d2'] Nov 02 12:25:31.060058 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2e18ab52-8851-41d2-b966-5e6c3abe0711'} Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.065381 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 does not exist Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-157e1ec6-252d-4ba5-a7b0-c17c35a171d2'] Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:25:31.067615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 does not exist Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-157e1ec6-252d-4ba5-a7b0-c17c35a171d2'] Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 does not exist Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-157e1ec6-252d-4ba5-a7b0-c17c35a171d2'] Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.069058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 does not exist Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-157e1ec6-252d-4ba5-a7b0-c17c35a171d2'] Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12c671f0-27d4-471f-9c86-ce53d2ba5461 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Returning 404 to user: Security group 2e18ab52-8851-41d2-b966-5e6c3abe0711 does not exist Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-157e1ec6-252d-4ba5-a7b0-c17c35a171d2'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-12c671f0-27d4-471f-9c86-ce53d2ba5461 tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/2e18ab52-8851-41d2-b966-5e6c3abe0711" status: 404 len: 194 microversion: 2.1 time: 0.065408 Nov 02 12:25:31.071060 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 702/1398] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:25:30 2022] GET /compute/v2.1/os-security-groups/2e18ab52-8851-41d2-b966-5e6c3abe0711 => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:25:31.073433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:31.073582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:31.086929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:31.087429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:31.087868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:31.088577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:31.089031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:31.089649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:31.218132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:31.230283 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3b0efaf3-62a2-4ed7-9932-cefb2cf56535 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.356961 Nov 02 12:25:31.234950 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 697/1399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:30 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:31.240803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-033c899e-55b9-47d8-b760-044714dcad0b tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Action: 'update', calling method: .version_select at 0x7f228e9945e0>, body: {"security_group": {"name": "tempest-sg-1793878207", "description": "tempest-description-536522722"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:31.321777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-033c899e-55b9-47d8-b760-044714dcad0b tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 708501c4-b4b9-40cb-b12e-295546e9d519 does not exist", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:25:31.322461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.security_group_api [None req-033c899e-55b9-47d8-b760-044714dcad0b tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Neutron security group 708501c4-b4b9-40cb-b12e-295546e9d519 not found {{(pid=120723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:25:31.322988 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-033c899e-55b9-47d8-b760-044714dcad0b tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] HTTP exception thrown: Security group 708501c4-b4b9-40cb-b12e-295546e9d519 does not exist Nov 02 12:25:31.322988 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-61a03cd3-9e6a-4611-8319-ebfa7f3fc2a7'] Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-033c899e-55b9-47d8-b760-044714dcad0b tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Request method failure captured: Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/os-security-groups/708501c4-b4b9-40cb-b12e-295546e9d519 HTTP/1.1 Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 101 Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmG2Lv2bKuK7iPtommf8Rio5BYa1qVTEtsGk4p7GU5LcRe8SnVgFkr8r-P4DCHnivhCgu0hKO2sPPIiYhb_pEovecpKZ79GIa86HQAeKFK9Alz8ZEQkGbwVJp7jJ7BnEcmMGKH_7Kv3acURMD6rSb4pkSVzBbvfjpMh7PBOy5QQyjBg Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 51064f089867495b9742ee5939ac1a6d Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:25:31.324946 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51064f089867495b9742ee5939ac1a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51064f089867495b9742ee5939ac1a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 51064f089867495b9742ee5939ac1a6d Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838 Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-SecurityGroupsNegativeTestJSON-1062422838-project Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: e702fdd73f6f4070bb64a3488296d798 Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1062422838-project Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: {"security_group": {"name": "tempest-sg-1793878207", "description": "tempest-description-536522722"}} Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:25:31.326445 n-d-855650-5 devstack@n-api.service[120723]: exception: Security group 708501c4-b4b9-40cb-b12e-295546e9d519 does not exist Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-61a03cd3-9e6a-4611-8319-ebfa7f3fc2a7'] Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '708501c4-b4b9-40cb-b12e-295546e9d519', 'body': {'security_group': {'name': 'tempest-sg-1793878207', 'description': 'tempest-description-536522722'}}} Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:25:31.327320 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 708501c4-b4b9-40cb-b12e-295546e9d519 does not exist Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a03cd3-9e6a-4611-8319-ebfa7f3fc2a7'] Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:25:31.328530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 708501c4-b4b9-40cb-b12e-295546e9d519 does not exist Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a03cd3-9e6a-4611-8319-ebfa7f3fc2a7'] Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 708501c4-b4b9-40cb-b12e-295546e9d519 does not exist Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a03cd3-9e6a-4611-8319-ebfa7f3fc2a7'] Nov 02 12:25:31.329745 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 708501c4-b4b9-40cb-b12e-295546e9d519 does not exist Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a03cd3-9e6a-4611-8319-ebfa7f3fc2a7'] Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-033c899e-55b9-47d8-b760-044714dcad0b tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] Returning 404 to user: Security group 708501c4-b4b9-40cb-b12e-295546e9d519 does not exist Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: Neutron server returns request_ids: ['req-61a03cd3-9e6a-4611-8319-ebfa7f3fc2a7'] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:31.333825 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-033c899e-55b9-47d8-b760-044714dcad0b tempest-SecurityGroupsNegativeTestJSON-1062422838 tempest-SecurityGroupsNegativeTestJSON-1062422838-project] 10.222.0.45 "PUT /compute/v2.1/os-security-groups/708501c4-b4b9-40cb-b12e-295546e9d519" status: 404 len: 194 microversion: 2.1 time: 0.090850 Nov 02 12:25:31.346071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 698/1400] 10.222.0.45 () {60 vars in 1290 bytes} [Wed Nov 2 12:25:31 2022] PUT /compute/v2.1/os-security-groups/708501c4-b4b9-40cb-b12e-295546e9d519 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:25:31.382922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:31.391915 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff4bf8bd-444c-4e2d-b1c9-9cc58c69b526 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1526 microversion: 2.1 time: 0.326506 Nov 02 12:25:31.392501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 703/1401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:31 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1526 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:31.585069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:31.585661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:31.598856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:31.599706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:31.602546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:31.603661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:31.606991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:31.607931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:31.778034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:31.779664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:31.798220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:31.799585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:31.801349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:31.803480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:31.807272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:31.808496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:31.839071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:31.878012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:31.887883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:31.889324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:31.896037 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c314ea9-8a52-4bf4-aacd-c82bc485266d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.314540 Nov 02 12:25:31.905691 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 699/1402] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:31 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:25:31.913562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-606969e0-bd76-4f81-924b-aea5801bedf2 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e978c10>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:31.950803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:31.960065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f87d12b4-42f0-4591-a8ff-08ad431551f9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1220 microversion: 2.1 time: 0.192380 Nov 02 12:25:31.963272 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 704/1403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:31 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1220 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:31.992794 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-606969e0-bd76-4f81-924b-aea5801bedf2 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.085600 Nov 02 12:25:31.993375 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 700/1404] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:31 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:32.024000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:32.024629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:32.036875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.037368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.037804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.040792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.042680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.043390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.257456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:32.258117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:32.277904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.278367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.278819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.279545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.280005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.290231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:32.295443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.302880 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e04a5b3f-9762-41af-a655-15d20cc572d6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.283664 Nov 02 12:25:32.305699 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 705/1405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:32 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:32.419176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:32.420422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:32.437033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.437991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.438600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.439638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.441393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.444818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.699033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:32.707548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4047fb19-ed0b-405c-849d-94d97ae7a1a8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.454649 Nov 02 12:25:32.711095 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 701/1406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:32 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:32.721671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d475de0c-2ccd-4d7a-a3db-018cc55018de req-c88b785b-bbb7-4506-8f71-a028a809908e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1c9deb-57fd-4e6f-99ab-2b38d0265349", "name": "network-vif-unplugged", "status": "completed", "tag": "0e224186-7075-402e-bcba-bb782ace3e07"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:32.747575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d475de0c-2ccd-4d7a-a3db-018cc55018de req-c88b785b-bbb7-4506-8f71-a028a809908e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.748423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d475de0c-2ccd-4d7a-a3db-018cc55018de req-c88b785b-bbb7-4506-8f71-a028a809908e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.752330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d475de0c-2ccd-4d7a-a3db-018cc55018de req-c88b785b-bbb7-4506-8f71-a028a809908e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.777873 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d475de0c-2ccd-4d7a-a3db-018cc55018de req-c88b785b-bbb7-4506-8f71-a028a809908e service nova] Creating event network-vif-unplugged:0e224186-7075-402e-bcba-bb782ace3e07 for instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 on n-h1-855650-5 Nov 02 12:25:32.788816 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d475de0c-2ccd-4d7a-a3db-018cc55018de req-c88b785b-bbb7-4506-8f71-a028a809908e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076127 Nov 02 12:25:32.795845 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 702/1407] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:32.809777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:32.821306 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dbc9cc45-998b-4b94-8d74-4eecb0095844 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1526 microversion: 2.1 time: 0.408201 Nov 02 12:25:32.824988 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 706/1408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:32 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1526 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:32.932400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:32.933499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:32.945053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.947722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.948463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.949597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.952758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.953697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.991232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:32.991925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:33.015457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.019741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.021172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.022143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.024243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.026943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.207256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:33.221138 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-052ce7c0-737c-4e81-b85a-95ff95406629 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1220 microversion: 2.1 time: 0.234629 Nov 02 12:25:33.223246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 707/1409] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:32 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1220 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:33.234413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59ef4fff-7862-4b90-810b-84e8db9293b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e66c550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:33.347627 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59ef4fff-7862-4b90-810b-84e8db9293b8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.120925 Nov 02 12:25:33.353521 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 708/1410] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:33 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:33.360152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:33.360786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:33.379291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.382383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.382883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.383649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.384127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.384563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.442388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:33.460863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:33.470439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:33.471940 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd0057c6-3f30-4f84-acc7-f122707363f3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.543820 Nov 02 12:25:33.495707 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 703/1411] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:32 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:33.745113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:33.751801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:33.785715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.806764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.807310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.811672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.814873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.816097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.866560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:33.882028 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bea25c6f-9727-48c2-9f1e-85c01dbc10b2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.525209 Nov 02 12:25:33.884897 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 709/1412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:33 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:33.903915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:33.905158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:33.917885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.929848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.931517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.936056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.937302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.937933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:34.420537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:34.434020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-251c9211-6cb9-4ddc-80f2-e9a6a8a42d79 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.697729 Nov 02 12:25:34.434616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 704/1413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:33 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:34.439348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:34.443658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:34.460936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:34.461676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:34.463751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:34.464774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:34.467795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:34.468489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:34.483663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:34.529678 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c02bccc-a128-4538-aa75-ef78fd660965 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1526 microversion: 2.1 time: 0.642920 Nov 02 12:25:34.531304 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 710/1414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:33 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1526 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:34.537655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5bde48a-1d21-428d-9b12-5df50ea15419 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e520550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:34.590548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:34.600333 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6cec1b8e-3e8b-44d4-975a-304fed4002db tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1268 microversion: 2.1 time: 0.164459 Nov 02 12:25:34.604211 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 705/1415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:34 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:34.619672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:34.620633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:34.636361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:34.636880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:34.637334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:34.638104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:34.644081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:34.644722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:34.662385 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a5bde48a-1d21-428d-9b12-5df50ea15419 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.129653 Nov 02 12:25:34.674585 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 711/1416] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:34 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:34.898117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:34.908897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:34.909512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:34.910175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:34.911667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:34.913232 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-51b2139b-2c45-4321-ac2b-2dafcf5845cf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.307771 Nov 02 12:25:34.914671 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 706/1417] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:34 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:34.928958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:34.929773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:34.931394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:34.933587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:34.935336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:34.936083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.212704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:35.231841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dbba812e-8e83-473d-9ceb-ac0acac80c05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.326937 Nov 02 12:25:35.232438 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 712/1418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:34 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:35.466841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:35.469661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:35.482039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.483319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.485059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.489116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.490464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.491244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.559662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:35.561106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:35.568915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.569792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.570620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.572333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.574136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.574850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.754504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:35.763405 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-32f7e205-a544-4178-b218-0476dcd3cbfa tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1484 microversion: 2.1 time: 0.208459 Nov 02 12:25:35.769163 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 713/1419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:35 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1484 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:35.781854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:35.782970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:35.803469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:35.804313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.805040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.806168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.807243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.807713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.808148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.812505 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-19219175-0a97-4a7a-8630-f9b5073c7862 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.353719 Nov 02 12:25:35.821314 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 707/1420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:35 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:35.850101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-62449308-079c-40b0-bd7f-e41168862c5c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8b4700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:35.943939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:35.955890 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-941d8209-48fb-4d99-b2b6-dc5f8ccc95be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1274 microversion: 2.1 time: 0.185168 Nov 02 12:25:35.957365 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 714/1421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:35 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:35.965323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:35.966174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:35.974984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.975653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.976222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.977134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.977699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.978270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.985808 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-62449308-079c-40b0-bd7f-e41168862c5c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1455 microversion: 2.1 time: 0.153436 Nov 02 12:25:35.987943 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 708/1422] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:35 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:36.140225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-598ab72f-75c1-4a30-a40f-0f07f006c909 req-9af23599-e02b-4da4-bd8b-44097ee15836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1c9deb-57fd-4e6f-99ab-2b38d0265349", "name": "network-vif-deleted", "tag": "0e224186-7075-402e-bcba-bb782ace3e07"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:36.158027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-598ab72f-75c1-4a30-a40f-0f07f006c909 req-9af23599-e02b-4da4-bd8b-44097ee15836 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.158520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-598ab72f-75c1-4a30-a40f-0f07f006c909 req-9af23599-e02b-4da4-bd8b-44097ee15836 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.158957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-598ab72f-75c1-4a30-a40f-0f07f006c909 req-9af23599-e02b-4da4-bd8b-44097ee15836 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.194114 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-598ab72f-75c1-4a30-a40f-0f07f006c909 req-9af23599-e02b-4da4-bd8b-44097ee15836 service nova] Creating event network-vif-deleted:0e224186-7075-402e-bcba-bb782ace3e07 for instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 on n-h1-855650-5 Nov 02 12:25:36.207302 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-598ab72f-75c1-4a30-a40f-0f07f006c909 req-9af23599-e02b-4da4-bd8b-44097ee15836 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070400 Nov 02 12:25:36.208570 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 709/1423] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:36.250199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:36.258460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:36.259405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:36.264525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:36.266203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:36.267538 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eadd3b94-8a55-40d4-9400-25032eabee5c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.308814 Nov 02 12:25:36.268850 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 715/1424] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:35 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:36.275717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.282760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.283555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.285080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.285778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.286755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.594243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:36.608265 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ab027d2-622b-480a-a0dc-7fac5a318a4e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.355298 Nov 02 12:25:36.628652 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 710/1425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:36 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:36.799329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:36.801402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:36.809503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.810460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.811336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.812483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.813193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.814649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.849114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:36.850211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:36.861273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.863165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.870038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.870314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.870734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.871525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.873374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.874784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.875904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.881593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lazy-loading 'fault' on Instance uuid 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:25:36.933024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:36.942859 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95fe9590-bc6b-47a1-be48-3e0eaaeacb6f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 200 len: 1314 microversion: 2.1 time: 0.150204 Nov 02 12:25:36.950545 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 716/1426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:36 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:36.988338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:36.989081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:36.995911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.997802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.997802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.998158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.998325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.998748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.077441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:37.086261 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64307a10-5bf6-481d-8498-ca3b7a559abb tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1274 microversion: 2.1 time: 0.104100 Nov 02 12:25:37.086855 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 717/1427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:36 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:37.100839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a27db3a-e482-4ed0-b2ce-df9e1cd58516 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e57cf70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:37.113148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:37.121147 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4a67a3a6-437b-4ffe-b1a4-11fbda37c518 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.277959 Nov 02 12:25:37.121728 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 711/1428] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:36 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:37.156120 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a27db3a-e482-4ed0-b2ce-df9e1cd58516 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1464 microversion: 2.1 time: 0.068005 Nov 02 12:25:37.156994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 718/1429] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:37 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1464 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:37.171379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d1b27e5-0f4c-467b-a46d-1ff8e56cb2fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8b24c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:37.222459 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d1b27e5-0f4c-467b-a46d-1ff8e56cb2fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 200 len: 1464 microversion: 2.1 time: 0.054300 Nov 02 12:25:37.223261 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 712/1430] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:37 2022] GET /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:37.237094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:37.238254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:37.244843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:37.245283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:37.245945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.246890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:37.247517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:37.248109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.298546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:37.298546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:37.322131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:37.322867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:37.323367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.324069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:37.324609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:37.339236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.342465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:37.613603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:37.624402 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92af792a-eb97-4bed-8cbd-318c1896ca14 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1481 microversion: 2.1 time: 0.391140 Nov 02 12:25:37.642974 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 719/1431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:37 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1481 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:37.668736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:37.671536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:37.695732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:37.698238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:37.701787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.703987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:37.705934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:37.706521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.714173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:37.729925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:37.732408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:37.733888 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eea4b437-a9ef-44fd-991d-e8e58ff1dd04 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.439997 Nov 02 12:25:37.735180 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 713/1432] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:37 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:37.920360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:37.933094 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bcd57a80-dade-444c-81ef-fc1461d4e42b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.285916 Nov 02 12:25:37.933789 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 720/1433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:37 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:37.967705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:37.968733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:37.976900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:37.977377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:37.977890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.978922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:37.979485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:37.980142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.995358 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 HTTP/1.1 Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:25:37.997126 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:25:37.998859 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '5f1c9deb-57fd-4e6f-99ab-2b38d0265349'} Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:37.999762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:25:38.001065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:25:38.003425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:38.004606 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8dfe54fc-103a-4dfc-a7eb-3d75d9754975 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 404 len: 111 microversion: 2.1 time: 0.040912 Nov 02 12:25:38.005188 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 714/1434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:37 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:25:38.111078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:38.112258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:38.125134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-126828644", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:38.134895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.136538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.137351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.138217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.138905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.139506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.198661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] validate_networks() for [('4f15fe59-ad56-4fe4-bb95-1f56ed9444ee', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:25:38.411778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:38.420637 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef4482c7-4e2a-4c25-b19f-04f3df3e7b22 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.314248 Nov 02 12:25:38.436251 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 721/1435] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:38 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:38.443829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:38.444954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:38.452584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.453379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.454154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.455108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.455782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.457028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.737757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:38.749857 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33b5e634-242c-4d2a-a51a-827569ee38ad tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.311987 Nov 02 12:25:38.754578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 722/1436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:38 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:38.774408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1ce901fc-9138-49bf-8fa4-c9d2d238ede0 req-315f5208-0dd1-459b-ac2d-5e1f377ba053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf7c70a-03b4-456d-96c0-8e892183b1ac", "name": "network-vif-unplugged", "status": "completed", "tag": "9264ba98-f8b6-4854-ae4f-4f7c06f5258d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:38.791567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1ce901fc-9138-49bf-8fa4-c9d2d238ede0 req-315f5208-0dd1-459b-ac2d-5e1f377ba053 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.792165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1ce901fc-9138-49bf-8fa4-c9d2d238ede0 req-315f5208-0dd1-459b-ac2d-5e1f377ba053 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.793066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1ce901fc-9138-49bf-8fa4-c9d2d238ede0 req-315f5208-0dd1-459b-ac2d-5e1f377ba053 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.822684 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1ce901fc-9138-49bf-8fa4-c9d2d238ede0 req-315f5208-0dd1-459b-ac2d-5e1f377ba053 service nova] Creating event network-vif-unplugged:9264ba98-f8b6-4854-ae4f-4f7c06f5258d for instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac on n-h1-855650-5 Nov 02 12:25:38.848649 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1ce901fc-9138-49bf-8fa4-c9d2d238ede0 req-315f5208-0dd1-459b-ac2d-5e1f377ba053 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091594 Nov 02 12:25:38.849803 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 723/1437] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:38.855351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8383052e-a55b-4945-84ce-097969a0fd47 req-240e206a-fb35-44ca-a5fe-da342dd77893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d49e5e-9685-40ff-8809-82f6164edf54", "name": "network-vif-plugged", "status": "completed", "tag": "f9b01e21-de84-46e4-b5e7-8f2972efa454"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:38.866223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8383052e-a55b-4945-84ce-097969a0fd47 req-240e206a-fb35-44ca-a5fe-da342dd77893 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.866872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8383052e-a55b-4945-84ce-097969a0fd47 req-240e206a-fb35-44ca-a5fe-da342dd77893 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.867427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8383052e-a55b-4945-84ce-097969a0fd47 req-240e206a-fb35-44ca-a5fe-da342dd77893 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.880047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8383052e-a55b-4945-84ce-097969a0fd47 req-240e206a-fb35-44ca-a5fe-da342dd77893 service nova] Creating event network-vif-plugged:f9b01e21-de84-46e4-b5e7-8f2972efa454 for instance 24d49e5e-9685-40ff-8809-82f6164edf54 on n-h1-855650-5 Nov 02 12:25:38.897320 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8383052e-a55b-4945-84ce-097969a0fd47 req-240e206a-fb35-44ca-a5fe-da342dd77893 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045833 Nov 02 12:25:38.899529 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 724/1438] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:38.910166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:38.911971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:38.930544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.931450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.932471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.933300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.934024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.934665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.940925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:39.065424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:25:39.065930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:25:39.066448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:25:39.067916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:25:39.068785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:25:39.088979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.095168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.095763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.098576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.100384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.102943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.123778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Getting quotas for project ec1d3a52fa334a5397b03d71086cfffc. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:39.130004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Getting quotas for user ead418d7f3f945b3a3ad7432805fd929 and project ec1d3a52fa334a5397b03d71086cfffc. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:39.144814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:39.145218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:25:39.148789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:25:39.157659 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19fca4ee-bcf3-40b4-a333-927752abb024 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1468 microversion: 2.1 time: 0.254276 Nov 02 12:25:39.158631 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 725/1439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:38 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1468 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:39.175670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:39.176293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:39.188735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.189774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.192315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.195564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.197848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.198572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.234857 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-966190c9-362d-4d42-9910-31c7762c5898 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.113443 Nov 02 12:25:39.243809 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 715/1440] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:25:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:25:39.248278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:39.252371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:39.269061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.269061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.269061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.273381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.274469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.276791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.579723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:39.612641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:39.617850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:39.627702 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a241235d-ddbd-409d-8ab8-3c11fcd13ddc tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.467206 Nov 02 12:25:39.628606 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 726/1441] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:39 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:39.635335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2029430886"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:39.643253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:39.657471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:39.661243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.662312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.663832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.667435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.669713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.670394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:40.012118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:40.025330 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e8d5dac-a018-4228-ad5e-025cd145ce34 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.785570 Nov 02 12:25:40.026542 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 716/1442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:39 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:40.033140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b382a0e0-7ac3-4daa-a779-67a7ff0ef76a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:40.036231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b382a0e0-7ac3-4daa-a779-67a7ff0ef76a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:40.043191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:40.092324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:40.114653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba21b8f7-31ab-430e-94a8-9bf3bd6f66fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "POST /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b/action" status: 202 len: 0 microversion: 2.1 time: 0.484471 Nov 02 12:25:40.116043 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 727/1443] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:25:39 2022] POST /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:25:40.125455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:40.126630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:40.133835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b382a0e0-7ac3-4daa-a779-67a7ff0ef76a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:40.138864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:40.139583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:40.140331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:40.141829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:40.142582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:40.143187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:40.145544 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b382a0e0-7ac3-4daa-a779-67a7ff0ef76a tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1224 microversion: 2.1 time: 0.117903 Nov 02 12:25:40.146743 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 717/1444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:40 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:40.169876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:40.170881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:40.180713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:40.183930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:40.184682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:40.186066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:40.186953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:40.187552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:40.533820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:40.548399 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8bfbde5f-7505-4d40-84ca-6ac104fe4460 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.387977 Nov 02 12:25:40.550320 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 718/1445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:40 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:40.567846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b0cd91e8-73c6-4269-9f2a-563b3e4df4e1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e904550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:40.572808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:40.596413 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4599360-3d66-4029-90d7-406b48ffce0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.477633 Nov 02 12:25:40.597293 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 728/1446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:40 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:40.629913 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b0cd91e8-73c6-4269-9f2a-563b3e4df4e1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.078294 Nov 02 12:25:40.638959 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 719/1447] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:40 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:40.658850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:40.659771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:40.672442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:40.673949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:40.679453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:40.683200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:40.685689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:40.687782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:40.887321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e4f77602-e433-45f0-9d12-7bdfb4c20823 req-7de5dfe6-22d3-49da-8aca-2008721d0092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf7c70a-03b4-456d-96c0-8e892183b1ac", "tag": "9264ba98-f8b6-4854-ae4f-4f7c06f5258d"}, {"name": "network-changed", "server_uuid": "eb99e945-3f4e-472d-bf1f-e503ca63242a", "tag": "fec13c2b-e1b2-462c-954b-ca9ba5526376"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:40.903782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:40.915818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e4f77602-e433-45f0-9d12-7bdfb4c20823 req-7de5dfe6-22d3-49da-8aca-2008721d0092 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:40.916331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e4f77602-e433-45f0-9d12-7bdfb4c20823 req-7de5dfe6-22d3-49da-8aca-2008721d0092 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:40.916773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e4f77602-e433-45f0-9d12-7bdfb4c20823 req-7de5dfe6-22d3-49da-8aca-2008721d0092 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:40.935282 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e4f77602-e433-45f0-9d12-7bdfb4c20823 req-7de5dfe6-22d3-49da-8aca-2008721d0092 service nova] Creating event network-changed:9264ba98-f8b6-4854-ae4f-4f7c06f5258d for instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac on n-h1-855650-5 Nov 02 12:25:40.936204 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e4f77602-e433-45f0-9d12-7bdfb4c20823 req-7de5dfe6-22d3-49da-8aca-2008721d0092 service nova] Creating event network-changed:fec13c2b-e1b2-462c-954b-ca9ba5526376 for instance eb99e945-3f4e-472d-bf1f-e503ca63242a on n-h1-855650-5 Nov 02 12:25:40.946198 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e4f77602-e433-45f0-9d12-7bdfb4c20823 req-7de5dfe6-22d3-49da-8aca-2008721d0092 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062547 Nov 02 12:25:40.947179 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 720/1448] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:41.006379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:41.019750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:41.021665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:41.023080 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c74366f0-5056-4f5c-9fd0-cda69b5dcfe8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.369507 Nov 02 12:25:41.024201 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 729/1449] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:40 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:41.055577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:41.056270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:41.071087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.071667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.072230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.073019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.074166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.074844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.177797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:41.178602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:41.185663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.186372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.186931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.187955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.188534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.189218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.286855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:41.296352 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36c30f1a-10ff-465b-9130-f569e6e3585e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1276 microversion: 2.1 time: 0.123699 Nov 02 12:25:41.307039 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 730/1450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:41 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:41.427642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:41.441669 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-034992ab-a22a-4a6b-8f34-dd37a98706e0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.392280 Nov 02 12:25:41.442845 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 721/1451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:41 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:41.576823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:41.577455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:41.584463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.584958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.585421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.586253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.586638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.587101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.623690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:41.624388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:41.635525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.636028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.639421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.641733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.643316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.645638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.845360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:41.860014 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-23994ef6-7eb4-4b48-b3a3-cd78c7a7cf31 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1351 microversion: 2.1 time: 0.285863 Nov 02 12:25:41.861090 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 731/1452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:41 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1351 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:41.881362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c9e0a8d-7cc5-43e3-85fb-5e8f0b66c8ca tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e521e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:41.955458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:41.963422 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c9e0a8d-7cc5-43e3-85fb-5e8f0b66c8ca tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.100893 Nov 02 12:25:41.964433 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 732/1453] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:41 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:41.976753 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-648af117-1846-4e6f-baa5-f3c56ad5781c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.356822 Nov 02 12:25:41.978496 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 722/1454] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:41 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:42.051272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:42.052012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:42.059264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.059765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.060219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.060937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.061400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.061873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.246577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:42.257545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:42.259177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:42.260383 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ed77fad8-6b05-4e2c-bf74-7d741618aa7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.214026 Nov 02 12:25:42.262342 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 733/1455] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:42 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:42.353712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:42.355169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:42.373068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.375633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.376102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.380100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.380823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.381272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.467806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:42.470722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:42.472900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:42.492450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.492734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49c32c90-d816-45e6-9fe8-94c55242ad04 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1282 microversion: 2.1 time: 0.140782 Nov 02 12:25:42.493327 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 723/1456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:42 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:42.503222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.504145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.511327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.512079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.512736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.760133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:42.777644 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1bfd9c5-e619-49b2-8f84-024c87da14df tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.313061 Nov 02 12:25:42.779815 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 734/1457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:42 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:42.885340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:42.886287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:42.894423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.895518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.896341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.897298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.898115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.898794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.926526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4abb79a4-eccc-49de-affb-1bfe46878efd req-53d6c498-1f90-470a-bdc4-a181ae82233d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f4ff71-fa75-4ac9-9661-ebb7bbc3995f", "name": "network-vif-unplugged", "status": "completed", "tag": "9d585ce4-7020-4e3d-b408-02a183917027"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:42.968230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4abb79a4-eccc-49de-affb-1bfe46878efd req-53d6c498-1f90-470a-bdc4-a181ae82233d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.969105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4abb79a4-eccc-49de-affb-1bfe46878efd req-53d6c498-1f90-470a-bdc4-a181ae82233d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.969782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4abb79a4-eccc-49de-affb-1bfe46878efd req-53d6c498-1f90-470a-bdc4-a181ae82233d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.996164 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4abb79a4-eccc-49de-affb-1bfe46878efd req-53d6c498-1f90-470a-bdc4-a181ae82233d service nova] Creating event network-vif-unplugged:9d585ce4-7020-4e3d-b408-02a183917027 for instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f on n-h1-855650-5 Nov 02 12:25:43.003694 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4abb79a4-eccc-49de-affb-1bfe46878efd req-53d6c498-1f90-470a-bdc4-a181ae82233d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081116 Nov 02 12:25:43.004779 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 735/1458] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:43.013318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cc0e5e0-a4f4-4194-a3f9-b65d77d63c57 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e4c5310>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:43.079059 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8cc0e5e0-a4f4-4194-a3f9-b65d77d63c57 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.072439 Nov 02 12:25:43.079928 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 736/1459] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:43 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:43.101249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:43.102484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:43.109524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.111020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.112000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.112996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.113751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.114414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.577928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:43.597211 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be649b86-3c03-4647-b316-306a44291f92 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1540 microversion: 2.1 time: 0.716378 Nov 02 12:25:43.598461 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 724/1460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:42 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1540 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:43.603990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:43.604956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:43.611850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.613304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.614240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.615565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.616036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.616468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.697361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:43.706893 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e8e3493-9a8c-4892-8124-bb2a5f425bb7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.625688 Nov 02 12:25:43.707588 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 737/1461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:43 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:43.730255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:43.730883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:43.739808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.740307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.740744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.741776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.742189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.742643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.853328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:43.870873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d9f2b14-8dd0-471e-9a1b-f96146b184f7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1282 microversion: 2.1 time: 0.160955 Nov 02 12:25:43.873333 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 738/1462] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:43 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:43.880257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:43.881326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:43.891665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.892959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.899026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.899941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.900536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.901056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.989663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:44.001300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:44.004332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:44.006562 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2584751f-b605-4d70-bf39-d912458ede63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.406157 Nov 02 12:25:44.007848 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 725/1463] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:43 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:44.014150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:44.015373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:44.021489 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e00d5d7-cac7-415e-9fac-e919d4410735 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146216 Nov 02 12:25:44.036563 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 739/1464] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:25:43 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:44.058643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:44.060036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:44.060932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:44.062202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:44.062935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:44.063601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:44.099523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2436c828-fa7a-406f-a2c2-c3b804410d0b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e4d2e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:44.160253 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2436c828-fa7a-406f-a2c2-c3b804410d0b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.066889 Nov 02 12:25:44.162039 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 740/1465] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:44 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:44.479781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:44.489878 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d921534-7292-49a3-b20d-4d45e9e64596 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.480276 Nov 02 12:25:44.491260 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 726/1466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:44 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:44.731128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:44.732414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:44.743152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:44.743923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:44.744564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:44.745601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:44.746311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:44.746907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:44.897862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:44.898568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:44.916957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:44.917758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:44.918817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:44.920312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:44.921216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:44.922499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:45.448778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:45.460066 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6d1f4c3-6613-4cab-8877-7afdd936e591 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.566520 Nov 02 12:25:45.477599 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 727/1467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:44 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:45.483324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:45.486697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:45.493011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:45.493766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:45.494433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:45.495340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:45.495951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:45.496536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:45.595075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:45.604310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b73c7b5f-5aae-4864-a8dd-9fc5c29f9e8b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.877283 Nov 02 12:25:45.605660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 741/1468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:44 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:45.611584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3564d939-1c12-45c8-8bf8-0a65a4df8152 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e521c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:45.673546 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3564d939-1c12-45c8-8bf8-0a65a4df8152 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.066417 Nov 02 12:25:45.674349 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 742/1469] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:45 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:45.681740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f029f158-6226-4f19-bce7-b5bbebef4434 req-c4e42eb8-d9f6-4e42-be40-b913cf9c2c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6c6158-52c8-43c7-af6c-7d4f5cac0c53", "tag": "82f9b39f-74e9-4951-8398-db585044d561"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:45.700954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f029f158-6226-4f19-bce7-b5bbebef4434 req-c4e42eb8-d9f6-4e42-be40-b913cf9c2c78 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:45.701894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f029f158-6226-4f19-bce7-b5bbebef4434 req-c4e42eb8-d9f6-4e42-be40-b913cf9c2c78 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:45.702617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f029f158-6226-4f19-bce7-b5bbebef4434 req-c4e42eb8-d9f6-4e42-be40-b913cf9c2c78 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:45.721249 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f029f158-6226-4f19-bce7-b5bbebef4434 req-c4e42eb8-d9f6-4e42-be40-b913cf9c2c78 service nova] Creating event network-changed:82f9b39f-74e9-4951-8398-db585044d561 for instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 on n-h2-855650-5 Nov 02 12:25:45.736750 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f029f158-6226-4f19-bce7-b5bbebef4434 req-c4e42eb8-d9f6-4e42-be40-b913cf9c2c78 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059788 Nov 02 12:25:45.738781 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 743/1470] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:45.748243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:45.748958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:45.758081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:45.758597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:45.759050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:45.759827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:45.760313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:45.760768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:45.923420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:45.954071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:45.956158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:45.957699 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c962bb3b-9824-401d-9f1a-0656698cd537 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.478843 Nov 02 12:25:45.974861 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 728/1471] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:45 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:46.102805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:46.112194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9cb13392-8326-4415-b84e-655751d29d0e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.371778 Nov 02 12:25:46.117115 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 744/1472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:45 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:46.369337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-2898045b-a6e3-451f-9268-81daacbe28ab req-452d3899-9e4b-4cba-b2ba-076275ef8446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d49e5e-9685-40ff-8809-82f6164edf54", "tag": "f9b01e21-de84-46e4-b5e7-8f2972efa454"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:46.380713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2898045b-a6e3-451f-9268-81daacbe28ab req-452d3899-9e4b-4cba-b2ba-076275ef8446 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:46.381395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2898045b-a6e3-451f-9268-81daacbe28ab req-452d3899-9e4b-4cba-b2ba-076275ef8446 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:46.381936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2898045b-a6e3-451f-9268-81daacbe28ab req-452d3899-9e4b-4cba-b2ba-076275ef8446 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:46.401674 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-2898045b-a6e3-451f-9268-81daacbe28ab req-452d3899-9e4b-4cba-b2ba-076275ef8446 service nova] Creating event network-changed:f9b01e21-de84-46e4-b5e7-8f2972efa454 for instance 24d49e5e-9685-40ff-8809-82f6164edf54 on n-h1-855650-5 Nov 02 12:25:46.410263 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-2898045b-a6e3-451f-9268-81daacbe28ab req-452d3899-9e4b-4cba-b2ba-076275ef8446 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043906 Nov 02 12:25:46.411458 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 729/1473] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:46.484507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:46.485408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:46.493590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:46.494392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:46.495301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:46.496342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:46.497009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:46.497779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:46.629626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:46.631035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:46.640141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:46.645358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:46.645892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:46.646696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:46.647166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:46.647620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:47.267598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:47.269498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:47.280691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb4e5eec-230a-437a-b2d9-5e852d888b06 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.800550 Nov 02 12:25:47.282386 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-75eac54c-7451-4c9c-b62c-6639b18b0cf9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.656902 Nov 02 12:25:47.292114 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 745/1474] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:46 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:47.298123 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 730/1475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:46 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:47.298620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-210d5b86-21f2-4127-8d9e-b9f189cf039b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e520430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:47.303792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:47.304410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:47.313258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:47.314064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:47.314683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:47.316753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:47.318386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:47.319024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:47.366824 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-210d5b86-21f2-4127-8d9e-b9f189cf039b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.073056 Nov 02 12:25:47.370323 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 746/1476] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:47 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:47.379175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:47.380075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:47.387035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:47.387822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:47.388270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:47.389436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:47.389896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:47.390525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:47.396522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:47.639630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:47.661879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:47.667879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:47.669139 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-79c89d57-f54d-43cc-834c-46a96c9dcf43 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.370004 Nov 02 12:25:47.669707 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 731/1477] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:47 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:47.729011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:47.739778 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fdf57328-4441-4baf-8a2d-9bb4d94de0fe tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.368218 Nov 02 12:25:47.750089 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 747/1478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:47 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:48.309431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:48.312474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:48.313096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:48.313373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:48.329667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:48.330623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:48.332192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:48.332739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:48.333226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:48.333913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:48.334897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:48.335922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:48.336634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:48.337328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:48.338057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:48.338745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:48.866656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:48.886235 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea451b70-6d00-4008-b12a-34fe4c1b788a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.579175 Nov 02 12:25:48.891095 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 748/1479] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:48 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:48.904550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b82cfdf3-9ba9-4cd1-a08b-880da7c469e0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e520280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:48.936367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:48.953414 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9ab121af-fb7f-4884-9f7f-721dc3a6c366 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.651749 Nov 02 12:25:48.955267 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 732/1480] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:48 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:48.967497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:49.006640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:49.021873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b82cfdf3-9ba9-4cd1-a08b-880da7c469e0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.123531 Nov 02 12:25:49.024604 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 749/1481] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:48 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:49.028600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:49.054813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:49.055317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:49.056127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:49.056613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:49.060427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:49.061573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:49.064653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:49.072253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:49.073881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:49.074895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:49.076018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:49.076945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:49.077710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:49.120086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:49.457119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:49.465946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-865a269b-cc42-4118-8aa3-1a396f6aa1a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1717 microversion: 2.1 time: 0.439302 Nov 02 12:25:49.466554 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 750/1482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:49 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1717 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:49.485219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:49.495249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:49.496731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:49.497929 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b0df2e82-90c5-461f-ad7e-b0586c0edd63 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.539365 Nov 02 12:25:49.498507 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 733/1483] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:48 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:49.914712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:49.916022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:49.925028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:49.925642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:49.926221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:49.927041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:49.927680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:49.928245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:49.983991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:49.984710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:49.993763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:49.994656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:49.995441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:49.996448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.001448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.003284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.021571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:50.143452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:50.416208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:50.420074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:50.427918 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-629f7214-cb04-49c2-a6fd-79ac80c9e8a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.517525 Nov 02 12:25:50.428771 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 751/1484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:49 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:50.433889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fcd280cd-0241-4956-9f5f-7df0b898b2d5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e502af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:50.436635 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a6fb58b-7191-4402-b13d-e8629ad25ed5 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.458242 Nov 02 12:25:50.440809 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 734/1485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:49 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:50.492302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:50.493342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:50.501904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.503054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.503664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.504656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.505222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.505758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.525716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fcd280cd-0241-4956-9f5f-7df0b898b2d5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.091527 Nov 02 12:25:50.528938 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 752/1486] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:50 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:50.543358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:50.561939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:50.584389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.585127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.585584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.586457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.587109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.587835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.896012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:50.907252 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8969d8fb-e9a0-4ad1-8f6e-e9d8e90e83c0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1707 microversion: 2.1 time: 0.421830 Nov 02 12:25:50.908444 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 735/1487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:50 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1707 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:50.932620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b71eb2a1-f66c-40ec-a04b-1e6d41c66946 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '.version_select at 0x7f228e978f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:50.937134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71eb2a1-f66c-40ec-a04b-1e6d41c66946 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.938001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71eb2a1-f66c-40ec-a04b-1e6d41c66946 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.938615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71eb2a1-f66c-40ec-a04b-1e6d41c66946 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.942620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:50.964928 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b71eb2a1-f66c-40ec-a04b-1e6d41c66946 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 2316 microversion: 2.1 time: 0.036458 Nov 02 12:25:50.970645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:50.976056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:50.976375 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 736/1488] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:25:50 2022] GET /compute/v2.1/os-migrations => generated 2316 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:50.980250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6a7cb15-d999-43e4-8260-375da37b902c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.449775 Nov 02 12:25:50.980879 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 753/1489] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:50 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:50.981401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:50.982335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:50.991071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.991903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.992599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.993544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.994290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.994949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.094309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-b13b70d6-72ad-4bda-8485-417a753ca874 req-5f2f11a7-9ead-45af-83b4-ccc340dc1b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0838ca-34c6-4d78-8d26-ce67982c4c7b", "name": "network-vif-plugged", "status": "completed", "tag": "68072907-6547-4e2b-8fb7-0c95d853ce3e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:51.107886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b13b70d6-72ad-4bda-8485-417a753ca874 req-5f2f11a7-9ead-45af-83b4-ccc340dc1b66 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.108379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b13b70d6-72ad-4bda-8485-417a753ca874 req-5f2f11a7-9ead-45af-83b4-ccc340dc1b66 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.108825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b13b70d6-72ad-4bda-8485-417a753ca874 req-5f2f11a7-9ead-45af-83b4-ccc340dc1b66 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.122251 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-b13b70d6-72ad-4bda-8485-417a753ca874 req-5f2f11a7-9ead-45af-83b4-ccc340dc1b66 service nova] Creating event network-vif-plugged:68072907-6547-4e2b-8fb7-0c95d853ce3e for instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b on n-h1-855650-5 Nov 02 12:25:51.128472 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-b13b70d6-72ad-4bda-8485-417a753ca874 req-5f2f11a7-9ead-45af-83b4-ccc340dc1b66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038991 Nov 02 12:25:51.129485 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 754/1490] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:51.316075 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-46a74777-5d4c-4057-9ae1-41e9b76b9fc2 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1858 microversion: 2.1 time: 0.338412 Nov 02 12:25:51.316671 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 737/1491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:50 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1858 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:51.341368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:51.348960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:51.357242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.358464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.358464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.359102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.359705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.360151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.478224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:51.486150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:51.515845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.517183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.517649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.518497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.519131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.519735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.623140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a91da588-8e76-45be-b4b4-769baf848a04 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1858 microversion: 2.1 time: 0.286954 Nov 02 12:25:51.624371 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 755/1492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:51 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1858 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:51.630068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:51.631036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:51.638886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.639699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.640326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.641235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.641901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.642538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.861736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:51.871147 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-298f4b78-fea5-4e75-97d3-0f0a198e185c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.419805 Nov 02 12:25:51.872020 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 738/1493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:51 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:51.877193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-512477bd-7e28-469f-93ae-e07aef1fc0ce tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e872550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:51.910378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:51.936849 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8271e116-c03c-4268-a7c1-48554f8426b7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.311128 Nov 02 12:25:51.942463 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 756/1494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:51 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:51.952328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:51.955460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:51.962917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-512477bd-7e28-469f-93ae-e07aef1fc0ce tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.089641 Nov 02 12:25:51.966730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.969906 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 739/1495] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:51 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:51.972632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.974190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.977189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.977929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.978486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.019512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:52.023123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:52.037434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:52.038512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:52.039242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.040188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:52.041467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:52.042258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.189038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lazy-loading 'services' on Instance uuid 3ce3f9c6-de73-4a88-8cb8-a20198986ffb {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:25:52.366258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:52.373737 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85c2ea47-daea-4752-be0b-90b6d7fd3a90 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments/b1060be9-0b01-40fc-97a7-261291549000" status: 202 len: 0 microversion: 2.1 time: 0.429839 Nov 02 12:25:52.374369 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 757/1496] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:25:51 2022] DELETE /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments/b1060be9-0b01-40fc-97a7-261291549000 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:25:52.383883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:52.385789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:52.386156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:52.387515 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9e5e865d-539c-44d3-8516-e62f56ae7bfb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.381639 Nov 02 12:25:52.388974 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 740/1497] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:52 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:52.404436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:52.420464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:52.421422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:52.422076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.422991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:52.423688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:52.424294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.483462 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5eeb5525-51e1-42a2-a75f-a426567f2999 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103621 Nov 02 12:25:52.483583 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 758/1498] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:25:52 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:52.897415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:52.898727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:52.913947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:52.916757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:52.918179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.919134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:52.919772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:52.920983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.968763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:52.972960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:52.984611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:52.985110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:52.985552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.986315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:52.986758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:52.987245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:53.183599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:53.195526 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce88053f-9960-4257-94e8-6c7ee61a2063 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.303052 Nov 02 12:25:53.198346 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 741/1499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:52 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:53.207841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ae231bb3-53c5-4a57-8c21-b5b2e527b971 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e9920d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:53.264728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ae231bb3-53c5-4a57-8c21-b5b2e527b971 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.064955 Nov 02 12:25:53.267294 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 742/1500] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:53 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:53.274709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:53.288984 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7649cb5-88ab-435e-81e1-e7c1a7e321be tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.323944 Nov 02 12:25:53.295382 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 759/1501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:52 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:53.417012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:53.417714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:53.426496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:53.426994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:53.427665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:53.428576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:53.429213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:53.429812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:53.439250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1193653216", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a7df809a-f8be-4cc9-9c4d-12a8352ea559"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:53.523116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] validate_networks() for [('a7df809a-f8be-4cc9-9c4d-12a8352ea559', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:25:53.685285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:53.700163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:53.706963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:53.708845 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c5321e34-ccb2-4095-aab3-6cc48a3f4d32 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.296039 Nov 02 12:25:53.726918 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 760/1502] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:53 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:25:53.737107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:53.740188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:53.747639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:53.748442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:53.749230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:53.750157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:53.750781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:53.751370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:53.808445 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-16f637b3-d513-455c-b4e9-96f5b5e7a4dc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080025 Nov 02 12:25:53.809479 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 761/1503] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:25:53 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:54.180068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:25:54.181089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:25:54.182584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:25:54.183208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:25:54.184018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:25:54.194359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:54.195244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:54.195922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:54.196914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:54.197627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:54.198337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:54.226108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.227510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:54.232705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Getting quotas for project dab3b72b58de4fc6a0957dc3f3141677. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:54.239289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:54.239600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Getting quotas for user 45e4bffe383e4049974ef4c9fe3e3ce0 and project dab3b72b58de4fc6a0957dc3f3141677. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:54.240280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:54.241127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:54.242245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:54.244177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:54.244909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:54.254652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:25:54.257151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:25:54.341063 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f3a7fd03-a426-4c93-95f9-631f27753a68 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.069242 Nov 02 12:25:54.343256 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 743/1504] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:25:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:25:54.359609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d2d9d18-f81d-4246-b0b4-6b3c2580d719 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e992ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.434340 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d2d9d18-f81d-4246-b0b4-6b3c2580d719 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.089468 Nov 02 12:25:54.435381 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 744/1505] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:54.450008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.451161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:54.464197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:54.465284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:54.466034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:54.467154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:54.467826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:54.468506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:54.751771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:54.768855 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ee0adf4-d325-4137-93a6-8fbf87a76b79 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.548873 Nov 02 12:25:54.769808 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 762/1506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:54.787201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-61321fd7-8283-45e5-8e06-9dbbe799cf86 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.788126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61321fd7-8283-45e5-8e06-9dbbe799cf86 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:55.017484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:55.029822 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-deff4f14-1cea-4c5d-bd27-7af7259b63df tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.592062 Nov 02 12:25:55.042523 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 745/1507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:55.046498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-61321fd7-8283-45e5-8e06-9dbbe799cf86 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:55.060021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:55.061914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-61321fd7-8283-45e5-8e06-9dbbe799cf86 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:55.065582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:55.068163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-61321fd7-8283-45e5-8e06-9dbbe799cf86 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:55.081466 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-61321fd7-8283-45e5-8e06-9dbbe799cf86 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1259 microversion: 2.21 time: 0.306885 Nov 02 12:25:55.082259 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 763/1508] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1259 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:55.110638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.111216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.111961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.114279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.115338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:55.116392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:55.116643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.117349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.136112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.137603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.138755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.141772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.144465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.146023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.178957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:25:55.355445 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7cfbafc9-c6dd-4503-9d4c-23389e03a459 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 204 len: 0 microversion: 2.1 time: 0.317821 Nov 02 12:25:55.363615 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 746/1509] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:25:55 2022] DELETE /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:25:55.389600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:55.393266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:55.404766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.412029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.412904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.413944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.414762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.415434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.498221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7ac5264b-3eee-4dd6-9574-283fd3471659 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131793 Nov 02 12:25:55.498867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 747/1510] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:25:55 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:55.512405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:55.513882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:55.527030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.527819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.528515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.530689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.533319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.534439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.674741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:55.694538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:55.696914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:55.701060 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4937b605-c8e8-4aec-a47a-ecb5d61bce67 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.609549 Nov 02 12:25:55.704010 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 764/1511] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:55 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:55.715266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f34533e-a9de-4775-b356-26b8d6b169c9 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e529f70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:55.801763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f34533e-a9de-4775-b356-26b8d6b169c9 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.094241 Nov 02 12:25:55.803743 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 765/1512] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:55 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:55.809248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6d974d8c-4421-4fc6-9e69-903a5a61892f req-36ce3323-5e1e-4993-8bea-ef0ce05d9440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb99e945-3f4e-472d-bf1f-e503ca63242a", "name": "network-vif-plugged", "status": "completed", "tag": "fec13c2b-e1b2-462c-954b-ca9ba5526376"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:55.824328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d974d8c-4421-4fc6-9e69-903a5a61892f req-36ce3323-5e1e-4993-8bea-ef0ce05d9440 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.825086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d974d8c-4421-4fc6-9e69-903a5a61892f req-36ce3323-5e1e-4993-8bea-ef0ce05d9440 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.825696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d974d8c-4421-4fc6-9e69-903a5a61892f req-36ce3323-5e1e-4993-8bea-ef0ce05d9440 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.840825 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6d974d8c-4421-4fc6-9e69-903a5a61892f req-36ce3323-5e1e-4993-8bea-ef0ce05d9440 service nova] Creating event network-vif-plugged:fec13c2b-e1b2-462c-954b-ca9ba5526376 for instance eb99e945-3f4e-472d-bf1f-e503ca63242a on n-h1-855650-5 Nov 02 12:25:55.847879 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6d974d8c-4421-4fc6-9e69-903a5a61892f req-36ce3323-5e1e-4993-8bea-ef0ce05d9440 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042661 Nov 02 12:25:55.850220 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 766/1513] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:55.859074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:55.860435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:55.870286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.871641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.872273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.875072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.876059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.878162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.987704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:56.002045 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a19692fa-24b7-43cd-b9b5-ca2344140f37 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1709 microversion: 2.1 time: 0.501688 Nov 02 12:25:56.005724 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 748/1514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:55 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1709 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:56.055434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.056255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:56.067133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:56.067712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:56.068219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:56.068992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:56.069687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:56.070367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:56.153218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:56.166761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26b67cc2-59fb-4a41-afaa-86e43004f36e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.314197 Nov 02 12:25:56.188179 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 767/1515] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:55 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:56.194921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.195788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:56.203209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:56.203979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:56.204615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:56.206111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:56.206737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:56.207329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:56.243258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:56.346819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:56.359757 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea08cadb-89e9-4b15-a13b-523663089c5e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.308426 Nov 02 12:25:56.360617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:56.368887 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 749/1516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:56.376924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:56.378960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:56.380363 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb647acc-d288-4408-a17e-77467a068b3d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1263 microversion: 2.21 time: 0.189795 Nov 02 12:25:56.381514 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 768/1517] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:56.511626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.515271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:56.524908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:56.525522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:56.526445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:56.527383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:56.528058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:56.529992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:56.600825 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8af70622-9e7b-400c-b393-bd2d749e601a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093407 Nov 02 12:25:56.606058 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 750/1518] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:56.739538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.740155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:56.755565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:56.756069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:56.756771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:56.757696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:56.759409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:56.761315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:56.822208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f57efcc6-ea91-4860-b985-e47d5966db54 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8ed040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.944571 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f57efcc6-ea91-4860-b985-e47d5966db54 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.124121 Nov 02 12:25:56.945776 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 751/1519] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:57.031035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:57.031972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:57.054366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:57.054896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:57.055351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:57.056098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:57.063134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:57.063784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:57.121801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:57.141230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:57.146140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:57.148244 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d451429e-fd37-4830-95e3-7a54284e3631 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.413363 Nov 02 12:25:57.149517 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 769/1520] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:57.197959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:57.199180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:57.219790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:57.220662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:57.222159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:57.226139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:57.231372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:57.232298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:57.505919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:57.517823 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2c9658c-188b-4170-86a8-ff16987cc518 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1709 microversion: 2.1 time: 0.490537 Nov 02 12:25:57.536388 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 752/1521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:57 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1709 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:57.550368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:57.551290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:57.570803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:57.574814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:57.575563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:57.576498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:57.577276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:57.578568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.526749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:58.542251 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2bd1319-a0ba-4b0f-bb1f-02979040903b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 1.347203 Nov 02 12:25:58.564252 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 770/1522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:57 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:58.575480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.576111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:58.593015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.593529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.594182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.595483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.595986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.597055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.605889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:58.634875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff6d8581-14fc-47bd-8468-e94a57b8a679 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 1.078403 Nov 02 12:25:58.636328 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 753/1523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:57 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:58.647836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.653166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:58.673689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.674651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.679285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.694635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.701157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.701863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.745079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:58.754143 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8c09a8f-bdf5-4bbd-913e-362bca92dec3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116479 Nov 02 12:25:58.755020 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 754/1524] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:58.765392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-292d77b7-4b39-46d3-a563-b1cbc6780361 req-5f6e9d32-9ced-4c9d-bc87-caead52c32a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6c6158-52c8-43c7-af6c-7d4f5cac0c53", "name": "network-vif-plugged", "status": "completed", "tag": "82f9b39f-74e9-4951-8398-db585044d561"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:58.776176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-292d77b7-4b39-46d3-a563-b1cbc6780361 req-5f6e9d32-9ced-4c9d-bc87-caead52c32a7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.776932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-292d77b7-4b39-46d3-a563-b1cbc6780361 req-5f6e9d32-9ced-4c9d-bc87-caead52c32a7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.777577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-292d77b7-4b39-46d3-a563-b1cbc6780361 req-5f6e9d32-9ced-4c9d-bc87-caead52c32a7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.792515 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-292d77b7-4b39-46d3-a563-b1cbc6780361 req-5f6e9d32-9ced-4c9d-bc87-caead52c32a7 service nova] Creating event network-vif-plugged:82f9b39f-74e9-4951-8398-db585044d561 for instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 on n-h2-855650-5 Nov 02 12:25:58.797957 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-292d77b7-4b39-46d3-a563-b1cbc6780361 req-5f6e9d32-9ced-4c9d-bc87-caead52c32a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037190 Nov 02 12:25:58.799746 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 755/1525] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:58.808768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16bbaaec-2e00-48ea-a7d0-f67461ddcb71 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e904670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.841204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:58.854903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:58.856908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:58.874253 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f6c9265-1a52-47b9-9045-3ffc91254bc5 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1255 microversion: 2.21 time: 0.292608 Nov 02 12:25:58.880218 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 771/1526] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1255 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:58.894210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.894962 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16bbaaec-2e00-48ea-a7d0-f67461ddcb71 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.093565 Nov 02 12:25:58.895152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:58.902088 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 756/1527] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:58.910042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.911079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:58.911847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.912362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.912809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.913536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.914016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.914455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.919770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.920584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.921336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:58.925552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:58.926346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:58.927000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:59.263799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:59.277594 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb3eb847-ab9f-4945-8be5-10b64f7a8485 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1709 microversion: 2.1 time: 0.373610 Nov 02 12:25:59.284267 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 757/1528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1709 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:59.402007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:59.440467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:59.443675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:59.448594 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85f8ccd5-3672-4df4-96d3-6a25c40c0a02 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.566451 Nov 02 12:25:59.470247 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 772/1529] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:59.574604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:59.575445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:59.587128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:59.587761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:59.588638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:59.589558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:59.590159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:59.591563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:59.687097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:59.689028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:59.700246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:59.701742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:59.702482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:59.704651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:59.706209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:59.706953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:59.906746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:59.925289 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3dddf137-5731-4f18-84d9-2a784116074d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1316 microversion: 2.1 time: 0.354775 Nov 02 12:25:59.970427 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 758/1530] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:59 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:59.986286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:59.995595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:00.006807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.007994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.008807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.009999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:00.010586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.011180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.011766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.037323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b518dc05-e813-4ad6-9829-2bb97e7e266e tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.356391 Nov 02 12:26:00.038695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 773/1531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:59 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:00.062195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:00.063017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:00.087806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.088323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.088777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.089507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.089990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.102134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.128574 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5c878271-fa92-466b-95ab-8cb3f33d4140 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156678 Nov 02 12:26:00.144602 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 759/1532] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:25:59 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:00.154862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-45856a8c-1f09-485c-a4fd-92f6c18102ca tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e9781f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:00.239493 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-45856a8c-1f09-485c-a4fd-92f6c18102ca tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.093672 Nov 02 12:26:00.248426 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 760/1533] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:00 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:00.287625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:00.299261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:00.305448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:00.308899 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b97a88cd-cc19-4e74-8f7d-e37430e6271e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1311 microversion: 2.21 time: 0.268745 Nov 02 12:26:00.310360 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 774/1534] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:00 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1311 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:00.335053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:00.335442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:00.343407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.343910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.344397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.345409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.346456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.346888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.480123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:00.483202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:00.484208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:00.493468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.494453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.495088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.496134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.496765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.497361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.526440 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-afc5fc18-de05-4ed8-9c3e-0fff9ffdbfaf tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1643 microversion: 2.1 time: 0.218351 Nov 02 12:26:00.531333 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 761/1535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:00 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1643 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:00.557890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6c0e8528-4c7f-445d-b35b-70921bfe8be6 req-56d9ade4-f5ff-4d87-9daa-6bbbca0d407d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1355556-3912-41a2-a733-92804b34fe22", "name": "network-vif-deleted", "tag": "e648d659-81f5-4ea0-ae85-26b235829c65"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:00.584444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6c0e8528-4c7f-445d-b35b-70921bfe8be6 req-56d9ade4-f5ff-4d87-9daa-6bbbca0d407d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.588879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6c0e8528-4c7f-445d-b35b-70921bfe8be6 req-56d9ade4-f5ff-4d87-9daa-6bbbca0d407d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.592518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6c0e8528-4c7f-445d-b35b-70921bfe8be6 req-56d9ade4-f5ff-4d87-9daa-6bbbca0d407d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.638110 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6c0e8528-4c7f-445d-b35b-70921bfe8be6 req-56d9ade4-f5ff-4d87-9daa-6bbbca0d407d service nova] Creating event network-vif-deleted:e648d659-81f5-4ea0-ae85-26b235829c65 for instance b1355556-3912-41a2-a733-92804b34fe22 on n-h1-855650-5 Nov 02 12:26:00.658350 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6c0e8528-4c7f-445d-b35b-70921bfe8be6 req-56d9ade4-f5ff-4d87-9daa-6bbbca0d407d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121074 Nov 02 12:26:00.664399 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 762/1536] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:00.809789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:00.820121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:00.821596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:00.822846 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f96e9e29-4c0b-480d-ae2d-8d534e14a4cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1813 microversion: 2.25 time: 0.344058 Nov 02 12:26:00.840871 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 775/1537] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:00 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1813 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:26:00.959661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:00.963256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:00.979662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.980167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.980614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:00.981337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:00.981798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:00.989658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.065444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:01.067374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:01.081021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.095388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.097331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.101335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.102648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.107595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.429528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:01.448704 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-531021cf-01fc-4320-a5f5-ae455a0a537e tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1465 microversion: 2.1 time: 0.488793 Nov 02 12:26:01.450559 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 763/1538] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:00 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1465 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:01.457296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:01.473988 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ddcdde9-b77a-409c-96a5-b71b72b09a00 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1324 microversion: 2.1 time: 0.412899 Nov 02 12:26:01.478515 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 776/1539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:01 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:01.479356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:01.488990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:01.494266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f36463e-f7df-42aa-9d36-6b9e43e60cf4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e776160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:01.511035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.513705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.515560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.517228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.517706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.518682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.576211 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-74b8511b-e017-4997-aadf-0bac1976c811 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124300 Nov 02 12:26:01.577073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 764/1540] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:26:01 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:26:01.582563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:01.583399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:01.601812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f36463e-f7df-42aa-9d36-6b9e43e60cf4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.119076 Nov 02 12:26:01.613290 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 777/1541] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:01 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:01.616630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.617698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.619549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.620739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.624726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.626875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:01.627181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.629095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:01.653434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.659013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.659480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.663720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.669283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.670816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.833433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:01.856400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:01.859483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:01.862434 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1bda64f7-257f-4686-96a7-ac109aa282ea tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1329 microversion: 2.21 time: 0.284024 Nov 02 12:26:01.876194 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 765/1542] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:01 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1329 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:01.892295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:01.899560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:01.913274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.917037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.917617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.918992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:01.920551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:01.922350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:01.995940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:02.013052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.016962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.018085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:02.018758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lazy-loading 'fault' on Instance uuid b1355556-3912-41a2-a733-92804b34fe22 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:02.125825 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d717d6f-b0bb-4a0e-af68-28705319aec4 tempest-ServersOnMultiNodesTest-1692969568 tempest-ServersOnMultiNodesTest-1692969568-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1616 microversion: 2.1 time: 0.509755 Nov 02 12:26:02.130453 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 778/1543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:01 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1616 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:02.135696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:02.139856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:02.157675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.162154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.163073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:02.164149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.166838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.167584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:02.169380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:02.183853 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b6ac3ea-ae27-4604-8066-c199c39c9f6f tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1351 microversion: 2.1 time: 0.306355 Nov 02 12:26:02.185386 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 766/1544] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:01 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1351 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:02.195581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:02.196227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:02.217275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.217762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.219123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:02.224809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.225325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.229181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:02.301645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:02.469756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d8fb32fb-89bb-4ded-ae83-af6ef67c91e9 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 204 len: 0 microversion: 2.1 time: 0.281816 Nov 02 12:26:02.474894 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 767/1545] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:02 2022] DELETE /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:02.481889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:02.482724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:02.499490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:02.499705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.503364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.504018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:02.507445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.509180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.510600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:02.520394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:02.534051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:02.540259 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b941f953-0622-4cc7-bb12-98ba76bc45c3 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1803 microversion: 2.25 time: 0.407647 Nov 02 12:26:02.558653 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 779/1546] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:02 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1803 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:02.579872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:02.581230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:02.599434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.608659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.609367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:02.610388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:02.611315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:02.612707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.102844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:03.115469 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ef45684-5d0f-4593-b344-5add29b1fc48 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1471 microversion: 2.1 time: 0.638381 Nov 02 12:26:03.122513 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 768/1547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:02 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1471 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:03.128080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b8fd0f3-f83a-4c64-b5ca-d90dce6dae0b tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '.version_select at 0x7f228e872dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.138010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:03.142383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0f3-f83a-4c64-b5ca-d90dce6dae0b tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.143355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0f3-f83a-4c64-b5ca-d90dce6dae0b tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.145221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0f3-f83a-4c64-b5ca-d90dce6dae0b tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.152616 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca4c485d-0272-4d39-a9fd-991104a3d05c tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1520 microversion: 2.1 time: 0.591895 Nov 02 12:26:03.153889 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 780/1548] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:02 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1520 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:03.158860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b5db738c-1c10-42b9-be30-156d21ece38c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e521670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.192265 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b8fd0f3-f83a-4c64-b5ca-d90dce6dae0b tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 2780 microversion: 2.25 time: 0.067720 Nov 02 12:26:03.205938 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 769/1549] 10.222.0.45 () {60 vars in 1184 bytes} [Wed Nov 2 12:26:03 2022] GET /compute/v2.1/os-migrations => generated 2780 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:03.205938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.205938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:03.208196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.208697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.209139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.209851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.210351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.210788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.274114 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b5db738c-1c10-42b9-be30-156d21ece38c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1455 microversion: 2.1 time: 0.118850 Nov 02 12:26:03.275432 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 781/1550] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:03 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:03.281600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.285118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:03.301983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:03.306878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.308355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.309051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.310279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.310893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:03.311229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.311923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.312334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:03.313447 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ec249a7-6ba7-421f-8813-9032cfcf8633 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1317 microversion: 2.21 time: 0.119259 Nov 02 12:26:03.326009 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 770/1551] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:03 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1317 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:03.326009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.326009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:03.341405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.343143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.346884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.347931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.348568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.349176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.380767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:03.531188 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e57cb39-6da3-4f3d-8cce-4a2bb8bcd4d7 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 204 len: 0 microversion: 2.1 time: 0.253589 Nov 02 12:26:03.532671 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 782/1552] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:03 2022] DELETE /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:03.545435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.553474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:03.566453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:03.568872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.569699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.570455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.571440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.572131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.572887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.620927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid 9bf7c70a-03b4-456d-96c0-8e892183b1ac {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:03.631816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.632823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.633764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.634884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lazy-loading 'fault' on Instance uuid b1355556-3912-41a2-a733-92804b34fe22 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:03.641473 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f153bc9-1047-4ab7-b1c1-39fa93c92137 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 2422 microversion: 2.25 time: 0.325582 Nov 02 12:26:03.655362 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 771/1553] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:03 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 2422 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:03.674713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.676507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:03.693463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.695295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.696638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.698274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.699625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.701566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.724295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20bdb026c50545849ac88f7c744cbf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19f46a5675c4f028057725f509a1d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:03.748512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-68201b43-11fc-42c7-ad0b-77934d3a70ef tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 200 len: 1351 microversion: 2.1 time: 0.213680 Nov 02 12:26:03.766645 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 783/1554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:03 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 1351 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:03.784913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.787005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:03.822000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.827477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.832354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:03.833879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:03.836449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:03.837258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:04.212030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:04.250418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:04.259276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:04.260738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid 9bf7c70a-03b4-456d-96c0-8e892183b1ac {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:04.269270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:04.280987 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2f090cfd-7fae-4634-957c-babbf5939ce6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1526 microversion: 2.1 time: 0.621578 Nov 02 12:26:04.281936 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 772/1555] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:03 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1526 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:04.287636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:04.288539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:04.298204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:04.298729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:04.299298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:04.300095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:04.300483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:04.300958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:04.304572 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-efc0e57c-3757-46fd-b3ac-46613f70f8cd tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 2422 microversion: 2.25 time: 0.534700 Nov 02 12:26:04.306176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:04.308029 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 784/1556] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:03 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 2422 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:04.317410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05b53c7a-e2a2-443a-aa04-66e885d0fd2a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e520820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:04.771678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:04.797514 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7883c915-65f6-478b-8f42-2e0af6472732 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1471 microversion: 2.1 time: 0.514253 Nov 02 12:26:04.829639 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 773/1557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:04 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:04.838599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:04.844827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:04.860421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:04.864494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:04.866563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:04.869595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:04.870392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:04.872112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:05.060470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:05.430768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:05.446564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:05.449625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:05.450958 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3726eca4-0b66-4487-b441-ddf7e97ce695 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1359 microversion: 2.21 time: 0.619826 Nov 02 12:26:05.451549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 774/1558] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:04 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1359 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:05.457910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:05.458706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:05.476383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:05.477874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:05.479739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:05.482401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:05.483761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:05.484205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:05.765373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lazy-loading 'services' on Instance uuid 9bf7c70a-03b4-456d-96c0-8e892183b1ac {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:06.082897 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cdd89705-236f-47f5-a234-e9f683042810 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments/6f719200-5c04-4a88-a398-b151b55c1fe6" status: 202 len: 0 microversion: 2.25 time: 0.628256 Nov 02 12:26:06.083941 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 775/1559] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Nov 2 12:26:05 2022] DELETE /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments/6f719200-5c04-4a88-a398-b151b55c1fe6 => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:06.100589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:06.105744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:06.128515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:06.130412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:06.131569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:06.136700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:06.137512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:06.138437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:06.162236 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] HTTP exception thrown: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Request method failure captured: Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 HTTP/1.1 Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCbQj5y5VMukfW53UdSScVIFJbHrVTS76UHzoSCN_FlEDXH6qF8ndkBQHH9ZfEQ48Lg0aQuDtcQ39a10wv4Uw1zEGy-nGLakVGxGxl-O7ns_KldgazQrrqZnhgRbKAGxNQ3Hpuachqoy1tqZdxf0wUywdojV_jim3L8gTGMe0tCGbE Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:06.164430 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f19f46a5675c4f028057725f509a1d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 20bdb026c50545849ac88f7c744cbf50 Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:06.166554 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b1355556-3912-41a2-a733-92804b34fe22'} Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:06.167608 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:06.170239 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:06.173602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Returning 404 to user: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:06.174863 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41ab63cf-605f-4ed9-a0e8-d31a20174e69 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 404 len: 111 microversion: 2.1 time: 0.088374 Nov 02 12:26:06.177850 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 776/1560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:06 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:06.185540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:06.186641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:06.198888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:06.199810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:06.200583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:06.201798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:06.202706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:06.203753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:06.707454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:06.721519 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f9bab7b-3d99-4fdb-94ae-c9e72050a62d tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1526 microversion: 2.1 time: 0.539473 Nov 02 12:26:06.722114 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 777/1561] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:06 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1526 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:06.731223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:06.731889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:06.754655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:06.758672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:06.759182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:06.760037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:06.760589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:06.761478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:06.840452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:06.843605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:06.845139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:06.846521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lazy-loading 'fault' on Instance uuid eb99e945-3f4e-472d-bf1f-e503ca63242a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:06.959561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:06.979429 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f64dbf7d-7d9d-4f36-b6ca-3dc3c8e61688 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 200 len: 1306 microversion: 2.1 time: 0.255138 Nov 02 12:26:06.989302 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 778/1562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:06 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 1306 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:07.002248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:07.008803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:07.021565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:07.024125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:07.038506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:07.041134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:07.047628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:07.049686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:07.130577 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb629aee-53fd-4d52-82c8-a946fea193a8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.139652 Nov 02 12:26:07.134999 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 779/1563] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 12:26:06 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:07.147362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e2f23717-01b1-4424-b69c-023fb8773664 req-c98ff7a9-4208-4acb-ace4-d386b04a69ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb99e945-3f4e-472d-bf1f-e503ca63242a", "name": "network-vif-deleted", "tag": "fec13c2b-e1b2-462c-954b-ca9ba5526376"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:07.193008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e2f23717-01b1-4424-b69c-023fb8773664 req-c98ff7a9-4208-4acb-ace4-d386b04a69ff service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:07.199158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e2f23717-01b1-4424-b69c-023fb8773664 req-c98ff7a9-4208-4acb-ace4-d386b04a69ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:07.200513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e2f23717-01b1-4424-b69c-023fb8773664 req-c98ff7a9-4208-4acb-ace4-d386b04a69ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:07.274917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e2f23717-01b1-4424-b69c-023fb8773664 req-c98ff7a9-4208-4acb-ace4-d386b04a69ff service nova] Creating event network-vif-deleted:fec13c2b-e1b2-462c-954b-ca9ba5526376 for instance eb99e945-3f4e-472d-bf1f-e503ca63242a on n-h1-855650-5 Nov 02 12:26:07.287634 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e2f23717-01b1-4424-b69c-023fb8773664 req-c98ff7a9-4208-4acb-ace4-d386b04a69ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151086 Nov 02 12:26:07.294268 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 780/1564] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:07.309235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:07.309721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:07.331612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:07.332137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:07.332595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:07.334817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:07.335285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:07.337447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:07.788714 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] HTTP exception thrown: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Request method failure captured: Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 HTTP/1.1 Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCbQj5y5VMukfW53UdSScVIFJbHrVTS76UHzoSCN_FlEDXH6qF8ndkBQHH9ZfEQ48Lg0aQuDtcQ39a10wv4Uw1zEGy-nGLakVGxGxl-O7ns_KldgazQrrqZnhgRbKAGxNQ3Hpuachqoy1tqZdxf0wUywdojV_jim3L8gTGMe0tCGbE Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:07.793498 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f19f46a5675c4f028057725f509a1d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 20bdb026c50545849ac88f7c744cbf50 Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:07.795484 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '2aa17e49-fd4f-4121-932a-3d8aad79bab1'} Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:07.796694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:07.798562 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:07.819073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Returning 404 to user: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:07.820475 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f243dff3-f19e-4df0-a328-8a8852b3e4c6 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 404 len: 111 microversion: 2.1 time: 0.524936 Nov 02 12:26:07.825279 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 781/1565] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:07 2022] DELETE /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 111 bytes in 530 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:07.835102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:07.838857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:07.854495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:07.855482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:07.856182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:07.857154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:07.860924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:07.862320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:08.219518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:08.230516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:08.237292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:08.247234 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-767f5944-2f93-4da6-bacc-2d45cbcb042d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1359 microversion: 2.21 time: 0.419992 Nov 02 12:26:08.248976 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 782/1566] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:07 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:08.269319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:08.270454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:08.277437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:08.285773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:08.286971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:08.288701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:08.289620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:08.290327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:08.560740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:08.586037 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2343d9e1-6c11-4d21-860f-b17c8e5a2206 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1526 microversion: 2.1 time: 0.333999 Nov 02 12:26:08.586888 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 783/1567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:08 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1526 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:08.929798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:08.930829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:08.953504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:08.960764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:08.961663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:08.962793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:08.964347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:08.979001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:09.020668 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] HTTP exception thrown: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Request method failure captured: Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 HTTP/1.1 Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCbQj5y5VMukfW53UdSScVIFJbHrVTS76UHzoSCN_FlEDXH6qF8ndkBQHH9ZfEQ48Lg0aQuDtcQ39a10wv4Uw1zEGy-nGLakVGxGxl-O7ns_KldgazQrrqZnhgRbKAGxNQ3Hpuachqoy1tqZdxf0wUywdojV_jim3L8gTGMe0tCGbE Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:09.022705 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f19f46a5675c4f028057725f509a1d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 20bdb026c50545849ac88f7c744cbf50 Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:09.024501 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '2aa17e49-fd4f-4121-932a-3d8aad79bab1'} Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:09.025476 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:09.027101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.029798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Returning 404 to user: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:09.030949 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ebc3c049-4ad8-4fcc-a1a4-6d47f1c1964b tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 404 len: 111 microversion: 2.1 time: 0.442697 Nov 02 12:26:09.031753 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 784/1568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:08 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 111 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:09.038023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:09.039188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: eb99e945-3f4e-472d-bf1f-e503ca63242a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:09.046403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:09.047270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:09.047935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:09.049370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:09.050363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:09.051223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:09.078648 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] HTTP exception thrown: Instance eb99e945-3f4e-472d-bf1f-e503ca63242a could not be found. Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Request method failure captured: Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a HTTP/1.1 Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEoKKH1d1dNCfx0n6k8xAaZ0DOfaqVNuTM4yH134_2ZI4YwbDiMytCq5LG5xXHF5CzDXD90RhBYzF1tMwyA72bzZGoGo_H4fTLyWD6bVx8F_PDgcNDnf-z3-PMnJUzDqQqSuxJfAXraxqZ7DoROSnlGBI06nxu2NdOTyDomMnvwV14 Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:09.092335 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7c91481067cd4be881f75d33b56ee431 Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance eb99e945-3f4e-472d-bf1f-e503ca63242a could not be found. Nov 02 12:26:09.094216 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'eb99e945-3f4e-472d-bf1f-e503ca63242a'} Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb99e945-3f4e-472d-bf1f-e503ca63242a could not be found. Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:09.095468 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb99e945-3f4e-472d-bf1f-e503ca63242a could not be found. Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb99e945-3f4e-472d-bf1f-e503ca63242a could not be found. Nov 02 12:26:09.097069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:09.101823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Returning 404 to user: Instance eb99e945-3f4e-472d-bf1f-e503ca63242a could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:09.105849 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-21ecfcdd-36d2-432e-a748-7fb279749f2c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a" status: 404 len: 111 microversion: 2.1 time: 0.072724 Nov 02 12:26:09.110321 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 785/1569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:09 2022] GET /compute/v2.1/servers/eb99e945-3f4e-472d-bf1f-e503ca63242a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:09.126493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:09.133466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:09.144072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:09.144816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:09.145496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:09.146544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:09.147362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:09.148004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:09.218359 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60e4619a-8332-4459-af1a-811ec98e4866 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105927 Nov 02 12:26:09.222609 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 786/1570] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 12:26:09 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:09.236524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0c7d39e8-921e-4abb-ba6e-e2bbb38ce588 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '.version_select at 0x7f228e8df1f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:09.286545 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0c7d39e8-921e-4abb-ba6e-e2bbb38ce588 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-961828759" status: 202 len: 0 microversion: 2.1 time: 0.060265 Nov 02 12:26:09.290963 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 787/1571] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:26:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-961828759 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:09.295564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:09.296189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:09.307812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:09.308572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:09.309890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:09.310765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:09.311324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:09.312734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:09.386411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:09.629108 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-143c1747-45a4-4d10-b54b-d177b11fb62a tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 204 len: 0 microversion: 2.1 time: 0.336640 Nov 02 12:26:09.633592 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 788/1572] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:09 2022] DELETE /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:09.642720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:09.645078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:09.668775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:09.671105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:09.672157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:09.675382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:09.676138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:09.676828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.000442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:10.030715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:10.034038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:10.037593 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-055dd2e8-e85d-4a72-81a4-760532374d55 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1359 microversion: 2.21 time: 0.402347 Nov 02 12:26:10.042940 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 789/1573] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:09 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:10.056378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:10.060141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:10.095323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:10.099451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:10.100193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.104039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:10.104812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:10.105528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.199464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:10.200309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:10.200970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.201662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lazy-loading 'fault' on Instance uuid 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:10.300889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:10.329497 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ccf44d87-5ee7-4037-a3a6-277e1f0affb9 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1314 microversion: 2.1 time: 0.280383 Nov 02 12:26:10.345826 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 790/1574] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:10 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:10.368747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:10.369623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:10.384363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:10.385258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:10.386056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.387063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:10.387843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:10.388554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.399155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:10.683642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:10.699393 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a4e97ff3-b4ad-4510-a785-d59ca623d484 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1473 microversion: 2.1 time: 0.357321 Nov 02 12:26:10.699987 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 791/1575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:10 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:10.708161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d16d5e8e-172f-42c8-b213-33410e8249c6 req-daf9eb7e-d2d9-42f1-be16-4a57f8a2bfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6c6158-52c8-43c7-af6c-7d4f5cac0c53", "name": "network-vif-deleted", "tag": "82f9b39f-74e9-4951-8398-db585044d561"}, {"name": "network-changed", "server_uuid": "621ca1e9-68ee-4395-a530-441538f9dcad", "tag": "568d56e8-787f-4940-a272-87913f4c8940"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:10.733522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d16d5e8e-172f-42c8-b213-33410e8249c6 req-daf9eb7e-d2d9-42f1-be16-4a57f8a2bfa9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:10.737611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d16d5e8e-172f-42c8-b213-33410e8249c6 req-daf9eb7e-d2d9-42f1-be16-4a57f8a2bfa9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:10.738099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d16d5e8e-172f-42c8-b213-33410e8249c6 req-daf9eb7e-d2d9-42f1-be16-4a57f8a2bfa9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.764668 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d16d5e8e-172f-42c8-b213-33410e8249c6 req-daf9eb7e-d2d9-42f1-be16-4a57f8a2bfa9 service nova] Creating event network-vif-deleted:82f9b39f-74e9-4951-8398-db585044d561 for instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 on n-h2-855650-5 Nov 02 12:26:10.766035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d16d5e8e-172f-42c8-b213-33410e8249c6 req-daf9eb7e-d2d9-42f1-be16-4a57f8a2bfa9 service nova] Creating event network-changed:568d56e8-787f-4940-a272-87913f4c8940 for instance 621ca1e9-68ee-4395-a530-441538f9dcad on n-h1-855650-5 Nov 02 12:26:10.782355 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d16d5e8e-172f-42c8-b213-33410e8249c6 req-daf9eb7e-d2d9-42f1-be16-4a57f8a2bfa9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081089 Nov 02 12:26:10.783793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 792/1576] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:10.789873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:10.792823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:10.800328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:10.801031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:10.801472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.802226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:10.802813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:10.803256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:10.846151 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a631c889-362a-4694-b939-38aa65adf9f9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060280 Nov 02 12:26:10.847274 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 793/1577] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 12:26:10 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:11.069116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a46ee2f-f276-4ed0-9a86-7bd851b614fb tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:11.113106 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a46ee2f-f276-4ed0-9a86-7bd851b614fb tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1003665394" status: 202 len: 0 microversion: 2.1 time: 0.264007 Nov 02 12:26:11.119436 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 794/1578] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:26:10 2022] DELETE /compute/v2.1/flavors/1003665394 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:11.125427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:11.126686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:11.137332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:11.138151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:11.142230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:11.147991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:11.149729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:11.150480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:11.446470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:11.457573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:11.459837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:11.460963 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8d6e00cc-95e0-4974-8989-7423d288246d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1359 microversion: 2.21 time: 0.339848 Nov 02 12:26:11.462569 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 795/1579] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:11 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:11.503235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ec77412-4cd6-4ef8-a7b6-1a028714a0b3 tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:11.554811 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ec77412-4cd6-4ef8-a7b6-1a028714a0b3 tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.067548 Nov 02 12:26:11.555827 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 796/1580] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:11 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:11.568172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:11.572297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:11.591945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:11.594737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:11.597998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:11.599681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:11.602589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:11.605000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:11.693211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:11.694821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:11.695508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:11.696162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lazy-loading 'fault' on Instance uuid 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:11.771030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead418d7f3f945b3a3ad7432805fd929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1d3a52fa334a5397b03d71086cfffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:11.785590 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d386dd01-8dd9-4fe9-b432-39e19225b84f tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 200 len: 1314 microversion: 2.1 time: 0.227576 Nov 02 12:26:11.803452 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 797/1581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:11 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:11.809232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-007f52f7-406e-45dc-9000-88e9ade2586b tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:11.838852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-007f52f7-406e-45dc-9000-88e9ade2586b tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/182260224" status: 202 len: 0 microversion: 2.1 time: 0.033355 Nov 02 12:26:11.840248 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 798/1582] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:26:11 2022] DELETE /compute/v2.1/flavors/182260224 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:11.846047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:11.847157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:11.855523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:11.856392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:11.857117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:11.858195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:11.860795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:11.862952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.143096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:12.153336 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-577a5a2f-bfac-40e9-832b-a1a29ee67822 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 200 len: 1473 microversion: 2.1 time: 0.311677 Nov 02 12:26:12.155195 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 799/1583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:11 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 1473 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:12.160360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bcd83695-bc1b-4b24-95ec-0d2abcc887ce tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:12.184766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bcd83695-bc1b-4b24-95ec-0d2abcc887ce tempest-ServersWithSpecificFlavorTestJSON-472020903 tempest-ServersWithSpecificFlavorTestJSON-472020903-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028098 Nov 02 12:26:12.198240 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 800/1584] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:12.198240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:12.198240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:12.222666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.223179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.223632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.224357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.224813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.228152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.320588 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c9bcb45-86c1-47b5-bbcc-9e28c2dfc73a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133299 Nov 02 12:26:12.321582 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 801/1585] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 12:26:12 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:12.328560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:12.329074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:12.332802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:12.384024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.384533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.393468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.394493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.395775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.396254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.431052 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] HTTP exception thrown: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Request method failure captured: Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 HTTP/1.1 Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCbQj5y5VMukfW53UdSScVIFJbHrVTS76UHzoSCN_FlEDXH6qF8ndkBQHH9ZfEQ48Lg0aQuDtcQ39a10wv4Uw1zEGy-nGLakVGxGxl-O7ns_KldgazQrrqZnhgRbKAGxNQ3Hpuachqoy1tqZdxf0wUywdojV_jim3L8gTGMe0tCGbE Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:12.443680 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f19f46a5675c4f028057725f509a1d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 20bdb026c50545849ac88f7c744cbf50 Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.445307 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b1355556-3912-41a2-a733-92804b34fe22'} Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:12.446163 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.447540 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.448903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Returning 404 to user: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:12.448903 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d8d81ae-5fff-4dbe-bc39-c77d647a3142 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 404 len: 111 microversion: 2.1 time: 0.122758 Nov 02 12:26:12.449805 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 802/1586] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:12 2022] DELETE /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:12.459974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:12.460598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: b1355556-3912-41a2-a733-92804b34fe22] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:12.495376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.495880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.496325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.497045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.497502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.507079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.542593 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] HTTP exception thrown: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Request method failure captured: Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 HTTP/1.1 Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCbQj5y5VMukfW53UdSScVIFJbHrVTS76UHzoSCN_FlEDXH6qF8ndkBQHH9ZfEQ48Lg0aQuDtcQ39a10wv4Uw1zEGy-nGLakVGxGxl-O7ns_KldgazQrrqZnhgRbKAGxNQ3Hpuachqoy1tqZdxf0wUywdojV_jim3L8gTGMe0tCGbE Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:12.544179 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f19f46a5675c4f028057725f509a1d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 20bdb026c50545849ac88f7c744cbf50 Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.546044 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b1355556-3912-41a2-a733-92804b34fe22'} Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:12.547056 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. Nov 02 12:26:12.548762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:12.553225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Returning 404 to user: Instance b1355556-3912-41a2-a733-92804b34fe22 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:12.553225 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b6e82baa-5371-4e54-979a-53ab50525976 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22" status: 404 len: 111 microversion: 2.1 time: 0.093037 Nov 02 12:26:12.553225 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 803/1587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:12 2022] GET /compute/v2.1/servers/b1355556-3912-41a2-a733-92804b34fe22 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:12.554142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:12.559542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:12.587333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.590557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.591273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.592706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.594769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.597376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.900338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:12.909433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:12.916568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:12.917779 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-00fff591-6d5c-43af-9eb6-f8a7f6e1b6fd tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1359 microversion: 2.21 time: 0.367762 Nov 02 12:26:12.945391 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 804/1588] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:12 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1359 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:12.958007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:12.958526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:12.973134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.973621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.974382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.975580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:12.976050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:12.976563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:12.996485 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] HTTP exception thrown: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Request method failure captured: Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 HTTP/1.1 Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCbQj5y5VMukfW53UdSScVIFJbHrVTS76UHzoSCN_FlEDXH6qF8ndkBQHH9ZfEQ48Lg0aQuDtcQ39a10wv4Uw1zEGy-nGLakVGxGxl-O7ns_KldgazQrrqZnhgRbKAGxNQ3Hpuachqoy1tqZdxf0wUywdojV_jim3L8gTGMe0tCGbE Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:12.998189 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f19f46a5675c4f028057725f509a1d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 20bdb026c50545849ac88f7c744cbf50 Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.000072 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '2aa17e49-fd4f-4121-932a-3d8aad79bab1'} Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:13.001057 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.003327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.004976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Returning 404 to user: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:13.004976 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6a60c3df-459a-45ad-9ae1-276518e44237 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 404 len: 111 microversion: 2.1 time: 0.052957 Nov 02 12:26:13.004976 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 805/1589] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:12 2022] DELETE /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:13.008875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:13.009491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:13.021003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:13.021540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:13.022039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:13.022792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:13.030469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:13.031021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:13.071490 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 could not be found. Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 HTTP/1.1 Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:13.073753 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 could not be found. Nov 02 12:26:13.075613 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '2c6c6158-52c8-43c7-af6c-7d4f5cac0c53'} Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 could not be found. Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:13.076644 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 could not be found. Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 could not be found. Nov 02 12:26:13.078302 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.079798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Instance 2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:13.079798 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8258a76-eb7d-4151-b390-fa2f528fde72 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53" status: 404 len: 111 microversion: 2.1 time: 0.070279 Nov 02 12:26:13.079798 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 806/1590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:13 2022] GET /compute/v2.1/servers/2c6c6158-52c8-43c7-af6c-7d4f5cac0c53 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:13.089471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-93e71679-f0ef-4b24-94f8-d786a2ae3310 req-c5713325-ed20-4f50-885a-cdbbabfdc52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abefed7-326a-4db8-838a-b79ed58b9eb5", "name": "network-vif-deleted", "tag": "837b8282-2bdd-44eb-b98d-dddc8d815fdd"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:13.110718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-93e71679-f0ef-4b24-94f8-d786a2ae3310 req-c5713325-ed20-4f50-885a-cdbbabfdc52d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:13.110718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-93e71679-f0ef-4b24-94f8-d786a2ae3310 req-c5713325-ed20-4f50-885a-cdbbabfdc52d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:13.111276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-93e71679-f0ef-4b24-94f8-d786a2ae3310 req-c5713325-ed20-4f50-885a-cdbbabfdc52d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:13.157245 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-93e71679-f0ef-4b24-94f8-d786a2ae3310 req-c5713325-ed20-4f50-885a-cdbbabfdc52d service nova] Creating event network-vif-deleted:837b8282-2bdd-44eb-b98d-dddc8d815fdd for instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 on n-h2-855650-5 Nov 02 12:26:13.168303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-93e71679-f0ef-4b24-94f8-d786a2ae3310 req-c5713325-ed20-4f50-885a-cdbbabfdc52d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091166 Nov 02 12:26:13.173462 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 807/1591] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:13.182268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:13.185577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] [instance: 2aa17e49-fd4f-4121-932a-3d8aad79bab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:13.210323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:13.211192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:13.211815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:13.212727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:13.213352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:13.215804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:13.250157 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] HTTP exception thrown: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Request method failure captured: Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 HTTP/1.1 Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmCbQj5y5VMukfW53UdSScVIFJbHrVTS76UHzoSCN_FlEDXH6qF8ndkBQHH9ZfEQ48Lg0aQuDtcQ39a10wv4Uw1zEGy-nGLakVGxGxl-O7ns_KldgazQrrqZnhgRbKAGxNQ3Hpuachqoy1tqZdxf0wUywdojV_jim3L8gTGMe0tCGbE Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:13.254731 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f19f46a5675c4f028057725f509a1d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f19f46a5675c4f028057725f509a1d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f19f46a5675c4f028057725f509a1d50 Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001 Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 20bdb026c50545849ac88f7c744cbf50 Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-691322001-project Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.256586 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '2aa17e49-fd4f-4121-932a-3d8aad79bab1'} Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:13.257534 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. Nov 02 12:26:13.258924 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:13.261420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] Returning 404 to user: Instance 2aa17e49-fd4f-4121-932a-3d8aad79bab1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:13.271402 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-83ded378-b91d-4c42-ba46-d9b8f663fe86 tempest-ServersWithSpecificFlavorTestJSON-691322001 tempest-ServersWithSpecificFlavorTestJSON-691322001-project] 10.222.0.45 "GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1" status: 404 len: 111 microversion: 2.1 time: 0.096344 Nov 02 12:26:13.286284 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 808/1592] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:13 2022] GET /compute/v2.1/servers/2aa17e49-fd4f-4121-932a-3d8aad79bab1 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:13.291871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3859da47-3f35-4d07-86ee-096329aa85dd tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '.version_select at 0x7f228e8b2af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:13.823579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=5 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:14.354302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:18.426647 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3859da47-3f35-4d07-86ee-096329aa85dd tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Image not found. Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3859da47-3f35-4d07-86ee-096329aa85dd tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/images/8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f HTTP/1.1 Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:18.428415 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f'} Nov 02 12:26:18.430100 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f to delete Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:18.431055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f could not be found. Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:18.432485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:26:18.433992 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.436709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3859da47-3f35-4d07-86ee-096329aa85dd tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:18.437875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3859da47-3f35-4d07-86ee-096329aa85dd tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/images/8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f" status: 404 len: 62 microversion: 2.1 time: 5.150403 Nov 02 12:26:18.438545 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 809/1593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:13 2022] DELETE /compute/v2.1/images/8b7d6a9d-f018-4795-8aed-99e8b9e8cf6f => generated 62 bytes in 5152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:26:18.443681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:18.444794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 5abefed7-326a-4db8-838a-b79ed58b9eb5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:18.452724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.453443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.453894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.455305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.456161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.456605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.472452 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] HTTP exception thrown: Instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 could not be found. Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Request method failure captured: Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 HTTP/1.1 Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEoKKH1d1dNCfx0n6k8xAaZ0DOfaqVNuTM4yH134_2ZI4YwbDiMytCq5LG5xXHF5CzDXD90RhBYzF1tMwyA72bzZGoGo_H4fTLyWD6bVx8F_PDgcNDnf-z3-PMnJUzDqQqSuxJfAXraxqZ7DoROSnlGBI06nxu2NdOTyDomMnvwV14 Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:18.474053 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7c91481067cd4be881f75d33b56ee431 Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 could not be found. Nov 02 12:26:18.475721 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '5abefed7-326a-4db8-838a-b79ed58b9eb5'} Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 could not be found. Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:18.476581 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 could not be found. Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 could not be found. Nov 02 12:26:18.478328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.481132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Returning 404 to user: Instance 5abefed7-326a-4db8-838a-b79ed58b9eb5 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:18.482463 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-417f5c51-0710-47a0-a3fc-101ec32a480f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5" status: 404 len: 111 microversion: 2.1 time: 0.042699 Nov 02 12:26:18.483204 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 810/1594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:18 2022] GET /compute/v2.1/servers/5abefed7-326a-4db8-838a-b79ed58b9eb5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:18.484994 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05b53c7a-e2a2-443a-aa04-66e885d0fd2a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1464 microversion: 2.1 time: 14.173403 Nov 02 12:26:18.489071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:18.491294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:18.495796 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 785/1595] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:04 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1464 bytes in 14187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:18.497903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.498430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.498871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.499642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.500098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.500590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.503591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:18.506369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:18.536667 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91285ce6-0814-4bda-a04c-7e1eeb389efa tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.052196 Nov 02 12:26:18.537243 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 811/1596] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 12:26:18 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:18.542489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ca8c41c3-995a-4e3c-85c9-342d6ac55bb1 req-41e8447e-14ae-494d-a1e6-76e29feadff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621ca1e9-68ee-4395-a530-441538f9dcad", "name": "network-vif-plugged", "status": "completed", "tag": "568d56e8-787f-4940-a272-87913f4c8940"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:18.550118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.550633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.551085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.551810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.552493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ca8c41c3-995a-4e3c-85c9-342d6ac55bb1 req-41e8447e-14ae-494d-a1e6-76e29feadff6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.552994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ca8c41c3-995a-4e3c-85c9-342d6ac55bb1 req-41e8447e-14ae-494d-a1e6-76e29feadff6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.553641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ca8c41c3-995a-4e3c-85c9-342d6ac55bb1 req-41e8447e-14ae-494d-a1e6-76e29feadff6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.553869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.554375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.583758 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ca8c41c3-995a-4e3c-85c9-342d6ac55bb1 req-41e8447e-14ae-494d-a1e6-76e29feadff6 service nova] Creating event network-vif-plugged:568d56e8-787f-4940-a272-87913f4c8940 for instance 621ca1e9-68ee-4395-a530-441538f9dcad on n-h1-855650-5 Nov 02 12:26:18.592576 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ca8c41c3-995a-4e3c-85c9-342d6ac55bb1 req-41e8447e-14ae-494d-a1e6-76e29feadff6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053892 Nov 02 12:26:18.597214 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 812/1597] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:18.604034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:18.609234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:18.623847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.624338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.624772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.625628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.626028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.626376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.642488 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 HTTP/1.1 Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:18.644553 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:18.646121 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '5f1c9deb-57fd-4e6f-99ab-2b38d0265349'} Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:18.646979 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:18.648313 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:18.651905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:18.653035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d68f4921-73bf-4f5b-b65d-8b58fe8bac34 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 404 len: 111 microversion: 2.1 time: 0.054394 Nov 02 12:26:18.678503 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 813/1598] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:18 2022] DELETE /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:18.691028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:18.694107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:18.711324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.712117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.712566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.713315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:18.713774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:18.714245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:18.747997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:18.931483 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d17bed0a-4837-4e56-bccf-2594348aee4f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 204 len: 0 microversion: 2.1 time: 0.250467 Nov 02 12:26:18.933574 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 814/1599] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:18 2022] DELETE /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:18.951787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9bb9561f-a4a8-4cf3-ae62-3636fd9cb912 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e872b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:18.973041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:18.988719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:18.992454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:18.993924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d839578-c59e-4776-8ec5-9cb9cfa5689e tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1359 microversion: 2.21 time: 0.497068 Nov 02 12:26:18.996062 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 786/1600] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:18 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1359 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:19.021429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:19.025040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 5f1c9deb-57fd-4e6f-99ab-2b38d0265349] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:19.050485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:19.053095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:19.053723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:19.055331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:19.063054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:19.064757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:19.113868 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 HTTP/1.1 Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:26:19.119025 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:19.121038 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '5f1c9deb-57fd-4e6f-99ab-2b38d0265349'} Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:19.122141 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. Nov 02 12:26:19.123865 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:19.125427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Instance 5f1c9deb-57fd-4e6f-99ab-2b38d0265349 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:19.133215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-75b3ece7-e402-4a52-9e92-8b1038b123d3 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349" status: 404 len: 111 microversion: 2.1 time: 0.135738 Nov 02 12:26:19.134345 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 787/1601] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:18 2022] GET /compute/v2.1/servers/5f1c9deb-57fd-4e6f-99ab-2b38d0265349 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:19.140554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:19.141432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:19.159457 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9bb9561f-a4a8-4cf3-ae62-3636fd9cb912 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 200 len: 1464 microversion: 2.1 time: 0.222925 Nov 02 12:26:19.162335 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 815/1602] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:18 2022] GET /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:19.170909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:19.172502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:19.173552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:19.175126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-880e6d63-9d17-4547-acfe-00c647264699 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '.version_select at 0x7f228e88cdc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:19.176217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:19.176931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:19.179316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:19.234583 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-880e6d63-9d17-4547-acfe-00c647264699 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372772041" status: 202 len: 0 microversion: 2.1 time: 0.067873 Nov 02 12:26:19.235331 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 816/1603] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:26:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372772041 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:19.260171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:19.262963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:19.278526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:19.279540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:19.281374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:19.282228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:19.283986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:19.284710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:19.829187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:19.842828 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f65e3a85-ec41-49b2-aaf1-6501e0477d3d tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1473 microversion: 2.1 time: 0.707155 Nov 02 12:26:19.843409 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 788/1604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:19 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1473 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:19.855662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:19.877399 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd175ab0-5468-4358-a88d-a5d0143d50be tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1480 microversion: 2.1 time: 0.638841 Nov 02 12:26:19.899245 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 817/1605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:19 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1480 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:20.029338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:20.029997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:20.037251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:20.037978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:20.039041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:20.040079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:20.041316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:20.042123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:20.286026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9559c7a-273a-434d-8392-47c76e4ff8f6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '.version_select at 0x7f228e874dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:20.365251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:20.375999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:20.378268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:20.379423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-113d4870-7abd-4ea9-8e25-f0ccd1c18282 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1359 microversion: 2.21 time: 0.355195 Nov 02 12:26:20.380130 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 789/1606] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:20 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1359 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:20.870592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:20.871974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:20.879387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:20.880191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:20.880637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:20.881556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:20.882051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:20.882528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:21.136566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:21.156696 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44a66db5-80fa-4258-bb04-460afa4d5f91 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 200 len: 1473 microversion: 2.1 time: 0.289912 Nov 02 12:26:21.158306 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 790/1607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:20 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:21.165075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:21.166550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:21.175163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:21.175680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:21.176109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:21.176828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:21.177549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:21.178330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:21.542846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:21.559303 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dcd764ce-9507-44dd-9709-c8f610b6dbc5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1467 microversion: 2.1 time: 0.398217 Nov 02 12:26:21.577116 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 791/1608] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:21 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1467 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:21.583910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:21.584861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:21.593770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:21.594753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:21.596061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:21.597084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:21.597621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:21.598152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:22.303439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:22.322487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:22.324665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:22.331535 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59d99cbb-3a66-4764-b605-b950eb44bf40 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1553 microversion: 2.21 time: 0.752800 Nov 02 12:26:22.346646 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 792/1609] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:21 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1553 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:22.353064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-454840659"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:22.365528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:22.384403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:22.386308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:22.387903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:22.389524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:22.390713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:22.393185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:24.872625 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-a9559c7a-273a-434d-8392-47c76e4ff8f6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Image not found. Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9559c7a-273a-434d-8392-47c76e4ff8f6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/images/ef4197de-3f4e-4f81-9ac4-4c27798d51bb HTTP/1.1 Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:24.875648 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'ef4197de-3f4e-4f81-9ac4-4c27798d51bb'} Nov 02 12:26:24.877622 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ef4197de-3f4e-4f81-9ac4-4c27798d51bb to delete Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:24.878824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef4197de-3f4e-4f81-9ac4-4c27798d51bb could not be found. Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:24.880452 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9559c7a-273a-434d-8392-47c76e4ff8f6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:24.884949 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9559c7a-273a-434d-8392-47c76e4ff8f6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/images/ef4197de-3f4e-4f81-9ac4-4c27798d51bb" status: 404 len: 62 microversion: 2.1 time: 4.599404 Nov 02 12:26:24.886386 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 818/1610] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:20 2022] DELETE /compute/v2.1/images/ef4197de-3f4e-4f81-9ac4-4c27798d51bb => generated 62 bytes in 4605 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:26:24.889574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0cec80c0-302b-4c34-98c6-7736add7f608 req-d0384566-637a-4b2a-8935-040a200b9489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0838ca-34c6-4d78-8d26-ce67982c4c7b", "name": "network-vif-unplugged", "status": "completed", "tag": "68072907-6547-4e2b-8fb7-0c95d853ce3e"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:24.911128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0cec80c0-302b-4c34-98c6-7736add7f608 req-d0384566-637a-4b2a-8935-040a200b9489 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:24.911871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0cec80c0-302b-4c34-98c6-7736add7f608 req-d0384566-637a-4b2a-8935-040a200b9489 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:24.912320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0cec80c0-302b-4c34-98c6-7736add7f608 req-d0384566-637a-4b2a-8935-040a200b9489 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:24.927008 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0cec80c0-302b-4c34-98c6-7736add7f608 req-d0384566-637a-4b2a-8935-040a200b9489 service nova] Creating event network-vif-unplugged:68072907-6547-4e2b-8fb7-0c95d853ce3e for instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b on n-h1-855650-5 Nov 02 12:26:24.933054 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0cec80c0-302b-4c34-98c6-7736add7f608 req-d0384566-637a-4b2a-8935-040a200b9489 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048925 Nov 02 12:26:24.934001 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 819/1611] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:24.946392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-fb0925bc-ebb1-4fcf-9834-64b847a0298a req-04fc2b0a-c825-48df-9df1-13d62fdac170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02bc114f-5d4a-4561-9ae3-8f7a44456697", "name": "network-vif-deleted", "tag": "49237042-1850-4e28-9305-32b5a2880647"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:24.959100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fb0925bc-ebb1-4fcf-9834-64b847a0298a req-04fc2b0a-c825-48df-9df1-13d62fdac170 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:24.960449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fb0925bc-ebb1-4fcf-9834-64b847a0298a req-04fc2b0a-c825-48df-9df1-13d62fdac170 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:24.961065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fb0925bc-ebb1-4fcf-9834-64b847a0298a req-04fc2b0a-c825-48df-9df1-13d62fdac170 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:24.976563 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-fb0925bc-ebb1-4fcf-9834-64b847a0298a req-04fc2b0a-c825-48df-9df1-13d62fdac170 service nova] Creating event network-vif-deleted:49237042-1850-4e28-9305-32b5a2880647 for instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 on n-h2-855650-5 Nov 02 12:26:24.985611 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-fb0925bc-ebb1-4fcf-9834-64b847a0298a req-04fc2b0a-c825-48df-9df1-13d62fdac170 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046894 Nov 02 12:26:24.986608 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 820/1612] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:24.996672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.000265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 02bc114f-5d4a-4561-9ae3-8f7a44456697] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:25.009455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.009955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.010635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.011990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.012737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.013150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.030870 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] HTTP exception thrown: Instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 could not be found. Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Request method failure captured: Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 HTTP/1.1 Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEoKKH1d1dNCfx0n6k8xAaZ0DOfaqVNuTM4yH134_2ZI4YwbDiMytCq5LG5xXHF5CzDXD90RhBYzF1tMwyA72bzZGoGo_H4fTLyWD6bVx8F_PDgcNDnf-z3-PMnJUzDqQqSuxJfAXraxqZ7DoROSnlGBI06nxu2NdOTyDomMnvwV14 Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:25.033123 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7c91481067cd4be881f75d33b56ee431 Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 could not be found. Nov 02 12:26:25.035102 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '02bc114f-5d4a-4561-9ae3-8f7a44456697'} Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 could not be found. Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:25.036151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 could not be found. Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 could not be found. Nov 02 12:26:25.037789 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.039318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Returning 404 to user: Instance 02bc114f-5d4a-4561-9ae3-8f7a44456697 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:25.039318 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-76d69265-e4ae-44b2-87e1-3600fe2a4952 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697" status: 404 len: 111 microversion: 2.1 time: 0.046464 Nov 02 12:26:25.039318 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 821/1613] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:24 2022] GET /compute/v2.1/servers/02bc114f-5d4a-4561-9ae3-8f7a44456697 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:25.044314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.044822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:25.063145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.064617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.065256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.066258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.066902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.067511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.093784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:25.102163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:25.148902 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e1c0589-a887-4038-9262-f6e8d1631577 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "POST /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f/action" status: 202 len: 0 microversion: 2.1 time: 2.812746 Nov 02 12:26:25.160094 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 793/1614] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:26:22 2022] POST /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f/action => generated 0 bytes in 2827 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:26:25.171630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.172531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:25.187538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.188100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.188553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.189367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.189837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.190865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.208835 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 HTTP/1.1 Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:26:25.212361 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.213856 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8'} Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:25.215163 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.216852 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.219169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:25.219650 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d2b813f7-0bb1-4ac4-96cb-b477edf9d3ad tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 404 len: 111 microversion: 2.1 time: 0.051992 Nov 02 12:26:25.222224 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 794/1615] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:25 2022] DELETE /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:25.230309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.232764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:25.243775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.245071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.245754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.246820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.247533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.248053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.274672 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-138159b6-7923-49b3-8cfd-5f49230bdda9 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "DELETE /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 204 len: 0 microversion: 2.21 time: 0.237379 Nov 02 12:26:25.275526 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 822/1616] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:26:25 2022] DELETE /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:26:25.280442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23729d60-db99-441b-ae36-a1f41ae75eae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e83c1f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.305917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:25.342838 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-23729d60-db99-441b-ae36-a1f41ae75eae tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.066246 Nov 02 12:26:25.344370 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 823/1617] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:25 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:25.349834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.350593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] [instance: 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:25.358713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.359491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.360273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.361307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.362025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.362607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.379055 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] HTTP exception thrown: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Request method failure captured: Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 HTTP/1.1 Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmFYNu6yRJ3cfpTd-cmP5vXvVHKnT7dvK__VqHHfSZT80IbQssfjCGUEOFs-YHEgvQ5Mqa3xsXi-oJVBkJHrvxZIg9pC6CAQI0wL0M8DKLq_-WZoVAMdAHc1PSa0gSYhjtp31XQ8IfQvlv7TViFrVhzHF4_iaL_wff5pjBMULoQFFog Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:25.380101 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec1d3a52fa334a5397b03d71086cfffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ec1d3a52fa334a5397b03d71086cfffc Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432 Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ead418d7f3f945b3a3ad7432805fd929 Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1236213432-project Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.381887 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8'} Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:25.382911 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. Nov 02 12:26:25.384574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:25.386790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] Returning 404 to user: Instance 3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:25.388314 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b9da5188-26bd-437b-9445-8d4cf49fadc6 tempest-ImagesOneServerNegativeTestJSON-1236213432 tempest-ImagesOneServerNegativeTestJSON-1236213432-project] 10.222.0.45 "GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8" status: 404 len: 111 microversion: 2.1 time: 0.043440 Nov 02 12:26:25.389343 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 824/1618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:25 2022] GET /compute/v2.1/servers/3cbf0d8e-cb7d-480a-8e41-cf4aa983ffd8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:25.394613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.395228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:25.401544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.402052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.402712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.403600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.404218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.404807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.486262 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91f2fe56-8cac-48ad-9c99-8cd889b275fd tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 204 len: 0 microversion: 2.1 time: 0.261384 Nov 02 12:26:25.488628 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 795/1619] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:25 2022] DELETE /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:25.500422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.502030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:25.509149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.509654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.510298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.511033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.511490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.512284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.544738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:25.703537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1171db9c-993a-4bea-a512-997cabc28f95 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 204 len: 0 microversion: 2.1 time: 0.210037 Nov 02 12:26:25.709147 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 796/1620] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:25 2022] DELETE /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:25.727207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:25.729983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:25.749816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.750610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.751142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.752505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:25.753039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:25.755596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:25.761215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:25.773706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:25.775512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:25.776961 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0bdcb46d-fb70-458d-b854-3ae9ccb57bc7 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1559 microversion: 2.21 time: 0.386678 Nov 02 12:26:25.778250 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 825/1621] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:25 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1559 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:25.983237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:25.996476 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3494e05b-64e8-4e4e-a43a-f1b3f5c2e7df tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 200 len: 1474 microversion: 2.1 time: 0.282886 Nov 02 12:26:26.000810 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 797/1622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:25 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 1474 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:26.362808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fcb022d4-968e-4730-8412-51e216e8c2bd tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e9864c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:26.431862 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fcb022d4-968e-4730-8412-51e216e8c2bd tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.076093 Nov 02 12:26:26.441640 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 826/1623] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:26 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:26.805919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:26.806798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:26.821856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:26.822858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:26.823314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:26.827863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:26.828287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:26.828720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:27.024570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:27.025390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:27.052751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:27.055610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:27.056836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:27.060975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:27.062556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:27.063555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:27.180501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:27.202849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:27.204768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:27.206219 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b7a2239-880d-49a7-b050-6d43dea26688 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1559 microversion: 2.21 time: 0.404207 Nov 02 12:26:27.207314 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 798/1624] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:26 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1559 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:27.448085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-23703e64-d209-4c04-915f-e730d08b38ec tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e7a18b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:27.535073 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-23703e64-d209-4c04-915f-e730d08b38ec tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.090726 Nov 02 12:26:27.537771 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 799/1625] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:27 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:27.539432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:27.552669 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d51b10d-831c-493d-ade1-198c0fb2c5e6 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 200 len: 1474 microversion: 2.1 time: 0.533540 Nov 02 12:26:27.578364 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 827/1626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:27 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:28.234725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:28.236801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:28.254289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:28.255489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:28.256941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:28.260096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:28.260842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:28.265641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:28.379452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-51145b50-81d3-48ae-943e-d943d68f1c8b tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1816004981", "id": 1756467640, "os-flavor-access:is_public": "True"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:28.415494 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-51145b50-81d3-48ae-943e-d943d68f1c8b tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.345661 Nov 02 12:26:28.416747 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 800/1627] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:28 2022] POST /compute/v2.1/flavors => generated 430 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:28.430289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18f6b6be-77a2-4060-8d46-7c9560b978ce tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:28.490608 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18f6b6be-77a2-4060-8d46-7c9560b978ce tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1756467640" status: 202 len: 0 microversion: 2.1 time: 0.064628 Nov 02 12:26:28.491518 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 801/1628] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:26:28 2022] DELETE /compute/v2.1/flavors/1756467640 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:26:28.500820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2e1fa69-1b8f-47e4-b80e-f007dc0a4aed tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:28.559877 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2e1fa69-1b8f-47e4-b80e-f007dc0a4aed tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063606 Nov 02 12:26:28.566584 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 802/1629] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:28.585059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80d9125a-682c-4cfe-a562-18c861cc9473 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e5073a0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:28.681218 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80d9125a-682c-4cfe-a562-18c861cc9473 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.111187 Nov 02 12:26:28.682161 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 803/1630] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:28 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:28.712683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:28.713706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:28.728933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:28.731821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:28.734453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:28.737273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:28.740193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:28.742511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:28.761533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:28.801580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:28.811922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:28.813371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:28.832045 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c7f58b1-28ad-4d18-b14f-db2c806ea6bf tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1559 microversion: 2.21 time: 0.601394 Nov 02 12:26:28.835958 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 828/1631] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:28 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1559 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:28.864659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55e6b972-f97f-4898-b1a6-940a154735f4 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-798846607", "id": 1683224746, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:28.930883 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55e6b972-f97f-4898-b1a6-940a154735f4 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.086384 Nov 02 12:26:28.932105 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 829/1632] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:28 2022] POST /compute/v2.1/flavors => generated 416 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:28.949068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05ba62f0-adc6-4119-9c97-a6c06ca4c58a tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:28.977543 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05ba62f0-adc6-4119-9c97-a6c06ca4c58a tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.036949 Nov 02 12:26:28.979262 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 830/1633] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:28 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:29.003748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d546e176-5b93-442b-a4c4-ce57c11bf9bb tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.051689 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d546e176-5b93-442b-a4c4-ce57c11bf9bb tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1683224746" status: 202 len: 0 microversion: 2.1 time: 0.053195 Nov 02 12:26:29.052780 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 831/1634] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:26:28 2022] DELETE /compute/v2.1/flavors/1683224746 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:29.065211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f576e1f-d335-42da-af04-3ad2250d1620 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.109701 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f576e1f-d335-42da-af04-3ad2250d1620 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051914 Nov 02 12:26:29.110388 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 832/1635] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:29.133485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58b2083c-159e-4f3c-86eb-eec68110e449 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1664859781", "id": 2025384678, "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:29.163958 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58b2083c-159e-4f3c-86eb-eec68110e449 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.033581 Nov 02 12:26:29.167231 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 833/1636] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:29 2022] POST /compute/v2.1/flavors => generated 429 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:29.181136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e6441b27-efcc-47ff-9350-21a5ff6d7b16 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.221810 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e6441b27-efcc-47ff-9350-21a5ff6d7b16 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/2025384678" status: 202 len: 0 microversion: 2.1 time: 0.045978 Nov 02 12:26:29.223665 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 834/1637] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:26:29 2022] DELETE /compute/v2.1/flavors/2025384678 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:26:29.236560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-154aebf1-8543-46f6-8904-cf3893ec030d tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.273809 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-154aebf1-8543-46f6-8904-cf3893ec030d tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045487 Nov 02 12:26:29.275033 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 835/1638] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:29.302640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a97a2e53-6a77-4835-ad10-6b2a50a0a3a1 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-282407815", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:29.360153 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a97a2e53-6a77-4835-ad10-6b2a50a0a3a1 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.064249 Nov 02 12:26:29.365780 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 836/1639] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:29 2022] POST /compute/v2.1/flavors => generated 506 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:29.381137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ec0ad2b8-0548-4706-b362-90743bd1034e tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.405171 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ec0ad2b8-0548-4706-b362-90743bd1034e tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/599cb38f-6e6b-443b-b81d-1b36e24d213c" status: 202 len: 0 microversion: 2.1 time: 0.032395 Nov 02 12:26:29.406241 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 837/1640] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:29 2022] DELETE /compute/v2.1/flavors/599cb38f-6e6b-443b-b81d-1b36e24d213c => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:26:29.417155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4bdf2b22-6357-490d-b39f-09532dad06fa tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.471233 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4bdf2b22-6357-490d-b39f-09532dad06fa tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058249 Nov 02 12:26:29.492193 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 838/1641] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:29.505002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd96f0d5-0f9c-477b-a19f-35bc78e23bc2 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-693313795", "id": "1d612ec0-fac9-4b0b-8739-ccd6f81f3e3e", "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:29.529234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=10,nova_api:INSERT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:29.581100 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd96f0d5-0f9c-477b-a19f-35bc78e23bc2 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.080920 Nov 02 12:26:29.614070 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 839/1642] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:29 2022] POST /compute/v2.1/flavors => generated 506 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:29.636450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0fe76532-7e1b-4f04-a1e3-4d9910f51f24 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.697222 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0fe76532-7e1b-4f04-a1e3-4d9910f51f24 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1d612ec0-fac9-4b0b-8739-ccd6f81f3e3e" status: 202 len: 0 microversion: 2.1 time: 0.079003 Nov 02 12:26:29.701475 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 840/1643] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:29 2022] DELETE /compute/v2.1/flavors/1d612ec0-fac9-4b0b-8739-ccd6f81f3e3e => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:29.708552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6f149d0-63ad-4ed8-9f3c-2ddcdc816d2f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e986790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.810003 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b6f149d0-63ad-4ed8-9f3c-2ddcdc816d2f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.106899 Nov 02 12:26:29.811874 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 841/1644] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:29 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:29.817334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d366dd5d-c69b-42ef-880e-00b3c332c574 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:29.871856 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d366dd5d-c69b-42ef-880e-00b3c332c574 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058440 Nov 02 12:26:29.873636 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 842/1645] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:29.905320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-182e5aa6-357c-48bd-82a1-23ed92134dbb req-2f03ac2a-be47-425c-ae5d-7467d9f2d708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621ca1e9-68ee-4395-a530-441538f9dcad", "name": "network-vif-deleted", "tag": "568d56e8-787f-4940-a272-87913f4c8940"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:29.935347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-182e5aa6-357c-48bd-82a1-23ed92134dbb req-2f03ac2a-be47-425c-ae5d-7467d9f2d708 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:29.937221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-182e5aa6-357c-48bd-82a1-23ed92134dbb req-2f03ac2a-be47-425c-ae5d-7467d9f2d708 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:29.937912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-182e5aa6-357c-48bd-82a1-23ed92134dbb req-2f03ac2a-be47-425c-ae5d-7467d9f2d708 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:29.947976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:29.975704 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-182e5aa6-357c-48bd-82a1-23ed92134dbb req-2f03ac2a-be47-425c-ae5d-7467d9f2d708 service nova] Creating event network-vif-deleted:568d56e8-787f-4940-a272-87913f4c8940 for instance 621ca1e9-68ee-4395-a530-441538f9dcad on n-h1-855650-5 Nov 02 12:26:29.989435 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-182e5aa6-357c-48bd-82a1-23ed92134dbb req-2f03ac2a-be47-425c-ae5d-7467d9f2d708 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101234 Nov 02 12:26:29.992017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 843/1646] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:30.010835 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d7e31daf-859e-4898-a6ed-1b0f4d726784 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 200 len: 1474 microversion: 2.1 time: 1.325165 Nov 02 12:26:30.016164 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 804/1647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:28 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 1474 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:30.019605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:30.022315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:30.042454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:30.043905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:30.054882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:30.056203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:30.061000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:30.061679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:30.100573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e11b0d0-087f-4281-b57d-2d9ab8afbc7c tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-68445376", "id": 13354193, "os-flavor-access:is_public": "True"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:30.189423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0e11b0d0-087f-4281-b57d-2d9ab8afbc7c tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.1 time: 0.161861 Nov 02 12:26:30.195761 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 805/1648] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:30.210578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:30.213634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:30.218130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:30.219095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6002fa0-5776-4897-8980-c2c5aeff4977 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:30.221163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lazy-loading 'fault' on Instance uuid 621ca1e9-68ee-4395-a530-441538f9dcad {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:30.244485 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6002fa0-5776-4897-8980-c2c5aeff4977 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/13354193" status: 200 len: 406 microversion: 2.1 time: 0.032445 Nov 02 12:26:30.246512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 806/1649] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:26:30 2022] GET /compute/v2.1/flavors/13354193 => generated 406 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:30.484702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:30.496553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:30.499742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45e4bffe383e4049974ef4c9fe3e3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab3b72b58de4fc6a0957dc3f3141677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:30.501381 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2909b13-6387-4247-9e08-e0e2dfd32f44 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 200 len: 1349 microversion: 2.21 time: 0.505697 Nov 02 12:26:30.502421 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 844/1650] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:29 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 1349 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:26:30.597215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67139725-a176-4049-acbc-4fe578a5778b tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:30.695294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67139725-a176-4049-acbc-4fe578a5778b tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5387 microversion: 2.1 time: 0.399330 Nov 02 12:26:30.710603 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 807/1651] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:30 2022] GET /compute/v2.1/flavors/detail => generated 5387 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:30.716905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03564c94-5a85-4449-a50c-b60c33d9fae9 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:30.757609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-03564c94-5a85-4449-a50c-b60c33d9fae9 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/13354193" status: 202 len: 0 microversion: 2.1 time: 0.045943 Nov 02 12:26:30.758949 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 845/1652] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:26:30 2022] DELETE /compute/v2.1/flavors/13354193 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:26:30.768044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b62a051-3e87-47de-ae17-e6a33b470811 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:30.833384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9cd29c3c-727a-4742-92a1-b725abbe269f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e986430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:30.892300 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b62a051-3e87-47de-ae17-e6a33b470811 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.125736 Nov 02 12:26:30.894304 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 808/1653] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:30.928700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-744a90bd-1c28-4ed3-b2e3-20ab243e46f0 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1926952235", "id": 271244398, "os-flavor-access:is_public": "False"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:30.953722 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9cd29c3c-727a-4742-92a1-b725abbe269f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.129456 Nov 02 12:26:30.961849 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 846/1654] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:30 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:31.017049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-744a90bd-1c28-4ed3-b2e3-20ab243e46f0 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.083678 Nov 02 12:26:31.023732 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 809/1655] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:30 2022] POST /compute/v2.1/flavors => generated 427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:31.035103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48eb0704-8d74-472c-ba1e-dfe874372820 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "271244398"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:31.057667 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-48eb0704-8d74-472c-ba1e-dfe874372820 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] HTTP exception thrown: Flavor 271244398 could not be found. Nov 02 12:26:31.062401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.063025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:31.090494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:31.091853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:31.096987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48eb0704-8d74-472c-ba1e-dfe874372820 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] Request method failure captured: Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 106 Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmHz-DiGkiHfKJkC9NmpT62ZBkBZF6eXVa_XKEblBOhPolcawegMT7BzrYH6Muicp5DdjF56KPNdF2j1e9dzMF4upZhiN9dWEEdPTfHNxlow0_lGnDTBxv_ea3rllPUtGywUtQm4kqj8m-1oIe_5Lz51gphM21q6f5PjrNqpezRsrUY Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 35f01d4574dc4efaa108ab6c37bfaa37 Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FlavorsAdminTestJSON-1845032346 Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:31.098713 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35f01d4574dc4efaa108ab6c37bfaa37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35f01d4574dc4efaa108ab6c37bfaa37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35f01d4574dc4efaa108ab6c37bfaa37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35f01d4574dc4efaa108ab6c37bfaa37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FlavorsAdminTestJSON-1845032346 Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 35f01d4574dc4efaa108ab6c37bfaa37 Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1845032346 Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FlavorsAdminTestJSON-1845032346-project Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 3e2a59d5fe7648b68bf2318c2ed67630 Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FlavorsAdminTestJSON-1845032346-project Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "test", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "271244398"}} Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:31.100651 n-d-855650-5 devstack@n-api.service[120723]: exception: Flavor 271244398 could not be found. Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '271244398'}}} Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 271244398 could not be found. Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.101828 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 271244398 could not be found. Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:31.104202 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:31.106679 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:31.106679 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:31.106679 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:31.106679 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 271244398 could not be found. Nov 02 12:26:31.106679 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.114667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:31.114667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:31.114667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:31.115428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48eb0704-8d74-472c-ba1e-dfe874372820 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] Returning 400 to user: Flavor 271244398 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:31.115428 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48eb0704-8d74-472c-ba1e-dfe874372820 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.078642 Nov 02 12:26:31.115876 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 847/1656] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:31 2022] POST /compute/v2.1/servers => generated 80 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:31.133862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9d372e04-8645-4aa2-a200-ed21860f8482 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.182918 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9d372e04-8645-4aa2-a200-ed21860f8482 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/271244398" status: 202 len: 0 microversion: 2.1 time: 0.065272 Nov 02 12:26:31.183996 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 848/1657] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:26:31 2022] DELETE /compute/v2.1/flavors/271244398 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:31.194789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-22e0f281-b346-4ef5-8597-adb5d5d4dcd0 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.223705 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-22e0f281-b346-4ef5-8597-adb5d5d4dcd0 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032961 Nov 02 12:26:31.237672 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 849/1658] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:31.260574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-304e9af8-68ef-4441-911c-5a33e4dea2d7 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1501398355", "id": 414003620, "os-flavor-access:is_public": "False"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:31.299843 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-304e9af8-68ef-4441-911c-5a33e4dea2d7 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.050215 Nov 02 12:26:31.300788 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 850/1659] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:31 2022] POST /compute/v2.1/flavors => generated 412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:31.316516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67a0c80f-4631-4466-b7ad-0d221937800d tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-13290618", "id": 2033165505, "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:31.364909 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67a0c80f-4631-4466-b7ad-0d221937800d tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.053150 Nov 02 12:26:31.366545 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 851/1660] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:31 2022] POST /compute/v2.1/flavors => generated 412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:31.380163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97a45e56-c5ce-4032-9586-c5090db72f92 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.424235 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97a45e56-c5ce-4032-9586-c5090db72f92 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.049353 Nov 02 12:26:31.435904 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 852/1661] 10.222.0.45 () {58 vars in 1169 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:31.446462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c61c8198-f34a-4f7e-b237-ab825428140f tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.467020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c61c8198-f34a-4f7e-b237-ab825428140f tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.026627 Nov 02 12:26:31.468773 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 853/1662] 10.222.0.45 () {58 vars in 1177 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:31.482959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3afe81fb-4ef2-4d85-9fff-e7eb9d2a2300 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.505269 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3afe81fb-4ef2-4d85-9fff-e7eb9d2a2300 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.026424 Nov 02 12:26:31.506260 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 854/1663] 10.222.0.45 () {58 vars in 1171 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:31.527276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aae42849-2ade-472b-bb93-1e1354831262 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.549809 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-aae42849-2ade-472b-bb93-1e1354831262 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.033949 Nov 02 12:26:31.553836 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 855/1664] 10.222.0.45 () {58 vars in 1169 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:31.565286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.566399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:31.579798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:31.583871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:31.584493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:31.586566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:31.588620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:31.589476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:31.626761 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] HTTP exception thrown: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Request method failure captured: Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad HTTP/1.1 Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmHQp3eleum_TiehG870LndrfQUk2PKaqzLg4UDpEpdVvxzaB-ovuiU7-wq7RzP4Xcu3xdLguCTl8nAG_8vv6CtCPiBgbFGSiI3u4Y0uBSdhQfQY988ekGEk79aTrblxIe8n4GKVYzM_6vWy5gpSlpok3AsdoCWxQ_bfB-NqPxMXnEc Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: dab3b72b58de4fc6a0957dc3f3141677 Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:31.628978 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: dab3b72b58de4fc6a0957dc3f3141677 Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-InstanceActionsV221TestJSON-2057666344-project Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 45e4bffe383e4049974ef4c9fe3e3ce0 Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-InstanceActionsV221TestJSON-2057666344-project Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:31.630842 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '621ca1e9-68ee-4395-a530-441538f9dcad'} Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:31.631712 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:31.633071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:31.634369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Returning 404 to user: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:31.634369 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb726618-3dd9-499b-88a4-2e8c27076740 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 404 len: 111 microversion: 2.21 time: 0.078667 Nov 02 12:26:31.634369 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 856/1665] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:26:31.650844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d3fc6e88-9c8e-49c7-848d-29c458560fc8 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.699228 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d3fc6e88-9c8e-49c7-848d-29c458560fc8 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5393 microversion: 2.1 time: 0.063726 Nov 02 12:26:31.704052 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 857/1666] 10.222.0.45 () {58 vars in 1169 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5393 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:31.724010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '.version_select at 0x7f228e8df820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.725069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:31.742735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:31.752357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:31.753550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:31.754436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:31.754996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:31.755838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:31.897341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:31.913915 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e148d12f-a707-40c6-b953-f2f0ad63ba16 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 200 len: 1432 microversion: 2.1 time: 0.862342 Nov 02 12:26:31.918399 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 810/1667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 1432 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:31.930394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e52d68f1-834d-4f55-87ea-f5a712bef486 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:31.996213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e52d68f1-834d-4f55-87ea-f5a712bef486 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5393 microversion: 2.1 time: 0.076122 Nov 02 12:26:31.997476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 811/1668] 10.222.0.45 () {58 vars in 1175 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5393 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:32.014893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-092e4958-353f-4cc8-88ad-ec7f3bf716b4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e5075e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.039623 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ad8a48f-ae70-4269-9026-66918f65177d tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.332571 Nov 02 12:26:32.041331 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 858/1669] 10.222.0.45 () {60 vars in 1337 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad/os-instance-actions => generated 611 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:32.059641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ea5aef4f-a324-4cec-aaaf-a71956491f7c req-fb25ee36-816e-4a3d-bb8f-ee7f8c3ae7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c61b8e-abe2-496b-812b-3690bb907ce5", "name": "network-vif-deleted", "tag": "2090fc2c-d631-486e-bc08-e2ca6dfb0526"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:32.091576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea5aef4f-a324-4cec-aaaf-a71956491f7c req-fb25ee36-816e-4a3d-bb8f-ee7f8c3ae7c8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:32.092213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea5aef4f-a324-4cec-aaaf-a71956491f7c req-fb25ee36-816e-4a3d-bb8f-ee7f8c3ae7c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:32.092691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea5aef4f-a324-4cec-aaaf-a71956491f7c req-fb25ee36-816e-4a3d-bb8f-ee7f8c3ae7c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:32.121705 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ea5aef4f-a324-4cec-aaaf-a71956491f7c req-fb25ee36-816e-4a3d-bb8f-ee7f8c3ae7c8 service nova] Creating event network-vif-deleted:2090fc2c-d631-486e-bc08-e2ca6dfb0526 for instance 69c61b8e-abe2-496b-812b-3690bb907ce5 on n-h1-855650-5 Nov 02 12:26:32.125282 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-092e4958-353f-4cc8-88ad-ec7f3bf716b4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.126515 Nov 02 12:26:32.127084 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 812/1670] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:31 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:32.140374 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ea5aef4f-a324-4cec-aaaf-a71956491f7c req-fb25ee36-816e-4a3d-bb8f-ee7f8c3ae7c8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097548 Nov 02 12:26:32.143117 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 859/1671] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:32.145293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9b6dab8-6825-423f-b979-4e95800fd0c6 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.148824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.149427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:32.179249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:32.180768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:32.181471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:32.194786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:32.195568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:32.195904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:32.215185 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] HTTP exception thrown: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Request method failure captured: Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad HTTP/1.1 Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmHQp3eleum_TiehG870LndrfQUk2PKaqzLg4UDpEpdVvxzaB-ovuiU7-wq7RzP4Xcu3xdLguCTl8nAG_8vv6CtCPiBgbFGSiI3u4Y0uBSdhQfQY988ekGEk79aTrblxIe8n4GKVYzM_6vWy5gpSlpok3AsdoCWxQ_bfB-NqPxMXnEc Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: dab3b72b58de4fc6a0957dc3f3141677 Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:32.217955 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: dab3b72b58de4fc6a0957dc3f3141677 Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-InstanceActionsV221TestJSON-2057666344-project Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 45e4bffe383e4049974ef4c9fe3e3ce0 Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-InstanceActionsV221TestJSON-2057666344-project Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.219924 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '621ca1e9-68ee-4395-a530-441538f9dcad'} Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:32.220932 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.222625 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.225432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Returning 404 to user: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:32.225432 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9dbb1f68-420d-4b30-bdf5-ebfef7c68cb1 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "DELETE /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 404 len: 111 microversion: 2.21 time: 0.077619 Nov 02 12:26:32.225632 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9b6dab8-6825-423f-b979-4e95800fd0c6 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5393 microversion: 2.1 time: 0.093324 Nov 02 12:26:32.225897 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 860/1672] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:26:32 2022] DELETE /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:26:32.231048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b0823b36-6fe2-45a8-bc87-1e025b3cd587 req-c58cd56e-2f29-47a5-93a8-4d6c8c300b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c534487-5ba6-4b04-a624-3a76d2874220", "name": "network-vif-deleted", "tag": "c6a80797-54bf-4134-9413-9d2c79830f2c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:32.239696 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 813/1673] 10.222.0.45 () {58 vars in 1173 bytes} [Wed Nov 2 12:26:32 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5393 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:32.244195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b0823b36-6fe2-45a8-bc87-1e025b3cd587 req-c58cd56e-2f29-47a5-93a8-4d6c8c300b77 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:32.245090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b0823b36-6fe2-45a8-bc87-1e025b3cd587 req-c58cd56e-2f29-47a5-93a8-4d6c8c300b77 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:32.245638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b0823b36-6fe2-45a8-bc87-1e025b3cd587 req-c58cd56e-2f29-47a5-93a8-4d6c8c300b77 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:32.249562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.250479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] [instance: 621ca1e9-68ee-4395-a530-441538f9dcad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:32.258831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:32.259843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:32.260297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:32.261023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:32.261482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:32.262123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:32.265206 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b0823b36-6fe2-45a8-bc87-1e025b3cd587 req-c58cd56e-2f29-47a5-93a8-4d6c8c300b77 service nova] Creating event network-vif-deleted:c6a80797-54bf-4134-9413-9d2c79830f2c for instance 0c534487-5ba6-4b04-a624-3a76d2874220 on n-h2-855650-5 Nov 02 12:26:32.272185 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b0823b36-6fe2-45a8-bc87-1e025b3cd587 req-c58cd56e-2f29-47a5-93a8-4d6c8c300b77 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047360 Nov 02 12:26:32.273188 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 861/1674] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:32.280419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfa258ba-10dc-4762-8168-a60a97939d76 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.281628 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] HTTP exception thrown: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Request method failure captured: Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad HTTP/1.1 Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmHQp3eleum_TiehG870LndrfQUk2PKaqzLg4UDpEpdVvxzaB-ovuiU7-wq7RzP4Xcu3xdLguCTl8nAG_8vv6CtCPiBgbFGSiI3u4Y0uBSdhQfQY988ekGEk79aTrblxIe8n4GKVYzM_6vWy5gpSlpok3AsdoCWxQ_bfB-NqPxMXnEc Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: dab3b72b58de4fc6a0957dc3f3141677 Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:26:32.283705 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dab3b72b58de4fc6a0957dc3f3141677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: dab3b72b58de4fc6a0957dc3f3141677 Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2057666344 Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-InstanceActionsV221TestJSON-2057666344-project Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 45e4bffe383e4049974ef4c9fe3e3ce0 Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-InstanceActionsV221TestJSON-2057666344-project Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.285260 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '621ca1e9-68ee-4395-a530-441538f9dcad'} Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:32.286208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. Nov 02 12:26:32.287906 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:32.289120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] Returning 404 to user: Instance 621ca1e9-68ee-4395-a530-441538f9dcad could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:32.289120 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0effa913-e076-4712-931e-dbe485ca8179 tempest-InstanceActionsV221TestJSON-2057666344 tempest-InstanceActionsV221TestJSON-2057666344-project] 10.222.0.45 "GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad" status: 404 len: 111 microversion: 2.21 time: 0.044313 Nov 02 12:26:32.289120 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 814/1675] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:26:32 2022] GET /compute/v2.1/servers/621ca1e9-68ee-4395-a530-441538f9dcad => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:26:32.347087 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cfa258ba-10dc-4762-8168-a60a97939d76 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5393 microversion: 2.1 time: 0.072508 Nov 02 12:26:32.347692 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 862/1676] 10.222.0.45 () {58 vars in 1169 bytes} [Wed Nov 2 12:26:32 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5393 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:32.376736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08037319-f1d6-453c-a7b3-209327468e0e tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.413865 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08037319-f1d6-453c-a7b3-209327468e0e tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/2033165505" status: 202 len: 0 microversion: 2.1 time: 0.042341 Nov 02 12:26:32.416668 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 815/1677] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:26:32 2022] DELETE /compute/v2.1/flavors/2033165505 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:32.425748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-970fd7a1-390c-4c8f-9b07-9a36700bc1c7 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.488506 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-970fd7a1-390c-4c8f-9b07-9a36700bc1c7 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064118 Nov 02 12:26:32.502001 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 863/1678] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:32.510570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fcf164ed-23b9-4f95-81fb-567f6be9a1b1 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.550741 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fcf164ed-23b9-4f95-81fb-567f6be9a1b1 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/414003620" status: 202 len: 0 microversion: 2.1 time: 0.044898 Nov 02 12:26:32.554865 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 816/1679] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:26:32 2022] DELETE /compute/v2.1/flavors/414003620 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:32.563309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8617cbf1-be77-4a91-826f-e40a903fb5a4 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.683123 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8617cbf1-be77-4a91-826f-e40a903fb5a4 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.123051 Nov 02 12:26:32.684330 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 864/1680] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:32.716516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b5337441-fdea-4f43-94fe-78ea881c1d88 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2037396485", "id": 2021713147, "os-flavor-access:is_public": "False"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:32.775351 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b5337441-fdea-4f43-94fe-78ea881c1d88 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.070469 Nov 02 12:26:32.777295 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 817/1681] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:32 2022] POST /compute/v2.1/flavors => generated 415 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:32.796167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfd56f74-0102-493f-99f5-2185ea833b59 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.868995 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cfd56f74-0102-493f-99f5-2185ea833b59 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078130 Nov 02 12:26:32.877043 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 865/1682] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:32.896939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-172b498c-88fb-41f6-9c7b-1773c96960a4 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.973846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:32.986612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:33.027879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:33.030805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:33.031310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:33.032073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:33.034990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:33.036891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:33.039340 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-172b498c-88fb-41f6-9c7b-1773c96960a4 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.151009 Nov 02 12:26:33.045266 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 818/1683] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:33.070992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44ace6ac-1853-4d88-9a08-698be9b958b5 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:33.128118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:33.128954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:33.129112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:33.129573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lazy-loading 'fault' on Instance uuid 69c61b8e-abe2-496b-812b-3690bb907ce5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:33.136763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=11 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:33.152337 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44ace6ac-1853-4d88-9a08-698be9b958b5 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/2021713147" status: 202 len: 0 microversion: 2.1 time: 0.093701 Nov 02 12:26:33.158390 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 819/1684] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:26:33 2022] DELETE /compute/v2.1/flavors/2021713147 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:26:33.182988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-732b0bfd-33ff-4f72-bda7-9bb22eb40c8b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e5075e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:33.320703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:33.333910 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-378db624-2e86-4824-b980-7e9efe7b18be tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 200 len: 1309 microversion: 2.1 time: 0.396571 Nov 02 12:26:33.352332 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 866/1685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:32 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:33.402526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc407d6d-49c8-41b4-815e-f9e6a83dd69c tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:33.466210 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-732b0bfd-33ff-4f72-bda7-9bb22eb40c8b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.303325 Nov 02 12:26:33.469493 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 820/1686] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:33 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:33.507149 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dc407d6d-49c8-41b4-815e-f9e6a83dd69c tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.153962 Nov 02 12:26:33.508087 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 867/1687] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:33.532006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff50203d-98e6-4304-b7ae-ee6b248cd99b tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2042130550", "id": 1295719454, "os-flavor-access:is_public": "True"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:33.593141 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff50203d-98e6-4304-b7ae-ee6b248cd99b tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.066058 Nov 02 12:26:33.596450 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 821/1688] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:33 2022] POST /compute/v2.1/flavors => generated 414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:33.610270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a99eed75-40a2-4855-8203-8cc1843bb6c8 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:33.651662 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a99eed75-40a2-4855-8203-8cc1843bb6c8 tempest-FlavorsAdminTestJSON-1845032346 tempest-FlavorsAdminTestJSON-1845032346-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.046678 Nov 02 12:26:33.652956 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 868/1689] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:33 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:33.676369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7393f921-c726-4927-80e2-ecb85300653f tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:33.713112 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7393f921-c726-4927-80e2-ecb85300653f tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1295719454" status: 202 len: 0 microversion: 2.1 time: 0.040297 Nov 02 12:26:33.714501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 822/1690] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:26:33 2022] DELETE /compute/v2.1/flavors/1295719454 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:33.724783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71203b17-9f7e-4b4c-b337-f7dce86d8ce5 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:33.757887 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-71203b17-9f7e-4b4c-b337-f7dce86d8ce5 tempest-FlavorsAdminTestJSON-249216268 tempest-FlavorsAdminTestJSON-249216268-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038852 Nov 02 12:26:33.759103 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 869/1691] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:34.376669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:34.378794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 69c61b8e-abe2-496b-812b-3690bb907ce5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:34.397517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:34.403966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:34.409759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:34.423353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:34.431927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:34.434543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:34.485204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b53512df-e272-4898-b402-42db436c47d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e88c790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:34.503927 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] HTTP exception thrown: Instance 69c61b8e-abe2-496b-812b-3690bb907ce5 could not be found. Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Request method failure captured: Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 HTTP/1.1 Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEoKKH1d1dNCfx0n6k8xAaZ0DOfaqVNuTM4yH134_2ZI4YwbDiMytCq5LG5xXHF5CzDXD90RhBYzF1tMwyA72bzZGoGo_H4fTLyWD6bVx8F_PDgcNDnf-z3-PMnJUzDqQqSuxJfAXraxqZ7DoROSnlGBI06nxu2NdOTyDomMnvwV14 Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:26:34.508651 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7c91481067cd4be881f75d33b56ee431 Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 69c61b8e-abe2-496b-812b-3690bb907ce5 could not be found. Nov 02 12:26:34.510516 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '69c61b8e-abe2-496b-812b-3690bb907ce5'} Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c61b8e-abe2-496b-812b-3690bb907ce5 could not be found. Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:34.511517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c61b8e-abe2-496b-812b-3690bb907ce5 could not be found. Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c61b8e-abe2-496b-812b-3690bb907ce5 could not be found. Nov 02 12:26:34.513453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.518096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Returning 404 to user: Instance 69c61b8e-abe2-496b-812b-3690bb907ce5 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:34.519567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d736da69-ac57-4146-bb4d-3138663b4279 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5" status: 404 len: 111 microversion: 2.1 time: 0.163600 Nov 02 12:26:34.528003 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 823/1692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:34 2022] GET /compute/v2.1/servers/69c61b8e-abe2-496b-812b-3690bb907ce5 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:34.541652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:34.542857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0c534487-5ba6-4b04-a624-3a76d2874220] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:34.565416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:34.566210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:34.566886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:34.568256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:34.568796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:34.569855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:34.612058 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] HTTP exception thrown: Instance 0c534487-5ba6-4b04-a624-3a76d2874220 could not be found. Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Request method failure captured: Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 HTTP/1.1 Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEoKKH1d1dNCfx0n6k8xAaZ0DOfaqVNuTM4yH134_2ZI4YwbDiMytCq5LG5xXHF5CzDXD90RhBYzF1tMwyA72bzZGoGo_H4fTLyWD6bVx8F_PDgcNDnf-z3-PMnJUzDqQqSuxJfAXraxqZ7DoROSnlGBI06nxu2NdOTyDomMnvwV14 Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:26:34.614176 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7c91481067cd4be881f75d33b56ee431 Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 0c534487-5ba6-4b04-a624-3a76d2874220 could not be found. Nov 02 12:26:34.615685 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '0c534487-5ba6-4b04-a624-3a76d2874220'} Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c534487-5ba6-4b04-a624-3a76d2874220 could not be found. Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:34.616508 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c534487-5ba6-4b04-a624-3a76d2874220 could not be found. Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c534487-5ba6-4b04-a624-3a76d2874220 could not be found. Nov 02 12:26:34.617936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:34.621250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Returning 404 to user: Instance 0c534487-5ba6-4b04-a624-3a76d2874220 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:34.622847 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-469c622c-cb78-404b-ae09-954154429dd7 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220" status: 404 len: 111 microversion: 2.1 time: 0.092654 Nov 02 12:26:34.630347 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 824/1693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:34 2022] GET /compute/v2.1/servers/0c534487-5ba6-4b04-a624-3a76d2874220 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:34.640313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-527d6bda-6571-4314-a4eb-bf2f7308cf7b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:34.702157 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b53512df-e272-4898-b402-42db436c47d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.221344 Nov 02 12:26:34.702753 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 870/1694] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:34 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:34.751825 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-527d6bda-6571-4314-a4eb-bf2f7308cf7b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/93914208-75e9-41bb-8f4f-12cfd960a6a6" status: 204 len: 0 microversion: 2.1 time: 0.116216 Nov 02 12:26:34.755054 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 825/1695] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:26:34 2022] DELETE /compute/v2.1/os-server-groups/93914208-75e9-41bb-8f4f-12cfd960a6a6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:34.765094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:34.765766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:34.778537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:34.779098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:34.779553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:34.781492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:34.786539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:34.787246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:34.855884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:35.125467 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-054640d9-43e7-438b-83f5-8b3b16b323a1 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 204 len: 0 microversion: 2.1 time: 0.365758 Nov 02 12:26:35.126737 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 871/1696] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:34 2022] DELETE /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:35.136128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:35.137242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:35.146649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:35.147353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:35.148104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:35.148944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:35.149798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:35.150498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:35.187474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:35.432755 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df57ae14-7dae-4639-b4e9-9bacca6689b5 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 204 len: 0 microversion: 2.1 time: 0.300874 Nov 02 12:26:35.433653 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 826/1697] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:35 2022] DELETE /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:35.443325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:35.444221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:35.463188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:35.463691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:35.464141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:35.464907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:35.465354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:35.465789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:35.835710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:35.878577 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6148c5d0-1572-49e0-b371-6045412ae9bc tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 200 len: 1473 microversion: 2.1 time: 0.438668 Nov 02 12:26:35.888799 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 872/1698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:35 2022] GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:35.921183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c2a84282-cae0-43e0-ae68-4d67e388ca8a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f2290113e50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:36.003175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f604d44-0b4e-4f4a-8af3-1397e6e4d615 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Action: 'create', calling method: .version_select at 0x7f228efa6790>, body: {"keypair": {"name": "tempest-keypair-458011988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcdpUwherIY2Ydf30XjayqTRt7/3z3ljKnE89pc15k7CiYyIxxHPqjkGQZ9saQOtJvbtD8FkcXkg8x62I8wS9Ezw+4ASkM0H153jFkG85joy2Vcx983jZrDG+j1QJMZ7g=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:36.045847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-2f604d44-0b4e-4f4a-8af3-1397e6e4d615 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:36.059118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-2f604d44-0b4e-4f4a-8af3-1397e6e4d615 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:36.162587 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f604d44-0b4e-4f4a-8af3-1397e6e4d615 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.479122 Nov 02 12:26:36.163349 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 827/1699] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Nov 2 12:26:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 484 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 12:26:36.173520 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c2a84282-cae0-43e0-ae68-4d67e388ca8a tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.279606 Nov 02 12:26:36.186460 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 873/1700] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:35 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:36.189562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d70185e4-9f12-410d-9fb8-45e3c7fc8195 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e507ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:36.235203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d70185e4-9f12-410d-9fb8-45e3c7fc8195 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-458011988" status: 200 len: 512 microversion: 2.2 time: 0.061337 Nov 02 12:26:36.237450 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 828/1701] 10.222.0.45 () {60 vars in 1255 bytes} [Wed Nov 2 12:26:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-458011988 => generated 512 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:36.253448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f762296-72a7-4dbe-aaf5-b9bed5093566 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e9b4af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:36.322427 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f762296-72a7-4dbe-aaf5-b9bed5093566 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-458011988" status: 204 len: 0 microversion: 2.2 time: 0.073674 Nov 02 12:26:36.331133 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 874/1702] 10.222.0.45 () {60 vars in 1258 bytes} [Wed Nov 2 12:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-458011988 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:36.349744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9fff318-7b00-48f6-95c4-ed12dbc2d22e tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Action: 'create', calling method: .version_select at 0x7f228e520430>, body: {"keypair": {"name": "tempest-keypair-2097397835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnblnheqbgzMBtgmX3jBGSi5bDklVR4wKNp2o3wFJwxDRzAjOcdR4CBjdVuMHP0w4uBmQRpDFijEFLGpLgKHnaxGtLB/7IsczoevVzDux4iQssWvQOluwC8PgLaaEsWWw=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:36.395649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-e9fff318-7b00-48f6-95c4-ed12dbc2d22e tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:36.410274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-e9fff318-7b00-48f6-95c4-ed12dbc2d22e tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:36.461077 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9fff318-7b00-48f6-95c4-ed12dbc2d22e tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.117118 Nov 02 12:26:36.465460 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 829/1703] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Nov 2 12:26:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:26:36.479454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-975e31b0-1666-46a8-a0ed-3ea7aacbe48a tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e8b2ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:36.522685 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-975e31b0-1666-46a8-a0ed-3ea7aacbe48a tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097397835" status: 204 len: 0 microversion: 2.2 time: 0.049484 Nov 02 12:26:36.525399 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 875/1704] 10.222.0.45 () {60 vars in 1261 bytes} [Wed Nov 2 12:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097397835 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:36.537722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-464aab35-bb17-4250-a669-11040ba5cc9d tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Action: 'create', calling method: .version_select at 0x7f228e759ee0>, body: {"keypair": {"name": "tempest-keypair-672847528", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:36.573166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-464aab35-bb17-4250-a669-11040ba5cc9d tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:36.581837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-464aab35-bb17-4250-a669-11040ba5cc9d tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:36.666949 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-464aab35-bb17-4250-a669-11040ba5cc9d tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.133439 Nov 02 12:26:36.669726 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 830/1705] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Nov 2 12:26:36 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:26:36.682380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a82f237-c278-4500-8469-0896688ba726 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228ea4dd30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:36.701123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=11,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:36.763538 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4a82f237-c278-4500-8469-0896688ba726 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-672847528" status: 204 len: 0 microversion: 2.2 time: 0.086918 Nov 02 12:26:36.765726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 876/1706] 10.222.0.45 () {60 vars in 1258 bytes} [Wed Nov 2 12:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-672847528 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:36.784909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-58150d2d-25f5-46b3-881b-6c870bc998e0 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Action: 'create', calling method: .version_select at 0x7f228e6c18b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1207755391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQFstusVoPDg3ML6AqvNdiN4/J/hufwwrqGmIhyEHjLaMdfYgILieMgxh+JD6tv5vy0HhW5KX4T+pvnbSb9FxzGlUg2JklXA6vcoVXXIvJd0rtUiYaRTDCViq0KhaDI9A=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:36.809296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-58150d2d-25f5-46b3-881b-6c870bc998e0 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:36.819864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-58150d2d-25f5-46b3-881b-6c870bc998e0 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:36.874945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-58150d2d-25f5-46b3-881b-6c870bc998e0 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.099643 Nov 02 12:26:36.875630 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 831/1707] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Nov 2 12:26:36 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:26:36.893934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d9b550d-1306-4610-96a1-05bcbd5da508 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Action: 'create', calling method: .version_select at 0x7f228e9fe9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1634899792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu3fyYrZs8ZT5bFod0b/gyQXFGeqPzpA6S74PBnBShS3h1kylrjD3mtZ+oearPgdR5AfbmyMqpxO9ka7xxOWrOV4O/6lg1wnezVvXpR36Nu/WYh/E0CnhyI3MhzuOuNqQ=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:36.945993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:36.948154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:36.972895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:36.975168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7d9b550d-1306-4610-96a1-05bcbd5da508 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:36.979371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:36.979924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:36.982380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:36.983864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:36.985854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:37.000491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7d9b550d-1306-4610-96a1-05bcbd5da508 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:37.084588 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d9b550d-1306-4610-96a1-05bcbd5da508 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.198468 Nov 02 12:26:37.085202 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 877/1708] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Nov 2 12:26:36 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:26:37.106495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6be6f79-5304-45c8-aa71-1d78c0748a0c tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Action: 'create', calling method: .version_select at 0x7f228e9953a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-361791714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF2CnHuZ7TRn1m+Tyao6MXCxqF/qclV/Zpkeg/hWWaRcLfSM2h0XYMRH2jZJpTRMbghUXRSvoGWBwaGbbMyaYLU7lkuoBcKeZN3289mJy1JdlDcNAND7SsqHG3auyteZw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:37.174350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c6be6f79-5304-45c8-aa71-1d78c0748a0c tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:37.187298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c6be6f79-5304-45c8-aa71-1d78c0748a0c tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:37.254317 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6be6f79-5304-45c8-aa71-1d78c0748a0c tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.151541 Nov 02 12:26:37.260308 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 878/1709] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Nov 2 12:26:37 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 12:26:37.285932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b96ee016-4fe3-4704-9009-2effa45d37e4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e96f430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.341189 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b96ee016-4fe3-4704-9009-2effa45d37e4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.078833 Nov 02 12:26:37.342532 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 879/1710] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:37 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:37.349305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ffd1605-613c-41f7-8c22-7fc8a7930abe tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228ea4d550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.354208 n-d-855650-5 devstack@n-api.service[120723]: WARNING oslo_db.sqlalchemy.utils [None req-4ffd1605-613c-41f7-8c22-7fc8a7930abe tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:26:37.365391 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ffd1605-613c-41f7-8c22-7fc8a7930abe tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.020535 Nov 02 12:26:37.366889 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 880/1711] 10.222.0.45 () {60 vars in 1177 bytes} [Wed Nov 2 12:26:37 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:37.381706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56b05024-ceec-46f9-8fdc-e307e449f827 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228eac8940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.409898 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-56b05024-ceec-46f9-8fdc-e307e449f827 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-361791714" status: 204 len: 0 microversion: 2.2 time: 0.034221 Nov 02 12:26:37.414792 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 881/1712] 10.222.0.45 () {60 vars in 1318 bytes} [Wed Nov 2 12:26:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-361791714 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:37.424134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7ef728b0-8062-4b38-bc0a-06537783c37e tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e978310>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.450779 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7ef728b0-8062-4b38-bc0a-06537783c37e tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1634899792" status: 204 len: 0 microversion: 2.2 time: 0.034634 Nov 02 12:26:37.457287 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 882/1713] 10.222.0.45 () {60 vars in 1321 bytes} [Wed Nov 2 12:26:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1634899792 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:37.463978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1b8da9fb-4714-4104-bd90-c2dbe6c77157 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e995af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.501955 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1b8da9fb-4714-4104-bd90-c2dbe6c77157 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1207755391" status: 204 len: 0 microversion: 2.2 time: 0.041520 Nov 02 12:26:37.510605 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 883/1714] 10.222.0.45 () {60 vars in 1321 bytes} [Wed Nov 2 12:26:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1207755391 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:37.525450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13bcdcd5-e116-4be1-a327-9a9838a68e77 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Action: 'create', calling method: .version_select at 0x7f228ea30dc0>, body: {"keypair": {"name": "tempest-keypair-674044301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExcpVAbzdomiDW79RulJmGBAe50TBjGP/WiBu0x+73QsBuxedXSJB5avf7rU8dSLSPNwsmT/KGfVKHEU+uRzqzFUdNyMCKwgDYKOY/Vam95pTnUIC4Bh0Gqeld8V3ENGw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:37.549704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-13bcdcd5-e116-4be1-a327-9a9838a68e77 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:37.560060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-13bcdcd5-e116-4be1-a327-9a9838a68e77 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:37.593698 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-13bcdcd5-e116-4be1-a327-9a9838a68e77 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.073554 Nov 02 12:26:37.595305 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 884/1715] 10.222.0.45 () {62 vars in 1199 bytes} [Wed Nov 2 12:26:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:26:37.618391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:37.621434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e06f2896-c9da-42f5-bbca-8f234e66ed01 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e9fec10>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.627969 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a906014e-f3e1-4ce0-909e-4b70ba2eefa8 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 200 len: 1473 microversion: 2.1 time: 0.696892 Nov 02 12:26:37.637252 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 832/1716] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:36 2022] GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 1473 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:37.651736 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e06f2896-c9da-42f5-bbca-8f234e66ed01 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-674044301" status: 200 len: 512 microversion: 2.2 time: 0.047542 Nov 02 12:26:37.652684 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 885/1717] 10.222.0.45 () {60 vars in 1255 bytes} [Wed Nov 2 12:26:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-674044301 => generated 512 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:37.665022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1df876e0-f6cb-4a2f-8bc6-fc5182de6993 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e524160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.670471 n-d-855650-5 devstack@n-api.service[120722]: WARNING oslo_db.sqlalchemy.utils [None req-1df876e0-f6cb-4a2f-8bc6-fc5182de6993 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:26:37.687701 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1df876e0-f6cb-4a2f-8bc6-fc5182de6993 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.027120 Nov 02 12:26:37.689007 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 833/1718] 10.222.0.45 () {60 vars in 1177 bytes} [Wed Nov 2 12:26:37 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:37.705565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6379bd74-64b6-4725-941d-541fbb072a42 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e8c2f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.747091 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6379bd74-64b6-4725-941d-541fbb072a42 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-674044301" status: 204 len: 0 microversion: 2.2 time: 0.050135 Nov 02 12:26:37.749062 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 886/1719] 10.222.0.45 () {60 vars in 1258 bytes} [Wed Nov 2 12:26:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-674044301 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:37.758364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Action: 'create', calling method: .version_select at 0x7f228e4d2d30>, body: {"keypair": {"name": "tempest-keypair-662652173", "type": "x509"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:37.792152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:37.809746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:37.870249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.processutils [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpgwl7rwa3/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpgwl7rwa3/temp.key -subj /CN=c34b7e0163ed4d7fa768b25684b452b5 -extensions v3_req_client {{(pid=120722) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 12:26:38.357915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8450ce32-783c-438f-b1f4-225427997a8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eb8aee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:38.427779 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8450ce32-783c-438f-b1f4-225427997a8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.073760 Nov 02 12:26:38.436348 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 887/1720] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:38 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:38.510246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.processutils [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpgwl7rwa3/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpgwl7rwa3/temp.key -subj /CN=c34b7e0163ed4d7fa768b25684b452b5 -extensions v3_req_client" returned: 0 in 0.641s {{(pid=120722) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 12:26:38.511930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.processutils [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpgwl7rwa3/temp.key -password pass: {{(pid=120722) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 12:26:38.583339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.processutils [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpgwl7rwa3/temp.key -password pass:" returned: 0 in 0.068s {{(pid=120722) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 12:26:38.632674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=7,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:38.661323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:38.662490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:38.664063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:38.670478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Getting quotas for user c34b7e0163ed4d7fa768b25684b452b5 and project 5b325215456f4c75916998437a44276b. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:38.673209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:38.673209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:38.673209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:38.673781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:38.674279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:38.674718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:38.708019 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f6fe7a5-6eee-47f9-bc1c-f22857fc302f tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.953532 Nov 02 12:26:38.712176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 834/1721] 10.222.0.45 () {62 vars in 1198 bytes} [Wed Nov 2 12:26:37 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 958 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:38.726054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a498a4ec-8552-4dcd-9f78-fa5231d8cf92 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e8d48b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:38.753701 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a498a4ec-8552-4dcd-9f78-fa5231d8cf92 tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-662652173" status: 200 len: 1533 microversion: 2.2 time: 0.031567 Nov 02 12:26:38.754463 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 835/1722] 10.222.0.45 () {60 vars in 1255 bytes} [Wed Nov 2 12:26:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-662652173 => generated 1533 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:38.769460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36a6b6e7-9ca2-4a7f-849e-46fb3b5558fe tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e635d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:38.775656 n-d-855650-5 devstack@n-api.service[120722]: WARNING oslo_db.sqlalchemy.utils [None req-36a6b6e7-9ca2-4a7f-849e-46fb3b5558fe tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:26:38.782441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36a6b6e7-9ca2-4a7f-849e-46fb3b5558fe tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.017647 Nov 02 12:26:38.783363 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 836/1723] 10.222.0.45 () {60 vars in 1177 bytes} [Wed Nov 2 12:26:38 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:38.796159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bd48b488-0cf4-4f6b-8638-c5e6c09f867a tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] Calling method '.version_select at 0x7f228e8ccdc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:38.838838 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bd48b488-0cf4-4f6b-8638-c5e6c09f867a tempest-KeyPairsV22TestJSON-1182420469 tempest-KeyPairsV22TestJSON-1182420469-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662652173" status: 204 len: 0 microversion: 2.2 time: 0.046921 Nov 02 12:26:38.840772 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 837/1724] 10.222.0.45 () {60 vars in 1258 bytes} [Wed Nov 2 12:26:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662652173 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:26:39.117517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:39.130987 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d12cbab-1af8-478c-aa68-d6d8c4f6547c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 200 len: 1473 microversion: 2.1 time: 0.473729 Nov 02 12:26:39.134989 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 888/1725] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:38 2022] GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 1473 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:39.429674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1518918898", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "88aa3408-37b9-415a-84a9-1aa8b9400b9d"}], "block_device_mapping_v2": [{"uuid": "c4ef818f-136f-4bdf-9fa1-e463a64e6134", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:39.449445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c079d0eb-eea3-4803-839b-10705533f5da tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8c2430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:39.541070 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c079d0eb-eea3-4803-839b-10705533f5da tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.101676 Nov 02 12:26:39.541668 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 889/1726] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:39 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:39.699576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] validate_networks() for [('88aa3408-37b9-415a-84a9-1aa8b9400b9d', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:26:40.159762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:40.160944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:40.173003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:40.180399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:40.180957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:40.181921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:40.182742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:40.183425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:40.356786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:40.384704 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-150fb537-a755-46af-8d17-306e65ef711b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 200 len: 1431 microversion: 2.1 time: 0.225168 Nov 02 12:26:40.386073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 890/1727] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:40 2022] GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 1431 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:40.403547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-69967360-d2e8-4a24-92d1-2d29f3ba851f req-97ad360a-e487-4271-9faa-04473a30b1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d19e5f5-bf7a-400e-a979-748822b5a92a", "name": "network-vif-deleted", "tag": "aedfadec-b75a-4177-b41e-f4101241d2f7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:40.448504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-69967360-d2e8-4a24-92d1-2d29f3ba851f req-97ad360a-e487-4271-9faa-04473a30b1f8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:40.449285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-69967360-d2e8-4a24-92d1-2d29f3ba851f req-97ad360a-e487-4271-9faa-04473a30b1f8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:40.452904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-69967360-d2e8-4a24-92d1-2d29f3ba851f req-97ad360a-e487-4271-9faa-04473a30b1f8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:40.482804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:40.497253 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-69967360-d2e8-4a24-92d1-2d29f3ba851f req-97ad360a-e487-4271-9faa-04473a30b1f8 service nova] Creating event network-vif-deleted:aedfadec-b75a-4177-b41e-f4101241d2f7 for instance 6d19e5f5-bf7a-400e-a979-748822b5a92a on n-h2-855650-5 Nov 02 12:26:40.506983 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-69967360-d2e8-4a24-92d1-2d29f3ba851f req-97ad360a-e487-4271-9faa-04473a30b1f8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116580 Nov 02 12:26:40.510279 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 891/1728] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:40.848896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:26:40.849422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:26:40.849808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:26:40.850259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:26:40.850699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:26:40.863248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:40.863791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:40.864267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:40.865023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:40.865987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:40.866663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:40.889245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for project 3579208e4ca549d9a0cdb14af362384e. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:40.896446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Getting quotas for user 9f2ebf76beec4d3185c3c279868f8366 and project 3579208e4ca549d9a0cdb14af362384e. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:41.021657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ad9497bd-f085-40a7-aec7-26b6da47e225 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1931120372", "id": 544483503, "os-flavor-access:is_public": "False"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:41.075038 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ad9497bd-f085-40a7-aec7-26b6da47e225 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.559740 Nov 02 12:26:41.088870 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 892/1729] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:40 2022] POST /compute/v2.1/flavors => generated 428 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:41.092811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:26:41.095469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-030dc45b-d10e-4b5f-bcc1-062c43383584 req-96ce74d7-af02-49b2-b340-3b65518a28b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f4ff71-fa75-4ac9-9661-ebb7bbc3995f", "name": "network-vif-plugged", "status": "completed", "tag": "9d585ce4-7020-4e3d-b408-02a183917027"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:41.097340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4ef818f-136f-4bdf-9fa1-e463a64e6134',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:26:41.131680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-030dc45b-d10e-4b5f-bcc1-062c43383584 req-96ce74d7-af02-49b2-b340-3b65518a28b7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:41.132625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-030dc45b-d10e-4b5f-bcc1-062c43383584 req-96ce74d7-af02-49b2-b340-3b65518a28b7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:41.134961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-030dc45b-d10e-4b5f-bcc1-062c43383584 req-96ce74d7-af02-49b2-b340-3b65518a28b7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:41.190271 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-030dc45b-d10e-4b5f-bcc1-062c43383584 req-96ce74d7-af02-49b2-b340-3b65518a28b7 service nova] Creating event network-vif-plugged:9d585ce4-7020-4e3d-b408-02a183917027 for instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f on n-h1-855650-5 Nov 02 12:26:41.212645 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-030dc45b-d10e-4b5f-bcc1-062c43383584 req-96ce74d7-af02-49b2-b340-3b65518a28b7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120961 Nov 02 12:26:41.215093 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 893/1730] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:41.229136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-90405670-3466-4408-891d-6f0778f77dfc tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eaa8820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:41.398099 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99840e16-8a4f-44c3-86f3-16f75c182925 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.975124 Nov 02 12:26:41.400530 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 838/1731] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:26:41.419319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1ee96f5-3c65-4702-9e8b-60727f3e931e tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eee2f97992b74597b30a30df9717df4d"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:41.812139 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-90405670-3466-4408-891d-6f0778f77dfc tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.591897 Nov 02 12:26:41.823588 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 894/1732] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:41 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:41.833682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-752aba4e-1979-4375-909f-b7817ccebe02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:41.840154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-752aba4e-1979-4375-909f-b7817ccebe02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:41.841272 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1ee96f5-3c65-4702-9e8b-60727f3e931e tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/544483503/action" status: 200 len: 96 microversion: 2.1 time: 0.438775 Nov 02 12:26:41.845016 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 839/1733] 10.222.0.45 () {60 vars in 1197 bytes} [Wed Nov 2 12:26:41 2022] POST /compute/v2.1/flavors/544483503/action => generated 96 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:26:41.867124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:41.870746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 6d19e5f5-bf7a-400e-a979-748822b5a92a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:41.891324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:41.893022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:41.895578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:41.902302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:41.903681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:41.906656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:41.952766 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] HTTP exception thrown: Instance 6d19e5f5-bf7a-400e-a979-748822b5a92a could not be found. Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Request method failure captured: Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a HTTP/1.1 Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEoKKH1d1dNCfx0n6k8xAaZ0DOfaqVNuTM4yH134_2ZI4YwbDiMytCq5LG5xXHF5CzDXD90RhBYzF1tMwyA72bzZGoGo_H4fTLyWD6bVx8F_PDgcNDnf-z3-PMnJUzDqQqSuxJfAXraxqZ7DoROSnlGBI06nxu2NdOTyDomMnvwV14 Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:26:41.963045 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7c91481067cd4be881f75d33b56ee431 Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6d19e5f5-bf7a-400e-a979-748822b5a92a could not be found. Nov 02 12:26:41.965825 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6d19e5f5-bf7a-400e-a979-748822b5a92a'} Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d19e5f5-bf7a-400e-a979-748822b5a92a could not be found. Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:41.967349 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d19e5f5-bf7a-400e-a979-748822b5a92a could not be found. Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d19e5f5-bf7a-400e-a979-748822b5a92a could not be found. Nov 02 12:26:41.970427 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:41.975546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Returning 404 to user: Instance 6d19e5f5-bf7a-400e-a979-748822b5a92a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:41.979110 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14ffdff1-35b3-491a-90dc-37bb07b35f96 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a" status: 404 len: 111 microversion: 2.1 time: 0.124670 Nov 02 12:26:41.982922 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 840/1734] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:41 2022] GET /compute/v2.1/servers/6d19e5f5-bf7a-400e-a979-748822b5a92a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:42.074768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-752aba4e-1979-4375-909f-b7817ccebe02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:42.087821 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-752aba4e-1979-4375-909f-b7817ccebe02 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1053 microversion: 2.1 time: 0.269739 Nov 02 12:26:42.088688 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 895/1735] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:41 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1053 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:42.098333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:42.099219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:42.113292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:42.115657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:42.117145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:42.118604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:42.122373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:42.122840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:42.212207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:42.213467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:42.214828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:42.217147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lazy-loading 'fault' on Instance uuid 0d96ede4-9bfa-4448-8891-fbe9566cdab1 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:42.303921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:42.324537 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2b0f237b-7491-46bd-965b-ea2e175ad15f tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 200 len: 1308 microversion: 2.1 time: 0.232168 Nov 02 12:26:42.325286 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 896/1736] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:42 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:42.477608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-52e1ad8f-5f01-4dce-88d1-eb30db62d8ab tempest-FlavorsAccessTestJSON-903570259 tempest-FlavorsAccessTestJSON-903570259-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:42.625306 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-52e1ad8f-5f01-4dce-88d1-eb30db62d8ab tempest-FlavorsAccessTestJSON-903570259 tempest-FlavorsAccessTestJSON-903570259-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.635569 Nov 02 12:26:42.628576 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 841/1737] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:41 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:42.648252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-786e8c92-8838-493d-ac63-1b9fc46b1f7a tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eee2f97992b74597b30a30df9717df4d"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:42.671841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-04a6a481-e541-4752-8b59-9ffe4c18c632 req-3d37bde8-d7f1-44e5-b411-7a5655a29030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d96ede4-9bfa-4448-8891-fbe9566cdab1", "name": "network-vif-deleted", "tag": "3dc52f47-b930-4470-b4aa-5fb00f9209ad"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:42.726268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-04a6a481-e541-4752-8b59-9ffe4c18c632 req-3d37bde8-d7f1-44e5-b411-7a5655a29030 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:42.726762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-04a6a481-e541-4752-8b59-9ffe4c18c632 req-3d37bde8-d7f1-44e5-b411-7a5655a29030 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:42.727201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-04a6a481-e541-4752-8b59-9ffe4c18c632 req-3d37bde8-d7f1-44e5-b411-7a5655a29030 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:42.769203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-04a6a481-e541-4752-8b59-9ffe4c18c632 req-3d37bde8-d7f1-44e5-b411-7a5655a29030 service nova] Creating event network-vif-deleted:3dc52f47-b930-4470-b4aa-5fb00f9209ad for instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 on n-h2-855650-5 Nov 02 12:26:42.783836 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-04a6a481-e541-4752-8b59-9ffe4c18c632 req-3d37bde8-d7f1-44e5-b411-7a5655a29030 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129688 Nov 02 12:26:42.784460 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 842/1738] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:42.833991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30c30c04-50ee-49a2-bff7-9c867b88b161 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e5245e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:42.910816 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30c30c04-50ee-49a2-bff7-9c867b88b161 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.083024 Nov 02 12:26:42.919437 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 843/1739] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:42 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:43.115736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.116775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:43.137653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:43.138823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:43.142316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:43.144458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:43.148910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:43.150262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:43.303381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:43.312987 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-68047390-d6b1-47d9-a7f7-8d78635be3a4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1095 microversion: 2.1 time: 0.201313 Nov 02 12:26:43.318407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 844/1740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:43 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1095 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:43.355566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.356406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 0d96ede4-9bfa-4448-8891-fbe9566cdab1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:43.364030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:43.364932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:43.365630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:43.366971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:43.367624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:43.368222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:43.433025 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] HTTP exception thrown: Instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 could not be found. Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Request method failure captured: Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 HTTP/1.1 Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmEoKKH1d1dNCfx0n6k8xAaZ0DOfaqVNuTM4yH134_2ZI4YwbDiMytCq5LG5xXHF5CzDXD90RhBYzF1tMwyA72bzZGoGo_H4fTLyWD6bVx8F_PDgcNDnf-z3-PMnJUzDqQqSuxJfAXraxqZ7DoROSnlGBI06nxu2NdOTyDomMnvwV14 Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:26:43.438710 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7c91481067cd4be881f75d33b56ee431 Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 could not be found. Nov 02 12:26:43.440356 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '0d96ede4-9bfa-4448-8891-fbe9566cdab1'} Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 could not be found. Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:43.441238 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 could not be found. Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 could not be found. Nov 02 12:26:43.445027 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:43.448762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Returning 404 to user: Instance 0d96ede4-9bfa-4448-8891-fbe9566cdab1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:43.448762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-557f58fb-5864-42f2-900e-c64ebaa0633b tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1" status: 404 len: 111 microversion: 2.1 time: 0.092832 Nov 02 12:26:43.448762 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 845/1741] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:43 2022] GET /compute/v2.1/servers/0d96ede4-9bfa-4448-8891-fbe9566cdab1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:26:43.450188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2902f2a8-000d-4054-bfe1-826630a3c486 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.519091 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2902f2a8-000d-4054-bfe1-826630a3c486 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/d4cf0680-b6a6-41b9-ad6e-851beecaa04a" status: 204 len: 0 microversion: 2.1 time: 0.073653 Nov 02 12:26:43.521307 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 846/1742] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:26:43 2022] DELETE /compute/v2.1/os-server-groups/d4cf0680-b6a6-41b9-ad6e-851beecaa04a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:43.525544 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-786e8c92-8838-493d-ac63-1b9fc46b1f7a tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/544483503/action" status: 200 len: 21 microversion: 2.1 time: 0.882059 Nov 02 12:26:43.529845 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 897/1743] 10.222.0.45 () {60 vars in 1197 bytes} [Wed Nov 2 12:26:42 2022] POST /compute/v2.1/flavors/544483503/action => generated 21 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:26:43.541224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.544051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:43.552741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16194d47-44e4-40ba-9d64-17b9d0bfd320 tempest-FlavorsAccessTestJSON-903570259 tempest-FlavorsAccessTestJSON-903570259-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.564116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:43.566434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:43.567524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:43.569789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:43.571227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:43.572427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:43.606070 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16194d47-44e4-40ba-9d64-17b9d0bfd320 tempest-FlavorsAccessTestJSON-903570259 tempest-FlavorsAccessTestJSON-903570259-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064411 Nov 02 12:26:43.606978 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 898/1744] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:43.641778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2235baf4-12d4-4c62-9a10-cc32eff0c787 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.649408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:43.675897 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2235baf4-12d4-4c62-9a10-cc32eff0c787 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/544483503" status: 202 len: 0 microversion: 2.1 time: 0.047145 Nov 02 12:26:43.676979 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 899/1745] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:26:43 2022] DELETE /compute/v2.1/flavors/544483503 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:43.685888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c698ab8e-df84-485a-a0e7-40eba8f69f49 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.758805 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c698ab8e-df84-485a-a0e7-40eba8f69f49 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075703 Nov 02 12:26:43.760955 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 900/1746] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:43.790189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0dd39bf1-7226-4299-9d56-ff91055cb4bb tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-324496182", "id": 858932812, "os-flavor-access:is_public": "False"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:43.826238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:43.830261 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0dd39bf1-7226-4299-9d56-ff91055cb4bb tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.046584 Nov 02 12:26:43.831241 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 901/1747] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:26:43 2022] POST /compute/v2.1/flavors => generated 427 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:43.856767 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78942526-9fe8-48c1-b1ad-b8c607e4e529 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 204 len: 0 microversion: 2.1 time: 0.329091 Nov 02 12:26:43.861669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 847/1748] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:43 2022] DELETE /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:43.874653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.877332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:43.884710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1d74f9e-930a-4f2b-a6cb-fdf5cd6a5579 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:43.893284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:43.895041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:43.897912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:43.899123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:43.901111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:43.906579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:43.936619 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1d74f9e-930a-4f2b-a6cb-fdf5cd6a5579 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/858932812/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.065389 Nov 02 12:26:43.944058 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 902/1749] 10.222.0.45 () {58 vars in 1206 bytes} [Wed Nov 2 12:26:43 2022] GET /compute/v2.1/flavors/858932812/os-flavor-access => generated 21 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:26:43.962609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f703d98d-50c3-47d3-89a2-e5339a9b318e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eb8aa60>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:44.140964 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f703d98d-50c3-47d3-89a2-e5339a9b318e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.194874 Nov 02 12:26:44.143603 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 903/1750] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:43 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:44.169887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3f6d8df8-d7ac-44c3-bd38-c96ca2c5a35b tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:44.213102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:44.230186 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bbb6b065-2b34-440c-b5d5-e8dc72dc37e2 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1472 microversion: 2.1 time: 0.360997 Nov 02 12:26:44.240553 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 848/1751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:43 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:44.271082 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3f6d8df8-d7ac-44c3-bd38-c96ca2c5a35b tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/858932812" status: 202 len: 0 microversion: 2.1 time: 0.121479 Nov 02 12:26:44.278901 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 904/1752] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:26:44 2022] DELETE /compute/v2.1/flavors/858932812 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:44.285029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-109c0a97-a03e-4439-8a42-ada84450e0e6 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:44.376680 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-109c0a97-a03e-4439-8a42-ada84450e0e6 tempest-FlavorsAccessTestJSON-151471897 tempest-FlavorsAccessTestJSON-151471897-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095597 Nov 02 12:26:44.389224 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 905/1753] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:26:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:44.407866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:44.408814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:44.419654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:44.420422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:44.421129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:44.422239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:44.422833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:44.423339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:44.567055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:44.584944 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f89d5a59-ec05-4ee5-b472-333dd4183276 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1151 microversion: 2.1 time: 0.190445 Nov 02 12:26:44.586472 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 906/1754] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:44 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1151 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:44.847148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c23cffe-0006-4016-bad8-690df93a87e7 tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Calling method '.version_select at 0x7f228e8cc820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:44.911353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c23cffe-0006-4016-bad8-690df93a87e7 tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:44.913386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c23cffe-0006-4016-bad8-690df93a87e7 tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:44.914131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c23cffe-0006-4016-bad8-690df93a87e7 tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:44.920667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c23cffe-0006-4016-bad8-690df93a87e7 tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:44.926975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c23cffe-0006-4016-bad8-690df93a87e7 tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:44.927673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c23cffe-0006-4016-bad8-690df93a87e7 tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:44.979084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c23cffe-0006-4016-bad8-690df93a87e7 tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] 10.222.0.45 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.736819 Nov 02 12:26:44.980808 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 849/1755] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Nov 2 12:26:44 2022] GET /compute/v2.1/limits => generated 511 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:45.159610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a038a432-34d3-4b5c-9945-09fbbb9596fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eb8ad30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:45.195157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f49aeaa-9dac-42d5-a12d-24fda18523ec tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-901978359", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:45.320232 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a038a432-34d3-4b5c-9945-09fbbb9596fe tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.165155 Nov 02 12:26:45.321748 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 907/1756] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:45 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:45.340074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:45.345105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:45.345876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-7f49aeaa-9dac-42d5-a12d-24fda18523ec tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:26:45.370929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:45.372807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:45.374131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:45.378965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:45.379507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:45.380072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:45.865102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-7f49aeaa-9dac-42d5-a12d-24fda18523ec tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Getting quotas for project 319726a5b34b4738b9f635484490af48. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:26:45.882878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-7f49aeaa-9dac-42d5-a12d-24fda18523ec tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Getting quotas for user 0c386fc767a247d8a4a7495676ecfa61 and project 319726a5b34b4738b9f635484490af48. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:26:45.938921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-7f49aeaa-9dac-42d5-a12d-24fda18523ec tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f49aeaa-9dac-42d5-a12d-24fda18523ec tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Request method failure captured: Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 1751 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmIDP4DfOdKbMo4spb441B05OLbcVp2DZxhfmCxAU9a_JfGHcZTF9NDwTxV7oMIAr8j9A_HzkIoG-oWbwemZp0SYrXzJhMOcQerxxeNJC0go0TpeBBV6msr862RQVDjbun_y0nGbDGQh2NNgAGida_UgWrh_tHEtmvyu2M49RdWu5VM Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 319726a5b34b4738b9f635484490af48 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1020395150 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/319726a5b34b4738b9f635484490af48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/319726a5b34b4738b9f635484490af48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/319726a5b34b4738b9f635484490af48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_319726a5b34b4738b9f635484490af48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1020395150 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 319726a5b34b4738b9f635484490af48 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1020395150 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 0c386fc767a247d8a4a7495676ecfa61 Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-901978359", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:26:45.943532 n-d-855650-5 devstack@n-api.service[120722]: exception: Maximum number of metadata items exceeds 128 Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-901978359', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:26:45.949076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:26:45.959282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f49aeaa-9dac-42d5-a12d-24fda18523ec tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:45.965434 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f49aeaa-9dac-42d5-a12d-24fda18523ec tempest-AbsoluteLimitsNegativeTestJSON-1020395150 tempest-AbsoluteLimitsNegativeTestJSON-1020395150-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.765782 Nov 02 12:26:45.967078 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 850/1757] 10.222.0.45 () {60 vars in 1148 bytes} [Wed Nov 2 12:26:45 2022] POST /compute/v2.1/servers => generated 87 bytes in 777 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:26:45.976819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:45.977900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:45.985644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:45.986591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:45.987373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:45.988348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:45.989133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:45.989897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:46.055237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:46.081618 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9d8c2b3f-e4ca-40c6-822c-0834ca6f3155 tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1472 microversion: 2.1 time: 0.754535 Nov 02 12:26:46.083546 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 908/1758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:45 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1472 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:46.230880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:46.256823 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4b24728-a9a5-4c6a-bf42-b86a4b2bad58 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1169 microversion: 2.1 time: 0.287948 Nov 02 12:26:46.263176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 851/1759] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:45 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1169 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:46.341539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2536e8a2-1915-4f3e-8f6a-9cd3843a40d4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eb8a670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:46.478587 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2536e8a2-1915-4f3e-8f6a-9cd3843a40d4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.145425 Nov 02 12:26:46.488726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 909/1760] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:46 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:47.115657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:47.117284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:47.157012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:47.159697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:47.161272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:47.164914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:47.168150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:47.170072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:47.302106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:47.303440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:47.323588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:47.324193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:47.324726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:47.328150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:47.329025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:47.329726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:47.622196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:47.685778 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ab7ac77-2345-4e2d-9b5d-f2ff182eebed tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1430 microversion: 2.1 time: 0.559630 Nov 02 12:26:47.688958 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 852/1761] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:47 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1430 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:47.727309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9a32aa15-1dd4-4067-9881-a2450f7b5d1d req-92659d3a-7e21-49d1-8ec7-f68710565858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a61e28f-f3a1-4aea-be4b-4d12f85736ed", "name": "network-vif-deleted", "tag": "7c1cf308-5949-4835-8ba5-fe201fbdf126"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:47.791955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9a32aa15-1dd4-4067-9881-a2450f7b5d1d req-92659d3a-7e21-49d1-8ec7-f68710565858 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:47.793154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9a32aa15-1dd4-4067-9881-a2450f7b5d1d req-92659d3a-7e21-49d1-8ec7-f68710565858 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:47.794555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9a32aa15-1dd4-4067-9881-a2450f7b5d1d req-92659d3a-7e21-49d1-8ec7-f68710565858 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:47.845011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9a32aa15-1dd4-4067-9881-a2450f7b5d1d req-92659d3a-7e21-49d1-8ec7-f68710565858 service nova] Creating event network-vif-deleted:7c1cf308-5949-4835-8ba5-fe201fbdf126 for instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed on n-h1-855650-5 Nov 02 12:26:47.866678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:47.876352 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9a32aa15-1dd4-4067-9881-a2450f7b5d1d req-92659d3a-7e21-49d1-8ec7-f68710565858 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182638 Nov 02 12:26:47.882370 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 853/1762] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:47.918731 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fcfdc38c-b291-418f-b26f-9df659e4ab32 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1169 microversion: 2.1 time: 0.622026 Nov 02 12:26:47.927326 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 910/1763] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:47 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1169 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:47.927518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b53b9721-6b15-4abc-8584-fd288a23dead tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e911dc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:48.006664 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b53b9721-6b15-4abc-8584-fd288a23dead tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.116363 Nov 02 12:26:48.007926 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 854/1764] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:47 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:48.734381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:48.739531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:48.774642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:48.776027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:48.790822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:48.799221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:48.804636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:48.805732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:48.965105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:48.975239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:48.980504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:48.981006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:48.981451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:48.986148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lazy-loading 'fault' on Instance uuid 8a61e28f-f3a1-4aea-be4b-4d12f85736ed {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:49.054823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:49.060579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:49.061248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:49.068166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:49.069051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:49.069735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:49.096943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c91481067cd4be881f75d33b56ee431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74888962841648a7bfc8cd36cdf5526c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:49.129649 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f719ad7c-2f2a-4cd8-9636-ce1e1cfe07ac tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 200 len: 1306 microversion: 2.1 time: 0.403196 Nov 02 12:26:49.146880 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 911/1765] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:48 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 1306 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:49.155510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-10a6ab76-797c-451c-914a-550b94e5b010 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eaa8430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:49.281956 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-10a6ab76-797c-451c-914a-550b94e5b010 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.133502 Nov 02 12:26:49.285122 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 912/1766] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:49 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:49.534746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:49.545368 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eab52576-0023-4056-8034-5536573e6f63 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1169 microversion: 2.1 time: 0.603004 Nov 02 12:26:49.551020 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 855/1767] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:48 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1169 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:50.160875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:50.161626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] [instance: 8a61e28f-f3a1-4aea-be4b-4d12f85736ed] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:50.191455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:50.192478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:50.193147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:50.201191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:50.202385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:50.203133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:50.242938 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] HTTP exception thrown: Instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed could not be found. Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Request method failure captured: Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed HTTP/1.1 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmEoKKH1d1dNCfx0n6k8xAaZ0DOfaqVNuTM4yH134_2ZI4YwbDiMytCq5LG5xXHF5CzDXD90RhBYzF1tMwyA72bzZGoGo_H4fTLyWD6bVx8F_PDgcNDnf-z3-PMnJUzDqQqSuxJfAXraxqZ7DoROSnlGBI06nxu2NdOTyDomMnvwV14 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74888962841648a7bfc8cd36cdf5526c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74888962841648a7bfc8cd36cdf5526c Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-924858770 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7c91481067cd4be881f75d33b56ee431 Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersOnMultiNodesTest-924858770-project Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed could not be found. Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '8a61e28f-f3a1-4aea-be4b-4d12f85736ed'} Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed could not be found. Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed could not be found. Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:50.247740 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:50.266725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:50.266725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:50.266725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:50.266725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:50.266725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:50.266725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed could not be found. Nov 02 12:26:50.266725 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:26:50.286262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] Returning 404 to user: Instance 8a61e28f-f3a1-4aea-be4b-4d12f85736ed could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:50.291087 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b3001bd-26fd-4893-8289-80032a3d5d0c tempest-ServersOnMultiNodesTest-924858770 tempest-ServersOnMultiNodesTest-924858770-project] 10.222.0.45 "GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed" status: 404 len: 111 microversion: 2.1 time: 0.134346 Nov 02 12:26:50.296700 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 913/1768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:50 2022] GET /compute/v2.1/servers/8a61e28f-f3a1-4aea-be4b-4d12f85736ed => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:26:50.316401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ce67e5e5-46ca-414b-aa3b-741fd6072c77 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e507ee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:50.438038 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ce67e5e5-46ca-414b-aa3b-741fd6072c77 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.126997 Nov 02 12:26:50.439058 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 856/1769] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:50 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:50.576432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:50.577172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:50.598649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:50.599500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:50.607127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:50.608535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:50.609046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:50.609576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:51.462802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78e5f48a-8e68-4f8d-b4fb-402a7e7c82a6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8c6160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:51.583027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:51.601471 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65ecfd8b-9291-46a4-9d41-7dcbc954ef22 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1211 microversion: 2.1 time: 1.027443 Nov 02 12:26:51.618466 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 914/1770] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:50 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1211 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:51.618870 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78e5f48a-8e68-4f8d-b4fb-402a7e7c82a6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.162020 Nov 02 12:26:51.625843 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 857/1771] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:51 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:52.080461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=14 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:52.256527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0e0ae109-f37d-4cee-a031-1bc10b9c5acf tempest-AZV2TestJSON-929030140 tempest-AZV2TestJSON-929030140-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:52.259050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e0ae109-f37d-4cee-a031-1bc10b9c5acf tempest-AZV2TestJSON-929030140 tempest-AZV2TestJSON-929030140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:52.259790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e0ae109-f37d-4cee-a031-1bc10b9c5acf tempest-AZV2TestJSON-929030140 tempest-AZV2TestJSON-929030140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:52.260740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e0ae109-f37d-4cee-a031-1bc10b9c5acf tempest-AZV2TestJSON-929030140 tempest-AZV2TestJSON-929030140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:52.263893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e0ae109-f37d-4cee-a031-1bc10b9c5acf tempest-AZV2TestJSON-929030140 tempest-AZV2TestJSON-929030140-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:52.264643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e0ae109-f37d-4cee-a031-1bc10b9c5acf tempest-AZV2TestJSON-929030140 tempest-AZV2TestJSON-929030140-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:52.267150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e0ae109-f37d-4cee-a031-1bc10b9c5acf tempest-AZV2TestJSON-929030140 tempest-AZV2TestJSON-929030140-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:52.423370 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0e0ae109-f37d-4cee-a031-1bc10b9c5acf tempest-AZV2TestJSON-929030140 tempest-AZV2TestJSON-929030140-project] 10.222.0.45 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.805276 Nov 02 12:26:52.429481 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 915/1772] 10.222.0.45 () {58 vars in 1164 bytes} [Wed Nov 2 12:26:51 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:26:52.628578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:52.629212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:52.642314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b5720f78-c5c8-44ae-bf66-40ec7d1b721f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f2290113e50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:52.663404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:52.664099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:52.664896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:52.666418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:52.667238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:52.689447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:52.733591 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b5720f78-c5c8-44ae-bf66-40ec7d1b721f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.096046 Nov 02 12:26:52.744302 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 916/1773] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:52 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:52.835011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:53.755834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb4a4fc2-af77-459d-ac1d-26529e487936 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228ea68c10>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:53.838016 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb4a4fc2-af77-459d-ac1d-26529e487936 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.088575 Nov 02 12:26:53.848550 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 917/1774] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:53 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:53.908268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:53.949363 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67c83ed3-b521-40fc-9336-93c585ff6f0d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1211 microversion: 2.1 time: 1.325680 Nov 02 12:26:53.971425 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 858/1775] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:52 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1211 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:54.856078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-25986a06-8171-4226-811d-b2d2e895fc25 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e872550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:54.980899 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-25986a06-8171-4226-811d-b2d2e895fc25 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.129928 Nov 02 12:26:54.981918 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 918/1776] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:54 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:55.013373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:55.025216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:55.070055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:55.080007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:55.080524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:55.080983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:55.081730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:55.094767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:55.095375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:55.324622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-16fa09c6-8876-44b6-af12-fb0c6cdd7a81 req-ee6a70f2-abbe-4b6c-bddd-dd1bfb120148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed050eff-b84c-4742-adf2-5e7437f8c1a7", "tag": "16803170-ac59-42bc-83c0-a86a778086ff"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:55.358926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-16fa09c6-8876-44b6-af12-fb0c6cdd7a81 req-ee6a70f2-abbe-4b6c-bddd-dd1bfb120148 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:55.366553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-16fa09c6-8876-44b6-af12-fb0c6cdd7a81 req-ee6a70f2-abbe-4b6c-bddd-dd1bfb120148 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:55.369138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-16fa09c6-8876-44b6-af12-fb0c6cdd7a81 req-ee6a70f2-abbe-4b6c-bddd-dd1bfb120148 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:55.388817 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-16fa09c6-8876-44b6-af12-fb0c6cdd7a81 req-ee6a70f2-abbe-4b6c-bddd-dd1bfb120148 service nova] Creating event network-changed:16803170-ac59-42bc-83c0-a86a778086ff for instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 on n-h1-855650-5 Nov 02 12:26:55.425747 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-16fa09c6-8876-44b6-af12-fb0c6cdd7a81 req-ee6a70f2-abbe-4b6c-bddd-dd1bfb120148 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105216 Nov 02 12:26:55.430050 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 919/1777] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:55.912328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=36 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:56.004760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c09cc877-d297-4b24-a5f9-577ed8ec5721 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eec4430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:56.223067 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c09cc877-d297-4b24-a5f9-577ed8ec5721 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.227699 Nov 02 12:26:56.229592 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 920/1778] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:55 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:56.492894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:56.509471 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d409923-c274-40f6-a984-17c2fe4f271f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1211 microversion: 2.1 time: 1.505916 Nov 02 12:26:56.530988 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 859/1779] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:55 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1211 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:57.247671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c336bb44-a4ed-48ee-bca7-31d4c920830e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228edfaf70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:57.500677 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c336bb44-a4ed-48ee-bca7-31d4c920830e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.257816 Nov 02 12:26:57.501913 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 921/1780] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:57 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:57.544531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:57.546006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:57.567013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:57.567908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:57.568628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:57.569584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:57.570849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:57.571557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:58.296458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:58.306410 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8fc9fec6-24bb-4464-a8c7-728027da8e76 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1211 microversion: 2.1 time: 0.766371 Nov 02 12:26:58.307040 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 860/1781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:57 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1211 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:58.520103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e9bab6d-aa3a-4e9d-9506-9e636201675f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228f40ad30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:58.744751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4e9bab6d-aa3a-4e9d-9506-9e636201675f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.231141 Nov 02 12:26:58.745908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 922/1782] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:58 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:59.335519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:59.336319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:59.351036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:59.351596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:59.352496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:59.352789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:59.353257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:59.353699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:59.762234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c29721c-5330-4a20-b00c-6c33c357bd50 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228ede6700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:59.854786 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c29721c-5330-4a20-b00c-6c33c357bd50 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.097594 Nov 02 12:26:59.855384 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 923/1783] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:26:59 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:00.106253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:00.116827 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e021c924-94f3-4619-94a4-a17f7f4c839e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1211 microversion: 2.1 time: 0.785225 Nov 02 12:27:00.117453 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 861/1784] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:59 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1211 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:00.228235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-443396735", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a9f510fb-b50d-4af2-b983-5038fdf1b237"}], "block_device_mapping_v2": [{"uuid": "065794bb-7d48-4098-8539-2f1441298e28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:00.257153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:00.394898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] validate_networks() for [('a9f510fb-b50d-4af2-b983-5038fdf1b237', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:27:00.550097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-839f29b6-0083-493b-ba0e-17dd6078ffc1 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-352144857", "id": 1949707681, "os-flavor-access:is_public": "False"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:00.614590 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-839f29b6-0083-493b-ba0e-17dd6078ffc1 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.460719 Nov 02 12:27:00.617742 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 924/1785] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:00 2022] POST /compute/v2.1/flavors => generated 438 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:00.634555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c2cf3226-71a5-4ba3-bdf5-5398803e7f60 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:01.356366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:27:01.357032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:27:01.357953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:27:01.358939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:27:01.360158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:27:01.372724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:01.373661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:01.374396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:01.375571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:01.376597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:01.377309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:01.410222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for project 61f9f821af56421c98639028cc700a64. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:27:01.421339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Getting quotas for user a71d3feaad3148cc89c28cb18acf0cd0 and project 61f9f821af56421c98639028cc700a64. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:27:01.514427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:27:01.518669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='065794bb-7d48-4098-8539-2f1441298e28',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:27:01.670667 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c2cf3226-71a5-4ba3-bdf5-5398803e7f60 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1949707681/action" status: 200 len: 97 microversion: 2.1 time: 1.042051 Nov 02 12:27:01.681093 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 925/1786] 10.222.0.45 () {60 vars in 1200 bytes} [Wed Nov 2 12:27:00 2022] POST /compute/v2.1/flavors/1949707681/action => generated 97 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:27:01.695771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d89f4f6-b12a-4088-a7e0-1c91ce858bf3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8c2550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:01.770931 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d89f4f6-b12a-4088-a7e0-1c91ce858bf3 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.088029 Nov 02 12:27:01.784348 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 926/1787] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:01 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:01.977584 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7952cbea-379d-4526-9732-9c9a70f7bcf4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.748792 Nov 02 12:27:01.983342 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 862/1788] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 12:27:02.003426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:02.009100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:02.035577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:02.037610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:02.039228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:02.057022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:02.060372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:02.060932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:02.290006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:02.350118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-949258708", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:02.441726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:02.469981 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8867450f-31e6-479f-84f3-356fa74bd178 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1211 microversion: 2.1 time: 0.483630 Nov 02 12:27:02.474932 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 863/1789] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:01 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1211 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:02.498894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd8c58f7-b29f-4e51-ab8c-dd606136f6cd tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:02.578828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] validate_networks() for [('3bf27cad-1e78-46c1-9ef0-e5897098fc42', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:27:03.506520 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-dd8c58f7-b29f-4e51-ab8c-dd606136f6cd tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project ada5b62d59a24c31a1f0ebae223ec1cd combination. Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd8c58f7-b29f-4e51-ab8c-dd606136f6cd tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Request method failure captured: Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/flavors/1949707681/action HTTP/1.1 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 67 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmISUvgUvPBQRNIemPljXGEMgbjpK54LDyanVr7LaMrxsvK2schGCxbwhoN72JSVl8P15HuF_URF8mLtVw9e5dCvrKIvlatPXuMCWJcbG5_2N2dsglVlmnwBzl1r69Q9MwoPKuuTZQBXfPgVSVLnN19mIwG1211ZlNkMEc1V747DU6w Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: fdd3f4c39303418abf22d783f29e8881 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: fdd3f4c39303418abf22d783f29e8881 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1463bc1e71eb4e45b2b9f08438324710 Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: {"addTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: exception: Flavor access already exists for flavor 35 and project ada5b62d59a24c31a1f0ebae223ec1cd combination. Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1949707681', 'body': {'addTenantAccess': {'tenant': 'ada5b62d59a24c31a1f0ebae223ec1cd'}}} Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-ada5b62d59a24c31a1f0ebae223ec1cd' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.527299 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:27:03.533441 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-ada5b62d59a24c31a1f0ebae223ec1cd' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 12, 27, 3, 496180), 'updated_at': None, 'flavor_id': 35, 'project_id': 'ada5b62d59a24c31a1f0ebae223ec1cd'}] Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project ada5b62d59a24c31a1f0ebae223ec1cd combination. Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project ada5b62d59a24c31a1f0ebae223ec1cd combination. Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project ada5b62d59a24c31a1f0ebae223ec1cd combination. Nov 02 12:27:03.537782 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:03.545821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd8c58f7-b29f-4e51-ab8c-dd606136f6cd tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project ada5b62d59a24c31a1f0ebae223ec1cd combination. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:03.546471 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd8c58f7-b29f-4e51-ab8c-dd606136f6cd tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1949707681/action" status: 409 len: 152 microversion: 2.1 time: 1.052109 Nov 02 12:27:03.550830 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 864/1790] 10.222.0.45 () {60 vars in 1200 bytes} [Wed Nov 2 12:27:02 2022] POST /compute/v2.1/flavors/1949707681/action => generated 152 bytes in 1057 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:27:03.556873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:03.558145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:03.566881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:03.567658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:03.568932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:03.569859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:03.570551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:03.571281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:03.607394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:27:03.608288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:27:03.608908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:27:03.609870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:27:03.610674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:27:03.629838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:03.630374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:03.633743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:03.634643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:03.635144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:03.638726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:03.658452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:03.672809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:03.674972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:03.677295 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4e0f9b1-af4b-44f2-88dd-254e8af716ad tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1176 microversion: 2.25 time: 0.124292 Nov 02 12:27:03.679865 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 865/1791] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:03 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1176 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:03.700614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e24abfa1-8409-4e9a-8f1e-4e84e23bc94b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e6c1940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:03.712502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Getting quotas for project 2a51f8822491473b8edfe0b97a2e0d67. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:27:03.726727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Getting quotas for user 05ae1470e3b04928827e3757483e4c00 and project 2a51f8822491473b8edfe0b97a2e0d67. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:27:03.757217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:27:03.763378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:27:03.796481 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e24abfa1-8409-4e9a-8f1e-4e84e23bc94b tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.110853 Nov 02 12:27:03.797924 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 866/1792] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:03 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:04.005620 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9ac3688-f2eb-4df8-97d5-96ad644cbcf4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.217517 Nov 02 12:27:04.011802 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 927/1793] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:27:04.046353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.049879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e624c8b2-1d10-475e-ba72-36f382551f91 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.055530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e624c8b2-1d10-475e-ba72-36f382551f91 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.056399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e624c8b2-1d10-475e-ba72-36f382551f91 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.057042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e624c8b2-1d10-475e-ba72-36f382551f91 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.058145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e624c8b2-1d10-475e-ba72-36f382551f91 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.058822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:04.059645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e624c8b2-1d10-475e-ba72-36f382551f91 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.060376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e624c8b2-1d10-475e-ba72-36f382551f91 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.080546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.081775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.082995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.085705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.086476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.089407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.151812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e624c8b2-1d10-475e-ba72-36f382551f91 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.352469 Nov 02 12:27:04.154316 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 867/1794] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:27:03 2022] GET /compute/v2.1/os-services => generated 944 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:04.169051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ded7891c-1487-4747-863c-3a66ad10ca40 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:04.353109 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ded7891c-1487-4747-863c-3a66ad10ca40 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1949707681/action" status: 200 len: 21 microversion: 2.1 time: 0.197415 Nov 02 12:27:04.354694 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 868/1795] 10.222.0.45 () {60 vars in 1200 bytes} [Wed Nov 2 12:27:04 2022] POST /compute/v2.1/flavors/1949707681/action => generated 21 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:27:04.367792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70272c3d-1e3e-4eee-abbf-d07971ddc859 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.368756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70272c3d-1e3e-4eee-abbf-d07971ddc859 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:04.555826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70272c3d-1e3e-4eee-abbf-d07971ddc859 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:04.567198 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70272c3d-1e3e-4eee-abbf-d07971ddc859 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1213 microversion: 2.1 time: 0.203974 Nov 02 12:27:04.569128 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 869/1796] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:04.574453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8563b9f-fe22-49b7-8df1-953288271208 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.582053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8563b9f-fe22-49b7-8df1-953288271208 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.582946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8563b9f-fe22-49b7-8df1-953288271208 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.583641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8563b9f-fe22-49b7-8df1-953288271208 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.584707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8563b9f-fe22-49b7-8df1-953288271208 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.585492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8563b9f-fe22-49b7-8df1-953288271208 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.586251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8563b9f-fe22-49b7-8df1-953288271208 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.646760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:04.659912 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e10b631b-f4da-489e-8e66-a4a678eee70d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1199 microversion: 2.1 time: 0.646515 Nov 02 12:27:04.663640 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 928/1797] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1199 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:04.676191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc67b9eb-f5a7-434e-8c59-079671eeae77 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.694952 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8563b9f-fe22-49b7-8df1-953288271208 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.115262 Nov 02 12:27:04.708630 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 870/1798] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:04.730616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.735235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:04.748821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.750074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.751172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.752535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.753578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.754454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.774917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dc67b9eb-f5a7-434e-8c59-079671eeae77 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1949707681" status: 202 len: 0 microversion: 2.1 time: 0.109575 Nov 02 12:27:04.782170 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 929/1799] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:27:04 2022] DELETE /compute/v2.1/flavors/1949707681 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:27:04.807169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a72a392-7ad8-45c7-926c-fedc590a70f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.824137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a72a392-7ad8-45c7-926c-fedc590a70f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.829733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a72a392-7ad8-45c7-926c-fedc590a70f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.831327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a72a392-7ad8-45c7-926c-fedc590a70f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.834134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a72a392-7ad8-45c7-926c-fedc590a70f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.840608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a72a392-7ad8-45c7-926c-fedc590a70f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.841367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a72a392-7ad8-45c7-926c-fedc590a70f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.933606 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a72a392-7ad8-45c7-926c-fedc590a70f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.149684 Nov 02 12:27:04.955515 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 930/1800] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:04.967611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b24e4989-a1e2-48e7-a60e-e1e6128e7bb5 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.036701 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b24e4989-a1e2-48e7-a60e-e1e6128e7bb5 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079222 Nov 02 12:27:05.038792 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 931/1801] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:05.050677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fce310d5-ecf5-4bf0-b41c-b95007b78c62 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e9b4ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.052528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:05.068404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:05.069884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:05.071104 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-075410e1-a8ab-48d2-8a25-a5b70a901d89 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1232 microversion: 2.25 time: 0.360828 Nov 02 12:27:05.085759 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 871/1802] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1232 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:05.091168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fdc029d-c6a6-48e2-944c-39ef3ea537c0 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.117215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fdc029d-c6a6-48e2-944c-39ef3ea537c0 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.117700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fdc029d-c6a6-48e2-944c-39ef3ea537c0 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.118175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fdc029d-c6a6-48e2-944c-39ef3ea537c0 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.118927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fdc029d-c6a6-48e2-944c-39ef3ea537c0 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.119388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fdc029d-c6a6-48e2-944c-39ef3ea537c0 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.119816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fdc029d-c6a6-48e2-944c-39ef3ea537c0 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.134301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fce310d5-ecf5-4bf0-b41c-b95007b78c62 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.094140 Nov 02 12:27:05.137223 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 932/1803] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:05.143329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e4b69fa2-c51e-49ed-a0c4-0139365babf3 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-813447237", "id": 508349604, "os-flavor-access:is_public": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:05.189888 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e4b69fa2-c51e-49ed-a0c4-0139365babf3 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.050889 Nov 02 12:27:05.191092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 933/1804] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:05 2022] POST /compute/v2.1/flavors => generated 434 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:05.207770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08eeb34c-29e6-47e4-8485-0e8a39f75392 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.230178 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-08eeb34c-29e6-47e4-8485-0e8a39f75392 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08eeb34c-29e6-47e4-8485-0e8a39f75392 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Request method failure captured: Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/flavors/508349604/os-flavor-access HTTP/1.1 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmISUvgUvPBQRNIemPljXGEMgbjpK54LDyanVr7LaMrxsvK2schGCxbwhoN72JSVl8P15HuF_URF8mLtVw9e5dCvrKIvlatPXuMCWJcbG5_2N2dsglVlmnwBzl1r69Q9MwoPKuuTZQBXfPgVSVLnN19mIwG1211ZlNkMEc1V747DU6w Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: fdd3f4c39303418abf22d783f29e8881 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: fdd3f4c39303418abf22d783f29e8881 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 1463bc1e71eb4e45b2b9f08438324710 Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: exception: Access list not available for public flavors. Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'flavor_id': '508349604'} Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 02 12:27:05.234925 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:05.241284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08eeb34c-29e6-47e4-8485-0e8a39f75392 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:05.243303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08eeb34c-29e6-47e4-8485-0e8a39f75392 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/508349604/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.042946 Nov 02 12:27:05.244770 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 934/1805] 10.222.0.45 () {58 vars in 1206 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/flavors/508349604/os-flavor-access => generated 91 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:27:05.255275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b7c9e3ea-85a2-4a27-a48a-567dabb97c0f tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.261757 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fdc029d-c6a6-48e2-944c-39ef3ea537c0 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=n-d-855650-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.174199 Nov 02 12:27:05.262849 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 872/1806] 10.222.0.45 () {58 vars in 1194 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/os-services?host=n-d-855650-5&binary=xxx => generated 16 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:27:05.282756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95016f14-7635-44a1-aba7-7e11d8fded8a tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.286696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95016f14-7635-44a1-aba7-7e11d8fded8a tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.287136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95016f14-7635-44a1-aba7-7e11d8fded8a tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.287588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95016f14-7635-44a1-aba7-7e11d8fded8a tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.288347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95016f14-7635-44a1-aba7-7e11d8fded8a tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.297193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95016f14-7635-44a1-aba7-7e11d8fded8a tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.300211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95016f14-7635-44a1-aba7-7e11d8fded8a tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.314345 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b7c9e3ea-85a2-4a27-a48a-567dabb97c0f tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/508349604" status: 202 len: 0 microversion: 2.1 time: 0.062873 Nov 02 12:27:05.318791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 935/1807] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:27:05 2022] DELETE /compute/v2.1/flavors/508349604 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:27:05.331203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c7f12d63-deac-4d3f-b62b-406c9aad7777 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.374356 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95016f14-7635-44a1-aba7-7e11d8fded8a tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.097193 Nov 02 12:27:05.376196 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 873/1808] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:05.378869 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c7f12d63-deac-4d3f-b62b-406c9aad7777 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058068 Nov 02 12:27:05.401059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-715d3627-2f46-40a3-aba8-1948e883c3f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.401641 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 936/1809] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:05.410768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-552665be-03d5-489e-9e55-8caf2b0f20ef tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-136178229", "id": 2079184341, "os-flavor-access:is_public": "False"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:05.412091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-715d3627-2f46-40a3-aba8-1948e883c3f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.415796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-715d3627-2f46-40a3-aba8-1948e883c3f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.416634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-715d3627-2f46-40a3-aba8-1948e883c3f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.418903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-715d3627-2f46-40a3-aba8-1948e883c3f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.425671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-715d3627-2f46-40a3-aba8-1948e883c3f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.426586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-715d3627-2f46-40a3-aba8-1948e883c3f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.456252 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-552665be-03d5-489e-9e55-8caf2b0f20ef tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.052784 Nov 02 12:27:05.465084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 937/1810] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:05 2022] POST /compute/v2.1/flavors => generated 438 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:05.487577 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-715d3627-2f46-40a3-aba8-1948e883c3f9 tempest-ServicesAdminNegativeTestJSON-236429952 tempest-ServicesAdminNegativeTestJSON-236429952-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.091631 Nov 02 12:27:05.488883 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 874/1811] 10.222.0.45 () {58 vars in 1198 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:27:05.831907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd6c57b5-4dfe-4a17-a4da-21c5f2c22fe4 tempest-ServicesAdminNegativeTestJSON-922045198 tempest-ServicesAdminNegativeTestJSON-922045198-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.839776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd6c57b5-4dfe-4a17-a4da-21c5f2c22fe4 tempest-ServicesAdminNegativeTestJSON-922045198 tempest-ServicesAdminNegativeTestJSON-922045198-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '434dfd9579234a2cba835e92f4316af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a29fb29f964a1abe01edcd991934c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd6c57b5-4dfe-4a17-a4da-21c5f2c22fe4 tempest-ServicesAdminNegativeTestJSON-922045198 tempest-ServicesAdminNegativeTestJSON-922045198-project] Request method failure captured: Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmIVj3-WVA5wPK2C3FEqU6g49VnX4yJHRIDBjWdrvkb-O3bgXpyttNq2Uv1mRFjZjLaNw5vfXwLsZnUwntTsHAtQAh2-5z1LoKFBVW9LAR4jRJ826RW2mZ5nPlxBUbYerGqvL5nYC81dsX41-YFSJvt58_dXOq2Txn90-NABdMVH1dc Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c2a29fb29f964a1abe01edcd991934c6 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-922045198 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2a29fb29f964a1abe01edcd991934c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c2a29fb29f964a1abe01edcd991934c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c2a29fb29f964a1abe01edcd991934c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c2a29fb29f964a1abe01edcd991934c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-922045198 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c2a29fb29f964a1abe01edcd991934c6 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-922045198 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServicesAdminNegativeTestJSON-922045198-project Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 434dfd9579234a2cba835e92f4316af4 Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-922045198-project Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: action_args: {} Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:27:05.854795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:27:05.860397 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:05.865917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd6c57b5-4dfe-4a17-a4da-21c5f2c22fe4 tempest-ServicesAdminNegativeTestJSON-922045198 tempest-ServicesAdminNegativeTestJSON-922045198-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:05.872459 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd6c57b5-4dfe-4a17-a4da-21c5f2c22fe4 tempest-ServicesAdminNegativeTestJSON-922045198 tempest-ServicesAdminNegativeTestJSON-922045198-project] 10.222.0.45 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.373383 Nov 02 12:27:05.878618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 875/1812] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/os-services => generated 112 bytes in 380 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:27:05.904840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.905483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:05.972753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.973321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.976405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.977218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.979557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.980022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:06.002901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-947a60f9-6442-4def-acec-93fed9adc7bd tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:06.015956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-947a60f9-6442-4def-acec-93fed9adc7bd tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '4502e276ec434096b566752045f3f491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5b62d59a24c31a1f0ebae223ec1cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-947a60f9-6442-4def-acec-93fed9adc7bd tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] Request method failure captured: Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/flavors/2079184341/action HTTP/1.1 Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 67 Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmIPmZIyu0OVTjdLiz7E2I-HHPwXUXAqsUGb77HEWwgt8ZMBUikehAW0Ne5Tok7VhgdWfqCPmZw3aeQJd2Nfz75xfwQEP1sF8H4fwrdY_iH922pxKmdZleymWLEvm8F7XpMMcZQ6GNpsD32rLQzItecxYOohW9p4cWH54tp6j89912c Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ada5b62d59a24c31a1f0ebae223ec1cd Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-587739594 Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ada5b62d59a24c31a1f0ebae223ec1cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ada5b62d59a24c31a1f0ebae223ec1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ada5b62d59a24c31a1f0ebae223ec1cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ada5b62d59a24c31a1f0ebae223ec1cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-587739594 Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ada5b62d59a24c31a1f0ebae223ec1cd Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-587739594 Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FlavorsAccessNegativeTestJSON-587739594-project Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 4502e276ec434096b566752045f3f491 Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-587739594-project Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: {"addTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '2079184341', 'body': {'addTenantAccess': {'tenant': 'ada5b62d59a24c31a1f0ebae223ec1cd'}}} Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:27:06.025796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 12:27:06.032589 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:06.039277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-947a60f9-6442-4def-acec-93fed9adc7bd tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:06.040455 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-947a60f9-6442-4def-acec-93fed9adc7bd tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] 10.222.0.45 "POST /compute/v2.1/flavors/2079184341/action" status: 403 len: 130 microversion: 2.1 time: 0.573547 Nov 02 12:27:06.056873 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 938/1813] 10.222.0.45 () {60 vars in 1200 bytes} [Wed Nov 2 12:27:05 2022] POST /compute/v2.1/flavors/2079184341/action => generated 130 bytes in 588 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:27:06.085887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.086561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:06.116875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:06.117383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:06.119527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:06.120515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:06.121881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:06.123901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:06.476953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:06.490225 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8207fb7d-a874-424c-8cf0-3e50c2ebceab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1209 microversion: 2.1 time: 0.605214 Nov 02 12:27:06.499496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 876/1814] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1209 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:06.525500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba3be8ce-8136-4a20-90b8-01c62499191b tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.612658 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba3be8ce-8136-4a20-90b8-01c62499191b tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/2079184341" status: 202 len: 0 microversion: 2.1 time: 0.109740 Nov 02 12:27:06.619824 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 877/1815] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:27:06 2022] DELETE /compute/v2.1/flavors/2079184341 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:27:06.647312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.653817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:06.720115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:06.727840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:06.728817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:06.730686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:06.731965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:06.734669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:07.280379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:07.348730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:07.354866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:07.371661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:07.378828 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f8a3f7f-669c-45aa-bc61-6d0d5cb0b07d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1250 microversion: 2.25 time: 0.753005 Nov 02 12:27:07.385747 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 878/1816] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:06 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1250 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:07.400922 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2df25c24-dec0-407a-99b6-797b63ffc3b4 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1199 microversion: 2.1 time: 1.341928 Nov 02 12:27:07.402243 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 939/1817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:06 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1199 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:07.417618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-453eaf8e-d520-445c-a283-194500deab56 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e776b80>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:07.425136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2bb2ab6-c72e-4062-bfc3-401cab84d053 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:07.564638 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-453eaf8e-d520-445c-a283-194500deab56 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.174771 Nov 02 12:27:07.568155 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d2bb2ab6-c72e-4062-bfc3-401cab84d053 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.163674 Nov 02 12:27:07.570128 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 940/1818] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:27:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:07.577645 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 879/1819] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:07 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:07.580483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:07.584037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:07.605159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b5f0373-fcef-4cae-9f99-7d1221bbe394 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1410755155", "id": 419067992, "os-flavor-access:is_public": "False"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:07.623417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:07.624438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:07.625448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:07.630287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:07.631059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:07.636845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:07.713777 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4b5f0373-fcef-4cae-9f99-7d1221bbe394 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.112831 Nov 02 12:27:07.717537 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 880/1820] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:07 2022] POST /compute/v2.1/flavors => generated 436 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:07.745454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6eb3aff-6490-421c-96f4-9ddab4ee1611 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:08.175196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:08.198064 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-43eddb2f-c236-415e-b38d-7103e9605f2f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1265 microversion: 2.1 time: 0.621972 Nov 02 12:27:08.216620 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 941/1821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:07 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1265 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:08.413026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:08.413706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:08.443114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=7 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:08.454235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:08.467482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:08.468199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:08.471839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:08.472349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:08.472814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:08.847615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:08.908353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:08.919338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:08.925929 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5429305-70b2-4937-8b50-c6bde21f5f27 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1250 microversion: 2.25 time: 0.518074 Nov 02 12:27:08.927992 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6eb3aff-6490-421c-96f4-9ddab4ee1611 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/419067992/action" status: 200 len: 96 microversion: 2.1 time: 1.198386 Nov 02 12:27:08.934265 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 881/1823] 10.222.0.45 () {60 vars in 1197 bytes} [Wed Nov 2 12:27:07 2022] POST /compute/v2.1/flavors/419067992/action => generated 96 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:27:08.934383 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 942/1823] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:08 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1250 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:08.960096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9127ee3f-4053-4470-b872-832316737506 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e9951f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:08.963698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:08.974386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:09.022786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:09.023813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:09.024463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:09.026760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:09.029775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:09.040438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:09.084224 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9127ee3f-4053-4470-b872-832316737506 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.149409 Nov 02 12:27:09.085200 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 943/1824] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:08 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:09.098952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b227b173-d402-490d-9c03-294aad1de437 tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:09.110347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b227b173-d402-490d-9c03-294aad1de437 tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '4502e276ec434096b566752045f3f491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5b62d59a24c31a1f0ebae223ec1cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b227b173-d402-490d-9c03-294aad1de437 tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] Request method failure captured: Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/flavors/419067992/action HTTP/1.1 Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 70 Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmIPmZIyu0OVTjdLiz7E2I-HHPwXUXAqsUGb77HEWwgt8ZMBUikehAW0Ne5Tok7VhgdWfqCPmZw3aeQJd2Nfz75xfwQEP1sF8H4fwrdY_iH922pxKmdZleymWLEvm8F7XpMMcZQ6GNpsD32rLQzItecxYOohW9p4cWH54tp6j89912c Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ada5b62d59a24c31a1f0ebae223ec1cd Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-587739594 Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ada5b62d59a24c31a1f0ebae223ec1cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ada5b62d59a24c31a1f0ebae223ec1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ada5b62d59a24c31a1f0ebae223ec1cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ada5b62d59a24c31a1f0ebae223ec1cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-587739594 Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ada5b62d59a24c31a1f0ebae223ec1cd Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-587739594 Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FlavorsAccessNegativeTestJSON-587739594-project Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 4502e276ec434096b566752045f3f491 Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-587739594-project Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: {"removeTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '419067992', 'body': {'removeTenantAccess': {'tenant': 'ada5b62d59a24c31a1f0ebae223ec1cd'}}} Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can( Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 12:27:09.115440 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 12:27:09.120288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:09.124686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b227b173-d402-490d-9c03-294aad1de437 tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:09.126181 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b227b173-d402-490d-9c03-294aad1de437 tempest-FlavorsAccessNegativeTestJSON-587739594 tempest-FlavorsAccessNegativeTestJSON-587739594-project] 10.222.0.45 "POST /compute/v2.1/flavors/419067992/action" status: 403 len: 133 microversion: 2.1 time: 0.035331 Nov 02 12:27:09.129679 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 944/1825] 10.222.0.45 () {60 vars in 1197 bytes} [Wed Nov 2 12:27:09 2022] POST /compute/v2.1/flavors/419067992/action => generated 133 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:27:09.139376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f73edc11-d067-4464-9889-21cf934a4cff tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ada5b62d59a24c31a1f0ebae223ec1cd"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:09.311621 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f73edc11-d067-4464-9889-21cf934a4cff tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/419067992/action" status: 200 len: 21 microversion: 2.1 time: 0.175787 Nov 02 12:27:09.313549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 945/1826] 10.222.0.45 () {60 vars in 1197 bytes} [Wed Nov 2 12:27:09 2022] POST /compute/v2.1/flavors/419067992/action => generated 21 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:27:09.364935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:09.366278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:09.383136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:09.384301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:09.384958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:09.385872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:09.386602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:09.387808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:09.567612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:09.586000 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-07818612-6083-4657-ab30-d324fd0a5aec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1271 microversion: 2.1 time: 0.270617 Nov 02 12:27:09.602795 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 946/1827] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:09 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1271 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:09.632851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8de40ffe-bc7d-427f-8c4a-af2dfebe63ee tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:09.684137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:09.698208 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8de40ffe-bc7d-427f-8c4a-af2dfebe63ee tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/419067992" status: 202 len: 0 microversion: 2.1 time: 0.093663 Nov 02 12:27:09.705014 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 947/1828] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:27:09 2022] DELETE /compute/v2.1/flavors/419067992 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:27:09.710651 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c1c68c1-5c4e-4651-9d40-2d411f37be9e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1199 microversion: 2.1 time: 0.777153 Nov 02 12:27:09.716263 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 882/1829] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:08 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1199 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:09.730384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1793a268-ec2c-4c10-937a-985aeaf728a2 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:09.784901 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1793a268-ec2c-4c10-937a-985aeaf728a2 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078378 Nov 02 12:27:09.785719 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 948/1830] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:27:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:09.818475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-47f420ec-18d3-4412-8bd8-09e0ed03dd3d tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1257025883", "id": 1351879054, "os-flavor-access:is_public": "False"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:09.853109 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-47f420ec-18d3-4412-8bd8-09e0ed03dd3d tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.042022 Nov 02 12:27:09.854422 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 883/1831] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:09 2022] POST /compute/v2.1/flavors => generated 439 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:09.872824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc43b83b-5481-42c8-89aa-2670430a2e26 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2f2550bb668840109a592b7037d4c704"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:09.963808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:09.965131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:09.979313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:09.984799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:09.985260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:09.992080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:09.998217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:09.998702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:10.233314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:10.250343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:10.258119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:10.275451 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99feeb73-b915-4e4e-8084-d91cb65e86f8 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1250 microversion: 2.25 time: 0.317089 Nov 02 12:27:10.276108 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 884/1832] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:09 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1250 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:10.300392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-216cc048-21b6-4913-8093-2923e88c96ac tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e6c0dc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:10.391571 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-216cc048-21b6-4913-8093-2923e88c96ac tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.105527 Nov 02 12:27:10.392667 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 885/1833] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:10 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:10.508365 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-cc43b83b-5481-42c8-89aa-2670430a2e26 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] HTTP exception thrown: Flavor access not found for 39 / 2f2550bb668840109a592b7037d4c704 combination. Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc43b83b-5481-42c8-89aa-2670430a2e26 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Request method failure captured: Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/flavors/1351879054/action HTTP/1.1 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 70 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmISUvgUvPBQRNIemPljXGEMgbjpK54LDyanVr7LaMrxsvK2schGCxbwhoN72JSVl8P15HuF_URF8mLtVw9e5dCvrKIvlatPXuMCWJcbG5_2N2dsglVlmnwBzl1r69Q9MwoPKuuTZQBXfPgVSVLnN19mIwG1211ZlNkMEc1V747DU6w Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: fdd3f4c39303418abf22d783f29e8881 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fdd3f4c39303418abf22d783f29e8881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: fdd3f4c39303418abf22d783f29e8881 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 1463bc1e71eb4e45b2b9f08438324710 Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: {"removeTenantAccess": {"tenant": "2f2550bb668840109a592b7037d4c704"}} Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: exception: Flavor access not found for 39 / 2f2550bb668840109a592b7037d4c704 combination. Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1351879054', 'body': {'removeTenantAccess': {'tenant': '2f2550bb668840109a592b7037d4c704'}}} Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 2f2550bb668840109a592b7037d4c704 combination. Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:10.517436 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 2f2550bb668840109a592b7037d4c704 combination. Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 2f2550bb668840109a592b7037d4c704 combination. Nov 02 12:27:10.523212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:10.528485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc43b83b-5481-42c8-89aa-2670430a2e26 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Returning 404 to user: Flavor access not found for 39 / 2f2550bb668840109a592b7037d4c704 combination. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:10.531940 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cc43b83b-5481-42c8-89aa-2670430a2e26 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1351879054/action" status: 404 len: 124 microversion: 2.1 time: 0.664398 Nov 02 12:27:10.536894 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 949/1834] 10.222.0.45 () {60 vars in 1200 bytes} [Wed Nov 2 12:27:09 2022] POST /compute/v2.1/flavors/1351879054/action => generated 124 bytes in 672 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:27:10.546244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a126be40-9146-4703-b374-e211ef1c2b32 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:10.614453 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a126be40-9146-4703-b374-e211ef1c2b32 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1351879054" status: 202 len: 0 microversion: 2.1 time: 0.074330 Nov 02 12:27:10.615146 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 886/1835] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:27:10 2022] DELETE /compute/v2.1/flavors/1351879054 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:27:10.626032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48f05c7a-c752-4dee-8f5c-0084228e5e47 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:10.655189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:10.656977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:10.660628 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48f05c7a-c752-4dee-8f5c-0084228e5e47 tempest-FlavorsAccessNegativeTestJSON-1750134725 tempest-FlavorsAccessNegativeTestJSON-1750134725-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038534 Nov 02 12:27:10.679310 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 887/1836] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:27:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:10.689017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:10.690832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:10.703306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:10.704416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:10.705081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:10.705831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:10.736068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=84 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:10.750685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:10.751939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:10.779290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:10.781550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:10.784359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:10.790308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:10.794344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:10.798592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:10.881201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:10.906613 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39e80b95-3601-4205-a225-12a8808fa515 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1271 microversion: 2.1 time: 0.284107 Nov 02 12:27:10.914444 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 950/1837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:10 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:11.310245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:11.311020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:11.345505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:11.346388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:11.362058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:11.364609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:11.365114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:11.365579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:11.785796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:11.806531 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9221459-b996-47db-8804-50c28c48fed0 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1199 microversion: 2.1 time: 1.061471 Nov 02 12:27:11.818489 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 888/1838] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:10 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1199 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:11.825391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa8ad184-ee97-490b-8e3b-ccf77c9b52d4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e71d430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:11.944484 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa8ad184-ee97-490b-8e3b-ccf77c9b52d4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.124221 Nov 02 12:27:11.945103 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 889/1839] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:11 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:11.970276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:11.979766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:12.018655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:12.029898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:12.033251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:12.037190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:12.044742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:12.046019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:12.136131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:12.162607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:12.172270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:12.173927 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8fe3abd-4d59-4865-b160-7e225a4c350b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1292 microversion: 2.25 time: 0.870805 Nov 02 12:27:12.190815 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 951/1840] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:11 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1292 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:12.249486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:12.264642 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70a26fa9-560a-4634-864e-4dc10c49d16f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1271 microversion: 2.1 time: 0.306296 Nov 02 12:27:12.274330 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 890/1841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:11 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1271 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:12.849634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:12.850450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:12.875543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:12.876456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:12.877113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:12.877941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:12.878546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:12.878992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:12.963128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a153842b-6ceb-41a7-9cbb-0e19968b90a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8c70d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:13.089686 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a153842b-6ceb-41a7-9cbb-0e19968b90a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.130838 Nov 02 12:27:13.102831 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 891/1842] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:12 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:13.214057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:13.224131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:13.271548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:13.272157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:13.272630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:13.273585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:13.274172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:13.274689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:13.394221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:13.425202 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b2b4bc87-6e92-484c-aea2-0321c853637b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1199 microversion: 2.1 time: 0.580069 Nov 02 12:27:13.426573 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 952/1843] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:12 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1199 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:13.431788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:13.440717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:13.472464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:13.473886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:13.474760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:13.481181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:13.482834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:13.484995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:13.713823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:13.740989 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66fd36a3-f43a-4a1b-aecc-587f82cf1c40 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1271 microversion: 2.1 time: 0.312758 Nov 02 12:27:13.753455 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 953/1844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:13 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:13.793958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:13.820709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:13.840289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:13.850886 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ecf45374-b1c4-4295-be38-3652a0155a1c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1292 microversion: 2.25 time: 0.648396 Nov 02 12:27:13.868000 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 892/1845] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:13 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1292 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:14.111263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cdbcdd93-980a-4f7d-a563-99b8a58fab4d tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8c2550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:14.116947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:14.233942 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cdbcdd93-980a-4f7d-a563-99b8a58fab4d tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.128241 Nov 02 12:27:14.235281 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 954/1846] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:14 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:14.455989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:14.457590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:14.478815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:14.509062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:14.513039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:14.518950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:14.529920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:14.531959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:14.532470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:14.644317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:14.781032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:14.784214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:14.813281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:14.820012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:14.822802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:14.826532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:14.829568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:14.834104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:14.905823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:15.010854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:15.043506 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-521572b4-aaf3-432b-9ab6-24f9395f0eb8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1271 microversion: 2.1 time: 0.270898 Nov 02 12:27:15.047572 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 955/1847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:14 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:15.060082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:15.060721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:15.086938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:15.088730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:15.093815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:15.098803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:15.101579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:15.108913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:15.450791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:15.493567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:15.509462 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1615e171-d3f8-49f7-841c-8ec8afe7049e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1199 microversion: 2.1 time: 1.057758 Nov 02 12:27:15.530929 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 893/1848] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:14 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1199 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:15.547413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a0491e8-24fb-4b0d-a575-bbddbc7bafbb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228f2690d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:15.669696 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a0491e8-24fb-4b0d-a575-bbddbc7bafbb tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.136823 Nov 02 12:27:15.672728 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 894/1849] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:15 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:15.844083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:15.859080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:15.860575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:15.861762 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1082f7fb-4170-4246-9022-2190baf0bc50 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1292 microversion: 2.25 time: 0.812788 Nov 02 12:27:15.862379 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 956/1850] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:15 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1292 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:15.987079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d70f7d88-5ac6-4f7b-baf6-ab02dde247a6 req-db9d9e21-a963-4ff3-8909-0d5ffe4d00e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3", "tag": "505fabd6-494c-45db-a08c-cb6834eec257"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:16.014443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d70f7d88-5ac6-4f7b-baf6-ab02dde247a6 req-db9d9e21-a963-4ff3-8909-0d5ffe4d00e2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:16.015404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d70f7d88-5ac6-4f7b-baf6-ab02dde247a6 req-db9d9e21-a963-4ff3-8909-0d5ffe4d00e2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:16.016135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d70f7d88-5ac6-4f7b-baf6-ab02dde247a6 req-db9d9e21-a963-4ff3-8909-0d5ffe4d00e2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:16.024687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:16.038426 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d70f7d88-5ac6-4f7b-baf6-ab02dde247a6 req-db9d9e21-a963-4ff3-8909-0d5ffe4d00e2 service nova] Creating event network-changed:505fabd6-494c-45db-a08c-cb6834eec257 for instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 on n-h2-855650-5 Nov 02 12:27:16.047482 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d70f7d88-5ac6-4f7b-baf6-ab02dde247a6 req-db9d9e21-a963-4ff3-8909-0d5ffe4d00e2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082991 Nov 02 12:27:16.049484 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 895/1851] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:16.073359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:16.074034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:16.102904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:16.103707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:16.110126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:16.111211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:16.111867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:16.112469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:16.539517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:16.540333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:16.554899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:16.555687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:16.557518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:16.559726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:16.563660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:16.564588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:16.838527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:16.869451 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e94a9b9a-053e-44ae-96d7-ac183ba01c90 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.801444 Nov 02 12:27:16.897440 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 957/1852] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:16 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:16.905776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96ff5026-8f43-4601-b15a-5da5f0ec7063 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228ea30ca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:16.974348 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-96ff5026-8f43-4601-b15a-5da5f0ec7063 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.075711 Nov 02 12:27:16.983356 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 958/1853] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:16 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:16.988885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:16.996653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:17.038129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:17.047786 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f76c06d3-e3d9-4485-92d7-e284ba147116 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1199 microversion: 2.1 time: 0.515690 Nov 02 12:27:17.052212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:17.053214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:17.053938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:17.055013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:17.055750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:17.056428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:17.076968 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 896/1854] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:16 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1199 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:17.382594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0c3959a7-ee2a-4a1d-86d2-9215c819bb28 req-221f0a94-eccd-4a44-bf17-aa58e7505365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed050eff-b84c-4742-adf2-5e7437f8c1a7", "name": "network-vif-plugged", "status": "completed", "tag": "16803170-ac59-42bc-83c0-a86a778086ff"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:17.412231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0c3959a7-ee2a-4a1d-86d2-9215c819bb28 req-221f0a94-eccd-4a44-bf17-aa58e7505365 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:17.412740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0c3959a7-ee2a-4a1d-86d2-9215c819bb28 req-221f0a94-eccd-4a44-bf17-aa58e7505365 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:17.418854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0c3959a7-ee2a-4a1d-86d2-9215c819bb28 req-221f0a94-eccd-4a44-bf17-aa58e7505365 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:17.437152 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0c3959a7-ee2a-4a1d-86d2-9215c819bb28 req-221f0a94-eccd-4a44-bf17-aa58e7505365 service nova] Creating event network-vif-plugged:16803170-ac59-42bc-83c0-a86a778086ff for instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 on n-h1-855650-5 Nov 02 12:27:17.444458 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0c3959a7-ee2a-4a1d-86d2-9215c819bb28 req-221f0a94-eccd-4a44-bf17-aa58e7505365 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065945 Nov 02 12:27:17.445452 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 897/1855] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:27:17.914300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:17.915052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:17.946167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:17.948543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:17.951600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:17.954052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:17.954942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:17.959974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:18.501017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:18.510911 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62da87a3-31cb-4bb9-ad25-77a8e2bbed3b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.601912 Nov 02 12:27:18.515092 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 898/1856] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:17 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:18.551362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-124774a4-9aaf-4b50-a908-6cd8c8c50ca5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228ebfadc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:18.604352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:18.660181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:18.667779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:18.671772 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-34e10298-f714-436f-874d-6e588439ce80 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1292 microversion: 2.25 time: 1.686533 Nov 02 12:27:18.685096 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 959/1857] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:16 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1292 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:18.697373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:18.698130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:18.742434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:18.742942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:18.744061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:18.758678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:18.763195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:18.769994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:18.819853 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-124774a4-9aaf-4b50-a908-6cd8c8c50ca5 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1454 microversion: 2.1 time: 0.292924 Nov 02 12:27:18.820894 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 899/1858] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:18 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1454 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:19.524284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:19.546645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:19.547304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:19.554072 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c20529a9-41a2-422f-876d-bd7c650acbc2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1199 microversion: 2.1 time: 0.854260 Nov 02 12:27:19.566187 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 960/1859] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:18 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1199 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:19.571375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:19.574989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:19.578980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:19.582082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:19.587157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:19.588343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:19.706090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:19.719695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:19.745777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:19.753829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:19.756943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:19.760281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:19.762406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:19.764051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:20.514508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:20.530134 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc485429-f238-41be-8edb-d7734c407c7d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.993136 Nov 02 12:27:20.533509 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 900/1860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:19 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:20.542459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1e3ac96-8493-4b8e-8736-494a5a7f86fd tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228f0085e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:20.608058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:20.626100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:20.636132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:20.637644 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63812a02-b855-4f9e-a60f-14341d4e8dea tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1292 microversion: 2.25 time: 0.939170 Nov 02 12:27:20.641685 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 961/1861] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:19 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1292 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:20.650219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-fceca23a-16e4-48b2-9f5b-e4cca3e9f579 req-468d3379-b4a3-4163-8fcf-786f67d10f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49054040-b35d-4bc1-9fb7-a8da8b84319c", "tag": "bfb0b3e1-ba60-40e5-bdbb-316e361033a0"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:20.666452 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1e3ac96-8493-4b8e-8736-494a5a7f86fd tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1463 microversion: 2.1 time: 0.131733 Nov 02 12:27:20.667270 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 901/1862] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:20 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1463 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:20.683006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:20.683701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:20.693167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:20.694114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:20.694911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:20.695792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:20.696430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:20.697253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:20.698998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fceca23a-16e4-48b2-9f5b-e4cca3e9f579 req-468d3379-b4a3-4163-8fcf-786f67d10f08 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:20.699495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fceca23a-16e4-48b2-9f5b-e4cca3e9f579 req-468d3379-b4a3-4163-8fcf-786f67d10f08 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:20.700132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fceca23a-16e4-48b2-9f5b-e4cca3e9f579 req-468d3379-b4a3-4163-8fcf-786f67d10f08 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:20.739107 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-fceca23a-16e4-48b2-9f5b-e4cca3e9f579 req-468d3379-b4a3-4163-8fcf-786f67d10f08 service nova] Creating event network-changed:bfb0b3e1-ba60-40e5-bdbb-316e361033a0 for instance 49054040-b35d-4bc1-9fb7-a8da8b84319c on n-h2-855650-5 Nov 02 12:27:20.757538 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-fceca23a-16e4-48b2-9f5b-e4cca3e9f579 req-468d3379-b4a3-4163-8fcf-786f67d10f08 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114312 Nov 02 12:27:20.761151 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 962/1863] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:20.780773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-caaf9942-7eff-415d-a00b-0bfef723a9cf tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228ea30ca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:20.853546 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-caaf9942-7eff-415d-a00b-0bfef723a9cf tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 200 len: 1463 microversion: 2.1 time: 0.090470 Nov 02 12:27:20.854785 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 963/1864] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:20 2022] GET /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:20.873106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:20.875080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:20.892953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:20.897120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:20.897693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:20.899788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:20.900882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:20.903545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:21.363862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:21.373506 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b067732-ef36-4b74-a589-a54f06274174 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1382 microversion: 2.1 time: 0.695259 Nov 02 12:27:21.398154 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 902/1865] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:20 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1382 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:21.415439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:21.416367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:21.424937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:21.425464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:21.425919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:21.426983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:21.428591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:21.429046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:21.435580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:21.456060 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c1eab664-d054-4d5e-8020-050983075c8f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1468 microversion: 2.1 time: 0.580577 Nov 02 12:27:21.457074 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 964/1866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:20 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1468 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:21.481620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41d8f48f-e87e-420a-ab5f-1d0a63b5d8bc tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228edb58b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:21.645900 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41d8f48f-e87e-420a-ab5f-1d0a63b5d8bc tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images?changes-since=2022-11-02T12%3A24%3A28Z" status: 200 len: 1902 microversion: 2.1 time: 0.168050 Nov 02 12:27:21.646692 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 965/1867] 10.222.0.45 () {58 vars in 1199 bytes} [Wed Nov 2 12:27:21 2022] GET /compute/v2.1/images?changes-since=2022-11-02T12%3A24%3A28Z => generated 1902 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:21.667605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:21.667605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:21.679425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:21.680072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:21.680617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:21.691666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:21.692276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:21.693019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:21.944265 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a855ceea-4221-4009-9ea4-f3e2f13999f7 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1533 microversion: 2.1 time: 0.544801 Nov 02 12:27:21.945216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 903/1868] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:21 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1533 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:21.951853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:21.952524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:21.967216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:21.968839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:21.969483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:21.972757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:21.973697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:21.974582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:22.067796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:22.099693 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c35565a-7aac-4510-b303-8f031dca8149 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.451298 Nov 02 12:27:22.101443 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 966/1869] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:21 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:22.115771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5ac8bdf6-08a8-4e7b-8c63-00f77f22f1c4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8c2550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:22.261839 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5ac8bdf6-08a8-4e7b-8c63-00f77f22f1c4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1341885542" status: 200 len: 485 microversion: 2.1 time: 0.158388 Nov 02 12:27:22.262814 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 967/1870] 10.222.0.45 () {58 vars in 1231 bytes} [Wed Nov 2 12:27:22 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1341885542 => generated 485 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:22.274243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:22.275165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:22.289923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:22.297187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:22.298928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:22.302128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:22.304040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:22.305755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:22.876757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:22.890503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:22.894966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:22.897833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aeff9ba3-4b62-4ff9-b90c-65ed6283efed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.951208 Nov 02 12:27:22.920478 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 904/1871] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:21 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:22.930667 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-04f297e9-275b-4af2-97e3-6980412fab95 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1533 microversion: 2.1 time: 0.658659 Nov 02 12:27:22.931367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c8853ee-285a-4007-991b-6dd078adee42 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e73ad30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:22.936988 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 968/1872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:22 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1533 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:22.989071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1466c841-ed2d-4065-b970-2924716558bb tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:22.994596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1466c841-ed2d-4065-b970-2924716558bb tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:22.995448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1466c841-ed2d-4065-b970-2924716558bb tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:22.996205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1466c841-ed2d-4065-b970-2924716558bb tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:22.997484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1466c841-ed2d-4065-b970-2924716558bb tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:22.998323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1466c841-ed2d-4065-b970-2924716558bb tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:22.999613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1466c841-ed2d-4065-b970-2924716558bb tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:23.045430 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1466c841-ed2d-4065-b970-2924716558bb tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064104 Nov 02 12:27:23.059283 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 969/1873] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 12:27:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:23.068649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855650-5", "block_migration": false, "disk_over_commit": false}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:23.072738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:23.083867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:23.085012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:23.086051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:23.087564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:23.098124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:23.099895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:23.145483 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c8853ee-285a-4007-991b-6dd078adee42 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images?server=73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 957 microversion: 2.1 time: 0.223677 Nov 02 12:27:23.146386 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 905/1874] 10.222.0.45 () {58 vars in 1209 bytes} [Wed Nov 2 12:27:22 2022] GET /compute/v2.1/images?server=73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 957 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:23.163366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:23.167172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:23.190168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:23.190692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:23.191152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:23.194219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:23.194767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:23.195269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:23.212741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lazy-loading 'flavor' on Instance uuid ed050eff-b84c-4742-adf2-5e7437f8c1a7 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:23.266275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Going to try to live migrate instance to n-h2-855650-5 {{(pid=120723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:27:23.661268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:23.681094 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bc8a11fd-2831-49a0-8c54-95ddcb8c536b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.527247 Nov 02 12:27:23.683818 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 906/1875] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:23 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:23.695342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-014c1880-9978-4866-bdaa-6022cc1fd9da tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228ed8a1f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:23.817621 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-014c1880-9978-4866-bdaa-6022cc1fd9da tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fv2.1%2Fservers%2Fcd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 485 microversion: 2.1 time: 0.131111 Nov 02 12:27:23.818993 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 907/1876] 10.222.0.45 () {58 vars in 1317 bytes} [Wed Nov 2 12:27:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fv2.1%2Fservers%2Fcd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 485 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:24.121268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d9401a7-6e34-4551-9698-2be78599da29 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Calling method '.version_select at 0x7f228e520820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:24.126386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d9401a7-6e34-4551-9698-2be78599da29 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:24.127558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d9401a7-6e34-4551-9698-2be78599da29 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:24.128341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d9401a7-6e34-4551-9698-2be78599da29 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:24.130308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d9401a7-6e34-4551-9698-2be78599da29 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:24.132067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d9401a7-6e34-4551-9698-2be78599da29 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:24.132762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d9401a7-6e34-4551-9698-2be78599da29 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:24.171799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d9401a7-6e34-4551-9698-2be78599da29 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.348344 Nov 02 12:27:24.173307 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 908/1877] 10.222.0.45 () {58 vars in 1128 bytes} [Wed Nov 2 12:27:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:24.181786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3eab6e2e-01bb-41a6-9f24-ceff7f25d81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8c7dc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:24.258326 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3eab6e2e-01bb-41a6-9f24-ceff7f25d81e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fservers%2Fcd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 485 microversion: 2.1 time: 0.083626 Nov 02 12:27:24.259317 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 909/1878] 10.222.0.45 () {58 vars in 1303 bytes} [Wed Nov 2 12:27:24 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fservers%2Fcd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 485 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:24.386636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1734092620", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "fcc8bd62-cefc-49b7-bf94-3895bd70eb34"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:24.475483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] validate_networks() for [('fcc8bd62-cefc-49b7-bf94-3895bd70eb34', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:27:25.057125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:27:25.057940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:27:25.059327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:27:25.059953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:27:25.060738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:27:25.075532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:25.076704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:25.077415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:25.078431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:25.079556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:25.080242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:25.104958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Getting quotas for project a46439c7bf424cb1961085f610858688. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:27:25.111851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Getting quotas for user 5def23f73ff644cb8a7625a128b58b73 and project a46439c7bf424cb1961085f610858688. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:27:25.127711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:27:25.130752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:27:25.236710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3137f286-b7ec-4cc0-b574-2db58a0e6c12 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976185 Nov 02 12:27:25.241318 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 910/1879] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:27:25.259731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:25.260667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:25.270103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:25.270703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:25.271221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:25.272315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:25.273095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:25.273520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:25.497281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:25.509379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:25.515870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:25.523327 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-74d3bb3a-fa65-4f05-98c3-0d213660d0e4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.278831 Nov 02 12:27:25.525578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 911/1880] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:25 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:25.538158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6df2533b-da40-4bb4-8223-0680ee99d67d tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Calling method '.version_select at 0x7f228e759700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:25.557723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df2533b-da40-4bb4-8223-0680ee99d67d tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:25.560895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df2533b-da40-4bb4-8223-0680ee99d67d tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:25.564624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df2533b-da40-4bb4-8223-0680ee99d67d tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:25.566024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df2533b-da40-4bb4-8223-0680ee99d67d tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:25.568474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df2533b-da40-4bb4-8223-0680ee99d67d tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:25.569626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6df2533b-da40-4bb4-8223-0680ee99d67d tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:25.638656 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6df2533b-da40-4bb4-8223-0680ee99d67d tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.111306 Nov 02 12:27:25.639486 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 912/1881] 10.222.0.45 () {58 vars in 1139 bytes} [Wed Nov 2 12:27:25 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:25.647028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7fe0c9c6-fcce-42b0-bfef-67df10094e9e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e507280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:25.885378 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7fe0c9c6-fcce-42b0-bfef-67df10094e9e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.241765 Nov 02 12:27:25.886210 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 913/1882] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:27:25 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:25.893107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:25.894243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:25.904313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:25.904905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:25.905900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:25.906848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:25.908364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:25.908990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.164487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:26.175442 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fb9b7e5-8247-48b2-b2f0-b52f8dc91045 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.288140 Nov 02 12:27:26.179304 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 914/1883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:25 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:26.186622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2c4e4ef2-1913-4045-b8cc-b062efc023ee req-6f911360-f1a2-4624-a822-3b6054dfa279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f4ff71-fa75-4ac9-9661-ebb7bbc3995f", "name": "network-vif-unplugged", "status": "completed", "tag": "9d585ce4-7020-4e3d-b408-02a183917027"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:26.200384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2c4e4ef2-1913-4045-b8cc-b062efc023ee req-6f911360-f1a2-4624-a822-3b6054dfa279 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.201276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2c4e4ef2-1913-4045-b8cc-b062efc023ee req-6f911360-f1a2-4624-a822-3b6054dfa279 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.202747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2c4e4ef2-1913-4045-b8cc-b062efc023ee req-6f911360-f1a2-4624-a822-3b6054dfa279 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.216221 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2c4e4ef2-1913-4045-b8cc-b062efc023ee req-6f911360-f1a2-4624-a822-3b6054dfa279 service nova] Creating event network-vif-unplugged:9d585ce4-7020-4e3d-b408-02a183917027 for instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f on n-h1-855650-5 Nov 02 12:27:26.228166 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2c4e4ef2-1913-4045-b8cc-b062efc023ee req-6f911360-f1a2-4624-a822-3b6054dfa279 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046802 Nov 02 12:27:26.229388 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 915/1884] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:26.236458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:26.238683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:26.248859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.249625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.251349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.252359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.252877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.253340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.359905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:26.370781 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-669a8223-c21c-4669-bbc5-720412a46b34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1214 microversion: 2.1 time: 0.139860 Nov 02 12:27:26.379247 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 916/1885] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:26 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:26.399468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3088fd22-8366-40fd-b3f2-e30bb3b07b23 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Calling method '.version_select at 0x7f228e6f3ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:26.403742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3088fd22-8366-40fd-b3f2-e30bb3b07b23 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.404724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3088fd22-8366-40fd-b3f2-e30bb3b07b23 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.406003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3088fd22-8366-40fd-b3f2-e30bb3b07b23 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.407161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3088fd22-8366-40fd-b3f2-e30bb3b07b23 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.409036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3088fd22-8366-40fd-b3f2-e30bb3b07b23 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.409722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3088fd22-8366-40fd-b3f2-e30bb3b07b23 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.444236 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3088fd22-8366-40fd-b3f2-e30bb3b07b23 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.063723 Nov 02 12:27:26.444869 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 917/1886] 10.222.0.45 () {58 vars in 1145 bytes} [Wed Nov 2 12:27:26 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:27:26.451512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-141daf6f-86ed-4899-b9ba-65297ec33fa0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8c7820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:26.527547 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-141daf6f-86ed-4899-b9ba-65297ec33fa0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.081580 Nov 02 12:27:26.528523 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 918/1887] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:27:26 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:26.533523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f5bef1b-a8b6-4d6a-9cee-27125d0d09ea tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Calling method '.version_select at 0x7f228ebfaf70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:26.539184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f5bef1b-a8b6-4d6a-9cee-27125d0d09ea tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.540077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f5bef1b-a8b6-4d6a-9cee-27125d0d09ea tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.541018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f5bef1b-a8b6-4d6a-9cee-27125d0d09ea tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.543067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f5bef1b-a8b6-4d6a-9cee-27125d0d09ea tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.543854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f5bef1b-a8b6-4d6a-9cee-27125d0d09ea tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.545009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f5bef1b-a8b6-4d6a-9cee-27125d0d09ea tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.579241 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f5bef1b-a8b6-4d6a-9cee-27125d0d09ea tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.049365 Nov 02 12:27:26.580121 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 919/1888] 10.222.0.45 () {58 vars in 1128 bytes} [Wed Nov 2 12:27:26 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:26.592092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec27db9a-644c-406d-8ff7-290cd21a4680 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e635700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:26.676522 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec27db9a-644c-406d-8ff7-290cd21a4680 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.094909 Nov 02 12:27:26.687901 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 920/1889] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:27:26 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:26.689849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:26.690782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:26.705508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.706200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.706918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.708020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.708580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.710823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.023122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:27.038592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:27.042608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:27.045280 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c92b9050-b293-40ee-aabf-bc91ffc56cd7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.363909 Nov 02 12:27:27.051711 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 921/1890] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:26 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:27.058125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b0e7703-1aa7-4422-8a56-ccbe8e794c80 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Calling method '.version_select at 0x7f228ebfadc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.067599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b0e7703-1aa7-4422-8a56-ccbe8e794c80 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.069756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b0e7703-1aa7-4422-8a56-ccbe8e794c80 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.070099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b0e7703-1aa7-4422-8a56-ccbe8e794c80 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.072745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b0e7703-1aa7-4422-8a56-ccbe8e794c80 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.076204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b0e7703-1aa7-4422-8a56-ccbe8e794c80 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.076984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b0e7703-1aa7-4422-8a56-ccbe8e794c80 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.120146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b0e7703-1aa7-4422-8a56-ccbe8e794c80 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.067184 Nov 02 12:27:27.132749 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 922/1891] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:27.138358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f131bf75-a713-4cc1-8985-2ac901a701d6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eb4e9d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.261697 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f131bf75-a713-4cc1-8985-2ac901a701d6 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/detail?changes-since=2022-11-02T12%3A24%3A24Z" status: 200 len: 6334 microversion: 2.1 time: 0.127638 Nov 02 12:27:27.274374 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 923/1892] 10.222.0.45 () {58 vars in 1220 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-02T12%3A24%3A24Z => generated 6334 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:27.282461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-97a450a1-5394-4a13-a368-0d9947997481 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Calling method '.version_select at 0x7f228e6c0f70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.286577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97a450a1-5394-4a13-a368-0d9947997481 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.287371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97a450a1-5394-4a13-a368-0d9947997481 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.288057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97a450a1-5394-4a13-a368-0d9947997481 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.289039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97a450a1-5394-4a13-a368-0d9947997481 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.289709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97a450a1-5394-4a13-a368-0d9947997481 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.291113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97a450a1-5394-4a13-a368-0d9947997481 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.317864 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-97a450a1-5394-4a13-a368-0d9947997481 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.042075 Nov 02 12:27:27.318876 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 924/1893] 10.222.0.45 () {58 vars in 1128 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:27.329520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.330522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:27.337167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.338068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.338757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.339720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.340450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.341139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.541743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:27.553301 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-790f17d7-1fa5-4c76-bddc-fd54db4021a4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.227635 Nov 02 12:27:27.553893 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 925/1894] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:27.563904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df0cab52-b581-4f15-8ff5-36e244ec51d4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228efa29d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.627249 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df0cab52-b581-4f15-8ff5-36e244ec51d4 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1341885542" status: 200 len: 665 microversion: 2.1 time: 0.071784 Nov 02 12:27:27.628595 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 926/1895] 10.222.0.45 () {58 vars in 1252 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1341885542 => generated 665 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:27.635222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-afae0aac-67d4-4084-9f80-f32727012680 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Calling method '.version_select at 0x7f228e635d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.646840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae0aac-67d4-4084-9f80-f32727012680 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.647927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae0aac-67d4-4084-9f80-f32727012680 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.648719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae0aac-67d4-4084-9f80-f32727012680 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.670646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae0aac-67d4-4084-9f80-f32727012680 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.672774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae0aac-67d4-4084-9f80-f32727012680 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.673773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afae0aac-67d4-4084-9f80-f32727012680 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.710096 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-afae0aac-67d4-4084-9f80-f32727012680 tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-h1-855650-5" status: 200 len: 860 microversion: 2.1 time: 0.079850 Nov 02 12:27:27.711410 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 927/1896] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/os-hosts/n-h1-855650-5 => generated 860 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:27.719230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.720210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:27.728321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.729254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.729983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.731719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.732483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.734364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.777818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:27.850297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:27.860958 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40775473-de63-410e-b18c-dead65caa244 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1270 microversion: 2.1 time: 0.148193 Nov 02 12:27:27.861915 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 928/1897] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:27.875533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3011c539-3240-4f70-906b-5e2ebe270b32 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e776040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.965232 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3011c539-3240-4f70-906b-5e2ebe270b32 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fv2.1%2Fservers%2Fcd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1467 microversion: 2.1 time: 0.094752 Nov 02 12:27:27.966136 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 929/1898] 10.222.0.45 () {58 vars in 1338 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fv2.1%2Fservers%2Fcd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1467 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:27.982228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6512b84d-4137-4203-a28b-ce3d1619a47c tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Calling method '.version_select at 0x7f228e8b3670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.994414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6512b84d-4137-4203-a28b-ce3d1619a47c tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.995381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6512b84d-4137-4203-a28b-ce3d1619a47c tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.996110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6512b84d-4137-4203-a28b-ce3d1619a47c tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:28.026450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6512b84d-4137-4203-a28b-ce3d1619a47c tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:28.029809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6512b84d-4137-4203-a28b-ce3d1619a47c tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:28.030922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6512b84d-4137-4203-a28b-ce3d1619a47c tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:28.067215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6512b84d-4137-4203-a28b-ce3d1619a47c tempest-HostsAdminTestJSON-379192712 tempest-HostsAdminTestJSON-379192712-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-h2-855650-5" status: 200 len: 729 microversion: 2.1 time: 0.097959 Nov 02 12:27:28.068944 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 930/1899] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/os-hosts/n-h2-855650-5 => generated 729 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:28.074893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-49d163de-2101-4acd-b7b6-390e29cf8484 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e4d2d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:28.157822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-49d163de-2101-4acd-b7b6-390e29cf8484 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fservers%2Fcd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1467 microversion: 2.1 time: 0.087296 Nov 02 12:27:28.158471 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 931/1900] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Nov 2 12:27:28 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fservers%2Fcd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1467 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:28.173106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:28.174445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:28.194033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:28.194781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:28.195452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:28.196384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:28.196844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:28.197287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:28.590426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:28.601524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:28.604958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:28.608374 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-58d48976-bb43-4a2f-9eed-308117df1983 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.445171 Nov 02 12:27:28.610972 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 932/1901] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:28 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:28.621709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea36355d-e1be-4fd8-832b-c0b8ff90e755 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228efa6af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:28.739713 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea36355d-e1be-4fd8-832b-c0b8ff90e755 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.124426 Nov 02 12:27:28.741002 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 933/1902] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Nov 2 12:27:28 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:28.771438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:28.772136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:28.778778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:28.779280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:28.784320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:28.785224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:28.785717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:28.786220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:29.113913 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-70936b82-0a00-4314-a3c3-99313ab640a6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7/action" status: 202 len: 0 microversion: 2.1 time: 6.052654 Nov 02 12:27:29.114958 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 970/1903] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:27:23 2022] POST /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7/action => generated 0 bytes in 6055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:27:29.122186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82996dad-01a4-4a89-b6c6-877d5fc2eac0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eed7790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:29.234400 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-82996dad-01a4-4a89-b6c6-877d5fc2eac0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.117376 Nov 02 12:27:29.236128 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 971/1904] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Nov 2 12:27:29 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:29.242430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:29.243387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:29.263019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:29.263834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:29.266518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:29.267964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:29.268714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:29.270169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:29.276035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:29.475009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:29.494017 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-47fb0db5-ace8-4f9f-8dc4-f5b9a17b9639 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1276 microversion: 2.1 time: 0.255930 Nov 02 12:27:29.497592 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 972/1905] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:29 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:29.502837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:29.511582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a3f864c-9e11-45e3-8e58-eafeb2152fa7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.766983 Nov 02 12:27:29.513905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:29.515420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:29.524856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:29.525775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:29.527477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:29.529815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:29.531302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:29.532070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:29.539304 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 934/1906] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:28 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:29.546296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f0e10c9-8892-4c3c-8674-f1279264150e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228ef41ee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:29.628566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f0e10c9-8892-4c3c-8674-f1279264150e tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/5a18a9e9-495a-4970-9f7b-124577e0709a" status: 200 len: 784 microversion: 2.1 time: 0.087745 Nov 02 12:27:29.630153 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 935/1907] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:27:29 2022] GET /compute/v2.1/images/5a18a9e9-495a-4970-9f7b-124577e0709a => generated 784 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:29.643275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:29.644626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:29.655601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:29.657512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:29.658119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:29.659389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:29.660103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:29.662418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:30.143108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:30.160904 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-29dbfc8d-58cc-46c6-9b4e-d97b22b7398a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.657679 Nov 02 12:27:30.163174 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 973/1908] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:29 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:30.170202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:30.175084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3435b6e1-2194-447a-9904-a49d710173d9 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228edfa430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:30.188036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:30.190437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:30.192111 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d290412-905c-4204-b5b6-5319da121963 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.556046 Nov 02 12:27:30.198976 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 936/1909] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:29 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:30.204419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:30.204940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:30.228601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:30.228954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:30.229407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:30.232910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:30.234219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:30.234713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:30.275823 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3435b6e1-2194-447a-9904-a49d710173d9 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.111129 Nov 02 12:27:30.282103 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 974/1910] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:27:30 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:30.290685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:27:30.298475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a9ae77e-46b8-407f-92a0-200ee087f712 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228edd6f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:30.593548 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bbc0eabe-92d9-43f6-96ab-23a0ad97624f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "DELETE /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 204 len: 0 microversion: 2.1 time: 0.391722 Nov 02 12:27:30.594205 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 937/1911] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:27:30 2022] DELETE /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:27:30.616679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:30.617110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:30.633907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:30.634656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:30.634867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:30.636000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:30.636662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:30.637267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:30.981696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:30.993012 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11674ea9-f0ef-495a-bfd8-e8bc53a8decc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1318 microversion: 2.1 time: 0.397160 Nov 02 12:27:30.993221 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 938/1912] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:30 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:31.003946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:31.004820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:31.029377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.038289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.039047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.045075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.045667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.048377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.400522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:31.421534 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c221485-88f0-4d44-b069-e6ca21bf862f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.426637 Nov 02 12:27:31.424388 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 939/1913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:30 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:31.443120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:31.447874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:31.460280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:31.475280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.476797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.477654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.480843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.485377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.486624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.790808 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a9ae77e-46b8-407f-92a0-200ee087f712 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "DELETE /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680" status: 204 len: 0 microversion: 2.1 time: 1.497502 Nov 02 12:27:31.791704 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 975/1914] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:30 2022] DELETE /compute/v2.1/images/efa6df69-6c15-4ca9-b220-a4ea6dda6680 => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:27:31.803701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:31.804898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:31.819826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.820714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.821363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.826989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.827970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.828630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.848112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:31.862089 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-657bea80-b516-4a13-baf2-d60384c4e48b tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1664 microversion: 2.1 time: 0.436243 Nov 02 12:27:31.866220 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 940/1915] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:31 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1664 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:31.871691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:31.873094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:31.895728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.896492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.897436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.897817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.904105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.904589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:32.366196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:32.399380 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d2ed398d-d6af-4836-9a8f-3d7951b36b64 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.606227 Nov 02 12:27:32.401112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:32.404262 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 976/1916] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:31 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:32.423189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6f93af1f-c9a8-4efb-8181-7b1a3408e132 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eed7280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:32.443341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:32.444840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:32.446230 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfff23e2-a673-4897-ad32-e0cf9694b834 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.578599 Nov 02 12:27:32.454917 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 941/1917] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:31 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:32.454917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:32.455257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:32.467209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:32.472563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:32.473336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:32.474346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:32.475018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:32.475688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:32.774046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:32.792873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04052af9-96fb-49a8-893b-8e29d6191445 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1318 microversion: 2.1 time: 0.344543 Nov 02 12:27:32.798084 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 942/1918] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:32 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:32.807234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:32.808646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:32.824325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:32.825654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:32.827850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:32.833193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:32.834081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:32.835262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:33.013157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:33.177448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:33.187913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c2c791c-bdde-4330-89ec-3493360dfe9f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.388304 Nov 02 12:27:33.194883 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 943/1919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:32 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:33.220961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:33.221885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:33.233895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:33.250585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:33.251326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:33.252167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:33.252763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:33.253319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:33.978084 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6f93af1f-c9a8-4efb-8181-7b1a3408e132 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "DELETE /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833" status: 204 len: 0 microversion: 2.1 time: 1.568516 Nov 02 12:27:33.978691 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 977/1920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:32 2022] DELETE /compute/v2.1/images/cb134b99-aeea-4507-b9f8-bb89bd7fd833 => generated 0 bytes in 1572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:27:33.984757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:33.985732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:34.019530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:34.031655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:34.040209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:34.041527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:34.045127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:34.045700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:34.046221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:34.050475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-400cb66d-7277-4337-bd8d-50ea8cbc6625 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1664 microversion: 2.1 time: 0.853298 Nov 02 12:27:34.054879 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 944/1921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:33 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1664 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:34.060752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:34.068156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:34.087958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:34.090763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:34.091467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:34.098200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:34.098995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:34.099658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:35.122289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:35.196712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:35.215588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:35.217859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:35.225246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1eb05ace-9476-4e49-835c-5e21ef2d8080 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 1.168535 Nov 02 12:27:35.232441 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 945/1922] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:34 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:35.257662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:35.258315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:35.289922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:35.293919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:35.296880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:35.300024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:35.300668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:35.304152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:35.565207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:35.591855 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6ec283ac-1506-44a9-9744-e4d7ee24bff7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 1.611405 Nov 02 12:27:35.594904 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 978/1923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:33 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:35.686411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65366fe2-7a44-44cd-af28-92add71952b1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228eed7040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:36.537447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:36.547117 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0eeeff29-70d7-4f45-86d4-935b641bbc1c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1318 microversion: 2.1 time: 1.313022 Nov 02 12:27:36.553228 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 946/1924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:35 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1318 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:36.558751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:36.570667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:36.589080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:36.589616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:36.591403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:36.598073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:36.600739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:36.602530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:36.672941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:36.976221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:36.989849 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e164f5a1-f83d-464d-9094-b1eb683c7f03 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.435013 Nov 02 12:27:36.991285 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 947/1925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:36 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:36.998594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6e901190-64ef-4392-8dcf-c6b970822638 req-d1c75462-89ac-4cba-ba1c-c19f53a48cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d9a48d-0d18-4480-a9ae-708b657762df", "tag": "796b559d-cae0-4c63-b9bc-bda8fc24354a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:37.011040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e901190-64ef-4392-8dcf-c6b970822638 req-d1c75462-89ac-4cba-ba1c-c19f53a48cd5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.012141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e901190-64ef-4392-8dcf-c6b970822638 req-d1c75462-89ac-4cba-ba1c-c19f53a48cd5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.012888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e901190-64ef-4392-8dcf-c6b970822638 req-d1c75462-89ac-4cba-ba1c-c19f53a48cd5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:37.028501 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6e901190-64ef-4392-8dcf-c6b970822638 req-d1c75462-89ac-4cba-ba1c-c19f53a48cd5 service nova] Creating event network-changed:796b559d-cae0-4c63-b9bc-bda8fc24354a for instance 40d9a48d-0d18-4480-a9ae-708b657762df on n-h1-855650-5 Nov 02 12:27:37.044009 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6e901190-64ef-4392-8dcf-c6b970822638 req-d1c75462-89ac-4cba-ba1c-c19f53a48cd5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049592 Nov 02 12:27:37.045919 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 948/1926] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:37.069647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:37.070627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:37.083498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.094809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.096332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:37.098551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.099791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.101761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:37.303556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=14 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:37.397342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:37.439087 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f098ef8-f50e-4611-ba7e-4084eff6ee6f tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1596 microversion: 2.1 time: 0.381675 Nov 02 12:27:37.442001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 949/1927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:37 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1596 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:37.460271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3a4865c2-d956-48e5-9edf-be147a1188e8 req-10dc48b2-d2ca-476a-8212-9871502701a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49054040-b35d-4bc1-9fb7-a8da8b84319c", "name": "network-vif-plugged", "status": "completed", "tag": "bfb0b3e1-ba60-40e5-bdbb-316e361033a0"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:37.541433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3a4865c2-d956-48e5-9edf-be147a1188e8 req-10dc48b2-d2ca-476a-8212-9871502701a5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.546124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3a4865c2-d956-48e5-9edf-be147a1188e8 req-10dc48b2-d2ca-476a-8212-9871502701a5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.549340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3a4865c2-d956-48e5-9edf-be147a1188e8 req-10dc48b2-d2ca-476a-8212-9871502701a5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:37.623995 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3a4865c2-d956-48e5-9edf-be147a1188e8 req-10dc48b2-d2ca-476a-8212-9871502701a5 service nova] Creating event network-vif-plugged:bfb0b3e1-ba60-40e5-bdbb-316e361033a0 for instance 49054040-b35d-4bc1-9fb7-a8da8b84319c on n-h2-855650-5 Nov 02 12:27:37.651207 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3a4865c2-d956-48e5-9edf-be147a1188e8 req-10dc48b2-d2ca-476a-8212-9871502701a5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206538 Nov 02 12:27:37.654371 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 950/1928] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:37.671328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:37.674573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:37.724955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.729574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.730944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:37.736021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.739815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.741812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:37.836325 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65366fe2-7a44-44cd-af28-92add71952b1 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "DELETE /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e" status: 204 len: 0 microversion: 2.1 time: 2.189553 Nov 02 12:27:37.838343 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 979/1929] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:35 2022] DELETE /compute/v2.1/images/5ffecb4c-5c89-497b-9cda-55163cb3f16e => generated 0 bytes in 2243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:27:37.854018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:37.857146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:37.882958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.885252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.890274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:37.895849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.897081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.898909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:38.477831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:38.514664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:38.522921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:38.525823 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d2118d4-9937-44d3-ac3b-a7278c91a52a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.866946 Nov 02 12:27:38.547014 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 951/1930] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:37 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:38.563510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:38.568863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:38.584184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:38.585659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:38.589763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:38.590977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:38.594977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:38.596167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:38.598073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:38.628129 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-490061b1-701a-4903-8bbe-51dc66d1c3a6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.786648 Nov 02 12:27:38.630225 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 980/1931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:37 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:39.035266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:39.054152 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8497f4d0-219b-49f3-8e15-7e7e066fbc46 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1318 microversion: 2.1 time: 0.497118 Nov 02 12:27:39.070014 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 952/1932] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:38 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:39.070014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:39.070014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:39.084183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:39.087439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:39.090319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:39.091329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:39.092919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:39.095864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:39.173131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-278631053", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:39.182274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:27:39.210450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=5 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:39.396469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:27:39.468741 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82ae32cc-804a-4987-87e9-83a833bc743c tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 204 len: 0 microversion: 2.1 time: 0.410348 Nov 02 12:27:39.470995 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 953/1933] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:27:39 2022] DELETE /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:27:39.489407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:39.491591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:39.507981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:39.509399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:39.511031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:39.512935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:39.516062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:39.517449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.027126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:40.044870 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9115b653-07b8-4b9a-917a-f3edd6f63ce4 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1313 microversion: 2.1 time: 0.570961 Nov 02 12:27:40.050901 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 954/1934] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:39 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:40.072367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:40.073504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:40.089257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.093474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:27:40.094263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:27:40.094967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:27:40.095624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:27:40.096553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:27:40.100546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.104744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.106347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.114529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.117091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.121285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.122209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.122901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.125010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.125824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.126478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.167957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:27:40.178969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for user a5a3010848f74c94bb32b506e184d275 and project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:27:40.208932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:27:40.214430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:27:40.269389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.273437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.276540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.280456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lazy-loading 'fault' on Instance uuid 24d49e5e-9685-40ff-8809-82f6164edf54 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:40.362263 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d15cda5e-10db-4070-a2ac-9b3403ad8188 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.725498 Nov 02 12:27:40.364044 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 981/1935] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:27:40.381171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9f1405a9-dae2-4286-b663-7cdfd1d5e610 req-d7f4a07f-75d5-4f7f-8783-0a2974894fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d49e5e-9685-40ff-8809-82f6164edf54", "name": "network-vif-deleted", "tag": "f9b01e21-de84-46e4-b5e7-8f2972efa454"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:40.417096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9f1405a9-dae2-4286-b663-7cdfd1d5e610 req-d7f4a07f-75d5-4f7f-8783-0a2974894fd2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.418521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9f1405a9-dae2-4286-b663-7cdfd1d5e610 req-d7f4a07f-75d5-4f7f-8783-0a2974894fd2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.423158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9f1405a9-dae2-4286-b663-7cdfd1d5e610 req-d7f4a07f-75d5-4f7f-8783-0a2974894fd2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.449930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:40.470291 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9f1405a9-dae2-4286-b663-7cdfd1d5e610 req-d7f4a07f-75d5-4f7f-8783-0a2974894fd2 service nova] Creating event network-vif-deleted:f9b01e21-de84-46e4-b5e7-8f2972efa454 for instance 24d49e5e-9685-40ff-8809-82f6164edf54 on n-h1-855650-5 Nov 02 12:27:40.471521 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62fc614d-1175-4194-95d0-695980ea0256 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1315 microversion: 2.1 time: 0.416378 Nov 02 12:27:40.473916 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 955/1936] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:40 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:40.490845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:40.491901 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9f1405a9-dae2-4286-b663-7cdfd1d5e610 req-d7f4a07f-75d5-4f7f-8783-0a2974894fd2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120243 Nov 02 12:27:40.493892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:40.494379 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 982/1937] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:40.515159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:40.518622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:40.522422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.524646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.526820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.530588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.532403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.534291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.541271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.544145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.547540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.550916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.554526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.557048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:41.084600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:41.104685 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f14d404d-bfe2-4faa-a0b1-1b2c44d593fa tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1473 microversion: 2.1 time: 0.629303 Nov 02 12:27:41.126477 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 956/1938] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:40 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1473 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:41.144956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:41.145748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:41.171854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:41.176000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:41.177800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:41.183467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:41.184098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:41.188745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:41.294528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:41.314496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:41.335532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:41.336811 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d405a66-ab9e-4e6f-a27c-345a3f89e104 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.839796 Nov 02 12:27:41.337481 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 983/1939] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:40 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:41.356019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6d5af758-2930-48bd-a5bc-ca1282df6201 req-d6113c15-dc94-476b-a966-8a12bbb072b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3", "name": "network-vif-plugged", "status": "completed", "tag": "505fabd6-494c-45db-a08c-cb6834eec257"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:41.401699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d5af758-2930-48bd-a5bc-ca1282df6201 req-d6113c15-dc94-476b-a966-8a12bbb072b8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:41.402605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d5af758-2930-48bd-a5bc-ca1282df6201 req-d6113c15-dc94-476b-a966-8a12bbb072b8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:41.403399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d5af758-2930-48bd-a5bc-ca1282df6201 req-d6113c15-dc94-476b-a966-8a12bbb072b8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:41.448303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6d5af758-2930-48bd-a5bc-ca1282df6201 req-d6113c15-dc94-476b-a966-8a12bbb072b8 service nova] Creating event network-vif-plugged:505fabd6-494c-45db-a08c-cb6834eec257 for instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 on n-h2-855650-5 Nov 02 12:27:41.455490 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6d5af758-2930-48bd-a5bc-ca1282df6201 req-d6113c15-dc94-476b-a966-8a12bbb072b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115876 Nov 02 12:27:41.457312 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 984/1940] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:41.472001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:41.481142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:41.498678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:41.500064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:41.501359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:41.503032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:41.504438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:41.505580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:41.593899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:41.616505 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a6e8932e-3662-4f6b-b914-5e8e2bc164a2 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.485569 Nov 02 12:27:41.635635 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 957/1941] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:41 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:41.644815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:41.646538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:41.660848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:41.662409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:41.663252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:41.665037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:41.667386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:41.679775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.044455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:42.068070 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-87814171-79ae-41da-8a84-306c5a7ffc02 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1216 microversion: 2.1 time: 0.430733 Nov 02 12:27:42.068750 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 958/1942] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:41 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1216 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:42.104067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:42.105067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:42.123843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.124354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.124808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.128922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.129816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.130344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.179768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:42.247637 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d595a990-5bd7-418b-9bcc-bfed2076af0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1318 microversion: 2.1 time: 0.787686 Nov 02 12:27:42.274028 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 985/1943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:41 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:42.299878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:42.300875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:42.324941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.325455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.340380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.342413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.361904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.362534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.468549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.471784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.474686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.477161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lazy-loading 'fault' on Instance uuid 24d49e5e-9685-40ff-8809-82f6164edf54 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:42.700452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472cce6768a84038add872ae224bc616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c380c0d895194a59a3bc3cced29e022a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:42.736302 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5957cf8b-26d4-4fcb-8b46-8c83cf4e75d8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 200 len: 1315 microversion: 2.1 time: 0.459062 Nov 02 12:27:42.739789 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 986/1944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:42 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:42.771700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:42.781407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:42.807428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.811641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.812228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.823406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.824027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.826919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:43.128562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:43.169198 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66403a3c-7f50-4d63-8426-8827b09a4672 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1498 microversion: 2.1 time: 1.096180 Nov 02 12:27:43.176577 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 959/1945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:42 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1498 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:43.195250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:43.204851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:43.228920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:43.228920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:43.228920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:43.231416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:43.231416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:43.231416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:43.774133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:43.891757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:43.907932 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c4b591a-36a3-44c4-bf95-06e012edf2a0 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1473 microversion: 2.1 time: 1.165508 Nov 02 12:27:43.918793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 987/1946] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:42 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1473 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:43.958480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:43.966421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:43.969164 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43d8b497-f3ea-4b4d-b048-ba6a3fd93718 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1280 microversion: 2.25 time: 0.790206 Nov 02 12:27:43.980702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:43.981612 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 960/1947] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:43 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1280 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:43.991688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:44.009733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:44.012444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:44.014004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:44.017343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:44.018805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:44.020263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:44.086579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:44.087898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:44.139006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:44.139938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:44.140417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:44.141777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:44.142843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:44.143461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:44.575868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:44.596338 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-452e598a-c8fb-491f-820b-11a9d1ecc915 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1272 microversion: 2.1 time: 0.556253 Nov 02 12:27:44.600137 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 961/1948] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:44 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1272 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:44.617886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:44.630832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:44.657324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:44.663148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:44.664778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:44.667463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:44.672439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:44.674038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:44.730852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lazy-loading 'flavor' on Instance uuid 49054040-b35d-4bc1-9fb7-a8da8b84319c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:44.963992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:45.012704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:45.040884 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cc0a33f7-2537-4684-8ef1-f3a4d6eaf020 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 1.097154 Nov 02 12:27:45.052263 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 988/1949] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:43 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:45.112165 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5acc0d95-589f-478b-a201-bb498be19e9c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "POST /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c/action" status: 200 len: 32 microversion: 2.1 time: 0.509425 Nov 02 12:27:45.114286 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 962/1950] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:27:44 2022] POST /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c/action => generated 32 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:27:45.114607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:45.116470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:45.140821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:45.144327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] [instance: 24d49e5e-9685-40ff-8809-82f6164edf54] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:45.164434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.168659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.171812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.172065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.173340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.173553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.174701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.175580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.176104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.177185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.178116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.179591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.228321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] HTTP exception thrown: Instance 24d49e5e-9685-40ff-8809-82f6164edf54 could not be found. Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Request method failure captured: Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 HTTP/1.1 Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmGktL7lP8ShuqHLsskhJp0OsYLyOG6QrzZSBickWmE94ymOHSl0r7Zh8iK1c53BGXKWRBJHGq9hfb1zLUMBt4GIQfzR5k9GQARn4uH5O193MNoDMBbGVhCDgEhY4jo7WLhMLcWmN4bhf5BrKfdhWvjGmYShDB2u0-sStq5XxJdlDSs Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c380c0d895194a59a3bc3cced29e022a Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersTestFqdnHostnames-1505329028 Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c380c0d895194a59a3bc3cced29e022a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c380c0d895194a59a3bc3cced29e022a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c380c0d895194a59a3bc3cced29e022a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c380c0d895194a59a3bc3cced29e022a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersTestFqdnHostnames-1505329028 Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c380c0d895194a59a3bc3cced29e022a Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1505329028 Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersTestFqdnHostnames-1505329028-project Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 472cce6768a84038add872ae224bc616 Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersTestFqdnHostnames-1505329028-project Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 24d49e5e-9685-40ff-8809-82f6164edf54 could not be found. Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '24d49e5e-9685-40ff-8809-82f6164edf54'} Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d49e5e-9685-40ff-8809-82f6164edf54 could not be found. Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d49e5e-9685-40ff-8809-82f6164edf54 could not be found. Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:45.237829 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d49e5e-9685-40ff-8809-82f6164edf54 could not be found. Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Returning 404 to user: Instance 24d49e5e-9685-40ff-8809-82f6164edf54 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:45.243754 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9aba076-ca68-45f5-80c1-1a4131b601b8 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54" status: 404 len: 111 microversion: 2.1 time: 0.125505 Nov 02 12:27:45.245130 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 963/1951] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:45 2022] GET /compute/v2.1/servers/24d49e5e-9685-40ff-8809-82f6164edf54 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:27:45.259168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:45.267501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:45.277357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.281638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.282460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.283531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.286811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.287603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.492343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.516517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.522395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.522956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lazy-loading 'fault' on Instance uuid cd0838ca-34c6-4d78-8d26-ce67982c4c7b {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:45.708881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:45.757738 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba27cbd6-4774-4266-8cd1-8531cd8a9417 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 200 len: 1307 microversion: 2.1 time: 0.508699 Nov 02 12:27:45.762923 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 964/1952] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:45 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 1307 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:45.775169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c359bbe6-c19c-4aab-810d-ae6c1ebfb910 req-1a279a9a-e1d9-4d82-8849-d6dfc9a51630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0838ca-34c6-4d78-8d26-ce67982c4c7b", "name": "network-vif-deleted", "tag": "68072907-6547-4e2b-8fb7-0c95d853ce3e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:45.823065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c359bbe6-c19c-4aab-810d-ae6c1ebfb910 req-1a279a9a-e1d9-4d82-8849-d6dfc9a51630 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.824454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c359bbe6-c19c-4aab-810d-ae6c1ebfb910 req-1a279a9a-e1d9-4d82-8849-d6dfc9a51630 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.825814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:45.826971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c359bbe6-c19c-4aab-810d-ae6c1ebfb910 req-1a279a9a-e1d9-4d82-8849-d6dfc9a51630 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.840058 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6434287f-a037-4d72-9f62-de6b456df8a6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1318 microversion: 2.1 time: 0.783358 Nov 02 12:27:45.841397 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 989/1953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:45 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1318 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:45.850554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:45.851588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:45.861828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.863794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.865460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.866788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.867539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.868464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.876580 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c359bbe6-c19c-4aab-810d-ae6c1ebfb910 req-1a279a9a-e1d9-4d82-8849-d6dfc9a51630 service nova] Creating event network-vif-deleted:68072907-6547-4e2b-8fb7-0c95d853ce3e for instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b on n-h1-855650-5 Nov 02 12:27:45.884758 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c359bbe6-c19c-4aab-810d-ae6c1ebfb910 req-1a279a9a-e1d9-4d82-8849-d6dfc9a51630 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119715 Nov 02 12:27:45.886002 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 965/1954] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:45.894803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:45.896006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:45.912670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.913442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.914196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.915194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.916396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.917356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.197613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:46.216707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:46.220693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:46.223902 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d6e7f40-d6f2-4f1e-9ffd-deb787e66aef tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1476 microversion: 2.25 time: 0.378866 Nov 02 12:27:46.226173 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 990/1955] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:45 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:46.234918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-25838e8a-a36f-43d4-a272-5368c0a745d2 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] Calling method '.version_select at 0x7f228eb90a60>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:46.272041 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-25838e8a-a36f-43d4-a272-5368c0a745d2 tempest-ServersTestFqdnHostnames-1505329028 tempest-ServersTestFqdnHostnames-1505329028-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-800847278" status: 202 len: 0 microversion: 2.1 time: 0.043068 Nov 02 12:27:46.280210 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 991/1956] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:27:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-800847278 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:27:46.291791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:46.293958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:46.308476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.309859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.311526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.313329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.314506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.315664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.835207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:46.837652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:46.856042 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5cdfdf1-101d-4871-816d-3d0c8cd2d529 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1270 microversion: 2.1 time: 0.572433 Nov 02 12:27:46.857172 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-993e858c-61a1-4fe6-bc87-a6635f3905bc tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1504 microversion: 2.1 time: 0.969482 Nov 02 12:27:46.859102 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 966/1957] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:45 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1504 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:46.859715 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 992/1958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:46 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1270 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:46.864201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-cc1268e5-eead-4103-a50c-0021528a3be8 req-83f36e26-98b5-4987-805a-e6c34d1a652a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d9a48d-0d18-4480-a9ae-708b657762df", "name": "network-vif-plugged", "status": "completed", "tag": "796b559d-cae0-4c63-b9bc-bda8fc24354a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:46.872453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:46.874248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:46.888657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc1268e5-eead-4103-a50c-0021528a3be8 req-83f36e26-98b5-4987-805a-e6c34d1a652a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.889218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc1268e5-eead-4103-a50c-0021528a3be8 req-83f36e26-98b5-4987-805a-e6c34d1a652a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.889735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc1268e5-eead-4103-a50c-0021528a3be8 req-83f36e26-98b5-4987-805a-e6c34d1a652a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.893083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.896340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.898200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.899948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.901289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.902982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.918027 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-cc1268e5-eead-4103-a50c-0021528a3be8 req-83f36e26-98b5-4987-805a-e6c34d1a652a service nova] Creating event network-vif-plugged:796b559d-cae0-4c63-b9bc-bda8fc24354a for instance 40d9a48d-0d18-4480-a9ae-708b657762df on n-h1-855650-5 Nov 02 12:27:46.940523 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-cc1268e5-eead-4103-a50c-0021528a3be8 req-83f36e26-98b5-4987-805a-e6c34d1a652a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072256 Nov 02 12:27:46.941232 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 967/1959] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:46.946878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:46.947662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:46.971047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.971680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.972188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.972965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.973440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.974034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:47.453684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:47.513884 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98501c69-21b2-42c0-b7c2-3415951f17e8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1968 microversion: 2.25 time: 0.570146 Nov 02 12:27:47.517990 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 968/1960] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:46 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1968 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:47.540069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:47.563730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: cd0838ca-34c6-4d78-8d26-ce67982c4c7b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:47.590288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:47.595222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:47.596190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:47.597551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:47.604078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:47.604827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:47.657203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] HTTP exception thrown: Instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b could not be found. Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Request method failure captured: Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b HTTP/1.1 Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmF36HD7DEpNH05NIMXAkMseJIcngZTo0RCd3kAiB6Prvteyr5VpBwa84vIITvURLPN-zuKQyVkSg-bl7fQR8dF5GYe-V1F-GqTPKUTityMzVEcWf_EGISNvhCKHu1cv_xIe8aV254gBQsG7b8k3kTXwoH3X05PO6JZlyisIlmtsEMU Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0f82ade518194e1fa8dae47f66e67d8e Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ListImageFiltersTestJSON-1624431592 Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0f82ade518194e1fa8dae47f66e67d8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0f82ade518194e1fa8dae47f66e67d8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0f82ade518194e1fa8dae47f66e67d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0f82ade518194e1fa8dae47f66e67d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ListImageFiltersTestJSON-1624431592 Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0f82ade518194e1fa8dae47f66e67d8e Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1624431592 Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ListImageFiltersTestJSON-1624431592-project Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 51ab461132054e449ec6556e3eaa3d48 Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ListImageFiltersTestJSON-1624431592-project Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b could not be found. Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'cd0838ca-34c6-4d78-8d26-ce67982c4c7b'} Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b could not be found. Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b could not be found. Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:47.668247 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:47.688791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:47.688791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:47.688791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:47.688791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:27:47.688791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:27:47.688791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b could not be found. Nov 02 12:27:47.688791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:27:47.699422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Returning 404 to user: Instance cd0838ca-34c6-4d78-8d26-ce67982c4c7b could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:47.702205 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38b44d53-8752-4ff4-9f64-f2704d7a3ded tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b" status: 404 len: 111 microversion: 2.1 time: 0.181645 Nov 02 12:27:47.719502 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 969/1961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:47 2022] GET /compute/v2.1/servers/cd0838ca-34c6-4d78-8d26-ce67982c4c7b => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:27:47.741280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:47.746542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:47.776479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:47.779736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:47.797315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:47.799551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:47.800869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:47.802317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:47.876246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:47.929481 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d73a8f82-dfb5-4524-9436-c5bfacf9b25d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 1.064655 Nov 02 12:27:47.932973 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 993/1962] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:46 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:47.962708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:47.966055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:48.004577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:48.007785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:48.010462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:48.012446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:48.013708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:48.016956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:48.734064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:48.783891 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69e69068-1a74-4763-946a-66c2fb48c96a tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1968 microversion: 2.25 time: 0.844329 Nov 02 12:27:48.786930 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 994/1963] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:47 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1968 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:48.800717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:48.802416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:48.829902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:48.834372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:48.835662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:48.836960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:48.839146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:48.840554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:48.843328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:48.875521 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1fa17365-eb42-4faf-b106-82939c0c4934 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1318 microversion: 2.1 time: 1.152131 Nov 02 12:27:48.909294 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 970/1964] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:47 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1318 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:48.915832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:48.936685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:27:48.954690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:48.956281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:48.982123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:48.986039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:48.990541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:49.000764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:49.002949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:49.004095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:49.223885 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-066bc4ac-2db1-42f2-881a-f62defa81228 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "DELETE /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 204 len: 0 microversion: 2.1 time: 0.430477 Nov 02 12:27:49.225000 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 995/1965] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:27:48 2022] DELETE /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:27:49.258773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:49.259796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:49.276538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:49.279249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:49.285788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:49.291571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:49.292237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:49.292886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:49.895587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:49.905616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:49.936704 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a55a6816-1d0d-4198-aa3a-4379174fd0f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1312 microversion: 2.1 time: 0.706982 Nov 02 12:27:49.951206 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 996/1966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:49 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1312 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:49.964629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa2dad89-533b-4aaa-96ff-5409c6ed7bc2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:49.972765 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c2901d4-8b55-4c1e-adab-a97f93c4b9dd tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1504 microversion: 2.1 time: 1.061486 Nov 02 12:27:49.973889 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 971/1967] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:48 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1504 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:50.006423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:50.007862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:50.008494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2dad89-533b-4aaa-96ff-5409c6ed7bc2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.009319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2dad89-533b-4aaa-96ff-5409c6ed7bc2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.029699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2dad89-533b-4aaa-96ff-5409c6ed7bc2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.031362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2dad89-533b-4aaa-96ff-5409c6ed7bc2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.032238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2dad89-533b-4aaa-96ff-5409c6ed7bc2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.033065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2dad89-533b-4aaa-96ff-5409c6ed7bc2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.035277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.041762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.043259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.055329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.058879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.060037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.210578 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa2dad89-533b-4aaa-96ff-5409c6ed7bc2 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.264724 Nov 02 12:27:50.220252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 997/1968] 10.222.0.45 () {60 vars in 1217 bytes} [Wed Nov 2 12:27:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:27:50.256483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:50.262730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:50.303768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:50.331624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.334163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.337287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.372325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.374452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.379776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.728411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:50.751568 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88299bf4-2682-4b4d-a5e6-db155e8270eb tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.761481 Nov 02 12:27:50.766279 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 972/1969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:49 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:50.793799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:50.795862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:50.808433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.810024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.811772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.813550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.814881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.816026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.853533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:50.877498 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b0825083-bee8-4a50-bb8e-1a2e9fb453ab tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1474 microversion: 2.1 time: 0.664174 Nov 02 12:27:50.897323 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 998/1970] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:50 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1474 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:50.903447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-855650-5", "block_migration": "auto"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:50.906458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:50.915185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.916083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.917404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.918803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.920244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.920878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.958649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'flavor' on Instance uuid e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:50.979054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Going to try to live migrate instance to n-h1-855650-5 {{(pid=120723) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:27:51.988429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:52.003243 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ffd1068-5992-45a5-b74b-fa5b160ffe06 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1509 microversion: 2.1 time: 1.234735 Nov 02 12:27:52.019368 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 973/1971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:50 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1509 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:52.040803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9575c851-2c8b-4e0a-8a3b-b7ece04a4258 req-feaac122-e8b2-410e-a11e-a176536d6c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a522fa-dddf-4755-899a-445356170ce1", "tag": "1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:52.056787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9575c851-2c8b-4e0a-8a3b-b7ece04a4258 req-feaac122-e8b2-410e-a11e-a176536d6c19 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:52.057776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9575c851-2c8b-4e0a-8a3b-b7ece04a4258 req-feaac122-e8b2-410e-a11e-a176536d6c19 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:52.058512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9575c851-2c8b-4e0a-8a3b-b7ece04a4258 req-feaac122-e8b2-410e-a11e-a176536d6c19 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:52.079350 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9575c851-2c8b-4e0a-8a3b-b7ece04a4258 req-feaac122-e8b2-410e-a11e-a176536d6c19 service nova] Creating event network-changed:1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa for instance 08a522fa-dddf-4755-899a-445356170ce1 on n-h1-855650-5 Nov 02 12:27:52.089306 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9575c851-2c8b-4e0a-8a3b-b7ece04a4258 req-feaac122-e8b2-410e-a11e-a176536d6c19 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066966 Nov 02 12:27:52.090991 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 974/1972] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:52.103089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:52.108589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:52.119462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:52.120338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:52.121237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:52.122560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:52.124627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:52.125929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:53.323335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:53.351371 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dcaeb52f-9f39-47b4-81a1-42e1e9fdf162 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1312 microversion: 2.1 time: 1.257411 Nov 02 12:27:53.380597 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 975/1973] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:52 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1312 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:53.411311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:53.412937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:53.429039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:53.430383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:53.431434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:53.433183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:53.434379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:53.437095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:54.180815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:54.204400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91dd1437-cbf3-48f8-af19-bfa6ba6d3996 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1504 microversion: 2.1 time: 0.821134 Nov 02 12:27:54.215292 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 976/1974] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:53 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1504 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:54.289879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:54.295059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:54.347116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:54.348590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:54.348590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:54.349637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:54.350305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:54.350903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:54.905509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:54.941503 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83ee7d49-7d41-4124-807e-5932e53e01bf tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.686162 Nov 02 12:27:54.943879 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 977/1975] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:54 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:54.961467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:54.972086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:54.994672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:54.996503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:54.999242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:55.007109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:55.008106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:55.010895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:55.264819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab461132054e449ec6556e3eaa3d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f82ade518194e1fa8dae47f66e67d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:55.296493 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2dd9ff7d-44f2-407b-a614-3d904598a439 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 200 len: 1432 microversion: 2.1 time: 0.348751 Nov 02 12:27:55.312530 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 978/1976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:54 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 1432 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:55.374463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:55.384579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:55.452655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:55.463726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:55.464417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:55.465365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:55.472298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:55.472846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:56.431574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:56.449328 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-607fdb19-fc66-4551-9101-b7a46052681f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1509 microversion: 2.1 time: 1.128215 Nov 02 12:27:56.458371 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 979/1977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:55 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1509 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:56.483120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f5d6b5f9-1fb4-496b-a175-836d04c037b3 req-a1a7dfff-9b75-46d6-b0ab-7ec8d20c8d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed050eff-b84c-4742-adf2-5e7437f8c1a7", "name": "network-vif-unplugged", "status": "completed", "tag": "16803170-ac59-42bc-83c0-a86a778086ff"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:56.496740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5d6b5f9-1fb4-496b-a175-836d04c037b3 req-a1a7dfff-9b75-46d6-b0ab-7ec8d20c8d0c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:56.499184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5d6b5f9-1fb4-496b-a175-836d04c037b3 req-a1a7dfff-9b75-46d6-b0ab-7ec8d20c8d0c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:56.500114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5d6b5f9-1fb4-496b-a175-836d04c037b3 req-a1a7dfff-9b75-46d6-b0ab-7ec8d20c8d0c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:56.524931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f5d6b5f9-1fb4-496b-a175-836d04c037b3 req-a1a7dfff-9b75-46d6-b0ab-7ec8d20c8d0c service nova] Creating event network-vif-unplugged:16803170-ac59-42bc-83c0-a86a778086ff for instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 on n-h1-855650-5 Nov 02 12:27:56.535510 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f5d6b5f9-1fb4-496b-a175-836d04c037b3 req-a1a7dfff-9b75-46d6-b0ab-7ec8d20c8d0c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070622 Nov 02 12:27:56.537380 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 980/1978] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:56.553825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:56.558574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:56.575267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:56.578952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:56.579684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:56.583231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:56.584230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:56.584995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:56.640094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:57.180612 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84030cd7-ca0f-4e6f-ba3a-932c9497fb40 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3/action" status: 202 len: 0 microversion: 2.25 time: 6.281465 Nov 02 12:27:57.183280 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 999/1979] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:27:50 2022] POST /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3/action => generated 0 bytes in 6285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:27:57.192461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3b77d4b8-ce88-43a4-899f-522b049f787e req-4e4d0988-93bd-4378-ba3f-c2a3c721175d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f4ff71-fa75-4ac9-9661-ebb7bbc3995f", "name": "network-vif-deleted", "tag": "9d585ce4-7020-4e3d-b408-02a183917027"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:57.221220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3b77d4b8-ce88-43a4-899f-522b049f787e req-4e4d0988-93bd-4378-ba3f-c2a3c721175d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:57.228494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3b77d4b8-ce88-43a4-899f-522b049f787e req-4e4d0988-93bd-4378-ba3f-c2a3c721175d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:57.229300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3b77d4b8-ce88-43a4-899f-522b049f787e req-4e4d0988-93bd-4378-ba3f-c2a3c721175d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:57.265029 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3b77d4b8-ce88-43a4-899f-522b049f787e req-4e4d0988-93bd-4378-ba3f-c2a3c721175d service nova] Creating event network-vif-deleted:9d585ce4-7020-4e3d-b408-02a183917027 for instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f on n-h1-855650-5 Nov 02 12:27:57.276931 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3b77d4b8-ce88-43a4-899f-522b049f787e req-4e4d0988-93bd-4378-ba3f-c2a3c721175d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091729 Nov 02 12:27:57.277909 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1000/1980] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:57.293523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:57.295279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:57.319969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:57.321536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:57.322282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:57.323311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:57.324103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:57.324577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:57.379063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:57.390924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b53e484b-124b-476d-9a7d-80e487645dea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1312 microversion: 2.1 time: 0.847611 Nov 02 12:27:57.396982 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 981/1981] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:56 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1312 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:57.422197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:57.423358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:57.447859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:57.449250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:57.449925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:57.450964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:57.451445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:57.452012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.070456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:59.086852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f295f331-e30a-4928-8329-e4404eb34501 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1504 microversion: 2.1 time: 1.805714 Nov 02 12:27:59.088110 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1001/1982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:57 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1504 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:59.103055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:59.104237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] [instance: 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:59.116897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.118846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.119383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.120129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.120770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.121189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.147485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:59.163370 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1788f40b-7932-474d-80b6-658f97474491 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 1.753491 Nov 02 12:27:59.164840 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 982/1983] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:57 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:59.168920 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] HTTP exception thrown: Instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f could not be found. Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Request method failure captured: Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f HTTP/1.1 Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmF36HD7DEpNH05NIMXAkMseJIcngZTo0RCd3kAiB6Prvteyr5VpBwa84vIITvURLPN-zuKQyVkSg-bl7fQR8dF5GYe-V1F-GqTPKUTityMzVEcWf_EGISNvhCKHu1cv_xIe8aV254gBQsG7b8k3kTXwoH3X05PO6JZlyisIlmtsEMU Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0f82ade518194e1fa8dae47f66e67d8e Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListImageFiltersTestJSON-1624431592 Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0f82ade518194e1fa8dae47f66e67d8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0f82ade518194e1fa8dae47f66e67d8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0f82ade518194e1fa8dae47f66e67d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0f82ade518194e1fa8dae47f66e67d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListImageFiltersTestJSON-1624431592 Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0f82ade518194e1fa8dae47f66e67d8e Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1624431592 Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListImageFiltersTestJSON-1624431592-project Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 51ab461132054e449ec6556e3eaa3d48 Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListImageFiltersTestJSON-1624431592-project Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f could not be found. Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '73f4ff71-fa75-4ac9-9661-ebb7bbc3995f'} Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f could not be found. Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f could not be found. Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:59.171319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f could not be found. Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Returning 404 to user: Instance 73f4ff71-fa75-4ac9-9661-ebb7bbc3995f could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:59.178164 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8e1eec7-9596-4b44-bc35-217330f138d8 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f" status: 404 len: 111 microversion: 2.1 time: 0.082842 Nov 02 12:27:59.182304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:59.184580 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1002/1984] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:59 2022] GET /compute/v2.1/servers/73f4ff71-fa75-4ac9-9661-ebb7bbc3995f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:27:59.190380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:59.191140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:59.196520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:59.198665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.199235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.199685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.201358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.201702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.202173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.244284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.244790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.252163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.257317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.259807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.262315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.482835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:27:59.485829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:27:59.486697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:27:59.488223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:27:59.491751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:27:59.565722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:59.584051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:59.588252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:59.590808 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f54f7b9e-8199-419c-94d1-120885b4a4e0 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.404510 Nov 02 12:27:59.596310 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1003/1985] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:27:59 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:59.608531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:59.611177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:59.632082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.633052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.633788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.636554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.655238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:59.659611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.659877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.663393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:59.665728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.666934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.667612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.670131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.670862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.671483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.708826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f67b95e0-e217-4e2d-9f2e-3a796d68e2f5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "POST /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df/action" status: 202 len: 1111 microversion: 2.1 time: 0.542177 Nov 02 12:27:59.710542 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 983/1986] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:27:59 2022] POST /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df/action => generated 1111 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:27:59.719689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-63e6c349-a1fb-4de0-a3f6-3da8d7f32836 req-b63e7575-daec-4e6f-9628-04d41d46f1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a522fa-dddf-4755-899a-445356170ce1", "name": "network-vif-plugged", "status": "completed", "tag": "1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:59.733373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-63e6c349-a1fb-4de0-a3f6-3da8d7f32836 req-b63e7575-daec-4e6f-9628-04d41d46f1cf service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.734351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-63e6c349-a1fb-4de0-a3f6-3da8d7f32836 req-b63e7575-daec-4e6f-9628-04d41d46f1cf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.735180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-63e6c349-a1fb-4de0-a3f6-3da8d7f32836 req-b63e7575-daec-4e6f-9628-04d41d46f1cf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.752368 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-63e6c349-a1fb-4de0-a3f6-3da8d7f32836 req-b63e7575-daec-4e6f-9628-04d41d46f1cf service nova] Creating event network-vif-plugged:1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa for instance 08a522fa-dddf-4755-899a-445356170ce1 on n-h1-855650-5 Nov 02 12:27:59.764299 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-63e6c349-a1fb-4de0-a3f6-3da8d7f32836 req-b63e7575-daec-4e6f-9628-04d41d46f1cf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050757 Nov 02 12:27:59.772731 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 984/1987] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:59.783235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-903421d0-9414-4e1e-85bd-70bc421f9f3f req-9567c6bb-5141-4b88-a2c1-50120b03ad72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed050eff-b84c-4742-adf2-5e7437f8c1a7", "tag": "16803170-ac59-42bc-83c0-a86a778086ff"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:59.802640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-903421d0-9414-4e1e-85bd-70bc421f9f3f req-9567c6bb-5141-4b88-a2c1-50120b03ad72 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.805155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-903421d0-9414-4e1e-85bd-70bc421f9f3f req-9567c6bb-5141-4b88-a2c1-50120b03ad72 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.806233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-903421d0-9414-4e1e-85bd-70bc421f9f3f req-9567c6bb-5141-4b88-a2c1-50120b03ad72 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.847942 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-903421d0-9414-4e1e-85bd-70bc421f9f3f req-9567c6bb-5141-4b88-a2c1-50120b03ad72 service nova] Creating event network-changed:16803170-ac59-42bc-83c0-a86a778086ff for instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 on n-h1-855650-5 Nov 02 12:27:59.863280 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-903421d0-9414-4e1e-85bd-70bc421f9f3f req-9567c6bb-5141-4b88-a2c1-50120b03ad72 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083569 Nov 02 12:27:59.866668 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 985/1988] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:59.883784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8fe462f7-4676-413c-a9b7-26ce15fa3386 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e8b3280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:00.057381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:00.450320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:00.468723 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6a543bdb-e820-45da-b5dc-c287ca109d74 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1312 microversion: 2.1 time: 0.862611 Nov 02 12:28:00.476191 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1004/1989] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:59 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1312 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:00.500179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:00.507407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:00.536156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:00.556329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:00.562219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:00.568808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:00.574244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:00.577174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:00.959724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:00.973745 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97e6228b-2847-4e83-af2d-40616a2541f9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 0.495770 Nov 02 12:28:01.002370 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1005/1990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:00 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:01.014492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:01.015445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:01.033781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:01.034608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:01.035310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:01.036397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:01.037066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:01.037724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:01.039060 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8fe462f7-4676-413c-a9b7-26ce15fa3386 tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "DELETE /compute/v2.1/images/26b50a75-a175-4aa1-a075-7bf8b73148fc" status: 204 len: 0 microversion: 2.1 time: 1.170794 Nov 02 12:28:01.040679 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 986/1991] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:59 2022] DELETE /compute/v2.1/images/26b50a75-a175-4aa1-a075-7bf8b73148fc => generated 0 bytes in 1173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:28:01.050263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:01.051901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:01.086623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:01.091595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:01.092967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:01.109369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:01.128381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:01.129937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:01.798934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:01.817331 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d10b09c3-bc94-4c58-9a86-bd83eb38b0d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1504 microversion: 2.1 time: 0.810327 Nov 02 12:28:01.818422 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1006/1992] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:01 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:01.819888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:01.836227 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ccaad3e7-6166-4159-bb60-3c3d0fa3bd2e tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.793904 Nov 02 12:28:01.836734 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 987/1993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:01 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:01.838916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:01.839851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:01.857587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:01.858462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:01.859194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:01.860200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:01.860986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:01.863955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c5c05e0-56b0-410a-ae83-16fde0f72a3f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228e6f38b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:01.865215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:02.279965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:02.314192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:02.333298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:02.349276 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09d3f53d-de50-4ad4-9dee-fb2e5a8d3ed5 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.520638 Nov 02 12:28:02.351820 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1007/1994] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:01 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:02.379200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:02.380132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:02.392898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:02.393695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:02.394661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:02.395695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:02.396418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:02.397432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:02.521641 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c5c05e0-56b0-410a-ae83-16fde0f72a3f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "DELETE /compute/v2.1/images/27823842-9032-4294-afd1-80f1e7cefc2b" status: 204 len: 0 microversion: 2.1 time: 0.674126 Nov 02 12:28:02.522735 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 988/1995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:01 2022] DELETE /compute/v2.1/images/27823842-9032-4294-afd1-80f1e7cefc2b => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:28:02.538283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:02.539226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:02.558723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:02.559425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:02.573012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:02.576439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:02.577373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:02.577983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:03.063282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:03.088454 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ec24a3b-7b24-4bb0-bd61-c4d5b5bedd30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1312 microversion: 2.1 time: 0.735480 Nov 02 12:28:03.092872 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1008/1996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:02 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1312 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:03.109042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f18b5282-f87b-4c41-9934-1df4bcbe254f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] Calling method '.version_select at 0x7f228f1a18b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:03.183348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:03.203826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1dd50962-7dde-4cd5-a614-ed9c42f0dc93 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 0.678845 Nov 02 12:28:03.205703 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 989/1997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:02 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:03.218904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:03.222512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:03.242293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:03.244812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:03.245675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:03.250395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:03.250932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:03.251392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:03.544806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:03.577374 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ac609f6-873f-4893-8840-30da1fb8d4b5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1504 microversion: 2.1 time: 0.368027 Nov 02 12:28:03.580663 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 990/1998] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:03 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:03.614011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:03.618063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:03.637886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:03.639448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:03.642416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:03.643829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:03.644958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:03.646043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:03.657834 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f18b5282-f87b-4c41-9934-1df4bcbe254f tempest-ListImageFiltersTestJSON-1624431592 tempest-ListImageFiltersTestJSON-1624431592-project] 10.222.0.45 "DELETE /compute/v2.1/images/32b5e181-6e39-4a5a-b97f-77cccaf01534" status: 204 len: 0 microversion: 2.1 time: 0.561886 Nov 02 12:28:03.658741 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1009/1999] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:03 2022] DELETE /compute/v2.1/images/32b5e181-6e39-4a5a-b97f-77cccaf01534 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:28:03.677839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:03.682895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:03.699660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:03.700165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:03.700734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:03.701605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:03.702415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:03.703047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:04.210823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:04.227133 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f3aa822-0ff4-42ed-acf8-b3089ff987f3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.636976 Nov 02 12:28:04.228246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 991/2000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:03 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:04.240063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:04.240891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:04.272328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:04.273774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:04.285041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:04.286273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:04.288921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:04.290671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:04.322131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:04.353038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:04.359290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:04.367702 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd1121d7-a768-42ac-b30b-85a492c43303 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.707491 Nov 02 12:28:04.373785 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1010/2001] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:03 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:04.392497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:04.396810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:04.446707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:04.447833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:04.448747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:04.451339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:04.453048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:04.456686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:04.574275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:05.276067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:05.294932 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d590930a-6539-491f-8900-1ecb217b078c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1462 microversion: 2.1 time: 1.064914 Nov 02 12:28:05.297653 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 992/2002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:04 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1462 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:05.332141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:05.335820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:05.382385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:05.384110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:05.387047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:05.391974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:05.397846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:05.401853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:05.711873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:05.732245 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3145dd18-41e6-4791-a794-72744f207985 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 1.355887 Nov 02 12:28:05.751519 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1011/2003] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:04 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:05.774009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:05.776841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:05.795798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:05.796340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:05.796799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:05.797746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:05.801999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:05.805667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:06.274162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:06.293761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac736473-3b67-4698-a198-39a6aed78941 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1504 microversion: 2.1 time: 0.990387 Nov 02 12:28:06.298576 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 993/2004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:05 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1504 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:06.485827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:06.503111 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-092ee59f-8923-42b4-96f8-d18fd38d9201 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.746173 Nov 02 12:28:06.522013 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1012/2005] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:05 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:06.548946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:06.552817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:06.569341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:06.573822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:06.575061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:06.577501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:06.580258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:06.581108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:07.019525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:07.049728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:07.055242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:07.064527 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-740caca1-e01a-4f0a-970f-31ea9b54714a tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.535873 Nov 02 12:28:07.066362 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1013/2006] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:06 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:07.076968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:07.080755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:07.094648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:07.099010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:07.101539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:07.103812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:07.105382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:07.109483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:07.236157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:07.236679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:07.280683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:07.281660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:07.282526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:07.286903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:07.288321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:07.299897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:07.628387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:07.655929 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84fd4f0a-c415-4a09-a324-9b52d6e4fb7b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 0.588152 Nov 02 12:28:07.671705 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1014/2007] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:07 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:07.682584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:07.685575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:07.713702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:07.714252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:07.714714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:07.715610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:07.715974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:07.736765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:08.234373 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3c52b14-74f7-4432-8e09-22fcf587acc2 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1613 microversion: 2.1 time: 1.925649 Nov 02 12:28:08.258474 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 994/2008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:06 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1613 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:08.320397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:08.322682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:08.355673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:08.359327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:08.361689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:08.367972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:08.369124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:08.371498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:08.416601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:08.464809 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4027b7ef-1bcc-49cc-afa9-4da7f4e4a7f2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1504 microversion: 2.1 time: 0.785512 Nov 02 12:28:08.467229 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1015/2009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:07 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1504 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:08.490176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:08.494186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:08.523376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:08.524676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:08.531746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:08.534666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:08.539546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:08.542524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.003663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:09.045782 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66e87adb-8f11-43ee-a3ea-b433a77555b6 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.767356 Nov 02 12:28:09.049587 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 995/2010] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:08 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:09.078530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:09.081755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:09.120894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.121507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.125551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.129489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.134095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.136862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:09.139933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.180321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:09.192888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:09.198395 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-930eca05-ff72-4a07-abee-95bf887385f2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.728112 Nov 02 12:28:09.200170 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1016/2011] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:08 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:09.225497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:09.227660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:09.251286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.252955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.254100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.256375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.257644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.258973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.265454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '967308c7423c43a59823c37d00c23296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564a0532b82544df89f251012064ec27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:09.270243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: 08a522fa-dddf-4755-899a-445356170ce1] flavor_id is None. Assuming migration. {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 12:28:09.271628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:28:09.824156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:09.850594 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0dccdba8-fe30-4e30-bba7-a9f66354e8ab tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 0.643909 Nov 02 12:28:09.888358 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1017/2012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:09 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:09.912172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:09.917712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:09.950761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:09.958913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.960421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.962905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.967526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.971032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.973429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:10.486256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:10.499584 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-243ba52c-1340-44d5-8282-bf9baa997ddf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1484 microversion: 2.1 time: 0.604885 Nov 02 12:28:10.501008 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1018/2013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:09 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1484 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:10.676275 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f31afd0-5fd0-48a0-a2c1-88b6db2d67da tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1/action" status: 202 len: 0 microversion: 2.1 time: 1.625434 Nov 02 12:28:10.683323 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 996/2014] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:28:09 2022] POST /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1/action => generated 0 bytes in 1633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:28:10.697539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:10.698245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:10.717069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:10.719827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:10.722026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:10.722841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:10.723330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:10.725656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:11.220177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:11.229262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:11.272027 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e397e0f0-d4f3-40ff-8c30-10b67863ac53 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1392 microversion: 2.1 time: 0.586920 Nov 02 12:28:11.287001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 997/2015] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:10 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1392 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:11.306650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:11.309462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:11.325912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dfa4c527-3fec-46bc-8c15-0edb5df49271 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Action: 'create', calling method: .version_select at 0x7f228ee9ad30>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqQP/oTczsjYYp6HlpQ3FTvwFxzb1aEBY5eRokdbku/FKCZ7yAkU3xWxEyTeCzNWND4Tum4dduF6VfwBC00Kk5CaB/lgRVdIzZgqSK0w/NNq/PivBVbkcPXSjEN2gnuGg=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dfa4c527-3fec-46bc-8c15-0edb5df49271 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Request method failure captured: Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 257 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmJZ1Onj-VL_bAR9SGo4tAsPemUwuP0sFA_uq-JtHBOx_oaPjMAtz00hkxCMfW_4n-cmKrRKQTv579UqOIR9LHtUAfF5x8eBW15VZzXT0T_GzCuhLCj_81HNckYZm2l0PdEw8dn-HbZnPkIIJLjFhAPZZ-lwZ_Y5Ua3M0ZpYh1YkYZk Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqQP/oTczsjYYp6HlpQ3FTvwFxzb1aEBY5eRokdbku/FKCZ7yAkU3xWxEyTeCzNWND4Tum4dduF6VfwBC00Kk5CaB/lgRVdIzZgqSK0w/NNq/PivBVbkcPXSjEN2gnuGg=="}} Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqQP/oTczsjYYp6HlpQ3FTvwFxzb1aEBY5eRokdbku/FKCZ7yAkU3xWxEyTeCzNWND4Tum4dduF6VfwBC00Kk5CaB/lgRVdIzZgqSK0w/NNq/PivBVbkcPXSjEN2gnuGg=='}}} Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 02 12:28:11.344358 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 12:28:11.350132 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:11.357669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:11.360558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dfa4c527-3fec-46bc-8c15-0edb5df49271 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:11.407166 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dfa4c527-3fec-46bc-8c15-0edb5df49271 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.867292 Nov 02 12:28:11.407586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:11.408157 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1019/2016] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:28:10 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 870 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:28:11.408418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:11.408418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:11.408418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:11.408418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:11.409030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:11.409030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:11.418609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:11.421551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:11.423404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:11.428466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:11.429529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:11.437285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:11.982042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:12.036015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:12.047157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:12.054242 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e5ccc4b-5de0-4766-a63b-9d7ed57ef926 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.764198 Nov 02 12:28:12.055864 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 998/2017] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:11 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:12.079556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:12.080566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:12.095047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:12.096107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:12.096615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:12.097655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:12.098178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:12.098625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:12.368703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:12.384845 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e91b6f7-7a4e-4e42-b25b-d02944e9f2a0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1471 microversion: 2.1 time: 1.011065 Nov 02 12:28:12.385811 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1020/2018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:11 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1471 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:12.391683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-437803220", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:12.514743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] validate_networks() for [('3bf27cad-1e78-46c1-9ef0-e5897098fc42', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:28:12.543087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:12.569690 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de7f2e54-b372-4768-a79e-349d1c5aad40 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 0.507045 Nov 02 12:28:12.571328 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 999/2019] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:12 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:12.577733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71c6603d-db75-4f68-8476-87729b94752b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Action: 'create', calling method: .version_select at 0x7f228e507ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1777447847", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:12.635562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-71c6603d-db75-4f68-8476-87729b94752b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:12.642500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-71c6603d-db75-4f68-8476-87729b94752b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for user 7aa1f22691c14e87a9a9af92e422cdca and project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:12.727330 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-71c6603d-db75-4f68-8476-87729b94752b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71c6603d-db75-4f68-8476-87729b94752b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Request method failure captured: Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 2167 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmJZ1Onj-VL_bAR9SGo4tAsPemUwuP0sFA_uq-JtHBOx_oaPjMAtz00hkxCMfW_4n-cmKrRKQTv579UqOIR9LHtUAfF5x8eBW15VZzXT0T_GzCuhLCj_81HNckYZm2l0PdEw8dn-HbZnPkIIJLjFhAPZZ-lwZ_Y5Ua3M0ZpYh1YkYZk Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1777447847", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:28:12.740729 n-d-855650-5 devstack@n-api.service[120722]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1777447847', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:12.750618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71c6603d-db75-4f68-8476-87729b94752b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71c6603d-db75-4f68-8476-87729b94752b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.169938 Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1000/2020] 10.222.0.45 () {60 vars in 1160 bytes} [Wed Nov 2 12:28:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:28:12.759503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:12.774787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:12.810667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:12.813190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:12.813999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:12.815356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:12.820023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:12.824670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:13.916154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:13.997275 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1854eb18-c21b-4e7a-849a-5190ca8d8de3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1382 microversion: 2.1 time: 1.251670 Nov 02 12:28:14.000966 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1001/2021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:12 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1382 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:14.039905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7bd9914-3dab-4dbc-b102-0d8aa89e14a4 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Action: 'create', calling method: .version_select at 0x7f228e520790>, body: {"keypair": {"name": "tempest-keypair-1429101792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB36oNseZc3l/Tzn59MYKoab4ute9jzqMPV3o0y5P/uz94BHzWfnfHvwePxM0FB6eM99GkdjuykNEH6VWjR/zUWEoQCL21XDamZWt1zoV+Q67osNyBq/497kFWzd+mFA2Q=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:14.127342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c7bd9914-3dab-4dbc-b102-0d8aa89e14a4 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:14.165505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c7bd9914-3dab-4dbc-b102-0d8aa89e14a4 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for user 7aa1f22691c14e87a9a9af92e422cdca and project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:14.264287 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7bd9914-3dab-4dbc-b102-0d8aa89e14a4 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.256269 Nov 02 12:28:14.274353 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1002/2022] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:28:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:14.300698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:14.304469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:14.340209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:14.343500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:14.345270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:14.349179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:14.350105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:14.352854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:14.756664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:28:14.758186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:28:14.758901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:28:14.759572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:28:14.760419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:28:14.808147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:14.814758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:14.820342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:14.824356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:14.825293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:14.825814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:14.910903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Getting quotas for project 2a51f8822491473b8edfe0b97a2e0d67. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:14.937959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Getting quotas for user 05ae1470e3b04928827e3757483e4c00 and project 2a51f8822491473b8edfe0b97a2e0d67. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:14.964545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:28:14.969317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:28:15.114751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6496f9a7-205c-499d-a7c6-b1816e39303f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.727244 Nov 02 12:28:15.117823 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1021/2023] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:28:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:28:15.150751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:15.151767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:15.176821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:15.178160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:15.180185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:15.181877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:15.187459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:15.202158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:15.361734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:15.379784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:15.384725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:15.397154 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6eb9a972-1433-4521-96bd-08a9a2eff13c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 1.120064 Nov 02 12:28:15.404282 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1003/2024] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:14 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:15.431405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:15.432358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:15.450057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:15.453107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:15.454038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:15.455087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:15.456295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:15.457419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:15.706273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:15.730596 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-44d57962-2e40-43d9-9d6f-69616bde561a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1471 microversion: 2.1 time: 0.610703 Nov 02 12:28:15.738625 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1022/2025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:15 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1471 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:15.751818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f1b0805-e25b-4149-8a31-fa35087003b3 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '.version_select at 0x7f228e995b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:15.791579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f1b0805-e25b-4149-8a31-fa35087003b3 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:15.794343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f1b0805-e25b-4149-8a31-fa35087003b3 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:15.797029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f1b0805-e25b-4149-8a31-fa35087003b3 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:15.879233 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f1b0805-e25b-4149-8a31-fa35087003b3 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 3485 microversion: 2.1 time: 0.138621 Nov 02 12:28:15.883601 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1023/2026] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:28:15 2022] GET /compute/v2.1/os-migrations => generated 3485 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:15.901356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61102054-6667-43a1-a896-d0410dd31a75 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Action: 'create', calling method: .version_select at 0x7f228e84f1f0>, body: {"keypair": {"name": "tempest-keypair-1429101792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbrO3Ave4D76FakdHL+66cXvkG7jgQ0PKV1Cf3dGylIwSCl/GJjvoQvjK3jF7j5baDFDuwxmbEgw1qQPt+gsgn30yWL10V4KnwQk7iXCanKyseQZ275A7LiBxHBClPHRw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:15.944781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-61102054-6667-43a1-a896-d0410dd31a75 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:15.964639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-61102054-6667-43a1-a896-d0410dd31a75 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for user 7aa1f22691c14e87a9a9af92e422cdca and project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:16.016369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:16.027069 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-61102054-6667-43a1-a896-d0410dd31a75 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] HTTP exception thrown: Key pair 'tempest-keypair-1429101792' already exists. Nov 02 12:28:16.060132 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26184585-f3c4-4628-ab8c-ab8810651e8e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 0.636037 Nov 02 12:28:16.066450 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1004/2027] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:15 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:16.104107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe041299-6009-43c0-a54d-2fed8f38c579 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:16.112084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe041299-6009-43c0-a54d-2fed8f38c579 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61102054-6667-43a1-a896-d0410dd31a75 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Request method failure captured: Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 273 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmJZ1Onj-VL_bAR9SGo4tAsPemUwuP0sFA_uq-JtHBOx_oaPjMAtz00hkxCMfW_4n-cmKrRKQTv579UqOIR9LHtUAfF5x8eBW15VZzXT0T_GzCuhLCj_81HNckYZm2l0PdEw8dn-HbZnPkIIJLjFhAPZZ-lwZ_Y5Ua3M0ZpYh1YkYZk Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: {"keypair": {"name": "tempest-keypair-1429101792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbrO3Ave4D76FakdHL+66cXvkG7jgQ0PKV1Cf3dGylIwSCl/GJjvoQvjK3jF7j5baDFDuwxmbEgw1qQPt+gsgn30yWL10V4KnwQk7iXCanKyseQZ275A7LiBxHBClPHRw=="}} Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: exception: Key pair 'tempest-keypair-1429101792' already exists. Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1429101792', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbrO3Ave4D76FakdHL+66cXvkG7jgQ0PKV1Cf3dGylIwSCl/GJjvoQvjK3jF7j5baDFDuwxmbEgw1qQPt+gsgn30yWL10V4KnwQk7iXCanKyseQZ275A7LiBxHBClPHRw=='}}} Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7aa1f22691c14e87a9a9af92e422cdca-tempest-keypair-1429101792' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 12:28:16.116848 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:28:16.125370 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7aa1f22691c14e87a9a9af92e422cdca-tempest-keypair-1429101792' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 12, 28, 16, 9345), 'updated_at': None, 'name': 'tempest-keypair-1429101792', 'user_id': '7aa1f22691c14e87a9a9af92e422cdca', 'fingerprint': 'aa:11:ee:98:fc:03:11:6d:0f:bb:7e:4e:aa:e9:36:42', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbrO3Ave4D76FakdHL+66cXvkG7jgQ0PKV1Cf3dGylIwSCl/GJjvoQvjK3jF7j5baDFDuwxmbEgw1qQPt+gsgn30yWL10V4KnwQk7iXCanKyseQZ275A7LiBxHBClPHRw==', 'type': 'ssh'}] Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi keypair.create() Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._create() Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1429101792' already exists. Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 02 12:28:16.145650 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1429101792' already exists. Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1429101792' already exists. Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:16.160309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61102054-6667-43a1-a896-d0410dd31a75 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Returning 409 to user: Key pair 'tempest-keypair-1429101792' already exists. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:16.167377 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-61102054-6667-43a1-a896-d0410dd31a75 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.281124 Nov 02 12:28:16.180309 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1024/2028] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:28:15 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 296 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:28:16.191859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:16.198592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:16.237212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:16.239011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:16.240262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:16.247073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:16.248784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:16.249997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:16.702625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe041299-6009-43c0-a54d-2fed8f38c579 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:16.731999 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe041299-6009-43c0-a54d-2fed8f38c579 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1213 microversion: 2.1 time: 0.650174 Nov 02 12:28:16.758876 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1005/2029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:16 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1213 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:16.790895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c894413e-f428-402a-8355-58267fc26c93 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Calling method '.version_select at 0x7f228ebb1c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:16.866892 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c894413e-f428-402a-8355-58267fc26c93 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429101792" status: 202 len: 0 microversion: 2.1 time: 0.102054 Nov 02 12:28:16.868955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1006/2030] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:28:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429101792 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:28:16.875320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:16.899612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:16.917528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:16.918754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:16.921405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:16.926268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:16.927224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:16.927920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:17.032726 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-277e67f0-9955-4fcc-88fb-7fab268b5dd6 tempest-LiveMigrationTest-1750595821 tempest-LiveMigrationTest-1750595821-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1533 microversion: 2.1 time: 0.850023 Nov 02 12:28:17.038538 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1025/2031] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:16 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1533 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:17.078920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:17.080679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:17.143962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:17.155261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:17.156856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:17.158635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:17.159940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:17.167154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:18.025036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:18.042361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:18.048122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:18.049400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:18.052342 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df028bc8-b703-4db3-a576-98c1608faafd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 1.181539 Nov 02 12:28:18.067708 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1007/2032] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:16 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:18.085678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8698d5bd-62ca-4050-8f94-3a307140e1e4 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Action: 'create', calling method: .version_select at 0x7f2292b19550>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0N+EDGxf0Mq8rsdQrjaWhM9MQPmZD7QoDnmuMe76MeR8EKkDx+q2oHn/1oXoozGVTnTdG/JH2lTjNyu9FzEk2io5V+pRKQHYFQgt/8DvuiwNqs8TlSAiFdT7lftiGBWQ=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:18.092956 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09110d1c-b145-48fa-9d57-c3cde720720b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1471 microversion: 2.1 time: 1.050717 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8698d5bd-62ca-4050-8f94-3a307140e1e4 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Request method failure captured: Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 247 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmJZ1Onj-VL_bAR9SGo4tAsPemUwuP0sFA_uq-JtHBOx_oaPjMAtz00hkxCMfW_4n-cmKrRKQTv579UqOIR9LHtUAfF5x8eBW15VZzXT0T_GzCuhLCj_81HNckYZm2l0PdEw8dn-HbZnPkIIJLjFhAPZZ-lwZ_Y5Ua3M0ZpYh1YkYZk Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0N+EDGxf0Mq8rsdQrjaWhM9MQPmZD7QoDnmuMe76MeR8EKkDx+q2oHn/1oXoozGVTnTdG/JH2lTjNyu9FzEk2io5V+pRKQHYFQgt/8DvuiwNqs8TlSAiFdT7lftiGBWQ=="}} Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0N+EDGxf0Mq8rsdQrjaWhM9MQPmZD7QoDnmuMe76MeR8EKkDx+q2oHn/1oXoozGVTnTdG/JH2lTjNyu9FzEk2io5V+pRKQHYFQgt/8DvuiwNqs8TlSAiFdT7lftiGBWQ=='}}} Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi '' Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:28:18.095871 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:28:18.103916 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:18.106946 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1026/2033] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:17 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1471 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:18.108717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8698d5bd-62ca-4050-8f94-3a307140e1e4 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:18.110118 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8698d5bd-62ca-4050-8f94-3a307140e1e4 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.036219 Nov 02 12:28:18.111794 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1008/2034] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:28:18 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:28:18.122682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:18.124181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:18.127263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:18.127828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:18.137607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:18.138217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:18.139552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:18.140168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:18.140453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:18.141058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:18.141462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:18.141599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:18.142411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:18.143610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:18.144431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:18.145129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:18.227870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:28:18.554053 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa3cd58e-384d-49fd-b722-c46be0c40246 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 204 len: 0 microversion: 2.1 time: 0.434669 Nov 02 12:28:18.555602 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1027/2035] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:28:18 2022] DELETE /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:28:18.568435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:18.570302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:18.581471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:18.582621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:18.583529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:18.585888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:18.586756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:18.587564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:19.264055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:19.310912 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-077c342f-d7e2-4f59-8c31-26aa8204106e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1273 microversion: 2.1 time: 0.747923 Nov 02 12:28:19.326007 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1028/2036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:18 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1273 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:19.342136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e2ee8763-0d3d-4084-b160-af2177f3ae3b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Action: 'create', calling method: .version_select at 0x7f228e84f0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-795825653", "public_key": " "}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:19.373762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e2ee8763-0d3d-4084-b160-af2177f3ae3b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:19.382996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e2ee8763-0d3d-4084-b160-af2177f3ae3b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for user 7aa1f22691c14e87a9a9af92e422cdca and project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:19.459435 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e2ee8763-0d3d-4084-b160-af2177f3ae3b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e2ee8763-0d3d-4084-b160-af2177f3ae3b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Request method failure captured: Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 94 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmJZ1Onj-VL_bAR9SGo4tAsPemUwuP0sFA_uq-JtHBOx_oaPjMAtz00hkxCMfW_4n-cmKrRKQTv579UqOIR9LHtUAfF5x8eBW15VZzXT0T_GzCuhLCj_81HNckYZm2l0PdEw8dn-HbZnPkIIJLjFhAPZZ-lwZ_Y5Ua3M0ZpYh1YkYZk Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-795825653", "public_key": " "}} Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-795825653', 'public_key': ' '}}} Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:19.463006 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e2ee8763-0d3d-4084-b160-af2177f3ae3b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:19.476702 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e2ee8763-0d3d-4084-b160-af2177f3ae3b tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.150734 Nov 02 12:28:19.486357 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1029/2037] 10.222.0.45 () {60 vars in 1158 bytes} [Wed Nov 2 12:28:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:28:19.494360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:19.495106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:19.509344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:19.509862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:19.510355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:19.511112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:19.511582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:19.512024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:19.562667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:19.600837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:19.619322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-287dc960-f0fe-414c-b99d-181dea48b763 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 1.504276 Nov 02 12:28:19.622655 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1009/2038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:18 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:19.633786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:19.634453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:19.655053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:19.661788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:19.662607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:19.669761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:19.673255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:19.680160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:20.149014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:20.186245 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-50668dd6-8725-43aa-8f08-79f37ed72db1 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1388 microversion: 2.1 time: 0.700255 Nov 02 12:28:20.209141 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1030/2039] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:19 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1388 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:20.257742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:20.264063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:20.289372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:20.292994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:20.301839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:20.313228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:20.318997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:20.322010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:20.522247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:20.576312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:20.580469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:20.583690 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b694c1dc-b695-4319-b66c-a5e1dd213da9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.959290 Nov 02 12:28:20.585561 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1010/2040] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:19 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:20.596635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5104df2-8170-413d-b824-921ecec32cf7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Action: 'create', calling method: .version_select at 0x7f2292b19160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkAXfixoPAErtKNgvnUWi8CAy0GdC7k/6cBa7+WWuetT6zGMZ2TaMJKDQ7AxXStc+Vgbjob4feq8H5CZ1H7QTHbfGwbYWZhsr7sjrtzcOfQ0L+4duliTh0z+0vBc1mj0w=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5104df2-8170-413d-b824-921ecec32cf7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Request method failure captured: Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 507 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmJZ1Onj-VL_bAR9SGo4tAsPemUwuP0sFA_uq-JtHBOx_oaPjMAtz00hkxCMfW_4n-cmKrRKQTv579UqOIR9LHtUAfF5x8eBW15VZzXT0T_GzCuhLCj_81HNckYZm2l0PdEw8dn-HbZnPkIIJLjFhAPZZ-lwZ_Y5Ua3M0ZpYh1YkYZk Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkAXfixoPAErtKNgvnUWi8CAy0GdC7k/6cBa7+WWuetT6zGMZ2TaMJKDQ7AxXStc+Vgbjob4feq8H5CZ1H7QTHbfGwbYWZhsr7sjrtzcOfQ0L+4duliTh0z+0vBc1mj0w=="}} Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkAXfixoPAErtKNgvnUWi8CAy0GdC7k/6cBa7+WWuetT6zGMZ2TaMJKDQ7AxXStc+Vgbjob4feq8H5CZ1H7QTHbfGwbYWZhsr7sjrtzcOfQ0L+4duliTh0z+0vBc1mj0w=='}}} Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 12:28:20.607127 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 12:28:20.616013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.623335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5104df2-8170-413d-b824-921ecec32cf7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:20.632500 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5104df2-8170-413d-b824-921ecec32cf7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.040358 Nov 02 12:28:20.639506 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1011/2041] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:28:20 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:28:20.676468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:20.695061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:20.740848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:20.742585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:20.743276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:20.744238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:20.744836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:20.745381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:20.808958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:20.847008 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8fd2f364-d488-490e-a816-58ccb41c6f83 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1476 microversion: 2.1 time: 0.611962 Nov 02 12:28:20.860382 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1031/2042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:20 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1476 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:20.884926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d255afe-442e-4f87-b75d-e44a889cab03 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Action: 'create', calling method: .version_select at 0x7f228eb908b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1854033094", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:20.922505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-2d255afe-442e-4f87-b75d-e44a889cab03 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:20.941607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-2d255afe-442e-4f87-b75d-e44a889cab03 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Getting quotas for user 7aa1f22691c14e87a9a9af92e422cdca and project 24c36d888d354bdc824b1dd9a8ffe0f0. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:20.967712 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-2d255afe-442e-4f87-b75d-e44a889cab03 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d255afe-442e-4f87-b75d-e44a889cab03 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Request method failure captured: Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 118 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmJZ1Onj-VL_bAR9SGo4tAsPemUwuP0sFA_uq-JtHBOx_oaPjMAtz00hkxCMfW_4n-cmKrRKQTv579UqOIR9LHtUAfF5x8eBW15VZzXT0T_GzCuhLCj_81HNckYZm2l0PdEw8dn-HbZnPkIIJLjFhAPZZ-lwZ_Y5Ua3M0ZpYh1YkYZk Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1854033094", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1854033094', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 12:28:20.970451 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 12:28:20.980542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:20.996308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d255afe-442e-4f87-b75d-e44a889cab03 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:20.999223 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d255afe-442e-4f87-b75d-e44a889cab03 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.136066 Nov 02 12:28:21.000302 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1032/2043] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:28:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:28:21.007956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:21.010716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:21.031976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:21.034308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:21.035130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:21.037425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:21.039686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:21.041655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:21.081910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:21.109210 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34bea31a-c903-4a07-b8bf-a76e827cca67 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1271 microversion: 2.1 time: 0.463562 Nov 02 12:28:21.117456 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1012/2044] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:20 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1271 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:21.134914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f75b49c-5f5b-4a3b-af81-8e17e0ccc4a7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Calling method '.version_select at 0x7f2292b24430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:21.222826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0f75b49c-5f5b-4a3b-af81-8e17e0ccc4a7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-546895301 not found for user 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f75b49c-5f5b-4a3b-af81-8e17e0ccc4a7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Request method failure captured: Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-546895301 HTTP/1.1 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmJZ1Onj-VL_bAR9SGo4tAsPemUwuP0sFA_uq-JtHBOx_oaPjMAtz00hkxCMfW_4n-cmKrRKQTv579UqOIR9LHtUAfF5x8eBW15VZzXT0T_GzCuhLCj_81HNckYZm2l0PdEw8dn-HbZnPkIIJLjFhAPZZ-lwZ_Y5Ua3M0ZpYh1YkYZk Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_24c36d888d354bdc824b1dd9a8ffe0f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 24c36d888d354bdc824b1dd9a8ffe0f0 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2008593083 Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2008593083-project Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: exception: Keypair tempest-keypair-non-existent-546895301 not found for user 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'tempest-keypair-non-existent-546895301'} Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-546895301 not found for user 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:21.239339 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-546895301 not found for user 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-546895301 not found for user 7aa1f22691c14e87a9a9af92e422cdca Nov 02 12:28:21.249627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:21.259599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f75b49c-5f5b-4a3b-af81-8e17e0ccc4a7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] Returning 404 to user: Keypair tempest-keypair-non-existent-546895301 not found for user 7aa1f22691c14e87a9a9af92e422cdca {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:21.259599 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f75b49c-5f5b-4a3b-af81-8e17e0ccc4a7 tempest-KeyPairsNegativeTestJSON-2008593083 tempest-KeyPairsNegativeTestJSON-2008593083-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-546895301" status: 404 len: 144 microversion: 2.1 time: 0.137022 Nov 02 12:28:21.262158 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1013/2045] 10.222.0.45 () {58 vars in 1257 bytes} [Wed Nov 2 12:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-546895301 => generated 144 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:28:21.278390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:21.281440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:21.325548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:21.328678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:21.329802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:21.331052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:21.333295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:21.335041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:21.520914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:21.558078 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-53c099ad-c4c6-4bc7-9e63-6a9851713d1e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1516 microversion: 2.1 time: 0.555608 Nov 02 12:28:21.562397 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1033/2046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:21 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1516 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:21.662566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:21.668807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:21.705848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:21.707538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:21.715179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:21.717531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:21.719272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:21.720546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:22.513289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:22.550126 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a2d7f665-6074-46ac-b0b7-735d0e11b42d tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1388 microversion: 2.1 time: 1.284308 Nov 02 12:28:22.558693 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1014/2047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:21 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1388 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:22.574394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:22.576563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:22.605768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:22.607192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:22.615017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:22.616810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:22.618071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:22.619512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:22.979420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:23.014512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:23.018283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:23.025251 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c9820a4e-94a7-4b06-91b3-b41a4c9332c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 1.397871 Nov 02 12:28:23.031300 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1034/2048] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:21 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:23.051976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:23.055792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:23.092657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:23.096670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:23.098062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:23.102579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:23.107962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:23.109829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:23.431990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:23.467700 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6055837-963e-4336-b5d4-520f60a0e3c0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1476 microversion: 2.1 time: 0.906900 Nov 02 12:28:23.473652 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1015/2049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:22 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1476 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:23.490443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:23.491577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:23.510756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:23.511925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:23.512742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:23.514022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:23.514952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:23.514952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:24.211033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:24.215562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:24.240324 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d7ef313-e1d9-4a04-ae6c-964d3be27897 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1522 microversion: 2.1 time: 0.764541 Nov 02 12:28:24.241241 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1016/2050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:23 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1522 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:24.253379 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-760a3541-d479-4799-9aea-cbc93a1be375 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1313 microversion: 2.1 time: 1.220005 Nov 02 12:28:24.263673 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1035/2051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:23 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1313 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:24.297813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d659f187-1b21-4767-aaae-34d84e222d1d req-08dc3215-29ee-4e61-9460-eefd3aede3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed050eff-b84c-4742-adf2-5e7437f8c1a7", "name": "network-vif-deleted", "tag": "16803170-ac59-42bc-83c0-a86a778086ff"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:24.312588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:24.324184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:24.390262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:24.391160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:24.392496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:24.393298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:24.418694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:24.422000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d659f187-1b21-4767-aaae-34d84e222d1d req-08dc3215-29ee-4e61-9460-eefd3aede3eb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:24.422835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d659f187-1b21-4767-aaae-34d84e222d1d req-08dc3215-29ee-4e61-9460-eefd3aede3eb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:24.431538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:24.438536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d659f187-1b21-4767-aaae-34d84e222d1d req-08dc3215-29ee-4e61-9460-eefd3aede3eb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:24.497933 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d659f187-1b21-4767-aaae-34d84e222d1d req-08dc3215-29ee-4e61-9460-eefd3aede3eb service nova] Creating event network-vif-deleted:16803170-ac59-42bc-83c0-a86a778086ff for instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 on n-h2-855650-5 Nov 02 12:28:24.517997 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d659f187-1b21-4767-aaae-34d84e222d1d req-08dc3215-29ee-4e61-9460-eefd3aede3eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262015 Nov 02 12:28:24.534001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1017/2052] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:24.560849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:24.563130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:24.585104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:24.586454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:24.587518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:24.589640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:24.591444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:24.592004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:24.882287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:25.306312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:25.358441 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-710724a8-b1f3-4c1f-8c98-bfd25735ba8b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1184 microversion: 2.1 time: 1.086441 Nov 02 12:28:25.363834 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1036/2053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:24 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1184 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:25.370913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:25.371593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:25.395536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:25.396529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:25.400098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:25.407823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:25.411355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:25.412606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:25.766530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:25.833462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:25.833462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:25.836314 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa0c2672-2e90-4371-a811-24e317dc8f84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 1.299685 Nov 02 12:28:25.837950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1018/2054] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:24 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:25.847654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:25.849147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:25.868539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:25.869814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:25.870935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:25.873441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:25.874703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:25.875754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:25.882227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:25.910579 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-90c87b13-f5a0-49cb-a351-6a48a56aa9d4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1476 microversion: 2.1 time: 0.534068 Nov 02 12:28:25.942775 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1037/2055] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:25 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1476 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:25.951631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:25.974639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:25.991975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:25.992643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:25.993124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:25.994027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:25.994520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:25.994960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:26.709796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=10 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:26.713753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:26.731567 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c0a8588-9154-4033-935e-3b3b76241f28 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1313 microversion: 2.1 time: 0.780559 Nov 02 12:28:26.738057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:26.745884 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1038/2056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:25 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1313 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:26.759525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:26.760548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:26.785642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:26.791398 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd99c3a7-ce91-400a-a233-67eb0483066f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1522 microversion: 2.1 time: 0.951557 Nov 02 12:28:26.792920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:26.793877 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1019/2057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:25 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1522 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:26.794715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:26.797433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:26.797949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:26.798546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:26.815189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-834209f3-d9ca-4cc5-9911-73989fec16bd req-24396b7a-38ba-41be-a7e4-72a6f934737a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "607c6541-4b70-4b25-accf-4561ab91c26b", "tag": "0c4c8c89-f026-4d9a-b76b-907dc8861e93"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:26.839669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-834209f3-d9ca-4cc5-9911-73989fec16bd req-24396b7a-38ba-41be-a7e4-72a6f934737a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:26.841145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-834209f3-d9ca-4cc5-9911-73989fec16bd req-24396b7a-38ba-41be-a7e4-72a6f934737a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:26.842232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-834209f3-d9ca-4cc5-9911-73989fec16bd req-24396b7a-38ba-41be-a7e4-72a6f934737a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:26.902982 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-834209f3-d9ca-4cc5-9911-73989fec16bd req-24396b7a-38ba-41be-a7e4-72a6f934737a service nova] Creating event network-changed:0c4c8c89-f026-4d9a-b76b-907dc8861e93 for instance 607c6541-4b70-4b25-accf-4561ab91c26b on n-h1-855650-5 Nov 02 12:28:26.917672 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-834209f3-d9ca-4cc5-9911-73989fec16bd req-24396b7a-38ba-41be-a7e4-72a6f934737a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120840 Nov 02 12:28:26.942187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1020/2058] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:26.972114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:26.972114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:26.989205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:26.992082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:26.997039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:26.998289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:26.999033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:26.999765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:27.068436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:27.086439 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba67ee82-8269-433a-9644-464daaa5bd05 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1184 microversion: 2.1 time: 0.333285 Nov 02 12:28:27.101174 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1039/2059] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:26 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1184 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:27.138481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:27.140337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:27.160313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:27.169391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:27.170723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:27.172485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:27.173778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:27.174918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:27.456957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:27.519903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:27.536039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:27.543011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f798845f-9b06-4f5e-aaf2-2c8fa40ef901 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.597854 Nov 02 12:28:27.548448 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1021/2060] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:26 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:27.627307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:27.641624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67d43070-9b36-4f72-9df3-afa859af49a5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1476 microversion: 2.1 time: 0.537242 Nov 02 12:28:27.663330 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1040/2061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:27 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1476 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:27.782675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:27.791288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:27.836336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:27.839553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:27.869624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:27.872694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:27.884217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:27.890263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:27.965383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88795f99-d37a-45a7-8248-262607c47bff tempest-AbsoluteLimitsTestJSON-424214832 tempest-AbsoluteLimitsTestJSON-424214832-project] Calling method '.version_select at 0x7f228e548310>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:28.013446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88795f99-d37a-45a7-8248-262607c47bff tempest-AbsoluteLimitsTestJSON-424214832 tempest-AbsoluteLimitsTestJSON-424214832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.014556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88795f99-d37a-45a7-8248-262607c47bff tempest-AbsoluteLimitsTestJSON-424214832 tempest-AbsoluteLimitsTestJSON-424214832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.015998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88795f99-d37a-45a7-8248-262607c47bff tempest-AbsoluteLimitsTestJSON-424214832 tempest-AbsoluteLimitsTestJSON-424214832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.020119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88795f99-d37a-45a7-8248-262607c47bff tempest-AbsoluteLimitsTestJSON-424214832 tempest-AbsoluteLimitsTestJSON-424214832-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.022591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88795f99-d37a-45a7-8248-262607c47bff tempest-AbsoluteLimitsTestJSON-424214832 tempest-AbsoluteLimitsTestJSON-424214832-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.024092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88795f99-d37a-45a7-8248-262607c47bff tempest-AbsoluteLimitsTestJSON-424214832 tempest-AbsoluteLimitsTestJSON-424214832-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.073724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88795f99-d37a-45a7-8248-262607c47bff tempest-AbsoluteLimitsTestJSON-424214832 tempest-AbsoluteLimitsTestJSON-424214832-project] 10.222.0.45 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.522933 Nov 02 12:28:28.086084 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1022/2062] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Nov 2 12:28:27 2022] GET /compute/v2.1/limits => generated 511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:28.116819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:28.117768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:28.148593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:28.154155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.160296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.162194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.167457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.171060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.176093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.283846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:29.129720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:29.145435 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-623d9712-7bc9-4911-9143-ac58cb307718 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1522 microversion: 2.1 time: 1.067870 Nov 02 12:28:29.146723 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1023/2063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:28 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1522 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:29.165532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:29.168761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:29.183491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:29.184813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:29.185268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.193036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:29.193646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:29.198247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.217157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:29.248653 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-095a7229-a561-455d-9b34-7b8dc84adc4b tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1313 microversion: 2.1 time: 1.480927 Nov 02 12:28:29.250310 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1041/2064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:27 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1313 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:29.273481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:29.279235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:29.342729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:29.343239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:29.343687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.361797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:29.366230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:29.374019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.893621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:29.922463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8b4e0e25-f092-4ec8-b4ce-94fb4557f4da tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1184 microversion: 2.1 time: 0.773819 Nov 02 12:28:29.929613 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1024/2065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:29 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1184 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:29.939572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:29.952789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:29.963258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:29.966297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:29.971792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:29.977449 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ba40148-55e9-4840-9ac8-9796a6641b92 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.723180 Nov 02 12:28:30.010011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.010620 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1042/2066] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:29 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:30.016588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.020137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.021200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.021990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.024324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.025887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7402a9e2-f2b5-4d65-8081-1a89b14f4a7c req-88f33384-e5ef-4744-8e38-d0a0bf2acb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d9a48d-0d18-4480-a9ae-708b657762df", "name": "network-vif-unplugged", "status": "completed", "tag": "796b559d-cae0-4c63-b9bc-bda8fc24354a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:30.067510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7402a9e2-f2b5-4d65-8081-1a89b14f4a7c req-88f33384-e5ef-4744-8e38-d0a0bf2acb28 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.070404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7402a9e2-f2b5-4d65-8081-1a89b14f4a7c req-88f33384-e5ef-4744-8e38-d0a0bf2acb28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.071533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7402a9e2-f2b5-4d65-8081-1a89b14f4a7c req-88f33384-e5ef-4744-8e38-d0a0bf2acb28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.101691 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7402a9e2-f2b5-4d65-8081-1a89b14f4a7c req-88f33384-e5ef-4744-8e38-d0a0bf2acb28 service nova] Creating event network-vif-unplugged:796b559d-cae0-4c63-b9bc-bda8fc24354a for instance 40d9a48d-0d18-4480-a9ae-708b657762df on n-h1-855650-5 Nov 02 12:28:30.115378 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7402a9e2-f2b5-4d65-8081-1a89b14f4a7c req-88f33384-e5ef-4744-8e38-d0a0bf2acb28 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101893 Nov 02 12:28:30.131528 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1043/2067] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:30.192381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:30.193462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:30.210123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.210617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.211065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.211805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.212263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.212690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.730967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:30.741648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a595b7c-0c91-4204-b64a-783e17ee2c72 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1476 microversion: 2.1 time: 0.810194 Nov 02 12:28:30.750627 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1025/2068] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:29 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1476 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:30.759486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:30.771142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:30.795469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.801491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.802675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.804192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.806515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.811769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.933018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:30.958579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=18 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:30.971119 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ec141ef5-0c6a-41ad-bb99-0583934f57bf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1522 microversion: 2.1 time: 0.783519 Nov 02 12:28:30.986945 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1044/2069] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:30 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1522 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:30.992513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:31.002941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:31.019984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:31.021393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:31.030895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:31.032960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:31.033579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:31.034191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:32.135584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:32.160416 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16cb587c-00c2-479d-b6d5-40f1885e3357 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1184 microversion: 2.1 time: 1.171127 Nov 02 12:28:32.182011 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1045/2070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:30 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1184 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:32.217841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:32.219481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:32.238266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:32.239699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:32.240835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:32.245117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:32.247068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:32.248411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:32.647089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:32.714315 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2ade0169-426c-4caf-89bc-f0de9e059bc2 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1313 microversion: 2.1 time: 1.957472 Nov 02 12:28:32.721788 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1026/2071] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:30 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1313 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:32.755680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:32.763265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:32.798505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:32.802449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:32.803723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:32.809550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:32.813169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:32.816150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:33.254428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:33.284816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:33.297858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:33.300878 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dbb5329b-96b5-4d80-ac91-7054a066fc7b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 1.100343 Nov 02 12:28:33.308337 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1046/2072] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:32 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:33.324222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:33.327482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:33.349845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:33.357446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:33.360456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:33.361477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:33.366333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:33.367423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:33.370935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:33.914360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:33.939994 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cd2d36e-e913-474f-871b-07dd17252f29 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1476 microversion: 2.1 time: 1.213629 Nov 02 12:28:33.941120 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1027/2073] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:32 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1476 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:34.264391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44a2efb0-4ae9-4b9c-a707-ae4f0e0a9fbd tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Action: 'create', calling method: .version_select at 0x7f2292ae7430>, body: {"keypair": {"name": "tempest-keypair-443722116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRXQuAlDbqUGgCsKlBfxtoKFPtT9IyFBEnUui7RWwCB8+ToPITdSSwxrTBkf8toADXGe+duvArEK/mOeNtJZmUi8nv4aZGt52Y/KBK5ABt4saG5fgaO5Qj2XcXzdGucVg=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:34.278653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:34.292148 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-861ab50b-8986-44a5-a47e-db763fcddd69 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1522 microversion: 2.1 time: 0.981436 Nov 02 12:28:34.294834 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1047/2074] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:33 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1522 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:34.307436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:34.309021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:34.323430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-44a2efb0-4ae9-4b9c-a707-ae4f0e0a9fbd tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Getting quotas for project a1169d053f1348a8830d578267cc0e8d. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:34.327706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.330877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.338817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:34.340114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.340840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.341516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:34.357010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-44a2efb0-4ae9-4b9c-a707-ae4f0e0a9fbd tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Getting quotas for user af9d8c2d0a444f659d398db2d9fb72f8 and project a1169d053f1348a8830d578267cc0e8d. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:34.432093 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44a2efb0-4ae9-4b9c-a707-ae4f0e0a9fbd tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.489086 Nov 02 12:28:34.432751 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1028/2075] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:28:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:34.484089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a93ae05f-03a7-4dc7-9dc5-2706bad94fc5 req-43b5397c-1857-46b9-8afd-6e3f41e8da26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d9a48d-0d18-4480-a9ae-708b657762df", "name": "network-vif-plugged", "status": "completed", "tag": "796b559d-cae0-4c63-b9bc-bda8fc24354a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:34.541082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a93ae05f-03a7-4dc7-9dc5-2706bad94fc5 req-43b5397c-1857-46b9-8afd-6e3f41e8da26 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.549767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a93ae05f-03a7-4dc7-9dc5-2706bad94fc5 req-43b5397c-1857-46b9-8afd-6e3f41e8da26 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.555968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a93ae05f-03a7-4dc7-9dc5-2706bad94fc5 req-43b5397c-1857-46b9-8afd-6e3f41e8da26 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:34.590886 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a93ae05f-03a7-4dc7-9dc5-2706bad94fc5 req-43b5397c-1857-46b9-8afd-6e3f41e8da26 service nova] Creating event network-vif-plugged:796b559d-cae0-4c63-b9bc-bda8fc24354a for instance 40d9a48d-0d18-4480-a9ae-708b657762df on n-h1-855650-5 Nov 02 12:28:34.609124 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a93ae05f-03a7-4dc7-9dc5-2706bad94fc5 req-43b5397c-1857-46b9-8afd-6e3f41e8da26 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145468 Nov 02 12:28:34.622471 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1029/2076] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:34.645362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:34.646776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:34.658591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:34.661707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:34.690157 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-46489311-10c2-4aaf-8189-afc29359b17f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 200 len: 1184 microversion: 2.1 time: 0.386774 Nov 02 12:28:34.699034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.699976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.700883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:34.701417 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1048/2077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:34 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 1184 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:34.707490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:34.715832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.716723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.717530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:34.718177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:34.734608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.740379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.741285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:34.742613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.743557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.747617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:36.151635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:36.160936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:36.168857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:36.170166 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-12062ab9-3fa8-4571-8b02-590a51d23e2e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 1.466666 Nov 02 12:28:36.170772 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1049/2078] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:34 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:36.205239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9dcfb51f-9974-45bb-95c8-2c6d15f8c3cb req-05f00ec4-25ba-4e78-ba31-fe2b88446625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3", "name": "network-vif-unplugged", "status": "completed", "tag": "505fabd6-494c-45db-a08c-cb6834eec257"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:36.215626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:36.237086 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8b1cf40d-610f-471d-8c41-993939314d7a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1313 microversion: 2.1 time: 1.609356 Nov 02 12:28:36.238295 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1030/2079] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:34 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1313 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:36.244525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9dcfb51f-9974-45bb-95c8-2c6d15f8c3cb req-05f00ec4-25ba-4e78-ba31-fe2b88446625 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:36.245026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9dcfb51f-9974-45bb-95c8-2c6d15f8c3cb req-05f00ec4-25ba-4e78-ba31-fe2b88446625 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:36.245474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9dcfb51f-9974-45bb-95c8-2c6d15f8c3cb req-05f00ec4-25ba-4e78-ba31-fe2b88446625 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:36.250495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:36.258295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:36.279867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:36.280811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:36.283636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:36.285385 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9dcfb51f-9974-45bb-95c8-2c6d15f8c3cb req-05f00ec4-25ba-4e78-ba31-fe2b88446625 service nova] Creating event network-vif-unplugged:505fabd6-494c-45db-a08c-cb6834eec257 for instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 on n-h2-855650-5 Nov 02 12:28:36.287292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:36.288157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:36.291554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:36.295495 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9dcfb51f-9974-45bb-95c8-2c6d15f8c3cb req-05f00ec4-25ba-4e78-ba31-fe2b88446625 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111544 Nov 02 12:28:36.307412 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1050/2080] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:36.338389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:36.349259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:36.380416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:36.380849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:36.381310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:36.382095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:36.382572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:36.383077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:36.957516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:36.975065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04747fdf-7829-4d25-8b85-1e43691c554d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1476 microversion: 2.1 time: 0.734579 Nov 02 12:28:36.990471 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1031/2081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:36 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1476 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:37.009432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:37.012575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: ed050eff-b84c-4742-adf2-5e7437f8c1a7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:37.029913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:37.032666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:37.033507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:37.034646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:37.038512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:37.039353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:37.082281 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] HTTP exception thrown: Instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 could not be found. Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Request method failure captured: Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 HTTP/1.1 Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmBfJBsIBh2Nu8uXQPw5WprwYJgNYw5DsgD0ftckilaZnovlpJZGlXj_Uyu4PTXl0ou-jklUnQyrQGckOFAILYCliww7GtNeRSszbIQX8U4aM5lOV9l8j6yAi5w_VFAH_svSRsnyrb4isVDJXByxs_XsIrCwur0L6-eELXh0xkSJFpw Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 3579208e4ca549d9a0cdb14af362384e Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-LiveMigrationTest-1823599828 Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-LiveMigrationTest-1823599828 Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 3579208e4ca549d9a0cdb14af362384e Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-LiveMigrationTest-1823599828 Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-LiveMigrationTest-1823599828-project Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 9f2ebf76beec4d3185c3c279868f8366 Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-LiveMigrationTest-1823599828-project Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 could not be found. Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'ed050eff-b84c-4742-adf2-5e7437f8c1a7'} Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 could not be found. Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 could not be found. Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:37.090781 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:37.096641 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:37.096641 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:37.096641 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:37.096641 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:28:37.096641 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:28:37.096641 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 could not be found. Nov 02 12:28:37.096641 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:28:37.100691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Returning 404 to user: Instance ed050eff-b84c-4742-adf2-5e7437f8c1a7 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:37.112525 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0fadbfb3-737c-4b44-abad-819a5e43497c tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7" status: 404 len: 111 microversion: 2.1 time: 0.105557 Nov 02 12:28:37.114026 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1032/2082] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:36 2022] GET /compute/v2.1/servers/ed050eff-b84c-4742-adf2-5e7437f8c1a7 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:28:37.135800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c6225f44-d3ab-44b7-9a09-1a20a0056200 req-62fa5d67-bb09-42b0-ac7a-e13f0fbc18c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607c6541-4b70-4b25-accf-4561ab91c26b", "name": "network-vif-plugged", "status": "completed", "tag": "0c4c8c89-f026-4d9a-b76b-907dc8861e93"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:37.194663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6225f44-d3ab-44b7-9a09-1a20a0056200 req-62fa5d67-bb09-42b0-ac7a-e13f0fbc18c1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:37.196555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6225f44-d3ab-44b7-9a09-1a20a0056200 req-62fa5d67-bb09-42b0-ac7a-e13f0fbc18c1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:37.197723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6225f44-d3ab-44b7-9a09-1a20a0056200 req-62fa5d67-bb09-42b0-ac7a-e13f0fbc18c1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:37.275010 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c6225f44-d3ab-44b7-9a09-1a20a0056200 req-62fa5d67-bb09-42b0-ac7a-e13f0fbc18c1 service nova] Creating event network-vif-plugged:0c4c8c89-f026-4d9a-b76b-907dc8861e93 for instance 607c6541-4b70-4b25-accf-4561ab91c26b on n-h1-855650-5 Nov 02 12:28:37.344214 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c6225f44-d3ab-44b7-9a09-1a20a0056200 req-62fa5d67-bb09-42b0-ac7a-e13f0fbc18c1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218912 Nov 02 12:28:37.357787 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1033/2083] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:28:37.406268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:37.407494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:37.470657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:37.471957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:37.475899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:37.480501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:37.483859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:37.507549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:37.892972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:37.926587 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e0fba9b-2845-4ecd-aa47-3bb75884c8ee tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1522 microversion: 2.1 time: 1.608766 Nov 02 12:28:37.928186 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1051/2084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:36 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1522 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:37.952593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:37.953250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:37.992324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:37.996465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:37.997235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:37.999138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:38.004117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:38.006716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:38.053291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:38.353196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:38.365552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:38.383724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:38.384997 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f5a08bf-b08d-4695-9542-a9e5be97cb84 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 1.024740 Nov 02 12:28:38.385596 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1034/2085] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:37 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:38.406543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:38.409083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:38.428519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:38.436468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:38.437457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:38.438732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:38.439451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:38.441868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:38.525693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:38.535213 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-43b0a45d-8c95-41b5-8fcb-063d961f590a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1313 microversion: 2.1 time: 0.605571 Nov 02 12:28:38.546017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1052/2086] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:37 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:38.557241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-209f6959-32f8-48aa-9143-394b92896aff req-15df2052-e195-4633-a2bb-a0dffedfc602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3", "tag": "505fabd6-494c-45db-a08c-cb6834eec257"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:38.614552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-209f6959-32f8-48aa-9143-394b92896aff req-15df2052-e195-4633-a2bb-a0dffedfc602 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:38.615473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-209f6959-32f8-48aa-9143-394b92896aff req-15df2052-e195-4633-a2bb-a0dffedfc602 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:38.616116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-209f6959-32f8-48aa-9143-394b92896aff req-15df2052-e195-4633-a2bb-a0dffedfc602 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:38.686779 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-209f6959-32f8-48aa-9143-394b92896aff req-15df2052-e195-4633-a2bb-a0dffedfc602 service nova] Creating event network-changed:505fabd6-494c-45db-a08c-cb6834eec257 for instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 on n-h2-855650-5 Nov 02 12:28:38.732831 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-209f6959-32f8-48aa-9143-394b92896aff req-15df2052-e195-4633-a2bb-a0dffedfc602 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183471 Nov 02 12:28:38.741363 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1053/2087] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:38.977728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:38.982285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:39.024447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:39.025303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:39.040789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:39.042183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:39.043846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:39.059310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:39.322131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:39.356547 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9126b886-4213-4349-88e3-9b30d23d01ec tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1476 microversion: 2.1 time: 0.969669 Nov 02 12:28:39.381684 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1035/2088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:38 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1476 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:39.426071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:39.426071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:39.486905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:39.492247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:39.492847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:39.504485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:39.507825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:39.507825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.037879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:40.103057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:40.126446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:40.139218 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-baf0505d-ae02-4961-8f2a-7294730b0281 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.719090 Nov 02 12:28:40.146779 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1036/2089] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:39 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:40.191801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:40.200032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:40.255825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:40.269416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:40.274285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.278931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:40.280159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:40.284607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.287020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:40.301792 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c1df4d6-b8f8-4370-b6ea-0bdc9e7822c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1507 microversion: 2.1 time: 1.331771 Nov 02 12:28:40.326134 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1054/2090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:38 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1507 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:40.371096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:40.371868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:40.428683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:40.442129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:40.443089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.444613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:40.447652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:40.448800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.863263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:40.881555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f1e20f6-fc93-4014-bdd2-8625c8011472 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 200 len: 1507 microversion: 2.1 time: 0.515793 Nov 02 12:28:40.883210 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1055/2091] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:40 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:40.888858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:40.892958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:40.927238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:40.931722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:40.932293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.937880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:40.938534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:40.942957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.962606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:40.983649 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4177232f-714c-4a51-9d57-ebdf2cb29c0f tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1313 microversion: 2.1 time: 0.832551 Nov 02 12:28:40.993488 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1037/2092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:40 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1313 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:41.231380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2eadb771-20ff-446b-93c1-899dd3143942 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Action: 'create', calling method: .version_select at 0x7f228ea3a700>, body: {"keypair": {"name": "tempest-keypair-1410186928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeIgpC1hMhGTc3QAzdlZcmW9rHz0VwK17zBCItd88Dr0LVfVAzdYg2IFSHruCMpKIDiE9wiYH7OVQjcz2gJj5ULkl2eGLTQpfNM6JOkoi2Gk1zo8JRexLim6TgWBDa80A=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:41.265573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-2eadb771-20ff-446b-93c1-899dd3143942 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Getting quotas for project 5f524fd657674a6d983357a1ac57e683. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:41.280203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-2eadb771-20ff-446b-93c1-899dd3143942 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Getting quotas for user b38bf7bb374b426bb140f534be4aa186 and project 5f524fd657674a6d983357a1ac57e683. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:41.327679 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2eadb771-20ff-446b-93c1-899dd3143942 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.341268 Nov 02 12:28:41.334140 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1038/2093] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:28:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:41.351575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:41.352394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:41.367373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:41.372030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:41.373478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:41.374500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:41.377726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:41.380065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:41.407264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:41.436002 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e1994542-f15a-47eb-90ce-d3c682694676 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1475 microversion: 2.1 time: 0.548589 Nov 02 12:28:41.440842 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1056/2094] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:40 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1475 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:41.443495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:28:41.459640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:41.462047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:41.488148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:41.489213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:41.497835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:41.501386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:41.504302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:41.505107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:41.719132 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a5beda82-1fc3-43a3-894d-514d2899697e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 204 len: 0 microversion: 2.1 time: 0.382189 Nov 02 12:28:41.724987 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1039/2095] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:28:41 2022] DELETE /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:28:41.764859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1730208518", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0fe55d05-f29a-4024-9acb-ee67b1b68097"}], "security_groups": [{"name": "tempest-securitygroup--1858133912"}], "key_name": "tempest-keypair-443722116", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:41.894380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:41.929162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:41.940414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:41.954443 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c27218b-d487-474b-aba5-8cc26aa2b45e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.503715 Nov 02 12:28:41.973096 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1057/2096] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:41 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:42.038980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:42.044689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:42.095828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:42.096606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:42.097353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:42.107059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:42.107883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:42.112353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:42.161932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] validate_networks() for [('0fe55d05-f29a-4024-9acb-ee67b1b68097', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:28:42.794788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:42.811343 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4bcd3003-9207-4e57-b56b-0368cc734379 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1313 microversion: 2.1 time: 0.789599 Nov 02 12:28:42.847526 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1058/2097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:42 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1313 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:42.857171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-338521238", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "fcc8bd62-cefc-49b7-bf94-3895bd70eb34"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:43.078641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] validate_networks() for [('fcc8bd62-cefc-49b7-bf94-3895bd70eb34', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:28:44.134131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Getting quotas for project a1169d053f1348a8830d578267cc0e8d. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:44.168475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Getting quotas for user af9d8c2d0a444f659d398db2d9fb72f8 and project a1169d053f1348a8830d578267cc0e8d. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:44.231485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:28:44.232287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:28:44.237203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:28:44.238250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:28:44.240555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:28:44.288965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.289487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.291739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:44.294517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.295261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.297289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:44.410325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Getting quotas for project a1169d053f1348a8830d578267cc0e8d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:44.495934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Getting quotas for user af9d8c2d0a444f659d398db2d9fb72f8 and project a1169d053f1348a8830d578267cc0e8d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:44.567349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:28:44.573849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:28:44.773492 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4b99446-1be4-4ef7-b62c-d125c4e5fe26 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.028058 Nov 02 12:28:44.779894 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1040/2098] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:28:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:28:44.793334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:44.805922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:44.831263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.838356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.840006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:44.841644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.842382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.845392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.012562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:28:45.013147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:28:45.013511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:28:45.014257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:28:45.014689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:28:45.048424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.048924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.049368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.050170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.050633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.051203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.115436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Getting quotas for project a46439c7bf424cb1961085f610858688. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:45.127905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Getting quotas for user 5def23f73ff644cb8a7625a128b58b73 and project a46439c7bf424cb1961085f610858688. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:45.162738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:28:45.169400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:28:45.221058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:45.236663 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-875faac3-9a6c-456a-ac98-ca4d7abe1cb6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1475 microversion: 2.1 time: 0.453375 Nov 02 12:28:45.237702 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1041/2099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:44 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1475 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:45.270834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-749c8664-57b7-477d-936a-c3b39f270533 req-7714bd2f-ddb6-4585-81ae-55d059766d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a522fa-dddf-4755-899a-445356170ce1", "name": "network-vif-unplugged", "status": "completed", "tag": "1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:45.307828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-749c8664-57b7-477d-936a-c3b39f270533 req-7714bd2f-ddb6-4585-81ae-55d059766d44 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.309021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-749c8664-57b7-477d-936a-c3b39f270533 req-7714bd2f-ddb6-4585-81ae-55d059766d44 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.309475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-749c8664-57b7-477d-936a-c3b39f270533 req-7714bd2f-ddb6-4585-81ae-55d059766d44 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.352738 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e6f03fde-2a63-4cfd-bac8-6fe29fd1f531 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.506665 Nov 02 12:28:45.355856 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1059/2100] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:28:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:28:45.393191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:45.393819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:45.395376 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-749c8664-57b7-477d-936a-c3b39f270533 req-7714bd2f-ddb6-4585-81ae-55d059766d44 service nova] Creating event network-vif-unplugged:1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa for instance 08a522fa-dddf-4755-899a-445356170ce1 on n-h2-855650-5 Nov 02 12:28:45.433255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-749c8664-57b7-477d-936a-c3b39f270533 req-7714bd2f-ddb6-4585-81ae-55d059766d44 service nova] Instance 08a522fa-dddf-4755-899a-445356170ce1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:28:45.441822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.442468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.442929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.443698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.444280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.444725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.478402 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-749c8664-57b7-477d-936a-c3b39f270533 req-7714bd2f-ddb6-4585-81ae-55d059766d44 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.230117 Nov 02 12:28:45.479327 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1042/2101] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:45.498227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:45.505096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:45.534203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.537463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.537945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.541431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.546012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.546547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.687202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:46.050755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:46.067279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:46.068919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:46.093180 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7879fbce-b9ae-4c89-a261-790d11ab6a3c tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.712831 Nov 02 12:28:46.094840 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1060/2102] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:45 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:46.116642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48e426b6-1b79-42e3-bdac-9ceecf201f02 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:46.135058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-48e426b6-1b79-42e3-bdac-9ceecf201f02 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:46.387073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:46.432528 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14b3a6bc-1961-469e-8738-785461ea800c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1499 microversion: 2.1 time: 0.943565 Nov 02 12:28:46.473212 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1043/2103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:45 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1499 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:46.503506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0158a3c2-d2dd-4396-9752-83cf51a04bff tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:46.504377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0158a3c2-d2dd-4396-9752-83cf51a04bff tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:46.566798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-48e426b6-1b79-42e3-bdac-9ceecf201f02 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:46.610182 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48e426b6-1b79-42e3-bdac-9ceecf201f02 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1277 microversion: 2.1 time: 0.506425 Nov 02 12:28:46.611403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0158a3c2-d2dd-4396-9752-83cf51a04bff tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:46.619835 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1061/2104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:46 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1277 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:46.625252 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0158a3c2-d2dd-4396-9752-83cf51a04bff tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1217 microversion: 2.1 time: 0.144501 Nov 02 12:28:46.627412 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1044/2105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:46 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:46.634707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:46.637725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:46.656990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:46.665335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:46.667975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:46.668797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:46.669431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:46.670424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:46.671075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:46.671698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:46.705583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:46.709599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:46.713846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:46.715339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:46.718250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:46.720132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:46.771020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lazy-loading 'flavor' on Instance uuid 607c6541-4b70-4b25-accf-4561ab91c26b {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:28:47.047387 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98b2d67f-efd6-4f2a-9910-7947f33a4994 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "POST /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b/action" status: 200 len: 32 microversion: 2.1 time: 0.416955 Nov 02 12:28:47.056765 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1045/2106] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:28:46 2022] POST /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b/action => generated 32 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:28:47.072942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:47.084117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:47.128477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:47.130374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:47.134359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:47.135260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:47.135857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:47.142910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:47.739619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:47.795064 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c47cb1c-23b3-4180-9c3d-715903225272 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1475 microversion: 2.1 time: 1.169380 Nov 02 12:28:47.797829 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1062/2107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:46 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1475 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:47.830258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:47.831342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:47.867920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:47.871442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:47.874574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:47.880194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:47.891067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:47.897590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.000683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:48.023148 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e0fb603-fb74-4b0b-a88a-acf2fdcff960 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.951653 Nov 02 12:28:48.035671 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1046/2108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:47 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:48.056285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.059608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.065507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:48.094658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.098629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.100773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.102587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.105010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.106665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.415360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:48.435097 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1549b8df-2de6-421a-b64a-2f90b4b6a6a9 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1329 microversion: 2.1 time: 0.390921 Nov 02 12:28:48.438056 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1047/2109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:48 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1329 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:48.449058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.452124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.468804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.473334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.473481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.474510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.474995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.477534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.695028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:48.720505 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b717fa22-8259-4f58-afb4-2f2cc0ff420c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1269 microversion: 2.1 time: 0.281096 Nov 02 12:28:48.721113 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1048/2110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:48 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1269 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:48.768188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.769568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.785412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.792414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.794289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.795494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.796175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.796803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.815971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:48.831763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:48.839038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:48.848876 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-72064fb0-0330-4637-87fb-c51f8d26fbcb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 1.044240 Nov 02 12:28:48.852111 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1063/2111] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:47 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:48.867265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.874639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.901781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.913943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.915154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.917048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.922289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.923549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.935898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:28:49.187322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bcdaa58d-072e-48b8-972c-db010417db5b tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 204 len: 0 microversion: 2.1 time: 0.453444 Nov 02 12:28:49.195140 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1049/2112] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:28:48 2022] DELETE /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:28:49.209513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ef74150e-b0ca-44e0-a457-435709f7e5fd req-65f4a689-9dab-431e-ab42-d30a0ef96b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d9a48d-0d18-4480-a9ae-708b657762df", "name": "network-vif-deleted", "tag": "796b559d-cae0-4c63-b9bc-bda8fc24354a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:49.233032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ef74150e-b0ca-44e0-a457-435709f7e5fd req-65f4a689-9dab-431e-ab42-d30a0ef96b13 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:49.233626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ef74150e-b0ca-44e0-a457-435709f7e5fd req-65f4a689-9dab-431e-ab42-d30a0ef96b13 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:49.234104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ef74150e-b0ca-44e0-a457-435709f7e5fd req-65f4a689-9dab-431e-ab42-d30a0ef96b13 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:49.277931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ef74150e-b0ca-44e0-a457-435709f7e5fd req-65f4a689-9dab-431e-ab42-d30a0ef96b13 service nova] Creating event network-vif-deleted:796b559d-cae0-4c63-b9bc-bda8fc24354a for instance 40d9a48d-0d18-4480-a9ae-708b657762df on n-h1-855650-5 Nov 02 12:28:49.301827 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ef74150e-b0ca-44e0-a457-435709f7e5fd req-65f4a689-9dab-431e-ab42-d30a0ef96b13 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104539 Nov 02 12:28:49.303038 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1050/2113] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:49.369105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:49.369531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:49.372305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:49.383907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:49.387166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:49.387714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:49.388473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:49.388950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:49.389382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:49.394839 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-638acc8e-6a42-4617-871a-53e55abaa28f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1475 microversion: 2.1 time: 0.532638 Nov 02 12:28:49.406055 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1064/2114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:48 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1475 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:49.406055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:49.406055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:49.412540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:49.414000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:49.414945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:49.416963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:49.417766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:49.418464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:49.952179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:49.979543 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3915e17-2936-4b00-b6cc-020a3e4ba0e7 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.617812 Nov 02 12:28:49.996406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1051/2115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:49 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:50.007514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:50.011291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:50.028359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.029251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.029858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.030868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.038851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.039405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.167552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:50.212503 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dac6c221-3d44-4ae2-9ba1-42cb867d2cb7 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1667 microversion: 2.1 time: 0.814138 Nov 02 12:28:50.213848 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1065/2116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:49 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1667 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:50.239053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:50.245849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:50.267221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.270481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.271324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.275008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.275876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.280941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.289479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:50.322093 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ae4bfc0-7141-40fd-8f98-a663db2313ae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1335 microversion: 2.1 time: 0.323665 Nov 02 12:28:50.324704 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1052/2117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:49 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1335 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:50.340552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:50.342603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:50.366489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.369270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.370750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.373569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.375019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.376806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.588166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:50.627429 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-393f41b1-3f2c-4b3e-9153-32c60ca9dcaf tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1275 microversion: 2.1 time: 0.411985 Nov 02 12:28:50.629667 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1066/2118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:50 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1275 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:50.635587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:50.636533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:50.653942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.655076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.655745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.656693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.657390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.657893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.287204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:51.302863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:51.305171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:51.307598 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5595f5ea-a5dd-471c-9e1a-493cf3c497f6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.980146 Nov 02 12:28:51.315438 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1053/2119] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:50 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:51.330398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:51.334039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:51.356471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:51.359671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.361029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.363237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.365735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.367148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.368301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.372830 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9e05eec8-5c09-42fd-9b27-1ee4cb6422b0 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1475 microversion: 2.1 time: 0.741590 Nov 02 12:28:51.373936 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1067/2120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:50 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1475 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:51.381108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:51.382463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:51.401595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.402818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.403551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.404711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.405364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.412875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.441855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:51.843695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:51.859225 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05244730-d1a5-473d-84ed-58ff3362625a tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1667 microversion: 2.1 time: 0.483644 Nov 02 12:28:51.861380 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1068/2121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:51 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1667 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:51.870282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:51.871686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:51.890980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:51.892132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.893793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.894020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.895688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.897318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.897568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.920049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96a4c92b-57a7-4ee5-a9f1-081dd8dff7e3 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.602292 Nov 02 12:28:51.933164 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1054/2122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:51 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:51.940890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-db541bdb-0e7c-468c-9081-0dcd8cbbdce9 req-a6e83ab7-2f2b-4474-bb3b-744f82589271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a522fa-dddf-4755-899a-445356170ce1", "tag": "1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:51.969369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-db541bdb-0e7c-468c-9081-0dcd8cbbdce9 req-a6e83ab7-2f2b-4474-bb3b-744f82589271 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.970021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-db541bdb-0e7c-468c-9081-0dcd8cbbdce9 req-a6e83ab7-2f2b-4474-bb3b-744f82589271 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.970485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-db541bdb-0e7c-468c-9081-0dcd8cbbdce9 req-a6e83ab7-2f2b-4474-bb3b-744f82589271 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.993290 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-db541bdb-0e7c-468c-9081-0dcd8cbbdce9 req-a6e83ab7-2f2b-4474-bb3b-744f82589271 service nova] Creating event network-changed:1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa for instance 08a522fa-dddf-4755-899a-445356170ce1 on n-h2-855650-5 Nov 02 12:28:52.004932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-db541bdb-0e7c-468c-9081-0dcd8cbbdce9 req-a6e83ab7-2f2b-4474-bb3b-744f82589271 service nova] Instance 08a522fa-dddf-4755-899a-445356170ce1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:28:52.026271 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-db541bdb-0e7c-468c-9081-0dcd8cbbdce9 req-a6e83ab7-2f2b-4474-bb3b-744f82589271 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095910 Nov 02 12:28:52.026271 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1055/2123] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:52.034826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:52.035572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:52.052013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:52.059497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:52.062671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:52.063344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:52.064059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:52.066746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:52.067407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:52.077688 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d9d39cd-2561-4e71-adfd-97a74a8ef547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1335 microversion: 2.1 time: 0.214469 Nov 02 12:28:52.082102 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1069/2124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:51 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:52.218967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:52.228011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8037a163-ff37-4dda-8d88-b01498a70acc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1275 microversion: 2.1 time: 0.198981 Nov 02 12:28:52.236434 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1056/2125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:52 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:52.372390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:52.384480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:52.403913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:52.405051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:52.409448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:52.412672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:52.418298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:52.420622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:52.425717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:52.432430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:52.454963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:52.456523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:52.457834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:52.460773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:52.462515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:52.465186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.079719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.093683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.115867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.118969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.125441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-29a2f9d9-0fb8-4962-8eae-83dd59924429 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1475 microversion: 2.1 time: 0.707105 Nov 02 12:28:53.127726 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1057/2126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:52 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1475 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:53.130949 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-82f5d6b2-0f4f-4eb1-97b7-8a6385dbead4 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.764741 Nov 02 12:28:53.133112 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1070/2127] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:52 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:53.145798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:53.149060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:53.149305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:53.155756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:53.164189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.165115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.165593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.166873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.167384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.169439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.211236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.212765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.213900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.215682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.216866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.218035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.236842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:53.371221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.388104 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ada6cf7-e71a-4b1d-a3ba-1b07187a3fbc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 200 len: 1600 microversion: 2.1 time: 0.250615 Nov 02 12:28:53.399017 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1058/2128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:53 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 1600 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:53.413329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:53.413781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:53.425296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.426596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.428444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.430082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.431209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.432189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.644447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.656506 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd336d87-fcb0-4341-a70f-bcf4e5545b18 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.523577 Nov 02 12:28:53.657894 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1071/2129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:53 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:53.663336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3af00b30-6353-4f81-b609-332377628d41 req-90c50387-1ef5-4cf0-9a95-c6e89a197bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce3f9c6-de73-4a88-8cb8-a20198986ffb", "name": "network-vif-deleted", "tag": "ced7ed63-2e97-4192-938d-c3e96e6d249f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:53.677271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3af00b30-6353-4f81-b609-332377628d41 req-90c50387-1ef5-4cf0-9a95-c6e89a197bd9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.678187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3af00b30-6353-4f81-b609-332377628d41 req-90c50387-1ef5-4cf0-9a95-c6e89a197bd9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.679095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3af00b30-6353-4f81-b609-332377628d41 req-90c50387-1ef5-4cf0-9a95-c6e89a197bd9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.694616 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3af00b30-6353-4f81-b609-332377628d41 req-90c50387-1ef5-4cf0-9a95-c6e89a197bd9 service nova] Creating event network-vif-deleted:ced7ed63-2e97-4192-938d-c3e96e6d249f for instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb on n-h1-855650-5 Nov 02 12:28:53.701180 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3af00b30-6353-4f81-b609-332377628d41 req-90c50387-1ef5-4cf0-9a95-c6e89a197bd9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041553 Nov 02 12:28:53.702565 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1072/2130] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:53.709564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:53.710765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:53.719718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.720573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.721258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.722285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.723114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.723812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.771515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.788003 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d346c08-ae5a-4ee9-9136-b5b1d7965753 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.387718 Nov 02 12:28:53.804407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1059/2131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:53 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:53.827187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.836579 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-86628797-7143-45a3-987f-842010c89a0a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1275 microversion: 2.1 time: 0.132226 Nov 02 12:28:53.837429 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1073/2132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:53 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1275 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:54.211118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:54.211810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:54.212531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:54.215672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:54.226330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.229160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.231038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.232169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.233126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.233898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.234581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.235305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.236008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.236962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.240227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.240898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.352524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:54.592543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:54.610079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:54.613040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:54.615460 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-06445411-0a96-4213-b154-232973eb0e65 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.410427 Nov 02 12:28:54.630964 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1074/2133] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:54 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:28:54.647211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:54.647845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: 3ce3f9c6-de73-4a88-8cb8-a20198986ffb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:54.665322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.666426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.667146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.668896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.669820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.670563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.707221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] HTTP exception thrown: Instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb could not be found. Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Request method failure captured: Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb HTTP/1.1 Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBfJBsIBh2Nu8uXQPw5WprwYJgNYw5DsgD0ftckilaZnovlpJZGlXj_Uyu4PTXl0ou-jklUnQyrQGckOFAILYCliww7GtNeRSszbIQX8U4aM5lOV9l8j6yAi5w_VFAH_svSRsnyrb4isVDJXByxs_XsIrCwur0L6-eELXh0xkSJFpw Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 3579208e4ca549d9a0cdb14af362384e Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-LiveMigrationTest-1823599828 Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-LiveMigrationTest-1823599828 Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 3579208e4ca549d9a0cdb14af362384e Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-LiveMigrationTest-1823599828 Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-LiveMigrationTest-1823599828-project Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 9f2ebf76beec4d3185c3c279868f8366 Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-LiveMigrationTest-1823599828-project Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb could not be found. Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3ce3f9c6-de73-4a88-8cb8-a20198986ffb'} Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb could not be found. Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb could not be found. Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:28:54.710327 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:54.713897 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:28:54.713897 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:28:54.713897 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:28:54.713897 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:28:54.713897 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:28:54.713897 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb could not be found. Nov 02 12:28:54.713897 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:28:54.713897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Returning 404 to user: Instance 3ce3f9c6-de73-4a88-8cb8-a20198986ffb could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:28:54.714862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:54.715426 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba7a2c0e-d2ae-47f3-8854-2b076052d8d8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb" status: 404 len: 111 microversion: 2.1 time: 0.081075 Nov 02 12:28:54.719944 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1075/2134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:54 2022] GET /compute/v2.1/servers/3ce3f9c6-de73-4a88-8cb8-a20198986ffb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:28:54.730042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:54.734621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:54.756070 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17e08512-6ae2-4de8-bfeb-3d06d0251732 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1475 microversion: 2.1 time: 0.557997 Nov 02 12:28:54.757103 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1060/2135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:54 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1475 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:54.773140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.774072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.793548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.794834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.795620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.796322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.806265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4719f1d1-848b-4ade-bae2-bace677b33e3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '.version_select at 0x7f2292ad64c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:54.878979 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4719f1d1-848b-4ade-bae2-bace677b33e3 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541728575" status: 202 len: 0 microversion: 2.1 time: 0.087790 Nov 02 12:28:54.885628 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1061/2136] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541728575 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:28:54.894364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:54.895144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:54.902096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.902866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.903796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:54.904736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:54.905509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:54.906142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.079015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:55.359017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:55.363241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:55.373369 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-68fe3864-7f50-46db-bfe5-d380d44446ed tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.486000 Nov 02 12:28:55.392514 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1062/2137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:54 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:55.395978 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b15f0f03-9645-425c-8657-2185456138ae tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.673799 Nov 02 12:28:55.397749 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1076/2138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:54 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:55.408972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:55.409820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:55.425435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.426332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.427116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.428236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.428906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.429446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.652730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:55.655082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:55.674420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.676824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.678848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.680631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.681947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.683120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:56.007759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:56.034743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5455d1c9-863a-4e52-bf32-c1e8e978aa4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.640296 Nov 02 12:28:56.040480 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1063/2139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:55 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:56.063800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:56.064904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:56.075672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:56.076505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:56.077361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:56.078612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:56.079281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:56.079884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:56.503398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:56.513531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:56.515296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:56.516817 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e1e7805e-e842-4648-a02e-6475c03667e1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1486 microversion: 2.25 time: 0.872439 Nov 02 12:28:56.517455 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1077/2140] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:55 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1486 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:56.523810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:56.524816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:56.532469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:56.533316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:56.533993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:56.535017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:56.535702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:56.536337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:56.603133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:56.616381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=22 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:56.756899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:56.786025 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af0b89c1-ea11-4042-a024-54136ad59858 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1473 microversion: 2.1 time: 0.741684 Nov 02 12:28:56.796115 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1064/2141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:56 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1473 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:56.803979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:56.807065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:56.831233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:56.832235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:56.833177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:56.834501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:56.835451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:56.836102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:57.176937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:57.200438 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-44cd3309-f5ca-4bed-a211-cbfb6559735f tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.680827 Nov 02 12:28:57.202474 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1078/2142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:56 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:57.213197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-455027111", "imageRef": "2888785c-54cb-48a3-b512-90203396187c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "acd1e7e6-a566-4205-b17c-bb6fd387688a"}], "security_groups": [{"name": "tempest-securitygroup--232037751"}], "key_name": "tempest-keypair-1410186928", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:57.223895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:57.249441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15e193c1-a617-4e29-8907-56d4f57206d5 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.451227 Nov 02 12:28:57.250555 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1065/2143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:56 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:57.255982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:57.257083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:57.269437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:57.274571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:57.275374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:57.276474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:57.277742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:57.282136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:57.541801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] validate_networks() for [('acd1e7e6-a566-4205-b17c-bb6fd387688a', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:28:57.839659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:57.849743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d11f441f-dfae-4449-8871-6b2a73104488 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.597792 Nov 02 12:28:57.869172 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1066/2144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:57 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:57.875365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:57.876967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:57.884944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:57.886180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:57.887301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:57.888422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:57.889251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:57.889918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:58.809195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:58.828624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:58.831402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:58.835298 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f602d8a8-3423-459d-bf10-f2711279d6ed tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1476 microversion: 2.25 time: 0.963504 Nov 02 12:28:58.837182 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1067/2145] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:28:57 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1476 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:58.847571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:58.848665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:58.861154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:58.862287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:58.863077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:58.865364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:58.866257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:58.866961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.148775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:28:59.149447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:28:59.150064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:28:59.150776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:28:59.151153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:28:59.162037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:59.172452 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0359663f-d451-4b69-ac5f-a237ad9b5451 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1473 microversion: 2.1 time: 0.333272 Nov 02 12:28:59.173061 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1068/2146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:58 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:59.180916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.181611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.182086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.182856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.184105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.184556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.200721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:59.202313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:59.206978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Getting quotas for project 5f524fd657674a6d983357a1ac57e683. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:59.213499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Getting quotas for user b38bf7bb374b426bb140f534be4aa186 and project 5f524fd657674a6d983357a1ac57e683. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:59.216811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.218066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.218761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.220085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.221341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.222157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.247309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:28:59.249953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2888785c-54cb-48a3-b512-90203396187c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:28:59.404687 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8ea3a610-3f22-4cf6-a6d5-3e2bfed16b76 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.193769 Nov 02 12:28:59.406051 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1079/2147] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:28:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:28:59.411142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:59.438300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:59.458461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.461417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.462339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.466855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.469698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.470952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.556398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:59.572793 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e3b38903-e041-405a-a925-8b4f07e2f48c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.397866 Nov 02 12:28:59.575050 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1069/2148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:59 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:59.587717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-46b260e8-d534-4f1b-b357-68f8968a3113 req-04b18f04-0eeb-43a7-8214-89c1dd614c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6933b3c7-ad8a-4156-b959-f9c145bf08f0", "tag": "d22f84e2-3fb0-4d88-816d-1d02b67f5815"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:59.611430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-46b260e8-d534-4f1b-b357-68f8968a3113 req-04b18f04-0eeb-43a7-8214-89c1dd614c11 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.612340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-46b260e8-d534-4f1b-b357-68f8968a3113 req-04b18f04-0eeb-43a7-8214-89c1dd614c11 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.613136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-46b260e8-d534-4f1b-b357-68f8968a3113 req-04b18f04-0eeb-43a7-8214-89c1dd614c11 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.637810 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-46b260e8-d534-4f1b-b357-68f8968a3113 req-04b18f04-0eeb-43a7-8214-89c1dd614c11 service nova] Creating event network-changed:d22f84e2-3fb0-4d88-816d-1d02b67f5815 for instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 on n-h2-855650-5 Nov 02 12:28:59.661169 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-46b260e8-d534-4f1b-b357-68f8968a3113 req-04b18f04-0eeb-43a7-8214-89c1dd614c11 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081018 Nov 02 12:28:59.663792 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1070/2149] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:59.681360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:59.682918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:59.737016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.737654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.738348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.739949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.741104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.742121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.785890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:59.800276 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-225c2d77-e4e8-4956-9b80-ee9817126983 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.392894 Nov 02 12:28:59.801105 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1080/2150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:59 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:59.810213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:59.818013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:59.833542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:59.845732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.846126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.846937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.848299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.848903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.849453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.853440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:00.135568 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05638506-b700-4132-98fb-7202cb7cecbd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 204 len: 0 microversion: 2.1 time: 0.467065 Nov 02 12:29:00.137552 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1071/2151] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:28:59 2022] DELETE /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:29:00.146524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd4ce7d6-c7ee-4418-8806-b35f1344dbaf tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '.version_select at 0x7f228eb4ee50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:00.151614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7d6-c7ee-4418-8806-b35f1344dbaf tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:00.153000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7d6-c7ee-4418-8806-b35f1344dbaf tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:00.153674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd4ce7d6-c7ee-4418-8806-b35f1344dbaf tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:00.162128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:00.174078 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0957261e-00cc-430a-acf4-f99e52f3c9e9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.370590 Nov 02 12:29:00.189481 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd4ce7d6-c7ee-4418-8806-b35f1344dbaf tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 3209 microversion: 2.25 time: 0.049921 Nov 02 12:29:00.190358 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1072/2152] 10.222.0.45 () {60 vars in 1184 bytes} [Wed Nov 2 12:29:00 2022] GET /compute/v2.1/os-migrations => generated 3209 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:00.201917 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1081/2153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:59 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:00.212526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0927e1f9-1a6a-4ff9-bc85-5e09a46ef4d7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:00.212526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0927e1f9-1a6a-4ff9-bc85-5e09a46ef4d7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:00.225557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:00.227644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:00.247143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:00.249373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:00.250901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:00.252184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:00.253217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:00.253915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:00.328251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0927e1f9-1a6a-4ff9-bc85-5e09a46ef4d7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:00.347873 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0927e1f9-1a6a-4ff9-bc85-5e09a46ef4d7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1245 microversion: 2.1 time: 0.151968 Nov 02 12:29:00.349401 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1082/2154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:00 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1245 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:00.383180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:00.384434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:00.405505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:00.414049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:00.418228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:00.423488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:00.425368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:00.426482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:00.878850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:00.919093 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dfd242a9-4d7b-435e-9b2c-f5cc44c381c8 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1486 microversion: 2.1 time: 0.708439 Nov 02 12:29:00.922506 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1073/2155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:00 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1486 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:00.984799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:00.987983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:00.994168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:01.007228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.008488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.009529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.011781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.012897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.013955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.021329 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a63db9b-4809-47e9-b46c-374e529597aa tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1473 microversion: 2.1 time: 0.668180 Nov 02 12:29:01.028163 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1083/2156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:00 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1473 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:01.054405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:01.055595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:01.085155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.088167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.088787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.095902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.100492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.107482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.423691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] Lazy-loading 'services' on Instance uuid e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:01.470536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:01.487916 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b4b0906d-2e63-4bdb-b05f-eb733afff585 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.455307 Nov 02 12:29:01.490250 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1084/2157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:01 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:01.493202 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b498ed5e-0181-4139-a13e-4a91b3bf04a8 tempest-LiveAutoBlockMigrationV225Test-572884954 tempest-LiveAutoBlockMigrationV225Test-572884954-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1968 microversion: 2.25 time: 0.538147 Nov 02 12:29:01.495391 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1074/2158] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:00 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1968 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:01.498580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:01.499633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:01.510265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:01.512731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:01.515157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.515942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.516780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.517842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.518435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.518876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.530075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.531453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.532782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.534569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.536131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.537254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.628578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:02.040029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:02.058792 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b62b0ce-e99d-4fd6-a1cd-bdf51d292290 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.562692 Nov 02 12:29:02.074474 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1085/2159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:01 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:02.085101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:02.088741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:02.103703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.104318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.106460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.110151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.111863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.112793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.133757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:02.145742 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f0630fa-818b-4634-9801-e49e0b4adb67 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.647757 Nov 02 12:29:02.147212 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1075/2160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:01 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:02.162239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:02.163195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:02.176634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.177046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.177497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.178258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.178716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.179325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.213884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:02.227467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:02.242205 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-202273de-682b-4e36-92ad-6bff4dc0e04f tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1297 microversion: 2.1 time: 0.176945 Nov 02 12:29:02.244409 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1086/2161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:02 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1297 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:02.253270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:02.254989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:02.269836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.271290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.272413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.274163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.275404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.276425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.381047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6c89eb33-118f-4806-884f-d0a9f5a0038d tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 204 len: 0 microversion: 2.25 time: 0.230536 Nov 02 12:29:02.383670 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1076/2162] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:29:02 2022] DELETE /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:29:02.397756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:02.399841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:02.410499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.411550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.412484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.413913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.414708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.415520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.552521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:02.564221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9d9a2f10-7581-4742-97d4-0ae2c00ced03 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1486 microversion: 2.1 time: 0.317418 Nov 02 12:29:02.565616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1087/2163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:02 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1486 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:02.577672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:02.578693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:02.587808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.588815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.589630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.590729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.591365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.591985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.600796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:02.672428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:02.686523 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ca59672-12e3-4101-b535-0ee0cd10af9a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1470 microversion: 2.1 time: 0.300323 Nov 02 12:29:02.687843 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1077/2164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:02 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1470 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:02.694780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:02.695942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:02.704813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.705633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.706303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:02.707383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:02.708096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:02.708716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.013468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:03.029547 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-daa6110f-70e3-45ff-b07c-e2a2e53894d1 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.339878 Nov 02 12:29:03.041773 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1078/2165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:02 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:03.054867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:03.056430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:03.074975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.076032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.077815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.080882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.082234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.083384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.117093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:03.127701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:03.129816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:03.131529 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-daf5cf9a-c753-4778-9a5c-ba74c9678e9b tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1482 microversion: 2.25 time: 0.564485 Nov 02 12:29:03.132427 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1088/2166] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:02 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1482 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:03.139444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:03.140435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:03.148202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.148899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.149671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.150657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.151280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.151864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.313933 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d2bab699-4c3e-4eaa-ae1d-d3af8d7f085a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1/action" status: 204 len: 0 microversion: 2.1 time: 0.267274 Nov 02 12:29:03.315996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1079/2167] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:29:03 2022] POST /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1/action => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:29:03.328300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:03.333160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:03.351901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.352858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.354427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.355267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.355866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.356310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.434194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:03.450226 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97b7fdaf-0c69-4b2a-b05f-795878b17baf tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.316478 Nov 02 12:29:03.450840 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1089/2168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:03 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:03.474505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:03.476833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:03.495526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.496986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.497598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.498576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.499273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.499875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.777361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:03.813557 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c520171-d394-4932-90db-c5294ec4bf4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1303 microversion: 2.1 time: 0.345062 Nov 02 12:29:03.817621 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1090/2169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:03 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1303 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:03.830971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:03.832428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:03.852789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.853816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.854658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:03.856431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:03.857125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:03.859369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.109282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:04.136787 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-202365df-4e7c-4841-a813-382ec60f285f tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.818467 Nov 02 12:29:04.137765 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1080/2170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:03 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:04.167499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:04.169305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:04.206757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.207733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.208582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.209892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.210761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.211582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.477640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:04.503311 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e4127592-d1e5-47cb-aded-c7f52ba8ab87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1470 microversion: 2.1 time: 0.683908 Nov 02 12:29:04.504572 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1091/2171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:03 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1470 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:04.509609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6f25f3f3-9f38-46fb-8c9d-c24b0a54b0c4 req-ad2cdbb2-4b0f-4b41-b9cb-30000a96a85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a522fa-dddf-4755-899a-445356170ce1", "name": "network-vif-plugged", "status": "completed", "tag": "1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:04.546577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6f25f3f3-9f38-46fb-8c9d-c24b0a54b0c4 req-ad2cdbb2-4b0f-4b41-b9cb-30000a96a85b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.550531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6f25f3f3-9f38-46fb-8c9d-c24b0a54b0c4 req-ad2cdbb2-4b0f-4b41-b9cb-30000a96a85b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.551515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6f25f3f3-9f38-46fb-8c9d-c24b0a54b0c4 req-ad2cdbb2-4b0f-4b41-b9cb-30000a96a85b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.580539 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6f25f3f3-9f38-46fb-8c9d-c24b0a54b0c4 req-ad2cdbb2-4b0f-4b41-b9cb-30000a96a85b service nova] Creating event network-vif-plugged:1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa for instance 08a522fa-dddf-4755-899a-445356170ce1 on n-h2-855650-5 Nov 02 12:29:04.621876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-6f25f3f3-9f38-46fb-8c9d-c24b0a54b0c4 req-ad2cdbb2-4b0f-4b41-b9cb-30000a96a85b service nova] Instance 08a522fa-dddf-4755-899a-445356170ce1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:29:04.685731 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6f25f3f3-9f38-46fb-8c9d-c24b0a54b0c4 req-ad2cdbb2-4b0f-4b41-b9cb-30000a96a85b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178826 Nov 02 12:29:04.687819 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1092/2172] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:04.702670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:04.704629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:04.731474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.735440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.742342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.744327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.754815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.756097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.700311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:05.719300 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9de9d84c-3972-45fa-9d24-290e22e14943 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 200 len: 1486 microversion: 2.1 time: 1.571255 Nov 02 12:29:05.735499 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1081/2173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:04 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 1486 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:05.757557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:05.758240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:05.779178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.779877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.780341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.781111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.781649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.796305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.842457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:05.862891 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ca993fb7-c13b-434b-8f95-c589a0e1d547 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 1.171072 Nov 02 12:29:05.863758 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1093/2174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:04 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:05.890080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:05.891068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:05.954799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.955555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.956030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.956826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.957307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.957753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:06.572990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:06.584159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:06.586517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:06.590294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d021ab31-0376-412d-95fa-8c9b8becb4c2 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1482 microversion: 2.25 time: 0.847217 Nov 02 12:29:06.608595 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1082/2175] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:05 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1482 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:06.616206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:06.617287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:06.627634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:06.628529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:06.629241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:06.630405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:06.631142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:06.631825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:06.673685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:06.695983 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08783d4a-fd80-41a5-9bd1-df4d92dbae3c tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.830608 Nov 02 12:29:06.698252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1094/2176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:05 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:06.705381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:06.706404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:06.719921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:06.721360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:06.722151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:06.723850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:06.724677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:06.725362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:06.784875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:06.796275 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3ee4287-1c2e-4625-9c77-c6346e23eacb tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1303 microversion: 2.1 time: 0.186060 Nov 02 12:29:06.810474 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1083/2177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:06 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:06.820926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:06.822028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:06.830153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:06.831248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:06.831948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:06.833087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:06.833823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:06.834571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.223361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:07.238449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:07.247323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fa1ca402-8ba0-42a5-bb27-39e25db511d2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1470 microversion: 2.1 time: 0.435210 Nov 02 12:29:07.264253 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20963760-25d2-4447-bd47-46742125b296 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.560144 Nov 02 12:29:07.265985 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1084/2178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:06 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1470 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:07.272705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3988d4a3-b1fc-4a7a-9208-19e9a013465d req-1d7e1ffc-17f2-45ba-839c-5165ef6afeaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9", "name": "network-vif-deleted", "tag": "8dcc914c-ba8a-4857-ace9-4305134a0d30"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:07.284925 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1095/2179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:06 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:07.288385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3988d4a3-b1fc-4a7a-9208-19e9a013465d req-1d7e1ffc-17f2-45ba-839c-5165ef6afeaf service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.289122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3988d4a3-b1fc-4a7a-9208-19e9a013465d req-1d7e1ffc-17f2-45ba-839c-5165ef6afeaf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.289781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3988d4a3-b1fc-4a7a-9208-19e9a013465d req-1d7e1ffc-17f2-45ba-839c-5165ef6afeaf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.304025 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3988d4a3-b1fc-4a7a-9208-19e9a013465d req-1d7e1ffc-17f2-45ba-839c-5165ef6afeaf service nova] Creating event network-vif-deleted:8dcc914c-ba8a-4857-ace9-4305134a0d30 for instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 on n-h2-855650-5 Nov 02 12:29:07.305409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:07.309034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:07.310848 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3988d4a3-b1fc-4a7a-9208-19e9a013465d req-1d7e1ffc-17f2-45ba-839c-5165ef6afeaf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043455 Nov 02 12:29:07.311798 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1085/2180] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:07.318381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:07.319584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:07.329769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.331157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.339171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.339328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.340758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.341320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.341607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.342293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.342676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.342855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.343197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.343650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.375392 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] HTTP exception thrown: Instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 could not be found. Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Request method failure captured: Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 HTTP/1.1 Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBfJBsIBh2Nu8uXQPw5WprwYJgNYw5DsgD0ftckilaZnovlpJZGlXj_Uyu4PTXl0ou-jklUnQyrQGckOFAILYCliww7GtNeRSszbIQX8U4aM5lOV9l8j6yAi5w_VFAH_svSRsnyrb4isVDJXByxs_XsIrCwur0L6-eELXh0xkSJFpw Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 3579208e4ca549d9a0cdb14af362384e Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-LiveMigrationTest-1823599828 Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-LiveMigrationTest-1823599828 Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 3579208e4ca549d9a0cdb14af362384e Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-LiveMigrationTest-1823599828 Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-LiveMigrationTest-1823599828-project Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 9f2ebf76beec4d3185c3c279868f8366 Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-LiveMigrationTest-1823599828-project Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 could not be found. Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9'} Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 could not be found. Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 could not be found. Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:07.378751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 could not be found. Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Returning 404 to user: Instance f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:07.388126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0569af13-f8a9-4720-88bf-b2b041f3b281 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9" status: 404 len: 111 microversion: 2.1 time: 0.095414 Nov 02 12:29:07.390420 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1096/2181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:07 2022] GET /compute/v2.1/servers/f76370bb-9d0f-4b78-a7e7-6a7db0e6dff9 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:07.399966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:07.401104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:07.414101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.415514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.422383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.424130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.425248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.426553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.496707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:07.843875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:07.870402 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3aea824-e170-4408-8a5e-1c7c437bf0a0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.556147 Nov 02 12:29:07.873741 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1086/2182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:07 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:07.893177 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba47c411-5d4a-40d5-a31b-04a25b28f13f tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 204 len: 0 microversion: 2.1 time: 0.499969 Nov 02 12:29:07.893888 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1097/2183] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:07 2022] DELETE /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:29:07.907955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:07.912368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:07.913879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:07.919880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:07.940400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.945890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.946445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.946884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.947002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.947430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.947607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.948188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.948688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.949679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.958114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.958578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:08.410429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:08.424835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:08.426530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:08.427966 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a83ffae3-9dd1-4241-b1d0-73bd47e07196 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1482 microversion: 2.25 time: 0.552517 Nov 02 12:29:08.438535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1087/2184] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:07 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1482 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:08.438799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:08.446940 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1e18434-ff61-402e-854d-e770519c8201 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.551513 Nov 02 12:29:08.448066 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1098/2185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:07 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:08.455361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:08.456209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:08.463664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:08.464746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:08.467071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:08.477726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:08.479972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:08.480740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:08.481358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:08.482328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:08.483193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:08.483912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:08.484505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:08.485350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:08.489504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:08.490257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:08.491017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:09.091432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:09.114589 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4a6064f8-dae2-4841-a3e7-c515795ceadc tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1499 microversion: 2.1 time: 0.664131 Nov 02 12:29:09.118348 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1099/2186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:08 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1499 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:09.196549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:09.298865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-95ba1f7c-733f-49e8-9fb1-6561865d9e1b tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a00280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1351253164", "description": "tempest-description-1731134642"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:09.628691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:09.670191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c1062f9-738c-4634-bff0-048a7af9ed44 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 1.236676 Nov 02 12:29:09.675199 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1088/2187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:08 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:09.686451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:09.687894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:09.709198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:09.711079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:09.713945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:09.715184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:09.717955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:09.718639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:10.345133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:10.467952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:10.489490 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a965afca-455a-439c-b04f-ca742aa28154 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1470 microversion: 2.1 time: 0.810012 Nov 02 12:29:10.493436 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1089/2188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:09 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1470 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:10.510456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:10.516297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:10.535058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:10.538157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:10.541797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:10.546050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:10.546850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:10.548932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:10.558280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:10.640934 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-95ba1f7c-733f-49e8-9fb1-6561865d9e1b tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.521107 Nov 02 12:29:10.654706 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1100/2189] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:29:09 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:10.668795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:10.670080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:10.722812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:10.727509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:10.730364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:10.731547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:10.734998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:10.736072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:13.538820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:13.561219 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d920cd8d-622e-434a-9be1-467c143bd6ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 3.059480 Nov 02 12:29:13.578033 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1090/2190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:10 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 3070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:13.597012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-61bd92ee-761d-4e85-8393-7ce4ea1eb963 req-e1c9e76d-877e-440b-a82d-096161309f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25469484-61f1-46e8-b68c-24a3dde54b61", "tag": "41567816-d9a8-4ca0-b74c-0a939047cc8b"}, {"server_uuid": "e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3", "name": "network-vif-deleted", "tag": "505fabd6-494c-45db-a08c-cb6834eec257"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:13.655075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:13.686349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61bd92ee-761d-4e85-8393-7ce4ea1eb963 req-e1c9e76d-877e-440b-a82d-096161309f21 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:13.686349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61bd92ee-761d-4e85-8393-7ce4ea1eb963 req-e1c9e76d-877e-440b-a82d-096161309f21 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:13.686779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61bd92ee-761d-4e85-8393-7ce4ea1eb963 req-e1c9e76d-877e-440b-a82d-096161309f21 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:13.692261 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0bef4b22-9227-42ca-b64f-5a4ae87ef5cb tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 3.033345 Nov 02 12:29:13.694626 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1101/2191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:10 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 3039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:13.716501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:13.717195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:13.772127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:13.775863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:13.776295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:13.777095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:13.781631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:13.785426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:13.788629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-61bd92ee-761d-4e85-8393-7ce4ea1eb963 req-e1c9e76d-877e-440b-a82d-096161309f21 service nova] Creating event network-changed:41567816-d9a8-4ca0-b74c-0a939047cc8b for instance 25469484-61f1-46e8-b68c-24a3dde54b61 on n-h2-855650-5 Nov 02 12:29:13.799334 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-61bd92ee-761d-4e85-8393-7ce4ea1eb963 req-e1c9e76d-877e-440b-a82d-096161309f21 service nova] Creating event network-vif-deleted:505fabd6-494c-45db-a08c-cb6834eec257 for instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 on n-h1-855650-5 Nov 02 12:29:13.831362 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-61bd92ee-761d-4e85-8393-7ce4ea1eb963 req-e1c9e76d-877e-440b-a82d-096161309f21 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.264957 Nov 02 12:29:13.842593 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1091/2192] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:13.869792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:13.872333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:13.900667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:13.904664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:13.908682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:13.910805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:13.912991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:13.919283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:14.999037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:15.047328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:15.053696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:15.056730 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-12fbda63-a29f-48c4-b124-0e2a8637f091 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1265 microversion: 2.25 time: 1.211232 Nov 02 12:29:15.060514 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1092/2193] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:13 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1265 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:15.109692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:15.111496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:15.126484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:15.127848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:15.129047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:15.130804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:15.132103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:15.133322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:15.424566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:15.437579 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d73efe19-bf11-4c08-8c61-0cd539896dec tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1485 microversion: 2.1 time: 1.736784 Nov 02 12:29:15.440034 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1102/2194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:13 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1485 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:15.446316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e0b80917-4a7a-41a2-b9f3-6ec98aac6c01 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a08a60>, body: {"security_group_rule": {"parent_group_id": "ae3147bd-2f75-4ea7-9c28-d7b41e903e34", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:15.568029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ebf76beec4d3185c3c279868f8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579208e4ca549d9a0cdb14af362384e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:15.583952 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1705a404-303f-4ec6-8181-aefafa1e9afd tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 200 len: 1457 microversion: 2.1 time: 0.506618 Nov 02 12:29:15.590598 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1093/2195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:15 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 1457 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:15.601719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:15.602732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:15.617692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:15.620684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:15.621887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:15.631271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:15.632075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:15.633296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:16.113456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:16.127363 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-050065af-9196-4d5b-94bd-4be6e00defe8 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.535210 Nov 02 12:29:16.136492 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1094/2196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:15 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:16.173367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:16.178921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:16.203846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:16.207769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:16.211144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:16.212345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:16.213151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:16.215810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:16.628033 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e0b80917-4a7a-41a2-b9f3-6ec98aac6c01 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.186801 Nov 02 12:29:16.628655 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1103/2197] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:29:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:16.634260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:16.634897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:16.680991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:16.685306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:16.685776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:16.686598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:16.695320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:16.695796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:17.261499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:17.273303 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-350ac260-08ca-4802-aae4-3a8f1c0468ff tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1470 microversion: 2.1 time: 1.135047 Nov 02 12:29:17.291883 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1095/2198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:16 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1470 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:17.304225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:17.304847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:17.344008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:17.344658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:17.345282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:17.346275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:17.346792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:17.347564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:17.536185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:17.578096 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-660c5228-f691-47a4-8fb0-73f0b4ce4a4d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.947881 Nov 02 12:29:17.591333 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1104/2199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:16 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:17.623225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:17.624179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:17.652404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:17.653321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:17.662711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:17.664522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:17.666887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:17.669345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:17.905276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:17.974339 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3609a119-afcc-4fe9-b411-aa54b01228f1 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "POST /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b/action" status: 202 len: 0 microversion: 2.1 time: 0.373460 Nov 02 12:29:17.974783 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1105/2200] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:29:17 2022] POST /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:17.989719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-63d02e24-0fa3-4a33-8d51-3eb21f063297 req-e2a2ce1c-3c71-44fc-9820-1c7fbc988dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4728b36-5541-47b1-8f1d-773945ed64dd", "name": "network-vif-deleted", "tag": "57302fa0-ed89-4f1b-baf4-32d04a5d7684"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:18.018327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-63d02e24-0fa3-4a33-8d51-3eb21f063297 req-e2a2ce1c-3c71-44fc-9820-1c7fbc988dbe service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.020109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-63d02e24-0fa3-4a33-8d51-3eb21f063297 req-e2a2ce1c-3c71-44fc-9820-1c7fbc988dbe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.021272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-63d02e24-0fa3-4a33-8d51-3eb21f063297 req-e2a2ce1c-3c71-44fc-9820-1c7fbc988dbe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.052493 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-63d02e24-0fa3-4a33-8d51-3eb21f063297 req-e2a2ce1c-3c71-44fc-9820-1c7fbc988dbe service nova] Creating event network-vif-deleted:57302fa0-ed89-4f1b-baf4-32d04a5d7684 for instance c4728b36-5541-47b1-8f1d-773945ed64dd on n-h2-855650-5 Nov 02 12:29:18.064946 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-63d02e24-0fa3-4a33-8d51-3eb21f063297 req-e2a2ce1c-3c71-44fc-9820-1c7fbc988dbe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084065 Nov 02 12:29:18.070246 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1106/2201] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:18.097122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7f61ae7a-f98d-4567-9e02-55ef00678824 req-11191937-d6b2-4e8b-86d0-a2b45e5d7acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d42b47d-df80-48cf-a3a2-416031e2a041", "tag": "01dfabd4-1253-4651-b032-a93021f1cac6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:18.108075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:18.125001 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0d038ba-0f52-4892-ad86-105b2b5f5033 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.831914 Nov 02 12:29:18.128664 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1096/2202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:17 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:18.134327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:18.145833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f61ae7a-f98d-4567-9e02-55ef00678824 req-11191937-d6b2-4e8b-86d0-a2b45e5d7acb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.147060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:18.150308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f61ae7a-f98d-4567-9e02-55ef00678824 req-11191937-d6b2-4e8b-86d0-a2b45e5d7acb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.151121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f61ae7a-f98d-4567-9e02-55ef00678824 req-11191937-d6b2-4e8b-86d0-a2b45e5d7acb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.171462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.172406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.173146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.181463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.189127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.190155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.201463 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7f61ae7a-f98d-4567-9e02-55ef00678824 req-11191937-d6b2-4e8b-86d0-a2b45e5d7acb service nova] Creating event network-changed:01dfabd4-1253-4651-b032-a93021f1cac6 for instance 6d42b47d-df80-48cf-a3a2-416031e2a041 on n-h1-855650-5 Nov 02 12:29:18.226217 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7f61ae7a-f98d-4567-9e02-55ef00678824 req-11191937-d6b2-4e8b-86d0-a2b45e5d7acb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153975 Nov 02 12:29:18.227615 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1107/2203] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:18.261179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f9a83a2b-2117-4538-8d71-325899cce5c6 req-da203c37-0e92-4c47-86b4-44570e9c1b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6933b3c7-ad8a-4156-b959-f9c145bf08f0", "name": "network-vif-plugged", "status": "completed", "tag": "d22f84e2-3fb0-4d88-816d-1d02b67f5815"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:18.322087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f9a83a2b-2117-4538-8d71-325899cce5c6 req-da203c37-0e92-4c47-86b4-44570e9c1b8f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.327021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f9a83a2b-2117-4538-8d71-325899cce5c6 req-da203c37-0e92-4c47-86b4-44570e9c1b8f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.331495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f9a83a2b-2117-4538-8d71-325899cce5c6 req-da203c37-0e92-4c47-86b4-44570e9c1b8f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.392416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:18.404262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:18.416797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:18.418717 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6c5458e-7c7c-4984-82aa-3a1a3fc682c6 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1265 microversion: 2.25 time: 0.288558 Nov 02 12:29:18.438027 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f9a83a2b-2117-4538-8d71-325899cce5c6 req-da203c37-0e92-4c47-86b4-44570e9c1b8f service nova] Creating event network-vif-plugged:d22f84e2-3fb0-4d88-816d-1d02b67f5815 for instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 on n-h2-855650-5 Nov 02 12:29:18.438643 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1097/2204] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:18 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:18.454813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f0a5a83-7660-4718-bc25-fe2e8b1718bb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a5d040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1722439863", "description": "tempest-description-1048594793"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:18.462020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f9a83a2b-2117-4538-8d71-325899cce5c6 req-da203c37-0e92-4c47-86b4-44570e9c1b8f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225832 Nov 02 12:29:18.464929 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1108/2205] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:18.532292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:18.534899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] [instance: c4728b36-5541-47b1-8f1d-773945ed64dd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:18.590566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.593727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.599302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.600980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.604465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.610881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.664299 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] HTTP exception thrown: Instance c4728b36-5541-47b1-8f1d-773945ed64dd could not be found. Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Request method failure captured: Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd HTTP/1.1 Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmBfJBsIBh2Nu8uXQPw5WprwYJgNYw5DsgD0ftckilaZnovlpJZGlXj_Uyu4PTXl0ou-jklUnQyrQGckOFAILYCliww7GtNeRSszbIQX8U4aM5lOV9l8j6yAi5w_VFAH_svSRsnyrb4isVDJXByxs_XsIrCwur0L6-eELXh0xkSJFpw Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 3579208e4ca549d9a0cdb14af362384e Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-LiveMigrationTest-1823599828 Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3579208e4ca549d9a0cdb14af362384e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-LiveMigrationTest-1823599828 Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 3579208e4ca549d9a0cdb14af362384e Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-LiveMigrationTest-1823599828 Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-LiveMigrationTest-1823599828-project Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 9f2ebf76beec4d3185c3c279868f8366 Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-LiveMigrationTest-1823599828-project Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance c4728b36-5541-47b1-8f1d-773945ed64dd could not be found. Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c4728b36-5541-47b1-8f1d-773945ed64dd'} Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4728b36-5541-47b1-8f1d-773945ed64dd could not be found. Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4728b36-5541-47b1-8f1d-773945ed64dd could not be found. Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:18.670411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4728b36-5541-47b1-8f1d-773945ed64dd could not be found. Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] Returning 404 to user: Instance c4728b36-5541-47b1-8f1d-773945ed64dd could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:18.675005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d469b1ab-cc15-414c-a999-fb6a70ba0e46 tempest-LiveMigrationTest-1823599828 tempest-LiveMigrationTest-1823599828-project] 10.222.0.45 "GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd" status: 404 len: 111 microversion: 2.1 time: 0.201323 Nov 02 12:29:18.679600 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1109/2206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:18 2022] GET /compute/v2.1/servers/c4728b36-5541-47b1-8f1d-773945ed64dd => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:18.691399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:18.693197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:18.709921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.713557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.714794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.716456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.717234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.718266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:19.262654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:19.282842 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1903e4cd-2ebd-4093-9054-dd5e9d20c1a0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.604935 Nov 02 12:29:19.286667 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1110/2207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:18 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:19.304690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:19.305790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:19.322438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:19.327044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:19.329029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:19.333848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:19.335097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:19.336759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:19.790356 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f0a5a83-7660-4718-bc25-fe2e8b1718bb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.350285 Nov 02 12:29:19.791978 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1098/2208] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:29:18 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:19.797602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:19.798531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:19.844186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:19.845423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:19.847283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:19.852705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:19.854455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:19.862788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.346042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:20.357186 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-45072bc7-43d1-4174-8c21-c036ab0ebf71 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1493 microversion: 2.1 time: 1.067486 Nov 02 12:29:20.378010 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1111/2209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:19 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1493 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:20.382576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:20.383801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:20.393173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.393805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.394366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.394933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:20.395271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.395817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.396325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.407950 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe89f691-f331-42ed-96a1-34a5c6420657 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1462 microversion: 2.1 time: 0.614651 Nov 02 12:29:20.409472 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1099/2210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:19 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1462 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:20.415557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:20.416975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:20.430718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.431620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.434937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.437276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.439334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.440743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.676667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:20.682323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:20.692744 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a055b309-18f6-4cbb-aa44-d22ee6aa2fda tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.316311 Nov 02 12:29:20.693778 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba76ba9f-ded7-4b10-9341-28b8aa8e2a5c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1403 microversion: 2.1 time: 0.282917 Nov 02 12:29:20.694565 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1112/2211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:20 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:20.695105 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1100/2212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:20 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1403 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:20.701085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66bb9f27-fb2b-4f2c-9054-47370ffbc826 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a7cf70>, body: {"security_group_rule": {"parent_group_id": "7f6ccecc-2fbb-4954-80ed-fcda8368bc72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:20.727488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:20.735658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:20.752482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.753200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.754141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.755717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.756633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.758927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.873004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:20.885306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:20.888555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:20.890536 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7f571f60-b5d5-4911-be42-9be4e6edbd2f tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1265 microversion: 2.25 time: 0.177124 Nov 02 12:29:20.903303 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1113/2213] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:20 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:20.917326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:20.918499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:20.927960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.928540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.929102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.930261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.931008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.932877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.132513 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66bb9f27-fb2b-4f2c-9054-47370ffbc826 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.435982 Nov 02 12:29:21.133249 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1101/2214] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:29:20 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:21.139573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:21.140212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.147107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.147918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.148635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.150283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.150938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.151586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.169756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:21.184395 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f76560e8-5fe2-4a7b-943c-04321c6107da tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.279522 Nov 02 12:29:21.198383 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1114/2215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:20 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:21.210708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-020bbf8e-88eb-4227-b8af-757f4df3658a tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a14d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-374897158", "description": "tempest-description-1710964455"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:21.392850 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70798a72-1d24-4e3d-a29a-7862ccfdff67 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1613 microversion: 2.1 time: 0.258000 Nov 02 12:29:21.394254 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1102/2216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:21 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1613 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:21.400248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:21.401554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.412013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.412879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.413502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.414593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.415317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.415918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.517300 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-020bbf8e-88eb-4227-b8af-757f4df3658a tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.315901 Nov 02 12:29:21.519287 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1115/2217] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:29:21 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:21.528748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f7850271-4ea7-4032-88d6-0c0f3ed494ef tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '.version_select at 0x7f2292a38b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:21.539166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7850271-4ea7-4032-88d6-0c0f3ed494ef tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.541496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7850271-4ea7-4032-88d6-0c0f3ed494ef tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.543589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7850271-4ea7-4032-88d6-0c0f3ed494ef tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.572921 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f7850271-4ea7-4032-88d6-0c0f3ed494ef tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.051122 Nov 02 12:29:21.574523 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1116/2218] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:29:21 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:21.586156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f1875761-4c25-41b3-a985-35182944b34f tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a1e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-43965726", "description": "tempest-description-1407664537"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:21.739494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:21.754118 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f203d76d-b7b4-4708-b42c-2be993e1d571 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1493 microversion: 2.1 time: 0.358210 Nov 02 12:29:21.774352 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1103/2219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:21 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1493 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:21.795194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1927705129", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:21.953736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:29:22.193592 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f1875761-4c25-41b3-a985-35182944b34f tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.615281 Nov 02 12:29:22.195777 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1117/2220] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:29:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:22.222242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:22.227853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:22.270323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.271993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.273274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.276333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.277853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.279064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.732616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:22.733443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:22.733584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:22.734062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:22.734498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:22.776704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.777652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.778695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.780086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.780964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.781774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.844073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:22.868182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for user a5a3010848f74c94bb32b506e184d275 and project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:22.903882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:29:22.906909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:29:23.017267 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31d80480-52f5-47a2-b3ba-fc65847bd830 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240626 Nov 02 12:29:23.018473 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1104/2221] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:29:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:29:23.033580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:23.034465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:23.047257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.051158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.052237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.057606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.059985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.060458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.390739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.414461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5ce42e3f-5a57-4990-8133-a907c2be1227 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1591 microversion: 2.1 time: 1.214106 Nov 02 12:29:23.431901 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1118/2222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:22 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1591 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:23.437725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:23.444215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:23.460922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.461912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.462604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.463631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.464859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.465721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.541200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.541943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.546296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.547023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lazy-loading 'fault' on Instance uuid e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:23.648029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.664741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.669758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.675691 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6526c315-ad06-4e28-b3ed-47ddd222e9fe tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1270 microversion: 2.25 time: 0.242513 Nov 02 12:29:23.681941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.690515 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1119/2223] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:23 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1270 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:23.694328 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf8b77be-a804-4867-8e17-8cc20e5114a1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.673709 Nov 02 12:29:23.695594 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1105/2224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:23 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:23.701620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53a4486b-3739-424d-b752-0d709673ad9a tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a68c10>, body: {"security_group_rule": {"parent_group_id": "57eeee86-9748-443d-8290-1669766eb25c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "85e1f8f5-3280-4e82-bbe5-27b53c46dedb"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:23.702036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:23.702687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:23.717495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.718341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.718958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.719906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.720554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.721162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.161174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:24.176639 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dca39187-e383-4a42-b1cf-cd5665459077 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.484707 Nov 02 12:29:24.177278 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1120/2225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:23 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:24.182310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c3b2e98f-ad34-4702-a6da-e15c598e88e9 req-7282b2f5-d496-49ca-a7e9-f70033f266d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25469484-61f1-46e8-b68c-24a3dde54b61", "name": "network-vif-plugged", "status": "completed", "tag": "41567816-d9a8-4ca0-b74c-0a939047cc8b"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:24.195276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c3b2e98f-ad34-4702-a6da-e15c598e88e9 req-7282b2f5-d496-49ca-a7e9-f70033f266d6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.196274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c3b2e98f-ad34-4702-a6da-e15c598e88e9 req-7282b2f5-d496-49ca-a7e9-f70033f266d6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.196949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c3b2e98f-ad34-4702-a6da-e15c598e88e9 req-7282b2f5-d496-49ca-a7e9-f70033f266d6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.212673 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c3b2e98f-ad34-4702-a6da-e15c598e88e9 req-7282b2f5-d496-49ca-a7e9-f70033f266d6 service nova] Creating event network-vif-plugged:41567816-d9a8-4ca0-b74c-0a939047cc8b for instance 25469484-61f1-46e8-b68c-24a3dde54b61 on n-h2-855650-5 Nov 02 12:29:24.220567 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c3b2e98f-ad34-4702-a6da-e15c598e88e9 req-7282b2f5-d496-49ca-a7e9-f70033f266d6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041885 Nov 02 12:29:24.222517 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1121/2226] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:24.232141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:24.233435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:24.241688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.242686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.243869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.244923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.245678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.246369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.457138 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53a4486b-3739-424d-b752-0d709673ad9a tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.758509 Nov 02 12:29:24.458084 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1106/2227] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:29:23 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:24.480569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:24.491433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:24.510502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.511017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.512008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.512777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.513778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.514286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.578524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:24.590210 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9aa5328a-0fa7-4522-ada6-3f3f0993382e tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1493 microversion: 2.1 time: 0.365259 Nov 02 12:29:24.590978 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1122/2228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:24 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1493 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:24.600733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:24.604361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:24.616653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.617567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.618471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.619559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.620229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.620933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.678571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:24.688936 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d6431b1-e51d-4434-9cad-b2239e5fac30 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1217 microversion: 2.1 time: 0.228991 Nov 02 12:29:24.690253 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1107/2229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:24 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:24.696233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be56b4e7-75c3-411a-87c6-dff4b3c1305f tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f228ea99ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-57876148", "description": "tempest-description-804390293"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:24.868799 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bb8f31d8-cc1c-4d9d-9ec1-8a92b9afb4fa tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.276404 Nov 02 12:29:24.869944 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1123/2230] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:29:24 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0/os-interface => generated 285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:24.876368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:24.877213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:24.885046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.885918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.886659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.887782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.888436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.889049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.948064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.948889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.949534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.950200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lazy-loading 'fault' on Instance uuid e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:25.048749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:25.081066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:25.088061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:25.091065 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b5deb7ce-9584-4851-82eb-5686404d9bcf tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 200 len: 1270 microversion: 2.25 time: 0.218965 Nov 02 12:29:25.096235 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1124/2231] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:24 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 1270 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:25.108565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:25.109186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:25.136671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:25.137748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:25.138665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:25.140002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:25.140785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:25.141530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:25.361789 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be56b4e7-75c3-411a-87c6-dff4b3c1305f tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.669051 Nov 02 12:29:25.363003 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1108/2232] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:29:24 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:25.373627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:25.378451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:25.401186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:25.411556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:25.412519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:25.419105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:25.420272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:25.421711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:25.659576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:25.681324 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d19c5194-8115-4985-8da3-1c8ef296d10b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.582213 Nov 02 12:29:25.698095 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1125/2233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:25 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:25.698095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a608273a-7dd0-4241-968d-4af6131fb74e tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f22929bc310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1160194568", "description": "tempest-description-275207212"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:25.969881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:25.996468 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a961d0c-f016-4f22-94aa-beb95952e111 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.631153 Nov 02 12:29:25.997924 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1109/2234] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:25 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:26.020123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:26.021696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:26.048043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.049595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.050657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.052431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.053791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.055220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.252776 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a608273a-7dd0-4241-968d-4af6131fb74e tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.564872 Nov 02 12:29:26.259610 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1126/2235] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:29:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:26.285917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:26.286363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:26.307000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.311141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.312581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.314204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.314946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.315595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.368191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:26.386922 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22fca1c7-125c-4ae0-9e68-79ae5c0580ab tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1493 microversion: 2.1 time: 0.373478 Nov 02 12:29:26.389179 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1110/2236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:26 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1493 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:26.408129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:26.409935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:26.421177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:26.427262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.428263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.428929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.429991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.430844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.431535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.435284 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-71246ee4-4153-48d0-8431-5c131740aa3e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1265 microversion: 2.1 time: 0.171438 Nov 02 12:29:26.436177 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1127/2237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:26 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:26.446034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c5fa54f-2af3-4208-a6e5-14481e7ab718 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f228edb5940>, body: {"security_group_rule": {"parent_group_id": "2d1744e8-b705-4fb7-9f80-255ae191abd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c0b22d44-99cd-4ea9-a129-43e1984fced4"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:26.470147 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] HTTP exception thrown: Instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 could not be found. Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Request method failure captured: Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 HTTP/1.1 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmB4Da5rfuQQeaNtKoF0YwP3zsb7V5ij3p5RbltdpRztv3LMmkgX3jm8jnPSvu1Ofb-L7OQsC5GM2tpv8oCreRuYmQvsjeU5peCK3ESaK7t4TSx7CxuW0_PcSJtVvdrTWDcUn8xiDO7s7QGV4NcWmw8jn45mmMOljPckQaI5GIwCn3c Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 61f9f821af56421c98639028cc700a64 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/61f9f821af56421c98639028cc700a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/61f9f821af56421c98639028cc700a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/61f9f821af56421c98639028cc700a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_61f9f821af56421c98639028cc700a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 61f9f821af56421c98639028cc700a64 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-LiveAutoBlockMigrationV225Test-83176342-project Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a71d3feaad3148cc89c28cb18acf0cd0 Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-83176342-project Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 could not be found. Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3'} Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 could not be found. Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 could not be found. Nov 02 12:29:26.474405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 could not be found. Nov 02 12:29:26.481089 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:26.483172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Returning 404 to user: Instance e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:26.486807 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f1e9ed8-7bd3-4247-b962-e05bbfd86050 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3" status: 404 len: 111 microversion: 2.25 time: 0.095254 Nov 02 12:29:26.490386 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1111/2238] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:26 2022] GET /compute/v2.1/servers/e0b5b0d3-d163-4cd4-86ae-a72f0e03f7e3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:29:26.742292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:26.745325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:26.770564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.773618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.774964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.781833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.783443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.784618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.088122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:27.091007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:27.104750 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a764700-2f4b-4206-a300-6fe8ba4913cd tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1317 microversion: 2.1 time: 0.372638 Nov 02 12:29:27.106870 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1112/2239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:26 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:27.124881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:27.126428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:27.162459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.168297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.180985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.185417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.186663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.188581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.207011 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c5fa54f-2af3-4208-a6e5-14481e7ab718 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.769384 Nov 02 12:29:27.217423 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1128/2240] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:29:26 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:27.223262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c266b5ae-1fc7-4441-9a66-0a91f72b9e6e tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f22929bc280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:27.928007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:27.942691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d697d06b-1e48-454c-92d8-a9dbe7195cdc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.834018 Nov 02 12:29:27.946500 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1113/2241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:27 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:27.983630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:27.984377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:28.006793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.007304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.007781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.019201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.019715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.020167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.297453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c266b5ae-1fc7-4441-9a66-0a91f72b9e6e tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/c0b22d44-99cd-4ea9-a129-43e1984fced4" status: 202 len: 0 microversion: 2.1 time: 1.077768 Nov 02 12:29:28.298735 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1129/2242] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:27 2022] DELETE /compute/v2.1/os-security-groups/c0b22d44-99cd-4ea9-a129-43e1984fced4 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:28.316962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:28.318866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:28.338179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.340258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.341501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.343124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.344156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.345211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.383830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:28.384124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:28.408424 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39a5f33d-64e2-46f0-a449-76a73e52054a tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1493 microversion: 2.1 time: 0.458424 Nov 02 12:29:28.434184 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1114/2243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:27 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1493 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:28.440719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:28.443304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:28.451610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.454016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.454775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.455761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.456410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.457013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.534679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:28.561332 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-212b8029-3f82-4302-95b1-952620f21a3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1265 microversion: 2.1 time: 0.253791 Nov 02 12:29:28.567502 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1130/2244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:28 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:28.587902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67798ecc-c811-4f92-8f10-695bcbd583cb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f22929b63a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:28.852964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:28.890143 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e359b26f-a348-4a30-82aa-a257b2353484 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1508 microversion: 2.1 time: 0.451646 Nov 02 12:29:28.892619 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1115/2245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:28 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:28.924717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:28.926368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:28.968968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.970475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.977719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.980093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.986498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.988085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.997532 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67798ecc-c811-4f92-8f10-695bcbd583cb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/2d1744e8-b705-4fb7-9f80-255ae191abd4" status: 200 len: 245 microversion: 2.1 time: 0.427100 Nov 02 12:29:29.009548 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1131/2246] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:29:28 2022] GET /compute/v2.1/os-security-groups/2d1744e8-b705-4fb7-9f80-255ae191abd4 => generated 245 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:29.017343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f09868b6-4288-4dea-98a0-28f807c0a62b req-f7bc87c0-6364-4da0-9db5-5e0659c8bfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6933b3c7-ad8a-4156-b959-f9c145bf08f0", "tag": "d22f84e2-3fb0-4d88-816d-1d02b67f5815"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:29.070164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f09868b6-4288-4dea-98a0-28f807c0a62b req-f7bc87c0-6364-4da0-9db5-5e0659c8bfe6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:29.074729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f09868b6-4288-4dea-98a0-28f807c0a62b req-f7bc87c0-6364-4da0-9db5-5e0659c8bfe6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:29.077022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f09868b6-4288-4dea-98a0-28f807c0a62b req-f7bc87c0-6364-4da0-9db5-5e0659c8bfe6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:29.160431 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f09868b6-4288-4dea-98a0-28f807c0a62b req-f7bc87c0-6364-4da0-9db5-5e0659c8bfe6 service nova] Creating event network-changed:d22f84e2-3fb0-4d88-816d-1d02b67f5815 for instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 on n-h2-855650-5 Nov 02 12:29:29.193420 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f09868b6-4288-4dea-98a0-28f807c0a62b req-f7bc87c0-6364-4da0-9db5-5e0659c8bfe6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190081 Nov 02 12:29:29.199193 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1132/2247] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:29.233631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:29.240191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:29.275086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:29.279215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:29.280131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:29.283799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:29.284758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:29.286146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:30.472630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:30.512559 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7b0c58d2-786e-4a75-89b0-eb3da8d9b69a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1508 microversion: 2.1 time: 1.307699 Nov 02 12:29:30.514300 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1133/2248] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:29 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1508 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:30.531327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:30.540672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:30.587170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:30.595384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:30.596327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:30.599116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:30.599982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:30.603174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:30.604638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:30.606129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:30.633206 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-827902c3-db4a-449a-90ff-a58b658e1e84 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1591 microversion: 2.1 time: 1.731117 Nov 02 12:29:30.635964 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1116/2249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:28 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1591 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:30.662843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf26c285-78ae-407e-948f-27d47ad5a8f6 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a5d160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-680635762", "description": "tempest-description-565554887"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:31.302143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:31.336361 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-588b94e0-41d2-4ac1-8106-6985dc0980fa tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.817701 Nov 02 12:29:31.344616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1134/2250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:30 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:31.385037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-587f92f4-17d7-4f64-aa41-e44c39bd518d req-2bf8965c-a426-4ef8-96cb-ebdf00110480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d42b47d-df80-48cf-a3a2-416031e2a041", "name": "network-vif-plugged", "status": "completed", "tag": "01dfabd4-1253-4651-b032-a93021f1cac6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:31.412104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-587f92f4-17d7-4f64-aa41-e44c39bd518d req-2bf8965c-a426-4ef8-96cb-ebdf00110480 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:31.413402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-587f92f4-17d7-4f64-aa41-e44c39bd518d req-2bf8965c-a426-4ef8-96cb-ebdf00110480 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:31.414588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-587f92f4-17d7-4f64-aa41-e44c39bd518d req-2bf8965c-a426-4ef8-96cb-ebdf00110480 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:31.455933 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-587f92f4-17d7-4f64-aa41-e44c39bd518d req-2bf8965c-a426-4ef8-96cb-ebdf00110480 service nova] Creating event network-vif-plugged:01dfabd4-1253-4651-b032-a93021f1cac6 for instance 6d42b47d-df80-48cf-a3a2-416031e2a041 on n-h1-855650-5 Nov 02 12:29:31.472206 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-587f92f4-17d7-4f64-aa41-e44c39bd518d req-2bf8965c-a426-4ef8-96cb-ebdf00110480 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115557 Nov 02 12:29:31.474620 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1135/2251] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:31.518816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:31.523867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:31.560230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:31.560676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:31.561481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:31.563536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:31.564413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:31.565262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.609678 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf26c285-78ae-407e-948f-27d47ad5a8f6 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.962289 Nov 02 12:29:32.611440 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1117/2252] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:29:30 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:32.619819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:32.621046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:32.628342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:32.644851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.650456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.656172 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-caf13c2d-4816-4b73-9858-fc758e7c5498 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1499 microversion: 2.1 time: 1.178773 Nov 02 12:29:32.674008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.674008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.674008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.674008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.675258 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1136/2253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:31 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1499 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:32.694499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:32.707130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:32.737582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.740576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.741031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.749453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.753008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.753617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.819725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:32.877611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:32.967734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:32.984256 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f5fc43c7-d09b-45a4-8c6e-05fd3317dc34 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1271 microversion: 2.1 time: 0.371288 Nov 02 12:29:32.984852 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1118/2254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:32 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:32.991328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:32.994138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:33.010098 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36ec03be-989c-4773-b539-d1776a471960 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "PUT /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1080 microversion: 2.1 time: 0.337713 Nov 02 12:29:33.029999 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1137/2255] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:29:32 2022] PUT /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1080 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:33.045076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.045923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.046616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.049607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.050445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.051871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.055028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-946bb900-d7d2-4ec1-88a0-022966ef3fc5 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f22929da280>, body: {"security_group_rule": {"parent_group_id": "c3a314c4-c35c-4d38-8af8-f9e3a2d3d68d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:33.574467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:33.587447 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5cf51660-6892-4b9e-bfa1-d3b1ba9e6199 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.600936 Nov 02 12:29:33.588498 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1119/2256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:32 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:33.596638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:33.597425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:33.607729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.608828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.609557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.610654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.612501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.613202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.665563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:33.852913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11e5ae20-1577-4538-ae0b-47faf91704d8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "DELETE /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 204 len: 0 microversion: 2.1 time: 0.261158 Nov 02 12:29:33.854047 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1120/2257] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:33 2022] DELETE /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:29:33.860620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:33.861600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:33.871048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.871946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.872893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.874107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.875280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.876478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.079766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-946bb900-d7d2-4ec1-88a0-022966ef3fc5 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.046006 Nov 02 12:29:34.091239 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1138/2258] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:29:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:34.098032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:34.101325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:34.125990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.128291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.130326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.131978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.132643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.134947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.179960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:34.253909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:34.270055 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd7b9933-f944-435f-b052-f9e33b5c84a2 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1506 microversion: 2.1 time: 0.414286 Nov 02 12:29:34.270830 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1121/2259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:33 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:34.286365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:34.287006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:34.295290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.295809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.296258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.297027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.297486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.315841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.321538 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-06f837a2-aa71-478e-9450-e951c1a3a4cd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 204 len: 0 microversion: 2.25 time: 0.232405 Nov 02 12:29:34.327437 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1139/2260] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:29:34 2022] DELETE /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:29:34.335374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:34.337012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:34.351596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.352875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.353838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.356694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.356945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.358933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.844346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:34.854520 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-51adbbf2-6efa-47d6-b67f-7f3e84a7c6ea tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.525286 Nov 02 12:29:34.860179 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1140/2261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:34 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:34.879846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-75e34c2d-fe50-4738-a6e6-5b1e84980e8f tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Action: 'create', calling method: .version_select at 0x7f2292a5fee0>, body: {"security_group_rule": {"parent_group_id": "c3a314c4-c35c-4d38-8af8-f9e3a2d3d68d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:34.908323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:34.922826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df9aa0e2-0239-477f-a187-8326e16cfa51 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.650830 Nov 02 12:29:34.924452 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1122/2262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:34 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:34.935709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:34.937316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:34.953019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.954646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.955370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.957070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.957781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.958506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:35.507181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:35.538214 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46607a7e-b3a8-4605-a638-4a866eac6e33 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1506 microversion: 2.1 time: 0.605902 Nov 02 12:29:35.540099 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1123/2263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:34 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:35.556115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:35.558851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:35.583158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:35.584569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:35.609144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:35.611585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:35.612539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:35.613272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:35.727804 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-75e34c2d-fe50-4738-a6e6-5b1e84980e8f tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.865222 Nov 02 12:29:35.728901 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1141/2264] 10.222.0.45 () {60 vars in 1195 bytes} [Wed Nov 2 12:29:34 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:35.742217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:35.743885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:35.760428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:35.763155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:35.764347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:35.765933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:35.766832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:35.768117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.146083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:36.172501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:36.176641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:36.186961 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-880a27f5-372f-48bf-90d5-d1bb67401fe7 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1731 microversion: 2.25 time: 0.635922 Nov 02 12:29:36.187531 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1124/2265] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:35 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1731 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:36.193148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:36.205229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.217874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.218429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.219084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.219919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.220393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.220823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.249068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:36.291874 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cebca454-822e-4f1a-8282-70ae2769b8b6 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1370 microversion: 2.1 time: 0.560018 Nov 02 12:29:36.296348 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1142/2266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:35 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1370 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:36.315473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-35ea8f93-5811-4430-b1ae-93f83539050a tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f22929d8a60>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:36.387760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:36.388553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:36.389434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:36.390352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:36.391106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:36.563520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.579766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.579766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.580196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.580869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.581514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.582147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.616515 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f24a9376-032b-4eb7-ae0c-ea66e73660a3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "POST /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61/action" status: 202 len: 1112 microversion: 2.1 time: 0.427502 Nov 02 12:29:36.617737 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1125/2267] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:29:36 2022] POST /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61/action => generated 1112 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:29:36.640948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:36.641681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.669451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.672562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.673095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.675267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.676140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.680913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.842607 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-35ea8f93-5811-4430-b1ae-93f83539050a tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/c3a314c4-c35c-4d38-8af8-f9e3a2d3d68d" status: 200 len: 663 microversion: 2.1 time: 0.539045 Nov 02 12:29:36.843695 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1143/2268] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:29:36 2022] GET /compute/v2.1/os-security-groups/c3a314c4-c35c-4d38-8af8-f9e3a2d3d68d => generated 663 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:36.853101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:36.855662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.878816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.879521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.880017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.880834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.881380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.881805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.222806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:37.242052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:37.251432 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e3df58bc-9919-45b3-8a91-261f82c7088c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.631893 Nov 02 12:29:37.276311 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1126/2269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:36 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:37.294965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c40b771e-adb6-4590-ac3c-b7a35a1b6f64 req-662c82e6-4982-43f0-9d13-9b6475282c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1", "tag": "8096feea-680d-4ef5-8cb4-92af700234d1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:37.305984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:37.319532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c40b771e-adb6-4590-ac3c-b7a35a1b6f64 req-662c82e6-4982-43f0-9d13-9b6475282c4a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.320648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c40b771e-adb6-4590-ac3c-b7a35a1b6f64 req-662c82e6-4982-43f0-9d13-9b6475282c4a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.321594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c40b771e-adb6-4590-ac3c-b7a35a1b6f64 req-662c82e6-4982-43f0-9d13-9b6475282c4a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.357754 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c40b771e-adb6-4590-ac3c-b7a35a1b6f64 req-662c82e6-4982-43f0-9d13-9b6475282c4a service nova] Creating event network-changed:8096feea-680d-4ef5-8cb4-92af700234d1 for instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 on n-h1-855650-5 Nov 02 12:29:37.370246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c40b771e-adb6-4590-ac3c-b7a35a1b6f64 req-662c82e6-4982-43f0-9d13-9b6475282c4a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086766 Nov 02 12:29:37.372390 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8296679a-6b86-4fd6-a829-1772a08fe0b9 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.526146 Nov 02 12:29:37.372893 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1127/2270] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:37.373896 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1144/2271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:36 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:37.385218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:37.386974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:37.393690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1df19336-f498-431d-9d13-682d151a977b tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f2292a1e3a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:37.401412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.402799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.403692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.406128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.407403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.409498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.715912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:37.731958 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03356f24-f844-4c97-9169-cf47ad087668 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.352206 Nov 02 12:29:37.733053 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1128/2272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:37 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:37.741376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e544658d-8c77-4b50-93b4-93aba82000f6 req-b60f35f2-acfd-4a6e-bdef-9305a73dc68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf7c70a-03b4-456d-96c0-8e892183b1ac", "name": "network-vif-deleted", "tag": "9264ba98-f8b6-4854-ae4f-4f7c06f5258d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:37.747147 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1df19336-f498-431d-9d13-682d151a977b tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-group-rules/e46fd897-879e-41a7-937d-b91c1028c82f" status: 202 len: 0 microversion: 2.1 time: 0.369236 Nov 02 12:29:37.749019 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1145/2273] 10.222.0.45 () {58 vars in 1287 bytes} [Wed Nov 2 12:29:37 2022] DELETE /compute/v2.1/os-security-group-rules/e46fd897-879e-41a7-937d-b91c1028c82f => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:37.774901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e544658d-8c77-4b50-93b4-93aba82000f6 req-b60f35f2-acfd-4a6e-bdef-9305a73dc68b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.775072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:37.775814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e544658d-8c77-4b50-93b4-93aba82000f6 req-b60f35f2-acfd-4a6e-bdef-9305a73dc68b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.778773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:37.779513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e544658d-8c77-4b50-93b4-93aba82000f6 req-b60f35f2-acfd-4a6e-bdef-9305a73dc68b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.799178 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e544658d-8c77-4b50-93b4-93aba82000f6 req-b60f35f2-acfd-4a6e-bdef-9305a73dc68b service nova] Creating event network-vif-deleted:9264ba98-f8b6-4854-ae4f-4f7c06f5258d for instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac on n-h2-855650-5 Nov 02 12:29:37.805494 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e544658d-8c77-4b50-93b4-93aba82000f6 req-b60f35f2-acfd-4a6e-bdef-9305a73dc68b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070434 Nov 02 12:29:37.806944 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1129/2274] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:37.810745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.812374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.814495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.815733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.816284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:37.816639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.817449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.817987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:37.827513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.828506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.829302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.830550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.831359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.832013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.889459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.891348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.892195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.893301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lazy-loading 'fault' on Instance uuid 9bf7c70a-03b4-456d-96c0-8e892183b1ac {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:38.250234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:38.274693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:38.280710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:38.284374 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8904089e-b16d-42b2-8843-6f2b3aaa9264 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 200 len: 1375 microversion: 2.25 time: 0.533065 Nov 02 12:29:38.286504 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1146/2275] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:37 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 1375 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:38.309123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3411f85-2a75-45a3-84d8-5953631abe46 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f2292aa1dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:38.662288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:38.679725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8b02fb1f-0401-4802-884d-8acd525cacf9 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1555 microversion: 2.1 time: 0.869872 Nov 02 12:29:38.721943 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1130/2276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:37 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1555 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:38.744560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:38.746283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:38.751873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:38.788345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:38.790125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:38.791129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:38.794589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:38.795951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:38.796756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.305854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:39.318459 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86d4805d-1dbb-45a8-9be9-e9838a02e83c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.588898 Nov 02 12:29:39.320236 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1131/2277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:38 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:39.330603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:39.332055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:39.341127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.341870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.348678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.350428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.351095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.351681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.703388 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3411f85-2a75-45a3-84d8-5953631abe46 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/c3a314c4-c35c-4d38-8af8-f9e3a2d3d68d" status: 202 len: 0 microversion: 2.1 time: 1.414828 Nov 02 12:29:39.704534 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1147/2278] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:38 2022] DELETE /compute/v2.1/os-security-groups/c3a314c4-c35c-4d38-8af8-f9e3a2d3d68d => generated 0 bytes in 1417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:39.710467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:39.711080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:39.727683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.730071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.731249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.732329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.734398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.735076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.076367 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09eb7a2b-35e5-48f7-bede-751dfa177aa5 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.369689 Nov 02 12:29:40.079172 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1148/2279] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:29:39 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-interface => generated 284 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:40.088078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:40.090319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:40.107256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.108793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.108948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:40.112150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.113686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.114799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.115812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.139290 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a0460d3-7dbb-4be9-bdc3-3cf058323e93 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1505 microversion: 2.1 time: 0.817288 Nov 02 12:29:40.150575 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1132/2280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:39 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1505 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:40.159990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:40.169738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 9bf7c70a-03b4-456d-96c0-8e892183b1ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:40.201820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.202733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.203529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.204844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.205698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.206525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.239669 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] HTTP exception thrown: Instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac could not be found. Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Request method failure captured: Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac HTTP/1.1 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmB4Da5rfuQQeaNtKoF0YwP3zsb7V5ij3p5RbltdpRztv3LMmkgX3jm8jnPSvu1Ofb-L7OQsC5GM2tpv8oCreRuYmQvsjeU5peCK3ESaK7t4TSx7CxuW0_PcSJtVvdrTWDcUn8xiDO7s7QGV4NcWmw8jn45mmMOljPckQaI5GIwCn3c Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 61f9f821af56421c98639028cc700a64 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/61f9f821af56421c98639028cc700a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/61f9f821af56421c98639028cc700a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/61f9f821af56421c98639028cc700a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_61f9f821af56421c98639028cc700a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 61f9f821af56421c98639028cc700a64 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-LiveAutoBlockMigrationV225Test-83176342-project Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a71d3feaad3148cc89c28cb18acf0cd0 Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-83176342-project Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac could not be found. Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9bf7c70a-03b4-456d-96c0-8e892183b1ac'} Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac could not be found. Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac could not be found. Nov 02 12:29:40.243413 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac could not be found. Nov 02 12:29:40.251938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.254652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Returning 404 to user: Instance 9bf7c70a-03b4-456d-96c0-8e892183b1ac could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:40.256469 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad5d1eeb-70c5-4620-b960-e9160df79ddb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac" status: 404 len: 111 microversion: 2.25 time: 0.103737 Nov 02 12:29:40.258206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1133/2281] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:40 2022] GET /compute/v2.1/servers/9bf7c70a-03b4-456d-96c0-8e892183b1ac => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:29:40.273534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc54bf34-98e2-453a-ab77-47f64fd7c8fb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f228ea995e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:40.362532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG neutronclient.v2_0.client [None req-dc54bf34-98e2-453a-ab77-47f64fd7c8fb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c0b22d44-99cd-4ea9-a129-43e1984fced4 does not exist", "detail": ""}} {{(pid=120722) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:29:40.364300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-dc54bf34-98e2-453a-ab77-47f64fd7c8fb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Neutron security group c0b22d44-99cd-4ea9-a129-43e1984fced4 not found {{(pid=120722) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:29:40.365592 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-dc54bf34-98e2-453a-ab77-47f64fd7c8fb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] HTTP exception thrown: Security group c0b22d44-99cd-4ea9-a129-43e1984fced4 does not exist Nov 02 12:29:40.365592 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-bad6fb7d-977f-4e17-838b-17c77c165d2b'] Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc54bf34-98e2-453a-ab77-47f64fd7c8fb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Request method failure captured: Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-security-groups/c0b22d44-99cd-4ea9-a129-43e1984fced4 HTTP/1.1 Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmKT3dQ4NE5IzU5xKjolUm308cJ4kgHkGShqBG7iPv7BK0qh9VtM8vKamnGxb9-VK53WtmonvUFOjxpCYFmTNuyL8QnL2E-_PTmXcsZKXaZwhdHwVeKAioY_y2tQPD2pJxS5_pK5T2HHoOVOaQknmxbC1ikoL1trm8Wxx9xqewM3orQ Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 440977e6d1c146328c5856f007ee5dca Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-877954390 Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/440977e6d1c146328c5856f007ee5dca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/440977e6d1c146328c5856f007ee5dca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/440977e6d1c146328c5856f007ee5dca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_440977e6d1c146328c5856f007ee5dca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-SecurityGroupRulesTestJSON-877954390 Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 440977e6d1c146328c5856f007ee5dca Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-877954390 Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-SecurityGroupRulesTestJSON-877954390-project Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 3abad9e78bd846d6904d96274533f3be Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-SecurityGroupRulesTestJSON-877954390-project Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: exception: Security group c0b22d44-99cd-4ea9-a129-43e1984fced4 does not exist Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-bad6fb7d-977f-4e17-838b-17c77c165d2b'] Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c0b22d44-99cd-4ea9-a129-43e1984fced4'} Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:29:40.371450 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c0b22d44-99cd-4ea9-a129-43e1984fced4 does not exist Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bad6fb7d-977f-4e17-838b-17c77c165d2b'] Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c0b22d44-99cd-4ea9-a129-43e1984fced4 does not exist Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bad6fb7d-977f-4e17-838b-17c77c165d2b'] Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c0b22d44-99cd-4ea9-a129-43e1984fced4 does not exist Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bad6fb7d-977f-4e17-838b-17c77c165d2b'] Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c0b22d44-99cd-4ea9-a129-43e1984fced4 does not exist Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bad6fb7d-977f-4e17-838b-17c77c165d2b'] Nov 02 12:29:40.378780 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:40.387748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc54bf34-98e2-453a-ab77-47f64fd7c8fb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Returning 404 to user: Security group c0b22d44-99cd-4ea9-a129-43e1984fced4 does not exist Nov 02 12:29:40.387748 n-d-855650-5 devstack@n-api.service[120722]: Neutron server returns request_ids: ['req-bad6fb7d-977f-4e17-838b-17c77c165d2b'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:40.389914 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc54bf34-98e2-453a-ab77-47f64fd7c8fb tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/c0b22d44-99cd-4ea9-a129-43e1984fced4" status: 404 len: 194 microversion: 2.1 time: 0.129654 Nov 02 12:29:40.396811 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1134/2282] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:40 2022] DELETE /compute/v2.1/os-security-groups/c0b22d44-99cd-4ea9-a129-43e1984fced4 => generated 194 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:40.408163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96c77c2b-8449-41bf-b031-3e7a3b36443e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '.version_select at 0x7f2292a42280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:40.469304 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96c77c2b-8449-41bf-b031-3e7a3b36443e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-416199290" status: 204 len: 0 microversion: 2.25 time: 0.067122 Nov 02 12:29:40.474311 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1135/2283] 10.222.0.45 () {60 vars in 1259 bytes} [Wed Nov 2 12:29:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-416199290 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:29:40.486022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:40.487243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:40.501368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.502432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.504464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.506547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.507457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.508575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.675686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:40.690206 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb5322e9-d059-4983-bb2c-81b6c4f1f85a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.606799 Nov 02 12:29:40.690856 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1149/2284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:40 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:40.722248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c15015a-5f3c-4a54-a4fd-09b1aef569c5 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f22929dae50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:41.129289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:41.149801 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-961d46e4-d8eb-476e-a7cc-2227dde2c950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.672555 Nov 02 12:29:41.156666 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1136/2285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:40 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:41.169246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-593d5f1a-79d0-4438-b739-e096a8b262d7 req-3c7cf313-656a-47c0-89fe-72704d9f3e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607c6541-4b70-4b25-accf-4561ab91c26b", "name": "network-vif-deleted", "tag": "0c4c8c89-f026-4d9a-b76b-907dc8861e93"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:41.208823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-593d5f1a-79d0-4438-b739-e096a8b262d7 req-3c7cf313-656a-47c0-89fe-72704d9f3e11 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:41.210423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-593d5f1a-79d0-4438-b739-e096a8b262d7 req-3c7cf313-656a-47c0-89fe-72704d9f3e11 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:41.211491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-593d5f1a-79d0-4438-b739-e096a8b262d7 req-3c7cf313-656a-47c0-89fe-72704d9f3e11 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:41.242470 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-593d5f1a-79d0-4438-b739-e096a8b262d7 req-3c7cf313-656a-47c0-89fe-72704d9f3e11 service nova] Creating event network-vif-deleted:0c4c8c89-f026-4d9a-b76b-907dc8861e93 for instance 607c6541-4b70-4b25-accf-4561ab91c26b on n-h1-855650-5 Nov 02 12:29:41.251600 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-593d5f1a-79d0-4438-b739-e096a8b262d7 req-3c7cf313-656a-47c0-89fe-72704d9f3e11 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091572 Nov 02 12:29:41.252660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1137/2286] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:41.259136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:41.261466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:41.275830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:41.277193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:41.277959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:41.279016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:41.279730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:41.280393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:41.471796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:41.488418 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67acbdfc-cd39-4840-a3d0-9956bceb4fa8 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1463 microversion: 2.1 time: 0.234222 Nov 02 12:29:41.489732 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1138/2287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:41 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1463 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:41.599189 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c15015a-5f3c-4a54-a4fd-09b1aef569c5 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/2d1744e8-b705-4fb7-9f80-255ae191abd4" status: 202 len: 0 microversion: 2.1 time: 0.890578 Nov 02 12:29:41.600765 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1150/2288] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:40 2022] DELETE /compute/v2.1/os-security-groups/2d1744e8-b705-4fb7-9f80-255ae191abd4 => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:41.610014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68d9038c-9e99-45ef-9d59-b52618ab4382 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f22929da820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:41.718734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1087869690", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:41.787096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:29:42.249094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:42.250355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:42.250803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:42.251346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:42.252047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:42.264874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.265508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.266236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.267142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.267881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.268545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.293850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Getting quotas for project 1df56e6378214b2e9208a75a5ba352f8. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:42.300971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Getting quotas for user 279653ad8ae749c38be123a49e3ca4e2 and project 1df56e6378214b2e9208a75a5ba352f8. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:42.316722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:29:42.319631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:29:42.371753 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-68d9038c-9e99-45ef-9d59-b52618ab4382 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/85e1f8f5-3280-4e82-bbe5-27b53c46dedb" status: 202 len: 0 microversion: 2.1 time: 0.763561 Nov 02 12:29:42.377173 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1151/2289] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:41 2022] DELETE /compute/v2.1/os-security-groups/85e1f8f5-3280-4e82-bbe5-27b53c46dedb => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:29:42.390234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:42.392765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:42.399508 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59ebd8f4-7f1a-4718-a2e1-d1a69a2c4fe4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907688 Nov 02 12:29:42.400364 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1139/2290] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:29:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:29:42.410319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.410986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.412576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.413951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.415380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.416911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.584050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-21f555a3-77b7-4388-ae6d-5b780f46b8ae req-9abd4123-7941-4393-8cfb-95287e4ad23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d42b47d-df80-48cf-a3a2-416031e2a041", "tag": "01dfabd4-1253-4651-b032-a93021f1cac6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:42.600877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-21f555a3-77b7-4388-ae6d-5b780f46b8ae req-9abd4123-7941-4393-8cfb-95287e4ad23f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.601811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-21f555a3-77b7-4388-ae6d-5b780f46b8ae req-9abd4123-7941-4393-8cfb-95287e4ad23f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.602423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-21f555a3-77b7-4388-ae6d-5b780f46b8ae req-9abd4123-7941-4393-8cfb-95287e4ad23f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.616762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-21f555a3-77b7-4388-ae6d-5b780f46b8ae req-9abd4123-7941-4393-8cfb-95287e4ad23f service nova] Creating event network-changed:01dfabd4-1253-4651-b032-a93021f1cac6 for instance 6d42b47d-df80-48cf-a3a2-416031e2a041 on n-h1-855650-5 Nov 02 12:29:42.623104 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-21f555a3-77b7-4388-ae6d-5b780f46b8ae req-9abd4123-7941-4393-8cfb-95287e4ad23f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220163 Nov 02 12:29:42.624378 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1140/2291] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:42.631638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:42.632696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:42.642399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.643016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.643638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.645466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.646280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.647610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.692982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:42.707161 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ffe7e5ea-2c84-44bb-92f3-bf813b461391 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.327976 Nov 02 12:29:42.718244 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1152/2292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:42 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:42.718244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4fb66338-5189-4a0c-8634-cabc3cee4ef4 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f22929da160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:42.891030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:42.908256 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42ec4875-fe48-4bc7-b183-bcae6837d1bd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.282273 Nov 02 12:29:42.911584 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1141/2293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:42 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:42.918731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-16303777-da51-4644-9942-7a71c2e4f10a tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:42.919866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-16303777-da51-4644-9942-7a71c2e4f10a tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:42.999235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-16303777-da51-4644-9942-7a71c2e4f10a tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.012264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-16303777-da51-4644-9942-7a71c2e4f10a tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1223 microversion: 2.1 time: 0.099094 Nov 02 12:29:43.013652 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1142/2294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:42 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:43.032976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:43.034215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:43.043338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.044239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.044706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.045524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.046221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.046862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.082258 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4fb66338-5189-4a0c-8634-cabc3cee4ef4 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/57eeee86-9748-443d-8290-1669766eb25c" status: 202 len: 0 microversion: 2.1 time: 0.373243 Nov 02 12:29:43.084096 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1153/2295] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:42 2022] DELETE /compute/v2.1/os-security-groups/57eeee86-9748-443d-8290-1669766eb25c => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:43.090847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:43.091311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:43.107767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.108365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.108944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.109886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.110643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.111162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.148726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:43.168314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:43.282335 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-712d51c9-0949-4e01-90aa-11f89325fd99 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 204 len: 0 microversion: 2.25 time: 0.196836 Nov 02 12:29:43.282940 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1154/2296] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:29:43 2022] DELETE /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:29:43.296180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d888d9f-86d5-406a-bc62-702e0dc22c07 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f2292a5fee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:43.474531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.486182 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e05eb95b-75ce-43eb-b054-70d9ba91b855 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 200 len: 1463 microversion: 2.1 time: 0.469952 Nov 02 12:29:43.497640 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1143/2297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:43 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 1463 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:43.503675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:43.507104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:43.518430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.518954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.519405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.521253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.521253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.521488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.945176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.958580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.960978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.962914 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-263ae411-f315-41e8-88bc-b4be059c0e09 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1550 microversion: 2.25 time: 0.465234 Nov 02 12:29:43.963649 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1144/2298] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:43 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1550 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:43.970879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:43.971845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:43.980377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.981172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.981793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.982735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.983415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.984089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.466320 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d888d9f-86d5-406a-bc62-702e0dc22c07 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/7f6ccecc-2fbb-4954-80ed-fcda8368bc72" status: 202 len: 0 microversion: 2.1 time: 1.181948 Nov 02 12:29:44.469685 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1155/2299] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:43 2022] DELETE /compute/v2.1/os-security-groups/7f6ccecc-2fbb-4954-80ed-fcda8368bc72 => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:44.482023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:44.484152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:44.493514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.494454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.495232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.496215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.496892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.498300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.756762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:44.766946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f022fc98-cfea-4327-a914-e25807150fec tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.802072 Nov 02 12:29:44.783172 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1145/2300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:43 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:44.793232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:44.793820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:44.805718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.808554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.809297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.810317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.814670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.814670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.090550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:45.121346 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1db4e225-9c9e-4acd-9bbd-831a7bcda5d0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1275 microversion: 2.1 time: 0.335646 Nov 02 12:29:45.123984 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1146/2301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:44 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1275 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:45.142648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a690c44-928f-4ff0-9dd0-29a15bb60429 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] Calling method '.version_select at 0x7f22929f0940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:45.290941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:45.312174 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-495218f1-42e7-48c7-af92-59c4a193ae2e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.834279 Nov 02 12:29:45.313953 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1156/2302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:44 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:45.347544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:45.347544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 607c6541-4b70-4b25-accf-4561ab91c26b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:45.362109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.366240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.367053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.372317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.373447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.374160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.412725 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] HTTP exception thrown: Instance 607c6541-4b70-4b25-accf-4561ab91c26b could not be found. Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Request method failure captured: Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b HTTP/1.1 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmIUH3UYhVyHC4_haUQgui1TuENa4PiBxZKLvis8jOiaGLHlrOPcNBNijOf2BbRefesDUjtG9u_nZpEb4Elsa4Ooo3aF2FiEZj6ciqBaCLT6oi7KMiTvLQ22vUVUknSZtIt0lnwEAv7vOf2GOdeK44CLLqwpYWhXiZJ53CTk4cDuI1c Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 2a51f8822491473b8edfe0b97a2e0d67 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueTestJSON-37177427 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a51f8822491473b8edfe0b97a2e0d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a51f8822491473b8edfe0b97a2e0d67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a51f8822491473b8edfe0b97a2e0d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a51f8822491473b8edfe0b97a2e0d67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueTestJSON-37177427 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 2a51f8822491473b8edfe0b97a2e0d67 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueTestJSON-37177427 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueTestJSON-37177427-project Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 05ae1470e3b04928827e3757483e4c00 Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueTestJSON-37177427-project Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 607c6541-4b70-4b25-accf-4561ab91c26b could not be found. Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '607c6541-4b70-4b25-accf-4561ab91c26b'} Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 607c6541-4b70-4b25-accf-4561ab91c26b could not be found. Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 607c6541-4b70-4b25-accf-4561ab91c26b could not be found. Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:45.416226 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:45.423768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:45.423768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:45.423768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:45.423768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:45.423768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:45.423768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 607c6541-4b70-4b25-accf-4561ab91c26b could not be found. Nov 02 12:29:45.423768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:45.427117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Returning 404 to user: Instance 607c6541-4b70-4b25-accf-4561ab91c26b could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:45.429012 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de8e44ed-09b5-4757-9ee3-632b722b0549 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b" status: 404 len: 111 microversion: 2.1 time: 0.111386 Nov 02 12:29:45.438669 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1157/2303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:45 2022] GET /compute/v2.1/servers/607c6541-4b70-4b25-accf-4561ab91c26b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:45.449517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-08ca77a0-cc7e-4185-9ad1-10ffb9abd5d0 req-b0e5d562-84ab-4404-8f5d-c78bd37ff91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb59ac2b-fb2c-4690-9a9e-9cb56f78155a", "name": "network-vif-deleted", "tag": "a4f98e06-82ae-4a12-b885-9551951ad05a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:45.471453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-08ca77a0-cc7e-4185-9ad1-10ffb9abd5d0 req-b0e5d562-84ab-4404-8f5d-c78bd37ff91f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.472487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-08ca77a0-cc7e-4185-9ad1-10ffb9abd5d0 req-b0e5d562-84ab-4404-8f5d-c78bd37ff91f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.473278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-08ca77a0-cc7e-4185-9ad1-10ffb9abd5d0 req-b0e5d562-84ab-4404-8f5d-c78bd37ff91f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.498354 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-08ca77a0-cc7e-4185-9ad1-10ffb9abd5d0 req-b0e5d562-84ab-4404-8f5d-c78bd37ff91f service nova] Creating event network-vif-deleted:a4f98e06-82ae-4a12-b885-9551951ad05a for instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a on n-h2-855650-5 Nov 02 12:29:45.506093 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-08ca77a0-cc7e-4185-9ad1-10ffb9abd5d0 req-b0e5d562-84ab-4404-8f5d-c78bd37ff91f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064726 Nov 02 12:29:45.513400 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1158/2304] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:45.524171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:45.525611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:45.537681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.538654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.539724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.541053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.542494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.544267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.649223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.650177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.650999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.652871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lazy-loading 'fault' on Instance uuid eb59ac2b-fb2c-4690-9a9e-9cb56f78155a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:45.811736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:45.823462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:45.825397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:45.826842 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b3805d19-9ca6-4902-96e6-31a65ea9dde9 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1352 microversion: 2.25 time: 0.311318 Nov 02 12:29:45.827938 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1159/2305] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:45 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1352 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:45.833353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:45.834259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:45.841806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.842466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.842935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.843714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.844476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.845099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.898811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:46.066206 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a355a491-cff7-475d-963f-18d921abaac0 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "DELETE /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 204 len: 0 microversion: 2.1 time: 0.222644 Nov 02 12:29:46.067506 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1160/2306] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:45 2022] DELETE /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:29:46.082469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:46.084358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:46.092926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.093433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.093884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.094693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.095417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.096390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.107250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a690c44-928f-4ff0-9dd0-29a15bb60429 tempest-SecurityGroupRulesTestJSON-877954390 tempest-SecurityGroupRulesTestJSON-877954390-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/ae3147bd-2f75-4ea7-9c28-d7b41e903e34" status: 202 len: 0 microversion: 2.1 time: 0.975024 Nov 02 12:29:46.108617 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1147/2307] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:45 2022] DELETE /compute/v2.1/os-security-groups/ae3147bd-2f75-4ea7-9c28-d7b41e903e34 => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:46.115533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:46.116603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:46.126279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.127405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.128167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.129247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.129995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.131446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.826905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:46.835834 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-218c1c46-3210-47db-b37e-9293629ac730 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1490 microversion: 2.1 time: 0.725714 Nov 02 12:29:46.850004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:46.850004 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ff96d5c-1cbc-4d31-b5c0-112a08b45835 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.772181 Nov 02 12:29:46.854406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1148/2308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:46 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1490 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:46.860215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:46.861153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:46.868379 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1161/2309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:46 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:46.878914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.879692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.880395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.881590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.882361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:46.882502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.883224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.883787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:46.900055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.900898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.902284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.903501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.905733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.906598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.295222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:47.304815 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e76d0631-8f54-45d9-9eb6-7b0e34e7fa77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.434759 Nov 02 12:29:47.305028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:47.307903 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1162/2310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:46 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:47.311470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:47.312318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:47.320421 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf1518d4-ce4b-4661-a48c-7f708f223628 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1323 microversion: 2.1 time: 0.464069 Nov 02 12:29:47.322311 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1149/2311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:46 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:47.324893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.344392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.345143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.346090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.347451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.348098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.393576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.394267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.394955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.395705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lazy-loading 'fault' on Instance uuid eb59ac2b-fb2c-4690-9a9e-9cb56f78155a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:47.531047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:47.543810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:47.547725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:47.553092 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f625ac1-5472-4610-914b-79c1e131888e tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1352 microversion: 2.25 time: 0.244708 Nov 02 12:29:47.555484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1163/2312] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:47 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1352 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:47.598240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-62ee5e0d-e1a3-4e54-8580-6cde97793fef req-05a6d419-b051-4f81-b205-f50c50455e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1", "name": "network-vif-plugged", "status": "completed", "tag": "8096feea-680d-4ef5-8cb4-92af700234d1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:47.612145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62ee5e0d-e1a3-4e54-8580-6cde97793fef req-05a6d419-b051-4f81-b205-f50c50455e8c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.613222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62ee5e0d-e1a3-4e54-8580-6cde97793fef req-05a6d419-b051-4f81-b205-f50c50455e8c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.613992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62ee5e0d-e1a3-4e54-8580-6cde97793fef req-05a6d419-b051-4f81-b205-f50c50455e8c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.635081 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-62ee5e0d-e1a3-4e54-8580-6cde97793fef req-05a6d419-b051-4f81-b205-f50c50455e8c service nova] Creating event network-vif-plugged:8096feea-680d-4ef5-8cb4-92af700234d1 for instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 on n-h1-855650-5 Nov 02 12:29:47.642524 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-62ee5e0d-e1a3-4e54-8580-6cde97793fef req-05a6d419-b051-4f81-b205-f50c50455e8c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049252 Nov 02 12:29:47.643488 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1150/2313] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:29:47.823056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0a4f8e3f-df98-4abf-b009-df7b1c868cca req-d50c2aa9-846e-421d-a87f-9e9fe1ca690c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b97c454-302d-4064-8def-91d463f7873a", "tag": "79109b25-072f-4d51-b4ce-e7809b45d746"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:47.836340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0a4f8e3f-df98-4abf-b009-df7b1c868cca req-d50c2aa9-846e-421d-a87f-9e9fe1ca690c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.838187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0a4f8e3f-df98-4abf-b009-df7b1c868cca req-d50c2aa9-846e-421d-a87f-9e9fe1ca690c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.840246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0a4f8e3f-df98-4abf-b009-df7b1c868cca req-d50c2aa9-846e-421d-a87f-9e9fe1ca690c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.857773 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0a4f8e3f-df98-4abf-b009-df7b1c868cca req-d50c2aa9-846e-421d-a87f-9e9fe1ca690c service nova] Creating event network-changed:79109b25-072f-4d51-b4ce-e7809b45d746 for instance 6b97c454-302d-4064-8def-91d463f7873a on n-h1-855650-5 Nov 02 12:29:47.866621 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0a4f8e3f-df98-4abf-b009-df7b1c868cca req-d50c2aa9-846e-421d-a87f-9e9fe1ca690c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048345 Nov 02 12:29:47.867955 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1164/2314] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:47.876072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:47.877347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:47.882775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:47.883629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:47.896305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.897356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.898114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.899327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.900108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.900760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.910116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.910661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.911166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.911935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.912405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.912882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.255348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.265931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac799fa9-22e9-4341-b8b3-67377c071c4d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1490 microversion: 2.1 time: 0.408155 Nov 02 12:29:48.266577 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1151/2315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:47 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1490 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:48.294459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.304491 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b1bfeec2-c187-4c41-af07-3f33bdd1e1c0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.427344 Nov 02 12:29:48.305252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1165/2316] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:47 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:48.335880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:48.337126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:48.345568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.346095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.346545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.347267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.347727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.348157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.350157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:48.351030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:48.351942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:48.359607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.360289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.360724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.361764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.362334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.363055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.678395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.703797 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b36f41d4-cda6-4009-88f5-74a46ae586b2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.377230 Nov 02 12:29:48.704190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.704487 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1152/2317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:48 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:48.717127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:48.718327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:48.730260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.731137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.731954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.733282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.734169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.735312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.739111 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb9470c1-dd33-4abb-97ff-2bd0b48c8770 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1323 microversion: 2.1 time: 0.394043 Nov 02 12:29:48.740727 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1166/2318] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:48 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1323 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:48.812725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.813946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.815044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.816305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lazy-loading 'fault' on Instance uuid eb59ac2b-fb2c-4690-9a9e-9cb56f78155a {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:48.897830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.910543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.912408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.913634 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af69afe2-bb5c-4148-b767-118efc59c351 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 200 len: 1352 microversion: 2.25 time: 0.205163 Nov 02 12:29:48.914612 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1153/2319] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:48 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 1352 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:49.299083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:49.302505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:49.317666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.319388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.320073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.323193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.327682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.328473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.344703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:49.345600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:49.355696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.356617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.357273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.358355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.359170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.359858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.240668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:50.263022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ae1470e3b04928827e3757483e4c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a51f8822491473b8edfe0b97a2e0d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:50.264512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02f5d3ea-5a1c-422c-a473-8690f10c4f9d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.924217 Nov 02 12:29:50.266365 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1154/2320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:49 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:50.279597 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-14fee377-a7c8-47e0-abe7-22926af1b926 tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 200 len: 1490 microversion: 2.1 time: 0.992285 Nov 02 12:29:50.283858 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1167/2321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:49 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 1490 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:50.293088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:50.293088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:50.297881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.299202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.300170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.301471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.302334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.304434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.327842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:50.328792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:50.359033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.359568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.360062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.363228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.364305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.369096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.850908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:50.866146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1b51140-faa6-450a-9260-91e887b57d26 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.597641 Nov 02 12:29:50.867224 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1155/2322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:50 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:50.875986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:50.877252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: eb59ac2b-fb2c-4690-9a9e-9cb56f78155a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:50.879141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:50.895926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.897148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.898000 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30cde3b5-3cec-4cfb-bcb8-8a068f1e93f0 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1323 microversion: 2.1 time: 0.592235 Nov 02 12:29:50.898202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.899897 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1168/2323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:50 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1323 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:50.906381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.907397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-dd0c0a77-1361-4a48-8e0f-8d2de7f590fa req-592323b7-baa0-403e-a821-86119b1bd536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49054040-b35d-4bc1-9fb7-a8da8b84319c", "name": "network-vif-deleted", "tag": "bfb0b3e1-ba60-40e5-bdbb-316e361033a0"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:50.908904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.909644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.925696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd0c0a77-1361-4a48-8e0f-8d2de7f590fa req-592323b7-baa0-403e-a821-86119b1bd536 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.926594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd0c0a77-1361-4a48-8e0f-8d2de7f590fa req-592323b7-baa0-403e-a821-86119b1bd536 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.927364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd0c0a77-1361-4a48-8e0f-8d2de7f590fa req-592323b7-baa0-403e-a821-86119b1bd536 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.943661 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] HTTP exception thrown: Instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a could not be found. Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Request method failure captured: Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a HTTP/1.1 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmB4Da5rfuQQeaNtKoF0YwP3zsb7V5ij3p5RbltdpRztv3LMmkgX3jm8jnPSvu1Ofb-L7OQsC5GM2tpv8oCreRuYmQvsjeU5peCK3ESaK7t4TSx7CxuW0_PcSJtVvdrTWDcUn8xiDO7s7QGV4NcWmw8jn45mmMOljPckQaI5GIwCn3c Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 61f9f821af56421c98639028cc700a64 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/61f9f821af56421c98639028cc700a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/61f9f821af56421c98639028cc700a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/61f9f821af56421c98639028cc700a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_61f9f821af56421c98639028cc700a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 61f9f821af56421c98639028cc700a64 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-LiveAutoBlockMigrationV225Test-83176342-project Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a71d3feaad3148cc89c28cb18acf0cd0 Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-83176342-project Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a could not be found. Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'eb59ac2b-fb2c-4690-9a9e-9cb56f78155a'} Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a could not be found. Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a could not be found. Nov 02 12:29:50.946429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a could not be found. Nov 02 12:29:50.951844 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:29:50.952349 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-dd0c0a77-1361-4a48-8e0f-8d2de7f590fa req-592323b7-baa0-403e-a821-86119b1bd536 service nova] Creating event network-vif-deleted:bfb0b3e1-ba60-40e5-bdbb-316e361033a0 for instance 49054040-b35d-4bc1-9fb7-a8da8b84319c on n-h2-855650-5 Nov 02 12:29:50.954748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Returning 404 to user: Instance eb59ac2b-fb2c-4690-9a9e-9cb56f78155a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:50.956493 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a452f379-b0f6-4011-9558-61bc1c3275fd tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a" status: 404 len: 111 microversion: 2.25 time: 0.087256 Nov 02 12:29:50.956983 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-dd0c0a77-1361-4a48-8e0f-8d2de7f590fa req-592323b7-baa0-403e-a821-86119b1bd536 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055100 Nov 02 12:29:50.957950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1156/2324] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:50 2022] GET /compute/v2.1/servers/eb59ac2b-fb2c-4690-9a9e-9cb56f78155a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:29:50.962912 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1169/2325] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:50.971790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:50.972557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:50.983894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.984903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.985809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.987240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.988084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.988871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.023774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:51.144366 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22da92e3-dc40-4579-a954-d2311ec66324 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "DELETE /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 204 len: 0 microversion: 2.25 time: 0.179347 Nov 02 12:29:51.147213 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1157/2326] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:29:50 2022] DELETE /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:29:51.158651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:51.159363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:51.170655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.171634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.172277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.173208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.173991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.174605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.299155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:51.300508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:51.320563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.321327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.322097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.324211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.324876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.325338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.665239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.675697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.677280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.678651 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f158ab7f-2d8c-4101-97e9-c305d8ad84c1 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1563 microversion: 2.25 time: 0.524437 Nov 02 12:29:51.679514 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1170/2327] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:51 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1563 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:51.685853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:51.686997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] [instance: 49054040-b35d-4bc1-9fb7-a8da8b84319c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:51.694297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.694803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.695595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.696724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.697181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.697692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.716030 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] HTTP exception thrown: Instance 49054040-b35d-4bc1-9fb7-a8da8b84319c could not be found. Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Request method failure captured: Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c HTTP/1.1 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmIUH3UYhVyHC4_haUQgui1TuENa4PiBxZKLvis8jOiaGLHlrOPcNBNijOf2BbRefesDUjtG9u_nZpEb4Elsa4Ooo3aF2FiEZj6ciqBaCLT6oi7KMiTvLQ22vUVUknSZtIt0lnwEAv7vOf2GOdeK44CLLqwpYWhXiZJ53CTk4cDuI1c Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 2a51f8822491473b8edfe0b97a2e0d67 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueTestJSON-37177427 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a51f8822491473b8edfe0b97a2e0d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a51f8822491473b8edfe0b97a2e0d67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a51f8822491473b8edfe0b97a2e0d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a51f8822491473b8edfe0b97a2e0d67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueTestJSON-37177427 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 2a51f8822491473b8edfe0b97a2e0d67 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueTestJSON-37177427 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueTestJSON-37177427-project Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 05ae1470e3b04928827e3757483e4c00 Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueTestJSON-37177427-project Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 49054040-b35d-4bc1-9fb7-a8da8b84319c could not be found. Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '49054040-b35d-4bc1-9fb7-a8da8b84319c'} Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49054040-b35d-4bc1-9fb7-a8da8b84319c could not be found. Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49054040-b35d-4bc1-9fb7-a8da8b84319c could not be found. Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:51.717770 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49054040-b35d-4bc1-9fb7-a8da8b84319c could not be found. Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] Returning 404 to user: Instance 49054040-b35d-4bc1-9fb7-a8da8b84319c could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8056ce2-0d2d-4581-8f57-7f1a5d96d29d tempest-ServerRescueTestJSON-37177427 tempest-ServerRescueTestJSON-37177427-project] 10.222.0.45 "GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c" status: 404 len: 111 microversion: 2.1 time: 0.038440 Nov 02 12:29:51.724161 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1171/2328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:51 2022] GET /compute/v2.1/servers/49054040-b35d-4bc1-9fb7-a8da8b84319c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:51.776736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.802842 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e02fe440-97f0-41bc-aa20-51d7c033e2e1 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.512948 Nov 02 12:29:51.804456 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1158/2329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:51 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:51.902824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:51.903840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:51.913050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.913849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.914547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.916588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.917665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.918345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.923462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:51.936823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:51.940097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:51.969818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.970543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.971441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.972793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.973645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.974469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.280579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:52.420281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:52.433682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:52.451294 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1c71ded8-e037-4565-b4ec-cfae1a45a651 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1313 microversion: 2.1 time: 0.553024 Nov 02 12:29:52.459994 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1172/2330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:51 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:52.463530 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0ab0ce9-c6d7-4a2d-932f-1ac47c377a20 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1323 microversion: 2.1 time: 0.533309 Nov 02 12:29:52.466669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1159/2331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:51 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:52.731274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:52.734641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:52.750560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.751936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.752701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.754168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.755133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.756034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.849291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:52.850629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:52.869509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.871994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.883171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.886668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.888254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.889649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.012689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:53.257868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.281940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.285614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.300729 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-499fc37f-b636-41aa-bc36-e41b66fe97ca tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1563 microversion: 2.25 time: 0.578086 Nov 02 12:29:53.302320 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1173/2332] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:52 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1563 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:53.411199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.433566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb24d86b-640c-4ec0-8dda-227ee7417ab9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.589974 Nov 02 12:29:53.447532 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1160/2333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:52 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:53.485477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:53.487677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:53.497316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:53.502137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:53.505998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.515848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.519422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.520467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.521122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.523426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.524222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.530660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.531452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.532236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.532881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.533520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.027367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.040539 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2f3ac23-4e12-4906-bc7a-24668b7b727b tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1323 microversion: 2.1 time: 0.547320 Nov 02 12:29:54.041575 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1161/2334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:53 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1323 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:54.061392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.079764 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a740e2f4-e4b9-494a-aa02-657b6fc23e3d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1463 microversion: 2.1 time: 0.599775 Nov 02 12:29:54.085271 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1174/2335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:53 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1463 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:54.109501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ecabd59c-cc1c-4e5c-b316-4b4e3d80032d req-ed867e21-8308-4a4e-b4bd-ca97ad23fd24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82743148-2181-435d-868d-b5a11835e6ac", "name": "network-vif-deleted", "tag": "8bd2df87-fa0f-4d69-9959-45c6c7b34a0f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:54.129200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:54.133597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:54.145644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.147220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.148480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.149583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ecabd59c-cc1c-4e5c-b316-4b4e3d80032d req-ed867e21-8308-4a4e-b4bd-ca97ad23fd24 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.150039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.150264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ecabd59c-cc1c-4e5c-b316-4b4e3d80032d req-ed867e21-8308-4a4e-b4bd-ca97ad23fd24 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.150634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ecabd59c-cc1c-4e5c-b316-4b4e3d80032d req-ed867e21-8308-4a4e-b4bd-ca97ad23fd24 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.151149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.152457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.173277 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ecabd59c-cc1c-4e5c-b316-4b4e3d80032d req-ed867e21-8308-4a4e-b4bd-ca97ad23fd24 service nova] Creating event network-vif-deleted:8bd2df87-fa0f-4d69-9959-45c6c7b34a0f for instance 82743148-2181-435d-868d-b5a11835e6ac on n-h2-855650-5 Nov 02 12:29:54.181289 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ecabd59c-cc1c-4e5c-b316-4b4e3d80032d req-ed867e21-8308-4a4e-b4bd-ca97ad23fd24 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079801 Nov 02 12:29:54.184009 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1162/2336] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:54.334134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:54.336713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:54.347693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.348245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.348987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.350558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.351499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.351886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.353063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.368934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Old instance type m1.heat2, new instance type m1.heat {{(pid=120723) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:29:54.409227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:54.410136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:54.410877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:54.411470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:54.411768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.412098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:54.413023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.414086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.414857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lazy-loading 'fault' on Instance uuid 82743148-2181-435d-868d-b5a11835e6ac {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:54.528115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.550675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.552884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a71d3feaad3148cc89c28cb18acf0cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9f821af56421c98639028cc700a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.554572 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0f3d82e-f2c5-4fd4-a414-870d784227cb tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 200 len: 1351 microversion: 2.25 time: 0.228331 Nov 02 12:29:54.555639 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1163/2337] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:54 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 1351 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:54.590752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:54.592512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:54.602935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.603992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.604847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.606173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.607551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.608359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.803933 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-27d48eab-5908-4194-8932-202998f95582 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1/action" status: 202 len: 0 microversion: 2.1 time: 0.678425 Nov 02 12:29:54.812740 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1175/2338] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:29:54 2022] POST /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:54.825236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:54.827533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:54.842438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.844000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.845083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.846740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.847906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.848951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.015833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:55.036665 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53023610-703a-4bfc-acfc-aee355377ffa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.478263 Nov 02 12:29:55.039668 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1164/2339] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:54 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:55.069709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:55.073033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:55.084788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.086147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.087230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.088335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.089444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.090156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.335474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:55.355048 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7691b7f9-853d-436e-b8fb-917273e2eb99 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1472 microversion: 2.1 time: 0.537350 Nov 02 12:29:55.356656 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1176/2340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:54 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1472 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:55.489314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:55.503627 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33f8f57e-bfd1-4f2e-a7ff-3677332b45b4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1323 microversion: 2.1 time: 0.441844 Nov 02 12:29:55.506865 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1165/2341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:55 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1323 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:55.610800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:55.613800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] [instance: 82743148-2181-435d-868d-b5a11835e6ac] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:55.641625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.643088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.644174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.646985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.648289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.649465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.732294 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] HTTP exception thrown: Instance 82743148-2181-435d-868d-b5a11835e6ac could not be found. Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Request method failure captured: Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac HTTP/1.1 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmB4Da5rfuQQeaNtKoF0YwP3zsb7V5ij3p5RbltdpRztv3LMmkgX3jm8jnPSvu1Ofb-L7OQsC5GM2tpv8oCreRuYmQvsjeU5peCK3ESaK7t4TSx7CxuW0_PcSJtVvdrTWDcUn8xiDO7s7QGV4NcWmw8jn45mmMOljPckQaI5GIwCn3c Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 61f9f821af56421c98639028cc700a64 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/61f9f821af56421c98639028cc700a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/61f9f821af56421c98639028cc700a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/61f9f821af56421c98639028cc700a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_61f9f821af56421c98639028cc700a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 61f9f821af56421c98639028cc700a64 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-83176342 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-LiveAutoBlockMigrationV225Test-83176342-project Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a71d3feaad3148cc89c28cb18acf0cd0 Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-83176342-project Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 82743148-2181-435d-868d-b5a11835e6ac could not be found. Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '82743148-2181-435d-868d-b5a11835e6ac'} Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82743148-2181-435d-868d-b5a11835e6ac could not be found. Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82743148-2181-435d-868d-b5a11835e6ac could not be found. Nov 02 12:29:55.737041 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82743148-2181-435d-868d-b5a11835e6ac could not be found. Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.751504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] Returning 404 to user: Instance 82743148-2181-435d-868d-b5a11835e6ac could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:55.756602 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78800b24-0f49-4465-a452-d0dfaa206166 tempest-LiveAutoBlockMigrationV225Test-83176342 tempest-LiveAutoBlockMigrationV225Test-83176342-project] 10.222.0.45 "GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac" status: 404 len: 111 microversion: 2.25 time: 0.173447 Nov 02 12:29:55.759469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1177/2342] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:55 2022] GET /compute/v2.1/servers/82743148-2181-435d-868d-b5a11835e6ac => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:29:56.069098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:56.070976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:56.083316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.084198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.084919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.086358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.087413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.088842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.365467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-85e9414a-3e9d-4f3b-8594-5c6c6038fc44 req-ecc6017e-3893-4952-8b6a-75a5dfca6652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b97c454-302d-4064-8def-91d463f7873a", "name": "network-vif-plugged", "status": "completed", "tag": "79109b25-072f-4d51-b4ce-e7809b45d746"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:56.395980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-85e9414a-3e9d-4f3b-8594-5c6c6038fc44 req-ecc6017e-3893-4952-8b6a-75a5dfca6652 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.396482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-85e9414a-3e9d-4f3b-8594-5c6c6038fc44 req-ecc6017e-3893-4952-8b6a-75a5dfca6652 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.397021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-85e9414a-3e9d-4f3b-8594-5c6c6038fc44 req-ecc6017e-3893-4952-8b6a-75a5dfca6652 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.436651 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-85e9414a-3e9d-4f3b-8594-5c6c6038fc44 req-ecc6017e-3893-4952-8b6a-75a5dfca6652 service nova] Creating event network-vif-plugged:79109b25-072f-4d51-b4ce-e7809b45d746 for instance 6b97c454-302d-4064-8def-91d463f7873a on n-h1-855650-5 Nov 02 12:29:56.447578 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-85e9414a-3e9d-4f3b-8594-5c6c6038fc44 req-ecc6017e-3893-4952-8b6a-75a5dfca6652 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.411824 Nov 02 12:29:56.451254 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1166/2343] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:56.471861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:56.473425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:56.487014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.487526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.487973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.488767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.489236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.489798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.642468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:57.648746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:57.668484 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-79299a41-0855-4d00-95f9-87b909ce15f6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 1.606520 Nov 02 12:29:57.669084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1178/2344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:56 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:57.682251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:57.684305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:57.692363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:57.704131 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3162724-a91d-4159-b060-622cf7b3160c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1472 microversion: 2.1 time: 1.250374 Nov 02 12:29:57.706191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.707190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.707935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.709297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.709933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.710612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.713089 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1167/2345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:56 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1472 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:58.095907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:58.123711 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2561893d-20c2-4dc4-a9b2-39416f9d5856 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1323 microversion: 2.1 time: 0.452898 Nov 02 12:29:58.126582 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1179/2346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:57 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1323 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:58.715638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:58.717843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:58.739714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.740592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.743001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:58.746960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.750836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.751986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:58.754226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:58.754991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:58.789186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.789896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.790496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:58.791780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.793436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.794850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:58.798002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:59.298170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:59.317323 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f7aa3ff-fcab-4324-bef3-825c94d0104f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1472 microversion: 2.1 time: 0.565245 Nov 02 12:29:59.323140 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1180/2347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:58 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1472 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:59.347583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:59.349323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:59.364528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:59.365620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:59.367322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:59.370029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:59.371519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:59.372872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:59.399819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:59.436288 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9e9e6e6-2025-4625-b5a5-1852923ba71a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.727823 Nov 02 12:29:59.440528 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1168/2348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:58 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:59.847821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:59.865924 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4b674502-1956-4297-abb1-23e588f1dc41 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1472 microversion: 2.1 time: 0.539754 Nov 02 12:29:59.867986 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1181/2349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:59 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1472 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:59.925551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:59.927761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:59.939143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:59.955220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:59.957165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:59.958558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:59.960641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:59.963682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:59.966823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.046165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Request method failure captured: Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a/diagnostics HTTP/1.1 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmKz7q27pfvCS0rrAc9OBLevKejXb9o4WYobkfilvWTtiSdJhb40_LFgKuQjDKa4MExxdDr6gl3G5s_XcYb9-53Tc3gPLFcwn7XhCt2JidCChs23KvKbXwYDBfZ004kbcQ8nhCRoAkyBnPwJsTROxxPJt_FlfAcgsknRJ9k0lKsYIk8 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1df56e6378214b2e9208a75a5ba352f8 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-894133879 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1df56e6378214b2e9208a75a5ba352f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1df56e6378214b2e9208a75a5ba352f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1df56e6378214b2e9208a75a5ba352f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1df56e6378214b2e9208a75a5ba352f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-894133879 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1df56e6378214b2e9208a75a5ba352f8 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-894133879 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerDiagnosticsNegativeTest-894133879-project Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 279653ad8ae749c38be123a49e3ca4e2 Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-894133879-project Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': '6b97c454-302d-4064-8def-91d463f7873a'} Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:30:00.057901 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:00.065923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:00.065923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:00.065923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:30:00.065923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:30:00.065923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 12:30:00.065923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:30:00.072740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:00.075184 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1d9dbcb-6723-4ec5-b5ee-4f04dc7e3c8f tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.165799 Nov 02 12:30:00.080668 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1169/2350] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:29:59 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a/diagnostics => generated 117 bytes in 173 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:30:00.102115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:00.103312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:00.138149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.138750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.139435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.140804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.142719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.143292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.224778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:30:00.372360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:00.374078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:00.388371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.392947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.395492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.398104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.400163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.401359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.456311 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e9687f4-8da6-478c-9463-5c9dcd921209 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 204 len: 0 microversion: 2.1 time: 0.365682 Nov 02 12:30:00.457338 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1182/2351] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:30:00 2022] DELETE /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:30:00.475169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:00.477626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:00.505950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.508521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.511791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.515164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.515673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.516126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:01.044717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:01.066715 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8161ff8a-6c6a-4fae-8627-c47ee8309632 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1472 microversion: 2.1 time: 0.704955 Nov 02 12:30:01.086363 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1170/2352] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:00 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1472 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:01.103712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:01.110120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:01.126532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:01.128157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:01.130526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:01.133602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:01.137796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:01.139158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:01.283382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:01.295871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67d732bc-72c7-4243-9077-c4e4da302389 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1517 microversion: 2.1 time: 0.831120 Nov 02 12:30:01.298202 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1183/2353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:00 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1517 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:01.562497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:01.575716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c0d22d97-2ef0-4e77-8ae0-55e3eba229b6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1478 microversion: 2.1 time: 0.484441 Nov 02 12:30:01.577670 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1171/2354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:01 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1478 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:02.113022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:02.116290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:02.144124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:02.144999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:02.145788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:02.150379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:02.154201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:02.155359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:02.350474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:02.351646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:02.383473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:02.384350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:02.385185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:02.394190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:02.400057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:02.410938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.322463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:03.366381 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5a1b7bc6-cc8a-4b0e-a859-0f5b8a292b11 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1472 microversion: 2.1 time: 1.253261 Nov 02 12:30:03.380766 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1184/2355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:02 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1472 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:03.380766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:03.380766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:03.393863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.395479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.395950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.396721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.406075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.406823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.725494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:03.742179 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-290915e4-a33a-4263-a865-5e4c8d25f8d6 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1436 microversion: 2.1 time: 0.370371 Nov 02 12:30:03.754741 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1185/2356] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:03 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1436 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:03.804115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:03.873792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4947fc94-97ff-48b6-b8cb-003350861b1d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1523 microversion: 2.1 time: 1.529669 Nov 02 12:30:03.880739 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1172/2357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:02 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1523 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:03.956182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7864efc7-ead0-41df-b13c-5df410119760 req-2fcdb64b-3d87-426c-9f2a-f21c857dabf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b97c454-302d-4064-8def-91d463f7873a", "name": "network-vif-deleted", "tag": "79109b25-072f-4d51-b4ce-e7809b45d746"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:03.989805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7864efc7-ead0-41df-b13c-5df410119760 req-2fcdb64b-3d87-426c-9f2a-f21c857dabf7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.990657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7864efc7-ead0-41df-b13c-5df410119760 req-2fcdb64b-3d87-426c-9f2a-f21c857dabf7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.991171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7864efc7-ead0-41df-b13c-5df410119760 req-2fcdb64b-3d87-426c-9f2a-f21c857dabf7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:04.027204 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7864efc7-ead0-41df-b13c-5df410119760 req-2fcdb64b-3d87-426c-9f2a-f21c857dabf7 service nova] Creating event network-vif-deleted:79109b25-072f-4d51-b4ce-e7809b45d746 for instance 6b97c454-302d-4064-8def-91d463f7873a on n-h1-855650-5 Nov 02 12:30:04.061042 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7864efc7-ead0-41df-b13c-5df410119760 req-2fcdb64b-3d87-426c-9f2a-f21c857dabf7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121818 Nov 02 12:30:04.065297 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1186/2358] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:04.395734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:04.396672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:04.428556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:04.434656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:04.438728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:04.441095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:04.442658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:04.444429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:04.789748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:04.798942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:04.837907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:04.843205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:04.844861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:04.850340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:04.851625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:04.855568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:04.868445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:05.168268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:05.176163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:05.179082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:05.181691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lazy-loading 'fault' on Instance uuid 6b97c454-302d-4064-8def-91d463f7873a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:30:05.452060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:05.471835 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9c82bb7-32f4-4de1-9bfa-a78d9ce18dd6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1472 microversion: 2.1 time: 1.081300 Nov 02 12:30:05.472462 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1173/2359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:04 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1472 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:05.497384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:05.501842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:05.521082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279653ad8ae749c38be123a49e3ca4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df56e6378214b2e9208a75a5ba352f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:05.533759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:05.538358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:05.538843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:05.544818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:05.545329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:05.545872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:05.550330 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b106b2fa-5e0c-45c0-8b0e-c9e70ab16ff4 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 200 len: 1313 microversion: 2.1 time: 0.780844 Nov 02 12:30:05.550981 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1187/2360] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:04 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 1313 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:06.034830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:06.049061 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e883cbd9-6406-4d91-9f0e-e2384d5633b9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1523 microversion: 2.1 time: 0.570718 Nov 02 12:30:06.052910 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1174/2361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:05 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:06.498912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:06.500769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:06.521655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:06.522205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:06.522656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:06.529020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:06.529651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:06.532033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:06.581156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:06.581788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] [instance: 6b97c454-302d-4064-8def-91d463f7873a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:06.611900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:06.612554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:06.617163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:06.619049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:06.626265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:06.627246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:06.677375 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] HTTP exception thrown: Instance 6b97c454-302d-4064-8def-91d463f7873a could not be found. Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Request method failure captured: Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a HTTP/1.1 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmKz7q27pfvCS0rrAc9OBLevKejXb9o4WYobkfilvWTtiSdJhb40_LFgKuQjDKa4MExxdDr6gl3G5s_XcYb9-53Tc3gPLFcwn7XhCt2JidCChs23KvKbXwYDBfZ004kbcQ8nhCRoAkyBnPwJsTROxxPJt_FlfAcgsknRJ9k0lKsYIk8 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1df56e6378214b2e9208a75a5ba352f8 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-894133879 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1df56e6378214b2e9208a75a5ba352f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1df56e6378214b2e9208a75a5ba352f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1df56e6378214b2e9208a75a5ba352f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1df56e6378214b2e9208a75a5ba352f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-894133879 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1df56e6378214b2e9208a75a5ba352f8 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-894133879 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerDiagnosticsNegativeTest-894133879-project Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 279653ad8ae749c38be123a49e3ca4e2 Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-894133879-project Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6b97c454-302d-4064-8def-91d463f7873a could not be found. Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6b97c454-302d-4064-8def-91d463f7873a'} Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b97c454-302d-4064-8def-91d463f7873a could not be found. Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b97c454-302d-4064-8def-91d463f7873a could not be found. Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:30:06.701008 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:06.704795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:30:06.704795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:06.704795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:06.704795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:06.704795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:06.704795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:06.704795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b97c454-302d-4064-8def-91d463f7873a could not be found. Nov 02 12:30:06.704795 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:30:06.707649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] Returning 404 to user: Instance 6b97c454-302d-4064-8def-91d463f7873a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:06.708786 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d9a7b33-3e41-4f38-96fa-fca2f880e406 tempest-ServerDiagnosticsNegativeTest-894133879 tempest-ServerDiagnosticsNegativeTest-894133879-project] 10.222.0.45 "GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a" status: 404 len: 111 microversion: 2.1 time: 0.134741 Nov 02 12:30:06.715635 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1175/2362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:06 2022] GET /compute/v2.1/servers/6b97c454-302d-4064-8def-91d463f7873a => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:30:07.090964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:07.091605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:07.123946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:07.125150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:07.125616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:07.140509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:07.143481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:07.146809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:07.584466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:07.598301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fc1b6787-13c4-4541-a050-d2a0d585e276 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1477 microversion: 2.1 time: 1.104305 Nov 02 12:30:07.603158 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1188/2363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:06 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1477 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:07.613175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a29866a8-3cc0-4bd6-9c24-ba4cab019e16 req-2f46de3f-1a8a-42b5-aba1-c261b8bb3207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25469484-61f1-46e8-b68c-24a3dde54b61", "name": "network-vif-unplugged", "status": "completed", "tag": "41567816-d9a8-4ca0-b74c-0a939047cc8b"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:07.645832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a29866a8-3cc0-4bd6-9c24-ba4cab019e16 req-2f46de3f-1a8a-42b5-aba1-c261b8bb3207 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:07.647293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a29866a8-3cc0-4bd6-9c24-ba4cab019e16 req-2f46de3f-1a8a-42b5-aba1-c261b8bb3207 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:07.651724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a29866a8-3cc0-4bd6-9c24-ba4cab019e16 req-2f46de3f-1a8a-42b5-aba1-c261b8bb3207 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:07.686229 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a29866a8-3cc0-4bd6-9c24-ba4cab019e16 req-2f46de3f-1a8a-42b5-aba1-c261b8bb3207 service nova] Creating event network-vif-unplugged:41567816-d9a8-4ca0-b74c-0a939047cc8b for instance 25469484-61f1-46e8-b68c-24a3dde54b61 on n-h2-855650-5 Nov 02 12:30:07.707672 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a29866a8-3cc0-4bd6-9c24-ba4cab019e16 req-2f46de3f-1a8a-42b5-aba1-c261b8bb3207 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101212 Nov 02 12:30:07.710256 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1189/2364] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:07.942654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:07.967417 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5df7ed93-8adb-4043-ba30-21615b013071 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1523 microversion: 2.1 time: 0.879946 Nov 02 12:30:07.987652 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1176/2365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:07 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1523 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:08.670609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:08.675272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:08.735956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:08.737411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:08.749664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:08.751904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:08.753257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:08.754304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:09.003219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:09.007169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:09.050472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:09.051890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:09.055758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:09.060892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:09.065919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:09.079839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:10.193287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:10.272130 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69075685-dfcd-4912-8b04-f1a7b87410d8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1477 microversion: 2.1 time: 1.620363 Nov 02 12:30:10.276962 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1190/2366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:08 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1477 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:10.772328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:10.796485 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b31f55d-cac4-4f17-b42a-e965227875d6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1523 microversion: 2.1 time: 1.802006 Nov 02 12:30:10.799264 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1177/2367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:08 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1523 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:11.331126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:11.331126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:11.386058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:11.390706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:11.395983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:11.419892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:11.421424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:11.429249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:11.850607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:11.856579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:11.902354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:11.904262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:11.909496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:11.916112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:11.921812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:11.924975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:12.304732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:12.324569 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5746a615-5ea0-4432-8595-dec2a65c3968 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1477 microversion: 2.1 time: 1.003413 Nov 02 12:30:12.334070 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1191/2368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:11 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1477 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:12.501205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:12.527297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3c41f8f-75b4-447c-a8a9-82c3a441b560 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1523 microversion: 2.1 time: 0.691231 Nov 02 12:30:12.536085 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1178/2369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:11 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1523 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:13.372123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:13.375310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:13.394735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:13.396142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:13.398561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:13.400634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:13.402252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:13.403370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:13.576811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:13.579879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:13.607499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:13.611709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:13.617021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:13.624524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:13.627852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:13.634611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:14.329520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:14.344935 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f912a88f-e1b2-4419-885a-a24ad9836e5e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1477 microversion: 2.1 time: 0.982741 Nov 02 12:30:14.369025 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1192/2370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:13 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1477 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:14.375211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-383379d2-c7fe-4732-90f6-8f7eea4f745e req-cec79920-da84-4cc0-baeb-84a16ddc2ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25469484-61f1-46e8-b68c-24a3dde54b61", "name": "network-vif-plugged", "status": "completed", "tag": "41567816-d9a8-4ca0-b74c-0a939047cc8b"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:14.404312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-383379d2-c7fe-4732-90f6-8f7eea4f745e req-cec79920-da84-4cc0-baeb-84a16ddc2ab9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:14.409927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-383379d2-c7fe-4732-90f6-8f7eea4f745e req-cec79920-da84-4cc0-baeb-84a16ddc2ab9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:14.410812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-383379d2-c7fe-4732-90f6-8f7eea4f745e req-cec79920-da84-4cc0-baeb-84a16ddc2ab9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:14.439689 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-383379d2-c7fe-4732-90f6-8f7eea4f745e req-cec79920-da84-4cc0-baeb-84a16ddc2ab9 service nova] Creating event network-vif-plugged:41567816-d9a8-4ca0-b74c-0a939047cc8b for instance 25469484-61f1-46e8-b68c-24a3dde54b61 on n-h2-855650-5 Nov 02 12:30:14.447904 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-383379d2-c7fe-4732-90f6-8f7eea4f745e req-cec79920-da84-4cc0-baeb-84a16ddc2ab9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076581 Nov 02 12:30:14.455035 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1193/2371] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:14.495922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:14.513344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d127041-a9b6-47f5-8675-91af5173be34 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1523 microversion: 2.1 time: 0.943540 Nov 02 12:30:14.520419 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1179/2372] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:13 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1523 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:15.372447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:15.373228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:15.383040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:15.389045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:15.389891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:15.393639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:15.394987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:15.402135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:15.785837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1576998034", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "40ac8086-b78d-4f76-94e4-30121571d108"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:15.906740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:15.943577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] validate_networks() for [('40ac8086-b78d-4f76-94e4-30121571d108', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:15.945307 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b42460a3-c7cd-4911-8f65-d9712c620c7f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1477 microversion: 2.1 time: 0.578022 Nov 02 12:30:15.956748 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1180/2373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:15 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1477 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:15.970710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:15.978950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:15.997698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:15.999516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:16.000526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:16.002662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:16.003952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:16.005069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:16.403974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:16.421427 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-770b5101-5d04-4844-82d3-95e38152163d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1523 microversion: 2.1 time: 0.462295 Nov 02 12:30:16.444177 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1181/2374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:15 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:16.992948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:16.994105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:17.036271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.037180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.038019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.039331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.040164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.040960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.728316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:17.728316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:17.728316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:17.729011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:17.731089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:17.768314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.773679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.775893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.781705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.782812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.786534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.853645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:17.873573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Getting quotas for project 854f4fc2040844d88e9ae160ca83375a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:17.876550 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bfc1c788-bc9a-4f5a-82dd-d26589383265 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1477 microversion: 2.1 time: 0.894822 Nov 02 12:30:17.911483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Getting quotas for user 0696fbb6ed5c44ceb8e0c108232e8007 and project 854f4fc2040844d88e9ae160ca83375a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:17.912471 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1182/2375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:16 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1477 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:17.921676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:17.929310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:17.943797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.944798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.945406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.946801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.952181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.954061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.962284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Going to run 3 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:17.968637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:18.098336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=e59a9a86-b664-4c2f-9dd6-e752c7fb777d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:18.311955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=cf0cc60a-b436-4b6c-bf4c-6488ff5602b6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:18.340242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:18.380745 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae84c86c-bbac-4430-86fc-7c00cf29ea9b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1508 microversion: 2.1 time: 0.466513 Nov 02 12:30:18.386199 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1183/2376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:17 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1508 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:18.533947 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e2436150-0930-474a-8eec-1dacc7093a76 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.337037 Nov 02 12:30:18.535204 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1194/2377] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:30:18.546382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:18.551035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:18.567312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:18.570452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:18.579543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:18.583337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:18.586171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:18.586930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:18.923662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:18.933899 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8d3b0c12-74be-4d94-9da3-2375b15d25aa tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 200 len: 1508 microversion: 2.1 time: 0.397309 Nov 02 12:30:18.935414 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1195/2378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:18 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 1508 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:18.941227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:18.947149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:18.949084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'deleted': False, 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:30:18.976224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:18.977085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:18.977646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:18.980930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:18.981614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:18.982242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.016015 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5cb5e55-a618-4e54-a4ee-f578ec443327 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.079144 Nov 02 12:30:19.022241 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1196/2379] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:30:18 2022] GET /compute/v2.1/servers => generated 1018 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:19.029152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:19.030048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:19.037737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.038353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.038909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.040133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.040939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.042291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.294561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1572922392", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:19.504610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:19.817367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:19.847561 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d00f0a38-9162-45e2-a3d9-5d9c17bd2b54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1477 microversion: 2.1 time: 0.823712 Nov 02 12:30:19.851372 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1197/2380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:19 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1477 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:19.897125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:19.904282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:19.940630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.948162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.951256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.959463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.972108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.980177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:20.143570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:30:20.430633 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-afc3cbe0-e8d5-4f82-a430-79103ff32095 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 204 len: 0 microversion: 2.1 time: 0.574037 Nov 02 12:30:20.433331 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1198/2381] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:30:19 2022] DELETE /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:30:20.490568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b50494c-b712-4464-a355-374326043d34 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:20.494200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b50494c-b712-4464-a355-374326043d34 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:20.549960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:20.552492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:20.553053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:20.553477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:20.553960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:20.592435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:20.595622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:20.597937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:20.599024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:20.605835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:20.606581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:20.670563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Getting quotas for project d36baae805244e6983900973dd6dca37. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:20.688164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Getting quotas for user d27030caf3f740368ba4b588132e2b21 and project d36baae805244e6983900973dd6dca37. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:20.751574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:20.761050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5b50494c-b712-4464-a355-374326043d34 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:20.761639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:20.787212 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b50494c-b712-4464-a355-374326043d34 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1223 microversion: 2.1 time: 0.351116 Nov 02 12:30:20.796409 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1199/2382] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:20 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1223 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:20.822618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1256421021", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "fcc8bd62-cefc-49b7-bf94-3895bd70eb34"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:20.946580 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0fcf0b8e-26a0-4b36-b192-bd2afbe98666 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.554071 Nov 02 12:30:20.948427 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1184/2383] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:30:20.973212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] validate_networks() for [('fcc8bd62-cefc-49b7-bf94-3895bd70eb34', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:20.978012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:20.980147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:21.028224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.030519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.037449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:21.039302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.039997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.040449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:22.394742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:22.415252 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-078e0109-b120-421d-ba29-9c5274bfa509 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1477 microversion: 2.1 time: 1.463755 Nov 02 12:30:22.423260 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1185/2384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:20 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1477 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:22.454798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1883975250", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:22.644030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:23.128835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:23.129803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:23.132429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:23.134992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:23.139548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:23.179521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.179521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.179521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.179521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.179521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.180166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.254987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Getting quotas for project a46439c7bf424cb1961085f610858688. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:23.271371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Getting quotas for user 5def23f73ff644cb8a7625a128b58b73 and project a46439c7bf424cb1961085f610858688. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:23.306582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:23.312919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:23.334115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:23.334853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:23.335501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:23.336096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:23.336679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:23.351525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.353380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.355082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.356112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.356753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.357391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.386417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Getting quotas for project d36baae805244e6983900973dd6dca37. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:23.397871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Getting quotas for user d27030caf3f740368ba4b588132e2b21 and project d36baae805244e6983900973dd6dca37. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:23.426873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:23.432908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:23.438338 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-14f214c4-0095-474e-9ad9-c3af09edcc26 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.627347 Nov 02 12:30:23.439638 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1200/2385] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:30:23.446130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:23.447560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:23.460114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.461282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.462171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.466410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.468281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.470598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.623065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-022548a6-ae09-45f2-9087-d09345fd3dca tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183586 Nov 02 12:30:23.629132 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1186/2386] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:30:23.646380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:23.668354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:23.669795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:23.673792 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf0613c9-826b-4770-9e73-08330b160b58 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1219 microversion: 2.1 time: 0.232174 Nov 02 12:30:23.699309 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1201/2387] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:23 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1219 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:23.724268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c20d9571-2c92-4046-b812-1a18da797098 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:23.725727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c20d9571-2c92-4046-b812-1a18da797098 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:23.800110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:24.057712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c20d9571-2c92-4046-b812-1a18da797098 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:24.071715 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c20d9571-2c92-4046-b812-1a18da797098 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1218 microversion: 2.1 time: 0.364430 Nov 02 12:30:24.076060 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1202/2388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:23 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1218 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:24.096450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f9406053-e88c-4612-929a-a34c02896dd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:24.097513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f9406053-e88c-4612-929a-a34c02896dd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:24.369914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f9406053-e88c-4612-929a-a34c02896dd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:24.380126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f9406053-e88c-4612-929a-a34c02896dd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1214 microversion: 2.1 time: 0.301191 Nov 02 12:30:24.381473 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1203/2389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:24 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1214 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:24.490317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5882b898-8df6-4179-8139-1ecdbbd6abfb req-bd802516-0c0e-4b2b-af4a-d60c5967c038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25469484-61f1-46e8-b68c-24a3dde54b61", "name": "network-vif-deleted", "tag": "41567816-d9a8-4ca0-b74c-0a939047cc8b"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:24.524677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5882b898-8df6-4179-8139-1ecdbbd6abfb req-bd802516-0c0e-4b2b-af4a-d60c5967c038 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.525742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5882b898-8df6-4179-8139-1ecdbbd6abfb req-bd802516-0c0e-4b2b-af4a-d60c5967c038 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.530467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5882b898-8df6-4179-8139-1ecdbbd6abfb req-bd802516-0c0e-4b2b-af4a-d60c5967c038 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.570046 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5882b898-8df6-4179-8139-1ecdbbd6abfb req-bd802516-0c0e-4b2b-af4a-d60c5967c038 service nova] Creating event network-vif-deleted:41567816-d9a8-4ca0-b74c-0a939047cc8b for instance 25469484-61f1-46e8-b68c-24a3dde54b61 on n-h2-855650-5 Nov 02 12:30:24.584683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5882b898-8df6-4179-8139-1ecdbbd6abfb req-bd802516-0c0e-4b2b-af4a-d60c5967c038 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097544 Nov 02 12:30:24.585869 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1204/2390] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:30:24.727078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:24.728002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:24.756476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.758936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.762523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.775391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.779687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.780708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.781906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.786046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.790837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.791704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.794406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.798115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.832284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:25.177693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:25.215880 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5899da4-54fe-4716-bbe4-3eaf12a639ac tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1275 microversion: 2.1 time: 0.494057 Nov 02 12:30:25.221640 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1205/2391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:24 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1275 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:25.252779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:25.259459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:25.311333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:25.313233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:25.314360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:25.318000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:25.319498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:25.322960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:25.540596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:25.581727 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4e4f4da1-6bed-494c-b8a2-884fd008b2a8 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1214 microversion: 2.1 time: 0.356035 Nov 02 12:30:25.607317 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1206/2392] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:25 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1214 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:25.624579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:25.639630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:25.641073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:25.649883 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f16a615-1281-40d4-91ad-1d487eb70f3b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1476 microversion: 2.1 time: 2.017864 Nov 02 12:30:25.666022 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1187/2393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:23 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1476 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:25.668743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:25.669940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:25.671629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:25.674024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:25.675125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:25.679907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:25.834039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:25.845801 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b7a6a60-08e7-4973-b671-dfa3d004efd3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1218 microversion: 2.1 time: 0.234307 Nov 02 12:30:25.847182 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1207/2394] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:25 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:26.257222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:26.258652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:26.273383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.274726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.276032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.277671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.278884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.279970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.448373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:26.467999 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8cfc31d5-d42c-46c5-a8fb-e285b46ad927 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1281 microversion: 2.1 time: 0.219495 Nov 02 12:30:26.469519 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1188/2395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:26 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:26.634135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:26.634941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:26.653891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.655615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.656676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.657566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.658416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.659149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.701042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:26.701772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:26.721406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.721819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.730168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.731718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.738682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.740472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.845369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:26.848895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:26.867041 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb02d259-8eb4-43d5-a6f8-862652c71f9c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1214 microversion: 2.1 time: 0.239672 Nov 02 12:30:26.877122 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1208/2396] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:26 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:26.911434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:26.914547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:26.934262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.935193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.936070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.938382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.939861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.940804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.058381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:27.069308 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3aaed575-0cee-436c-9805-a6e44eddcd8a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1476 microversion: 2.1 time: 0.372122 Nov 02 12:30:27.070596 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1189/2397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:26 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:27.178817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:27.193707 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8752d660-4106-4db7-ab86-b7e172be1b40 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1210 microversion: 2.1 time: 0.299014 Nov 02 12:30:27.208837 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1209/2398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:26 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1210 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:27.498398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:27.500150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:27.518820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.519362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.519797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.521505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.524215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.524960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.602593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c71b794e-7189-4fec-a13d-577ff9a76b42 req-982b18a8-9d0a-4ffe-9370-21bd983d8b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1", "name": "network-vif-unplugged", "status": "completed", "tag": "8096feea-680d-4ef5-8cb4-92af700234d1"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:27.626400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c71b794e-7189-4fec-a13d-577ff9a76b42 req-982b18a8-9d0a-4ffe-9370-21bd983d8b32 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.630303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c71b794e-7189-4fec-a13d-577ff9a76b42 req-982b18a8-9d0a-4ffe-9370-21bd983d8b32 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.630921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c71b794e-7189-4fec-a13d-577ff9a76b42 req-982b18a8-9d0a-4ffe-9370-21bd983d8b32 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.662309 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c71b794e-7189-4fec-a13d-577ff9a76b42 req-982b18a8-9d0a-4ffe-9370-21bd983d8b32 service nova] Creating event network-vif-unplugged:8096feea-680d-4ef5-8cb4-92af700234d1 for instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 on n-h2-855650-5 Nov 02 12:30:27.675943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-c71b794e-7189-4fec-a13d-577ff9a76b42 req-982b18a8-9d0a-4ffe-9370-21bd983d8b32 service nova] Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:30:27.711304 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c71b794e-7189-4fec-a13d-577ff9a76b42 req-982b18a8-9d0a-4ffe-9370-21bd983d8b32 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114257 Nov 02 12:30:27.714580 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1210/2399] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:30:27.740360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:27.750308 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0129f3a0-bb34-4203-8eac-e6876b73a0e4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1281 microversion: 2.1 time: 0.260584 Nov 02 12:30:27.764435 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1190/2400] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:27 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1281 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:27.897492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:27.899010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:27.925775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.928456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.931440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.933271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.938437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.939724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.104936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:28.112468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:28.131214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:28.154109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:28.158930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:28.165483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.167605 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2f5d0c50-9f16-4f0e-8d9f-f9ff0b079b66 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1270 microversion: 2.1 time: 0.276009 Nov 02 12:30:28.170483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:28.172577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:28.173404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.189402 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1211/2401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:27 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1270 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:28.224623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:28.225257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:28.233567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:28.234165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:28.234624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.235374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:28.235832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:28.236686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.456234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:28.498161 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-255f0666-08ed-49b7-bc31-e6c9ae0035e3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1210 microversion: 2.1 time: 0.275792 Nov 02 12:30:28.501383 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1212/2402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:28 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1210 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:28.551116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:28.562902 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e9067d2-d299-4de0-89a3-11b280ef6b55 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1476 microversion: 2.1 time: 0.467959 Nov 02 12:30:28.563532 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1191/2403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:28 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:28.837657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:28.851396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:28.923410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:28.926607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:28.931409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.934328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:28.942410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:28.943392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:29.254692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:29.259032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:29.305480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:29.312453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:29.313257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:29.313777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:29.315403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:29.315950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:29.316393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:29.405404 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ca93b0e5-d422-4892-a586-aa4c6db71156 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1281 microversion: 2.1 time: 0.629348 Nov 02 12:30:29.415258 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1213/2404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:28 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1281 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:29.537365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:29.542511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:29.568406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:29.579825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:29.581236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:29.583741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:29.584649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:29.587482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:29.930795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:29.973073 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d521e501-a9a9-487c-a1cc-4c582a49dcb9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1278 microversion: 2.1 time: 0.743044 Nov 02 12:30:29.977073 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1192/2405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:29 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1278 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:30.001338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:30.005128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:30.021726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:30.060265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:30.060527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:30.060998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:30.065567 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c575cbcd-2a65-41bd-8101-361d78ebf396 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1266 microversion: 2.1 time: 0.539539 Nov 02 12:30:30.068809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:30.072225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:30.077885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:30.080884 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1214/2406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:29 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1266 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:30.115127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-dc8c44eb-f32b-4526-8bea-a38bcab47952 req-ced13b45-a4fe-4232-80f1-1d7d3f6d1a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1", "tag": "8096feea-680d-4ef5-8cb4-92af700234d1"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:30.172924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dc8c44eb-f32b-4526-8bea-a38bcab47952 req-ced13b45-a4fe-4232-80f1-1d7d3f6d1a68 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:30.184456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dc8c44eb-f32b-4526-8bea-a38bcab47952 req-ced13b45-a4fe-4232-80f1-1d7d3f6d1a68 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:30.187958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dc8c44eb-f32b-4526-8bea-a38bcab47952 req-ced13b45-a4fe-4232-80f1-1d7d3f6d1a68 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:30.259725 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-dc8c44eb-f32b-4526-8bea-a38bcab47952 req-ced13b45-a4fe-4232-80f1-1d7d3f6d1a68 service nova] Creating event network-changed:8096feea-680d-4ef5-8cb4-92af700234d1 for instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 on n-h2-855650-5 Nov 02 12:30:30.278129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-dc8c44eb-f32b-4526-8bea-a38bcab47952 req-ced13b45-a4fe-4232-80f1-1d7d3f6d1a68 service nova] Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:30:30.309650 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-dc8c44eb-f32b-4526-8bea-a38bcab47952 req-ced13b45-a4fe-4232-80f1-1d7d3f6d1a68 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217487 Nov 02 12:30:30.313307 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1215/2407] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:31.020449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:31.041383 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33b7b0ed-2e6a-4b33-bcfc-8cea934e5232 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1476 microversion: 2.1 time: 1.061006 Nov 02 12:30:31.052517 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1193/2408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:29 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1476 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:31.070203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:31.075796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:31.089756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:31.096001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.101462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.102332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:31.103427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.106273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.108803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:31.214090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b957dedf-9845-4965-8659-562efde6f942 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] Action: 'create', calling method: .version_select at 0x7f228e14e790>, body: {"security_group": {"name": "tempest-securitygroup-1932346247", "description": "tempest-description-1110312216"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:31.431883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:31.443955 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e230081a-9d83-47b5-9133-a518b81168a2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1281 microversion: 2.1 time: 0.383721 Nov 02 12:30:31.447895 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1194/2409] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:31 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1281 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:31.459536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:31.464176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:31.482711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.485300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.504995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:31.506093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.506754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.507489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:31.793516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:31.820581 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d6e4c4b-b3b7-4cd8-a870-f953dc9eed96 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1276 microversion: 2.1 time: 0.370018 Nov 02 12:30:31.824539 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1195/2410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:31 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1276 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:31.839145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:31.844439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:31.868708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.870979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.872359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:31.880097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.883125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.886791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:32.215395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:32.251459 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef22fa3f-f46f-4660-a6e9-6962dc1184de tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1272 microversion: 2.1 time: 0.423480 Nov 02 12:30:32.253004 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1196/2411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:31 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1272 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:32.264450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:32.265501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:32.273170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:32.274026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:32.274746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:32.275720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:32.279715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:32.280713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:33.215974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:33.316816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:33.344668 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64823fb8-f045-450c-9006-647660848a62 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1476 microversion: 2.1 time: 1.089064 Nov 02 12:30:33.346162 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1197/2412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:32 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1476 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:33.373832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:33.375071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:33.384451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:33.389414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:33.390257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:33.391930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:33.396330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:33.397750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:33.401604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:33.408429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:34.169823 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b957dedf-9845-4965-8659-562efde6f942 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 3.836683 Nov 02 12:30:34.183529 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1216/2413] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:30:30 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 3869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:34.198701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:34.200203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:34.214623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:34.215837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:34.216812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:34.218474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:34.219270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:34.220125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:34.375795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=18 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:34.442669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:34.455623 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0313e8c4-5389-4130-b1e9-ca70449d77cc tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1276 microversion: 2.1 time: 0.269629 Nov 02 12:30:34.456534 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1217/2414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:34 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1276 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:34.462134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:34.463041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:34.471564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:34.472332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:34.472967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:34.474228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:34.475024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:34.475611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:34.755731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:34.780404 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0fc9ada6-de3c-42d6-b7dc-8a3ddef249df tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1272 microversion: 2.1 time: 0.322500 Nov 02 12:30:34.781316 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1218/2415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:34 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:34.790045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9ccfd61a-66b2-4753-90ed-e5afe58048c2 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] Action: 'create', calling method: .version_select at 0x7f228e12af70>, body: {"security_group": {"name": "tempest-securitygroup-1402022385", "description": "tempest-description-1962878053"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:35.114624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:35.142868 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ea6c22a-4d53-4062-b9d3-b4c870233d06 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 1.793000 Nov 02 12:30:35.145116 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1198/2416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:33 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:35.166560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:35.167634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:35.181059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:35.182017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:35.182750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:35.184183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:35.185014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:35.186381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:35.896888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:35.930756 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb69d0e4-eeb0-4df1-a755-2d5cc4c73ab9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1474 microversion: 2.1 time: 0.781563 Nov 02 12:30:35.934825 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1199/2417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:35 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1474 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:35.959235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:35.960441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:35.979703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:35.980979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:35.981928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:35.983927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:35.985185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:35.986159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:36.047607 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9ccfd61a-66b2-4753-90ed-e5afe58048c2 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.265204 Nov 02 12:30:36.057941 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1219/2418] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:30:34 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:36.063335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:36.064343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:36.090942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:36.092641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:36.093825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:36.095472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:36.096763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:36.097831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:36.333078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:36.374534 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-92526c8f-5028-4d96-832e-257864b2ea93 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1272 microversion: 2.1 time: 0.306204 Nov 02 12:30:36.375544 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1220/2419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:36 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:36.794014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:36.835279 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e6f380c-b4e9-4e29-a379-c907e038cb2c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.896346 Nov 02 12:30:36.845663 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1200/2420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:35 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:36.881756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:36.885617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:36.930758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:36.933319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:36.940338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:36.943869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:36.945428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:36.951391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:37.546900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-040a5bd3-11ee-484b-9f51-7117fa3d5bdb tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] Action: 'create', calling method: .version_select at 0x7f228e154c10>, body: {"security_group": {"name": "tempest-securitygroup-1133804753", "description": "tempest-description-292881685"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:37.672886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:37.695384 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5632407f-0d2d-45e7-a819-4f3235740e11 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.847069 Nov 02 12:30:37.703811 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1201/2421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:36 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:37.729450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:37.733318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:37.750295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.753498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.754606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:37.756115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.757025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.757610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:38.696550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:38.722524 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d4ecd06-3449-4a7c-b657-02c12c3bdc94 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1474 microversion: 2.1 time: 1.010563 Nov 02 12:30:38.731589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1202/2422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:37 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1474 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:38.747734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:38.748518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:38.786625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:38.787891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:38.788886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:38.791067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:38.792301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:38.797237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.505106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:39.543174 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-055aa79a-8ac0-44f5-822c-bd7f89b6e9bf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.807337 Nov 02 12:30:39.551875 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1203/2423] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:38 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:39.570156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:39.571543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:39.583756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-040a5bd3-11ee-484b-9f51-7117fa3d5bdb tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 3.201916 Nov 02 12:30:39.596714 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1221/2424] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:30:36 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 3220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:39.600179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.601075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.601854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.603062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.603406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.604386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.616395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:39.643687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d4823ba8-d78f-4195-9e92-8a14a6f9670b req-d2dcc614-c8d1-4f31-8862-6d8fbf1b657b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f0bd24-8c20-4b97-a4ae-2075c823179e", "tag": "6a26b325-c41a-4ba3-9291-36c10956f17c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:39.685844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4823ba8-d78f-4195-9e92-8a14a6f9670b req-d2dcc614-c8d1-4f31-8862-6d8fbf1b657b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.686985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4823ba8-d78f-4195-9e92-8a14a6f9670b req-d2dcc614-c8d1-4f31-8862-6d8fbf1b657b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.687970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4823ba8-d78f-4195-9e92-8a14a6f9670b req-d2dcc614-c8d1-4f31-8862-6d8fbf1b657b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.728239 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d4823ba8-d78f-4195-9e92-8a14a6f9670b req-d2dcc614-c8d1-4f31-8862-6d8fbf1b657b service nova] Creating event network-changed:6a26b325-c41a-4ba3-9291-36c10956f17c for instance 05f0bd24-8c20-4b97-a4ae-2075c823179e on n-h2-855650-5 Nov 02 12:30:39.747110 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d4823ba8-d78f-4195-9e92-8a14a6f9670b req-d2dcc614-c8d1-4f31-8862-6d8fbf1b657b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105699 Nov 02 12:30:39.748529 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1222/2425] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:39.772454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:39.774394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:39.789382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.791111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.792965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.794984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.797199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.798850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:40.130314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:40.147143 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d55aa7b3-5193-4a81-8cd9-fecf038d7e81 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.593707 Nov 02 12:30:40.149519 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1204/2426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:39 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:40.163586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e74ab645-474f-4d0e-bf28-ab48f1b6e6fa tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] Action: 'create', calling method: .version_select at 0x7f2292a4d670>, body: {"security_group": {"name": "tempest-securitygroup-1970260007", "description": "tempest-description-1845773502"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:40.523035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:40.538899 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f217ac60-9f4c-45c1-a17e-d4a23a4fa5f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.787150 Nov 02 12:30:40.540155 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1223/2427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:39 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:40.571954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:40.573913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:40.596353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:40.597876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:40.602960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:40.604760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:40.605509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:40.606783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:41.618861 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e74ab645-474f-4d0e-bf28-ab48f1b6e6fa tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.467549 Nov 02 12:30:41.619998 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1205/2428] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:30:40 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:41.625389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:41.629600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:41.665386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:41.668872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:41.669582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:41.681340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:41.682847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:41.684176 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bc0c83d8-9d6b-4540-aba6-c5ec58f7210e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1471 microversion: 2.1 time: 1.142592 Nov 02 12:30:41.686697 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1224/2429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:40 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1471 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:41.693306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:41.694070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:42.152362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-58781bc4-dfb0-4c75-a35d-46884950d91f req-9133f28e-6488-4880-8916-b9cb6aacc10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e28e472-dbb7-4889-af10-435f3d4f1a5c", "tag": "0ec07e60-70a5-40b2-ac24-354b03c4039e"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:42.171891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-58781bc4-dfb0-4c75-a35d-46884950d91f req-9133f28e-6488-4880-8916-b9cb6aacc10d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.172383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-58781bc4-dfb0-4c75-a35d-46884950d91f req-9133f28e-6488-4880-8916-b9cb6aacc10d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.173005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-58781bc4-dfb0-4c75-a35d-46884950d91f req-9133f28e-6488-4880-8916-b9cb6aacc10d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:42.221308 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-58781bc4-dfb0-4c75-a35d-46884950d91f req-9133f28e-6488-4880-8916-b9cb6aacc10d service nova] Creating event network-changed:0ec07e60-70a5-40b2-ac24-354b03c4039e for instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c on n-h2-855650-5 Nov 02 12:30:42.237306 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-58781bc4-dfb0-4c75-a35d-46884950d91f req-9133f28e-6488-4880-8916-b9cb6aacc10d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.546555 Nov 02 12:30:42.238714 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1225/2430] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:42.258118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:42.272490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:42.303197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.306845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.311726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:42.313356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.315459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.323356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:42.428193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:42.473641 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2d3bf189-6bbc-4347-b386-ba7445a1be5d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.843216 Nov 02 12:30:42.474746 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1206/2431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:41 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:42.487342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:42.489700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:42.502711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.503862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.505410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:42.506465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.507151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.508315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:42.824881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:42.854530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:42.861898 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bda607be-4d01-4738-8af3-a04424710e15 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.620505 Nov 02 12:30:42.865398 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1226/2432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:42 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:42.868241 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-921b6155-6175-423d-bee9-8c912d9b5d39 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.389786 Nov 02 12:30:42.880387 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1207/2433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:42 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:42.895567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-471ecc1b-ff17-44f8-b834-4ec570165b78 tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] Calling method '.version_select at 0x7f228e166e50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:42.906226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:42.907816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:42.932726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.933564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.940092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:42.941505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.942226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.942916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:43.053260 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83ddef52-f8f8-40e8-bcc5-f27d63ae5fbd tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1/action" status: 204 len: 0 microversion: 2.1 time: 0.170972 Nov 02 12:30:43.055279 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1208/2434] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:30:42 2022] POST /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1/action => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:30:43.063349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-689a393e-59ff-4cd0-abf2-7367226b771c req-a27a2aee-23bb-4219-8083-01966612be97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1", "name": "network-vif-plugged", "status": "completed", "tag": "8096feea-680d-4ef5-8cb4-92af700234d1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:43.076893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-689a393e-59ff-4cd0-abf2-7367226b771c req-a27a2aee-23bb-4219-8083-01966612be97 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:43.078872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-689a393e-59ff-4cd0-abf2-7367226b771c req-a27a2aee-23bb-4219-8083-01966612be97 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:43.079529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-689a393e-59ff-4cd0-abf2-7367226b771c req-a27a2aee-23bb-4219-8083-01966612be97 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:43.096249 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-689a393e-59ff-4cd0-abf2-7367226b771c req-a27a2aee-23bb-4219-8083-01966612be97 service nova] Creating event network-vif-plugged:8096feea-680d-4ef5-8cb4-92af700234d1 for instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 on n-h2-855650-5 Nov 02 12:30:43.105176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-689a393e-59ff-4cd0-abf2-7367226b771c req-a27a2aee-23bb-4219-8083-01966612be97 service nova] Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:30:43.126990 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-689a393e-59ff-4cd0-abf2-7367226b771c req-a27a2aee-23bb-4219-8083-01966612be97 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069782 Nov 02 12:30:43.128337 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1209/2435] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:43.136455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3147901b-62d7-47c5-9b7c-f147a141fbdc req-d6d6147e-6955-4603-b183-8e3ce39ad830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf0cc60a-b436-4b6c-bf4c-6488ff5602b6", "tag": "a10fe17d-cc8a-4d6f-89f9-b32f340efbfc"}, {"name": "network-changed", "server_uuid": "4e355fe6-2194-43fc-bc6f-0f17973d4641", "tag": "528b251f-9fd7-40d7-a288-c4ff066751dc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:43.155200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3147901b-62d7-47c5-9b7c-f147a141fbdc req-d6d6147e-6955-4603-b183-8e3ce39ad830 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:43.156215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3147901b-62d7-47c5-9b7c-f147a141fbdc req-d6d6147e-6955-4603-b183-8e3ce39ad830 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:43.158061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3147901b-62d7-47c5-9b7c-f147a141fbdc req-d6d6147e-6955-4603-b183-8e3ce39ad830 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:43.188493 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3147901b-62d7-47c5-9b7c-f147a141fbdc req-d6d6147e-6955-4603-b183-8e3ce39ad830 service nova] Creating event network-changed:a10fe17d-cc8a-4d6f-89f9-b32f340efbfc for instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 on n-h1-855650-5 Nov 02 12:30:43.189645 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3147901b-62d7-47c5-9b7c-f147a141fbdc req-d6d6147e-6955-4603-b183-8e3ce39ad830 service nova] Creating event network-changed:528b251f-9fd7-40d7-a288-c4ff066751dc for instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 on n-h2-855650-5 Nov 02 12:30:43.200887 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3147901b-62d7-47c5-9b7c-f147a141fbdc req-d6d6147e-6955-4603-b183-8e3ce39ad830 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070445 Nov 02 12:30:43.208418 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1210/2436] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:43.216196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:43.218232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:43.226386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:43.227523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:43.229170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:43.230352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:43.231130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:43.231867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:43.539201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:43.551461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fa16ac9e-7258-42b2-943b-a0bdc23ff85f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1471 microversion: 2.1 time: 0.341105 Nov 02 12:30:43.552610 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1211/2437] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:43 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1471 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:43.570693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:43.575662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:43.592716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:43.593582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:43.594935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:43.596693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:43.597418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:43.598478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:43.958003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:43.968624 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22d35d78-6421-4404-ab42-73358dae0b7e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.414753 Nov 02 12:30:43.974828 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1212/2438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:43 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:43.990294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:43.992409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:44.011886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.013478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.014112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:44.015137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.016052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.017121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:44.305842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:44.323909 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-276f89f9-1e4b-40c0-9c3f-77c31cd2b9c3 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.345778 Nov 02 12:30:44.338489 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1213/2439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:43 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:44.350950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:44.350950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:44.361130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.361499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.362530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:44.363429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.367598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.367598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:44.665518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:44.684623 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1b41602-d060-41a8-ad69-2a440756930e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.348512 Nov 02 12:30:44.685542 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1214/2440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:44 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:44.690737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-957b8e48-580f-43fd-8293-51686fa6be80 req-d29e800d-0458-42d2-b878-305f4888577b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9781c413-fe30-4c8b-9f72-498daa9ee767", "tag": "d99043bf-664c-4d91-934b-b6c983cb2e5b"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:44.701661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-957b8e48-580f-43fd-8293-51686fa6be80 req-d29e800d-0458-42d2-b878-305f4888577b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.702214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-957b8e48-580f-43fd-8293-51686fa6be80 req-d29e800d-0458-42d2-b878-305f4888577b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.702661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-957b8e48-580f-43fd-8293-51686fa6be80 req-d29e800d-0458-42d2-b878-305f4888577b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:44.715922 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-957b8e48-580f-43fd-8293-51686fa6be80 req-d29e800d-0458-42d2-b878-305f4888577b service nova] Creating event network-changed:d99043bf-664c-4d91-934b-b6c983cb2e5b for instance 9781c413-fe30-4c8b-9f72-498daa9ee767 on n-h2-855650-5 Nov 02 12:30:44.721137 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-957b8e48-580f-43fd-8293-51686fa6be80 req-d29e800d-0458-42d2-b878-305f4888577b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034540 Nov 02 12:30:44.721959 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1215/2441] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:44.727298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:44.728005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:44.735345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.735860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.736536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:44.737273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.737741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.738207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:45.057024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:45.079191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fbd0ade3-616d-4af5-8b91-4f18c1451ba1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1471 microversion: 2.1 time: 0.355797 Nov 02 12:30:45.080212 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1216/2442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:44 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:45.110785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:45.118175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:45.170921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:45.173909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:45.176490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:45.180048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:45.182201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:45.184779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:45.746990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:45.758833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44cf3900-461d-44a4-b10f-ecda69ec326f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.665546 Nov 02 12:30:45.759495 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1217/2443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:45 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:45.764353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c88d9a84-629a-4650-a169-b7b22d4cc6a8 req-990bdc49-24ce-4ad3-8f6c-7e613ed54886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59a9a86-b664-4c2f-9dd6-e752c7fb777d", "tag": "f1ca04f8-5c7b-4c09-a10a-32b43308d7a2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:45.777608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c88d9a84-629a-4650-a169-b7b22d4cc6a8 req-990bdc49-24ce-4ad3-8f6c-7e613ed54886 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:45.778197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c88d9a84-629a-4650-a169-b7b22d4cc6a8 req-990bdc49-24ce-4ad3-8f6c-7e613ed54886 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:45.778653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c88d9a84-629a-4650-a169-b7b22d4cc6a8 req-990bdc49-24ce-4ad3-8f6c-7e613ed54886 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:45.792470 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c88d9a84-629a-4650-a169-b7b22d4cc6a8 req-990bdc49-24ce-4ad3-8f6c-7e613ed54886 service nova] Creating event network-changed:f1ca04f8-5c7b-4c09-a10a-32b43308d7a2 for instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d on n-h2-855650-5 Nov 02 12:30:45.804669 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c88d9a84-629a-4650-a169-b7b22d4cc6a8 req-990bdc49-24ce-4ad3-8f6c-7e613ed54886 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043903 Nov 02 12:30:45.805613 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1218/2444] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:45.812059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:45.813090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:45.821137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:45.821657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:45.822194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:45.823463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:45.824105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:45.824668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:46.225063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:46.242565 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d396acd-1924-4064-b7cc-2560b9cf03c6 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.435049 Nov 02 12:30:46.243929 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1219/2445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:45 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:46.259338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:46.260606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:46.267902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:46.268410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:46.268868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:46.269613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:46.270122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:46.270565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:46.697098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:46.721732 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a8f108a-377d-420b-b7db-3324eedf6f8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.467335 Nov 02 12:30:46.723038 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1220/2446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:46 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:46.730789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:46.732335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:46.750347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:46.758779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:46.766060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:46.768974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:46.770001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:46.770838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:47.158562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:47.194470 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7a695879-1f03-4fcb-a329-e0e37856ea0f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1471 microversion: 2.1 time: 0.469579 Nov 02 12:30:47.206027 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1221/2447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:46 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1471 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:47.225448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:47.227031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:47.243338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:47.244043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:47.245253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:47.246480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:47.247205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:47.247814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:47.300588 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-471ecc1b-ff17-44f8-b834-4ec570165b78 tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] 10.222.0.45 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10992 microversion: 2.1 time: 4.429508 Nov 02 12:30:47.320116 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1227/2448] 10.222.0.45 () {58 vars in 1191 bytes} [Wed Nov 2 12:30:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10992 bytes in 4436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:30:47.351187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:47.352281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:47.364212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:47.364834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:47.365682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:47.367078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:47.367806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:47.368686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:47.471241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:47.478278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:47.491322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5c87729e-2028-44bd-9418-426e358c5308 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.285203 Nov 02 12:30:47.492951 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1222/2449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:47 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:47.502855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4cb1048-0115-46d9-81f5-53e092808fe9 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] Calling method '.version_select at 0x7f22929f00d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:47.680823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:47.690992 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ceb888cd-7e13-49ac-b045-236e8233ca22 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.369092 Nov 02 12:30:47.692279 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1228/2450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:47 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:47.769918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:47.771068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:47.781474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:47.782204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:47.782849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:47.783920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:47.784506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:47.785140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:47.969339 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d4cb1048-0115-46d9-81f5-53e092808fe9 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.473820 Nov 02 12:30:47.976917 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1223/2451] 10.222.0.45 () {58 vars in 1191 bytes} [Wed Nov 2 12:30:47 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:48.003673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c1b7d78-83df-4853-92a9-af5a88958b2d tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] Calling method '.version_select at 0x7f2292ad6670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:48.181343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:48.197322 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bfb7c655-859b-4d2c-9dee-5ed809de0fbc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.433453 Nov 02 12:30:48.215227 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1229/2452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:47 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:48.254764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:48.258282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:48.281147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:48.285475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:48.290638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:48.296039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:48.303072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:48.305345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.095433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:49.106240 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4e30baea-6389-427c-b0fb-c14afd70a3b9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1463 microversion: 2.1 time: 0.870728 Nov 02 12:30:49.107075 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1230/2453] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:48 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1463 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:49.113801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:49.115133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:49.125028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.125921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.127163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.128106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.128463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.129064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.149072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:49.259792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c1b7d78-83df-4853-92a9-af5a88958b2d tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/7191325b-69ef-4379-8ab6-57e6475e3526" status: 202 len: 0 microversion: 2.1 time: 1.268468 Nov 02 12:30:49.261893 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1224/2454] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:30:47 2022] DELETE /compute/v2.1/os-security-groups/7191325b-69ef-4379-8ab6-57e6475e3526 => generated 0 bytes in 1273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:30:49.271283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:49.272468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:49.281724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.282488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.282965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.284073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.284881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.285776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.413602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:49.425892 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02cacc95-2a0b-435d-9831-986e8fbc2023 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.316924 Nov 02 12:30:49.426569 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1231/2455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:49 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:49.447732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:49.449025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:49.461074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.462347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.464366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.465723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.466725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.467908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.523128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:49.536894 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2178fb90-18e6-4420-8acc-e8c017607757 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.273063 Nov 02 12:30:49.553778 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1225/2456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:49 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:49.559684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:49.559962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:49.567095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.567828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.568317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.569252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.569890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.570363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.734823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:49.745432 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c3d5eaa9-02a2-4304-b754-10e0131beda5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1463 microversion: 2.1 time: 0.305642 Nov 02 12:30:49.747041 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1232/2457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:49 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1463 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:49.752473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe9c2291-4db4-4b78-869a-637219d45b22 tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] Calling method '.version_select at 0x7f228e157ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:49.852075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:49.872444 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05c4bb32-148b-40bd-b456-43eb8be9e799 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.316625 Nov 02 12:30:49.874016 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1226/2458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:49 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:49.882769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38386094-a63f-4a58-b585-6278a1babe6c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'create', calling method: .version_select at 0x7f22929c7820>, body: {"keypair": {"name": "tempest-keypair-437839530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMFVoohPPu/9TkIipyxPOCu6UGf7yCXVkXLKxIPoAJ8BHO3MelZKPXnsKoo6Rz/LHNMQ2ynFMQuRAvegbD+4eDQJywLs6qXHyfPHTB3cQ9ruPAUrvJdQBiI/2Dtz47Qgg=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:49.911101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-38386094-a63f-4a58-b585-6278a1babe6c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:49.920659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-38386094-a63f-4a58-b585-6278a1babe6c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for user a5a3010848f74c94bb32b506e184d275 and project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:49.958161 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38386094-a63f-4a58-b585-6278a1babe6c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.082405 Nov 02 12:30:49.959894 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1227/2459] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:30:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:50.074655 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe9c2291-4db4-4b78-869a-637219d45b22 tempest-SecurityGroupsTestAdminJSON-1028626132 tempest-SecurityGroupsTestAdminJSON-1028626132-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/07804058-9a5a-4d0c-a302-3b42007b0255" status: 202 len: 0 microversion: 2.1 time: 0.324970 Nov 02 12:30:50.075708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1233/2460] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:30:49 2022] DELETE /compute/v2.1/os-security-groups/07804058-9a5a-4d0c-a302-3b42007b0255 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:30:50.114723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56806ab0-eebc-41d3-a10d-b3cd29a1c7a8 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] Calling method '.version_select at 0x7f2292aca160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:50.436957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5bfea2b6-cf0a-42d6-af35-532a4723d1ad req-7d991b2d-3e71-428f-8567-6f06b84a5127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0bd24-8c20-4b97-a4ae-2075c823179e", "name": "network-vif-plugged", "status": "completed", "tag": "6a26b325-c41a-4ba3-9291-36c10956f17c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:50.460388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5bfea2b6-cf0a-42d6-af35-532a4723d1ad req-7d991b2d-3e71-428f-8567-6f06b84a5127 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:50.465651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5bfea2b6-cf0a-42d6-af35-532a4723d1ad req-7d991b2d-3e71-428f-8567-6f06b84a5127 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:50.466641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5bfea2b6-cf0a-42d6-af35-532a4723d1ad req-7d991b2d-3e71-428f-8567-6f06b84a5127 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:50.493868 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5bfea2b6-cf0a-42d6-af35-532a4723d1ad req-7d991b2d-3e71-428f-8567-6f06b84a5127 service nova] Creating event network-vif-plugged:6a26b325-c41a-4ba3-9291-36c10956f17c for instance 05f0bd24-8c20-4b97-a4ae-2075c823179e on n-h2-855650-5 Nov 02 12:30:50.504219 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5bfea2b6-cf0a-42d6-af35-532a4723d1ad req-7d991b2d-3e71-428f-8567-6f06b84a5127 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071530 Nov 02 12:30:50.506427 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1234/2461] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:30:50.520938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:50.527206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:50.540476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:50.544751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:50.545235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:50.546373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:50.547313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:50.547983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:50.563201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56806ab0-eebc-41d3-a10d-b3cd29a1c7a8 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/67492031-6e7b-460d-83d0-b87b5bb6e32d" status: 202 len: 0 microversion: 2.1 time: 0.480570 Nov 02 12:30:50.567615 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1228/2462] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:30:50 2022] DELETE /compute/v2.1/os-security-groups/67492031-6e7b-460d-83d0-b87b5bb6e32d => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:30:50.582374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:50.584636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:50.627295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:50.629448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:50.632088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:50.633787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:50.637194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:50.638390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:50.775137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:50.790415 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c813759e-06de-4424-872f-acbcfdf43c66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.278073 Nov 02 12:30:50.791563 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1235/2463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:50 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:50.802418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-87627c4f-aba5-44f5-b3f9-6e386e7d4d95 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] Calling method '.version_select at 0x7f22929b6d30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:51.259070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:51.276214 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85e1c370-4195-44aa-a84d-e456876b6df9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.709358 Nov 02 12:30:51.277133 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1229/2464] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:50 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:51.289820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:51.292344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:51.309303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.310452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.311472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.314340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.315706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.316421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.596467 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-87627c4f-aba5-44f5-b3f9-6e386e7d4d95 tempest-SecurityGroupsTestAdminJSON-969840898 tempest-SecurityGroupsTestAdminJSON-969840898-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/41e5a8d1-b1e9-40de-91f8-1a8767571b5f" status: 202 len: 0 microversion: 2.1 time: 0.802567 Nov 02 12:30:51.601885 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1236/2465] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:30:50 2022] DELETE /compute/v2.1/os-security-groups/41e5a8d1-b1e9-40de-91f8-1a8767571b5f => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:30:51.678849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:51.701181 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20df1820-da82-4dc7-b147-ffeb81cf18af tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.420061 Nov 02 12:30:51.714859 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1230/2466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:51 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:51.846168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:51.848005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:51.877006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.877564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.880001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.884252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.886534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.887421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:52.327156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:52.330794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:52.364131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:52.365284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:52.368788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:52.374143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:52.375302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:52.378821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:52.996101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:53.018807 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0895afbe-bdf9-4aa9-b76e-f52807eb5b07 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 1.185759 Nov 02 12:30:53.035640 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1237/2467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:51 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:53.072995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-aca57881-5634-46dd-a2ab-356035c71a38 req-1850869d-65f5-4bd4-b369-d0f94d1ef6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0cc60a-b436-4b6c-bf4c-6488ff5602b6", "name": "network-vif-plugged", "status": "completed", "tag": "a10fe17d-cc8a-4d6f-89f9-b32f340efbfc"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:53.073309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:53.088787 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6c04410-85ad-4854-9d6e-a0c60efe0a11 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.770092 Nov 02 12:30:53.089371 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1231/2468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:52 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:53.103082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aca57881-5634-46dd-a2ab-356035c71a38 req-1850869d-65f5-4bd4-b369-d0f94d1ef6f0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:53.103082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aca57881-5634-46dd-a2ab-356035c71a38 req-1850869d-65f5-4bd4-b369-d0f94d1ef6f0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:53.103313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aca57881-5634-46dd-a2ab-356035c71a38 req-1850869d-65f5-4bd4-b369-d0f94d1ef6f0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:53.108729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:53.112875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:53.124619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:53.125119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:53.125900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:53.126928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:53.127591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:53.128244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:53.138880 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-aca57881-5634-46dd-a2ab-356035c71a38 req-1850869d-65f5-4bd4-b369-d0f94d1ef6f0 service nova] Creating event network-vif-plugged:a10fe17d-cc8a-4d6f-89f9-b32f340efbfc for instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 on n-h1-855650-5 Nov 02 12:30:53.151897 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-aca57881-5634-46dd-a2ab-356035c71a38 req-1850869d-65f5-4bd4-b369-d0f94d1ef6f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112685 Nov 02 12:30:53.153419 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1238/2469] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:53.911054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:53.956611 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0b685ef-60d1-407d-bf10-688e1be66a0b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.851417 Nov 02 12:30:53.957353 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1232/2470] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:53 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:54.077391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:54.078626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:54.083046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=64 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:54.090968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.091739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.092401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.093419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.094099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.094691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.121102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:54.122783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:54.140553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.141358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.142031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.143554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.147664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.148293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.485879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:54.497451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:54.510343 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e8a3f97-0f42-4175-8f71-1ef491c5f490 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.442070 Nov 02 12:30:54.511680 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1239/2471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:54 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:54.519960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b59f2681-eb8f-451c-8e14-51cc90b211fa tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '.version_select at 0x7f228e14e940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:54.523995 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d10dfda-d30e-4dba-8099-3b54f8ebeefb tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.407280 Nov 02 12:30:54.526362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b59f2681-eb8f-451c-8e14-51cc90b211fa tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.527511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b59f2681-eb8f-451c-8e14-51cc90b211fa tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.528317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b59f2681-eb8f-451c-8e14-51cc90b211fa tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.535206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1233/2472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:54 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:54.544571 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b59f2681-eb8f-451c-8e14-51cc90b211fa tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.030781 Nov 02 12:30:54.546357 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1240/2473] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 12:30:54 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:54.586479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-adfb09da-c86e-4d18-ae06-3e20312f4482 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:54.598034 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-adfb09da-c86e-4d18-ae06-3e20312f4482 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017505 Nov 02 12:30:54.599255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1234/2474] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:30:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:54.619250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ebeb3f9a-300c-404f-9ebe-fa824412b7bd tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-64651846", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:54.658843 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ebeb3f9a-300c-404f-9ebe-fa824412b7bd tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.045562 Nov 02 12:30:54.660177 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1241/2475] 10.222.0.45 () {60 vars in 1146 bytes} [Wed Nov 2 12:30:54 2022] POST /compute/v2.1/flavors => generated 497 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:54.683698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f9d6546-68e6-4681-afb1-40fc61d7aab1 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:54.704435 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f9d6546-68e6-4681-afb1-40fc61d7aab1 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029782 Nov 02 12:30:54.715129 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1235/2476] 10.222.0.45 () {58 vars in 1182 bytes} [Wed Nov 2 12:30:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:30:55.033037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:55.035167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:55.052053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.053470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.055300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.057070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.058294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.059508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.067722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-302457787", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "807d1f59-73f9-465d-b93f-a26d08c17cd2"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:55.230878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:55.540115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:55.567494 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-869082af-ab0b-4433-9fa4-95da88526253 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.550693 Nov 02 12:30:55.571861 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1242/2477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:55 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:55.589989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0b318b72-d3a3-4a84-ae52-4557ba435266 req-c9c53316-8281-4cce-aa50-806eefdf0325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e28e472-dbb7-4889-af10-435f3d4f1a5c", "name": "network-vif-plugged", "status": "completed", "tag": "0ec07e60-70a5-40b2-ac24-354b03c4039e"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:55.610093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0b318b72-d3a3-4a84-ae52-4557ba435266 req-c9c53316-8281-4cce-aa50-806eefdf0325 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.611354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0b318b72-d3a3-4a84-ae52-4557ba435266 req-c9c53316-8281-4cce-aa50-806eefdf0325 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.612468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0b318b72-d3a3-4a84-ae52-4557ba435266 req-c9c53316-8281-4cce-aa50-806eefdf0325 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.651346 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0b318b72-d3a3-4a84-ae52-4557ba435266 req-c9c53316-8281-4cce-aa50-806eefdf0325 service nova] Creating event network-vif-plugged:0ec07e60-70a5-40b2-ac24-354b03c4039e for instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c on n-h2-855650-5 Nov 02 12:30:55.671000 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0b318b72-d3a3-4a84-ae52-4557ba435266 req-c9c53316-8281-4cce-aa50-806eefdf0325 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095960 Nov 02 12:30:55.673123 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1243/2478] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:55.684978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:55.686523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:55.694763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.695264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.695721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.696509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.696980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.698136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.852780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:55.855101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:55.855597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:55.856014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:55.856436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:55.872081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.872965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.873867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.874962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.875621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.876209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.907983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:55.924312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for user a5a3010848f74c94bb32b506e184d275 and project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:55.943143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:55.952196 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d0417397-a38f-4d3a-98e7-efda95af0738 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.275351 Nov 02 12:30:55.953833 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1244/2479] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:55 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:55.959504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:55.960120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:55.961194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:55.966666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:55.967312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.967824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.968267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.969154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.969607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.970199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.015321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:56.073012 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c4a54cd5-99ef-4d21-ae5f-d897df621236 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012335 Nov 02 12:30:56.080535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1236/2480] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:30:56.094031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb4bdab0-07cd-4949-bf10-2dcb916b965d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:56.095453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb4bdab0-07cd-4949-bf10-2dcb916b965d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:56.210651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb4bdab0-07cd-4949-bf10-2dcb916b965d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:56.222287 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb4bdab0-07cd-4949-bf10-2dcb916b965d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1278 microversion: 2.1 time: 0.139169 Nov 02 12:30:56.224046 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1237/2481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:56 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:56.252797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:56.263035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd789766-e3a7-4cc8-9c5c-19747497e3ad tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.307862 Nov 02 12:30:56.264460 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1245/2482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:55 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:56.633235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:56.638363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:56.653201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:56.654573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:56.655651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.657397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:56.658979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:56.660159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.022375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:57.027412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:57.049952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.072529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.074234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.076935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.078859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.080610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.297935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:57.362209 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ebe8da71-1922-4392-a5a8-4bd4ddc87a8b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.736185 Nov 02 12:30:57.374001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1238/2483] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:56 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:57.379944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:57.386538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:57.394754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.396326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.397099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.398115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.398850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.399922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.683992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:57.707205 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03dc2000-4fe4-486e-b09f-9af27c7fb577 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1274 microversion: 2.1 time: 0.341426 Nov 02 12:30:57.709156 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1239/2484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:57 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1274 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:57.719443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:57.720968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:57.733335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.737878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.742617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.745081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.752093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.753114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.829253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:57.867600 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20be33a2-68de-429d-8679-303e9654be76 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.870034 Nov 02 12:30:57.874984 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1246/2485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:56 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:57.902503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-23e242b8-eb10-40f1-a5a3-b8ea360f1902 req-eb1e7aad-fe51-4ab0-a160-43c12a9296be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e355fe6-2194-43fc-bc6f-0f17973d4641", "name": "network-vif-plugged", "status": "completed", "tag": "528b251f-9fd7-40d7-a288-c4ff066751dc"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:57.938055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-23e242b8-eb10-40f1-a5a3-b8ea360f1902 req-eb1e7aad-fe51-4ab0-a160-43c12a9296be service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.938937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-23e242b8-eb10-40f1-a5a3-b8ea360f1902 req-eb1e7aad-fe51-4ab0-a160-43c12a9296be service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.939727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-23e242b8-eb10-40f1-a5a3-b8ea360f1902 req-eb1e7aad-fe51-4ab0-a160-43c12a9296be service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.976136 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-23e242b8-eb10-40f1-a5a3-b8ea360f1902 req-eb1e7aad-fe51-4ab0-a160-43c12a9296be service nova] Creating event network-vif-plugged:528b251f-9fd7-40d7-a288-c4ff066751dc for instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 on n-h2-855650-5 Nov 02 12:30:57.988559 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-23e242b8-eb10-40f1-a5a3-b8ea360f1902 req-eb1e7aad-fe51-4ab0-a160-43c12a9296be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109662 Nov 02 12:30:57.998966 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1247/2486] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:58.011474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:58.018639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.019530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Searching by: {'deleted': False, 'project_id': 'a1169d053f1348a8830d578267cc0e8d'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:30:58.029170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.032005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.032634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.034113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.034955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.035746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.102693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:30:58.185870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.198670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a91ed5e4-ed68-41a8-9439-bf719c04827b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.195542 Nov 02 12:30:58.213472 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1248/2487] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:30:57 2022] GET /compute/v2.1/servers => generated 340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:58.225888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:58.228855 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-392cdb23-93be-4d8a-853d-17d1c7cc4f9a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.516228 Nov 02 12:30:58.229523 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1240/2488] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:57 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:58.232398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.233620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Searching by: {'deleted': False, 'project_id': 'a1169d053f1348a8830d578267cc0e8d'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:30:58.247206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.248848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.248848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.249090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.250498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.250498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.390710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:58.391795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:58.407358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:30:58.410998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.411512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.411974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.412761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.413185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.419262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.637242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.654371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.655704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.656961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.113644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:59.142216 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b37bef4-ac85-4c99-94e9-e40a0ac95473 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.756874 Nov 02 12:30:59.158470 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1241/2489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:58 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:59.177547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:59.178841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:59.205017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.206258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.207284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.208883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.215058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.216688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.376209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:59.394224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f39a0477-84fb-4c27-820b-871fc5e03c87 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1336 microversion: 2.1 time: 0.232946 Nov 02 12:30:59.397598 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1242/2490] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:59 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1336 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:59.413555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:59.416924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:59.441672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.443416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.443948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.444785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.445274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.445785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.475354 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab452b2b-6da0-4039-a69e-9fe65a10f0f0 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 1.255522 Nov 02 12:30:59.477477 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1249/2491] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:30:58 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:59.506024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:59.511432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:59.549058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.553050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.554985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.557274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.563451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.565315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.909403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:59.924151 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a0b4f8b0-c4b6-4e69-8298-7c57a510ede4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.524416 Nov 02 12:30:59.925620 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1243/2492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:59 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:59.930727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:59.942214 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-18c1ae23-c7fa-4b33-81c6-5d1ea6e078d9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.462468 Nov 02 12:30:59.954883 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1250/2493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:59 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:59.965222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad3a6cca-e085-44e4-9733-48e53f79f54b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:59.980890 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad3a6cca-e085-44e4-9733-48e53f79f54b tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037299 Nov 02 12:30:59.981642 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1244/2494] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:30:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:00.185176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:00.186798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:00.196853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.202969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.203741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.204677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.206015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.207808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.320879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1776176074", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": "none"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:00.510985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:00.513543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:00.531185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:00.533557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:00.543156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:00.573190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.574462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.575515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.577244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.578429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.579384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.622108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Getting quotas for project c49aaa4b95944a2494cc2084fc442284. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:00.633478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Getting quotas for user 84844a945f1b40f3b6e4b2206c888025 and project c49aaa4b95944a2494cc2084fc442284. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:00.665114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:31:00.670177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:31:00.801173 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b6db7ccd-d831-44b1-9d29-259f3319f0c7 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.844014 Nov 02 12:31:00.804554 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1251/2495] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:30:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:31:00.826062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:00.827654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:00.858131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.860679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.861474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.863365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.864810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.865550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.930590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:00.988175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.006220 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04ae2842-6c86-4568-98b6-825d9265dd25 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.825402 Nov 02 12:31:01.007440 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1245/2496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:00 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:01.022802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:01.025165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:01.038228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.039091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.039761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.062303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.063448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.064072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.070097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:01.212602 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d37818d-9c4f-4c16-83c0-fd0fd942d9b8 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 204 len: 0 microversion: 2.1 time: 0.406023 Nov 02 12:31:01.216392 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1252/2497] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:00 2022] DELETE /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:01.230376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6f9ad05-d062-41cf-a0de-09acba059e9d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:01.233264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6f9ad05-d062-41cf-a0de-09acba059e9d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:01.526723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.537438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6f9ad05-d062-41cf-a0de-09acba059e9d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.553864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6f9ad05-d062-41cf-a0de-09acba059e9d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.561726 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7e4862c3-5dfe-426e-85e8-0263230afbad tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1336 microversion: 2.1 time: 0.552583 Nov 02 12:31:01.563608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6f9ad05-d062-41cf-a0de-09acba059e9d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.576330 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1246/2498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:01 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1336 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:01.592778 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6f9ad05-d062-41cf-a0de-09acba059e9d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "PUT /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1359 microversion: 2.75 time: 0.370786 Nov 02 12:31:01.602574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:01.604686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:01.606685 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1253/2499] 10.222.0.45 () {62 vars in 1297 bytes} [Wed Nov 2 12:31:01 2022] PUT /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:01.635667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:01.636636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:01.645087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.646088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.657105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.658704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.659603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.659994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.660424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.660592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.661416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.663341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.663882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.664349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.253820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:02.272314 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d068844-8760-4a92-9251-87204dfd6444 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.662939 Nov 02 12:31:02.273391 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1254/2500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:01 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:02.285676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:02.289588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:02.304303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.305099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.306006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.307886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.308707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.309293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.440295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:02.474454 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44009659-c339-4d5d-8bf8-92bc686cece4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.894557 Nov 02 12:31:02.476487 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1247/2501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:01 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:02.507567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:02.511034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:02.533951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.535556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.538799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.543359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.544823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.551919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.725274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:02.927104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:02.968645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:02.977409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:03.036066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31550d29-5d2d-444c-9a16-1182f630575d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1355 microversion: 2.75 time: 0.557142 Nov 02 12:31:03.036703 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1248/2502] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:02 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1355 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:03.070550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83fec4df-eaf4-45a1-86ad-65f8286b4900"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:03.073939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:03.103938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.105170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.106060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.107231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.107912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.108644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.547430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:03.573032 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-626e9f38-9564-4e1e-bd56-82d17320fb59 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1715 microversion: 2.1 time: 1.297570 Nov 02 12:31:03.580859 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1255/2503] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:02 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1715 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:03.589846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:03.591120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:03.630500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.631477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.632276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.635854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.636706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.637494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.892100 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07064c4c-2ad4-4ad5-ba94-9538485c5636 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "POST /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848069 Nov 02 12:31:03.893240 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1249/2504] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:31:03 2022] POST /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:03.914188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ce82e401-9b2e-4e6b-851c-5e6679b79319 req-f0409e5c-084e-47a5-a676-8ff4eda663e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9781c413-fe30-4c8b-9f72-498daa9ee767", "name": "network-vif-plugged", "status": "completed", "tag": "d99043bf-664c-4d91-934b-b6c983cb2e5b"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:03.943622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ce82e401-9b2e-4e6b-851c-5e6679b79319 req-f0409e5c-084e-47a5-a676-8ff4eda663e3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.944484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ce82e401-9b2e-4e6b-851c-5e6679b79319 req-f0409e5c-084e-47a5-a676-8ff4eda663e3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.945618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ce82e401-9b2e-4e6b-851c-5e6679b79319 req-f0409e5c-084e-47a5-a676-8ff4eda663e3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.976957 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ce82e401-9b2e-4e6b-851c-5e6679b79319 req-f0409e5c-084e-47a5-a676-8ff4eda663e3 service nova] Creating event network-vif-plugged:d99043bf-664c-4d91-934b-b6c983cb2e5b for instance 9781c413-fe30-4c8b-9f72-498daa9ee767 on n-h2-855650-5 Nov 02 12:31:03.992825 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ce82e401-9b2e-4e6b-851c-5e6679b79319 req-f0409e5c-084e-47a5-a676-8ff4eda663e3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096687 Nov 02 12:31:03.998674 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1250/2505] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:04.030325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:04.034578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:04.069066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.094017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.095905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.102754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.116593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.128440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.526535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:04.546385 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8bdbd1e3-56eb-40b4-b06a-6080f236230b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 0.962905 Nov 02 12:31:04.548584 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1256/2506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:03 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:04.568943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:04.573025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:04.576640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:04.584512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb095a3b-fdf7-423a-880b-47b49aab7f7d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.581632 Nov 02 12:31:04.585412 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1251/2507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:03 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:04.598951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.599798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.600674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.601955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.606044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.611053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.612786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:04.614198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:04.632441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.633304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.634118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.646803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.647692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.648526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.350928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.364175 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2b259b8-563d-43f1-8aa4-d9b89b9db361 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.771499 Nov 02 12:31:05.372770 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1252/2508] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:04 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:05.383356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:05.384601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:05.401245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.403019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.403800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.405123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.406099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.407677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.411037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.433101 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-13ec333b-1cf6-4af4-aed5-d35ba2681ba7 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1318 microversion: 2.1 time: 0.880555 Nov 02 12:31:05.434628 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1257/2509] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:04 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1318 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:05.440306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:05.441876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:05.451913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.452846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.453487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.454677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.455409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.456106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.719483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.735559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.739509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.750248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1410e1ce-c7a9-495f-9616-33b5a27f2b1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1417 microversion: 2.75 time: 0.375447 Nov 02 12:31:05.751562 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1253/2510] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:05 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1417 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:05.759205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:05.760829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:05.771106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.771988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.772775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.774350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.776024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.777404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.892918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:06.217283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:06.522291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:06.586593 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d944580-a3bb-4c42-9a01-b7baf9e5c8fc tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1715 microversion: 2.1 time: 1.150041 Nov 02 12:31:06.591223 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1258/2511] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:05 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1715 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:06.620460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:06.625429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:06.647424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.651408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.656132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.658018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.661493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.663048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.724862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:06.768374 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-845e1fd6-a78d-4890-832b-c410c48594c2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1323 microversion: 2.1 time: 1.000241 Nov 02 12:31:06.778534 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1254/2512] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:05 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1323 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:06.829571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:06.846981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:06.868617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.869677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.882804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.884206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.886680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.887780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.669302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:07.670586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:07.687135 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f5aa462d-bbb7-480e-b8ef-c684b1e01335 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 1.092401 Nov 02 12:31:07.689566 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1259/2513] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:06 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:07.699357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:07.701735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:07.703112 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1d61445-7826-48e1-8853-6d390d93c205 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1314 microversion: 2.1 time: 0.920722 Nov 02 12:31:07.717122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.720262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.721584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.723345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.723752 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1255/2514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:06 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:07.725212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.726540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.730134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a953caeb-dba7-4b1b-9efa-1d899ffa8b59 req-eaffb2be-9823-4896-b5d8-4931523eaa6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:07.755494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a953caeb-dba7-4b1b-9efa-1d899ffa8b59 req-eaffb2be-9823-4896-b5d8-4931523eaa6a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.756017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a953caeb-dba7-4b1b-9efa-1d899ffa8b59 req-eaffb2be-9823-4896-b5d8-4931523eaa6a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.756832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a953caeb-dba7-4b1b-9efa-1d899ffa8b59 req-eaffb2be-9823-4896-b5d8-4931523eaa6a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.776676 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a953caeb-dba7-4b1b-9efa-1d899ffa8b59 req-eaffb2be-9823-4896-b5d8-4931523eaa6a service nova] Creating event network-changed:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h1-855650-5 Nov 02 12:31:07.782323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a953caeb-dba7-4b1b-9efa-1d899ffa8b59 req-eaffb2be-9823-4896-b5d8-4931523eaa6a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056645 Nov 02 12:31:07.782952 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1256/2515] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:07.791291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4aaac96a-bd7e-445a-b524-e208d6770076 req-4282b289-cbd1-4c73-ab21-a20ad5be5d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59a9a86-b664-4c2f-9dd6-e752c7fb777d", "name": "network-vif-plugged", "status": "completed", "tag": "f1ca04f8-5c7b-4c09-a10a-32b43308d7a2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:07.821416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4aaac96a-bd7e-445a-b524-e208d6770076 req-4282b289-cbd1-4c73-ab21-a20ad5be5d8b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.830433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4aaac96a-bd7e-445a-b524-e208d6770076 req-4282b289-cbd1-4c73-ab21-a20ad5be5d8b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.830433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4aaac96a-bd7e-445a-b524-e208d6770076 req-4282b289-cbd1-4c73-ab21-a20ad5be5d8b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.853482 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4aaac96a-bd7e-445a-b524-e208d6770076 req-4282b289-cbd1-4c73-ab21-a20ad5be5d8b service nova] Creating event network-vif-plugged:f1ca04f8-5c7b-4c09-a10a-32b43308d7a2 for instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d on n-h2-855650-5 Nov 02 12:31:07.867073 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4aaac96a-bd7e-445a-b524-e208d6770076 req-4282b289-cbd1-4c73-ab21-a20ad5be5d8b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081211 Nov 02 12:31:07.868549 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1257/2516] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:07.879729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:07.881383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:07.893847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.895447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.904566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.906596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.907937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.909007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.090676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.131796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.140972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.161729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b2da284e-b6d8-48a7-847a-32708f987857 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1417 microversion: 2.75 time: 0.290440 Nov 02 12:31:08.176644 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1258/2517] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:07 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1417 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:08.196529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:08.200563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:08.223576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.224408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.225567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.227060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.229458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.231192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.472155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.493221 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fdc02c02-ec56-463b-9c7d-819a8cde503c tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1647 microversion: 2.1 time: 0.309897 Nov 02 12:31:08.494488 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1259/2518] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:08 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1647 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:08.505222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:08.506580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:08.518795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.554741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.556319 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-022bf0ec-9d81-46cb-a740-20306e559c4e tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1508 microversion: 2.1 time: 0.864328 Nov 02 12:31:08.557178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.560039 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1260/2519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:07 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1508 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:08.585720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.586605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.587118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.593131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:08.594037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:08.596303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.611448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.612286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.617264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.618319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.618817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.619276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.853298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:09.870961 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cc70b04d-f71e-4904-88ae-533acf927c14 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1508 microversion: 2.1 time: 1.283511 Nov 02 12:31:09.875049 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1261/2520] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:08 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1508 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:09.903509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:09.904688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:09.915257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.920937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.921512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.929009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.930631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.931965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.000737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.017011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36b0deb3-af5e-4041-9d1d-4955d89975b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1516 microversion: 2.1 time: 1.520716 Nov 02 12:31:10.023590 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1260/2521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:08 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1516 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:10.044752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:10.054488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.067966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.068660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.069188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.070079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.070939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.072981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.424391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.442996 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba971cc0-a5c2-481a-81ad-37bc81836890 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.566636 Nov 02 12:31:10.443942 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1262/2522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:09 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:10.449295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:10.450234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.465408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.475096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.475914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.476863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.477699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.485417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.531190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.544970 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9544a1b7-3215-4f1c-8ea0-442333825104 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1464 microversion: 2.1 time: 0.518004 Nov 02 12:31:10.545577 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1261/2523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:10 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1464 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:10.558885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:10.559532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.569525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.570785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.571409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.591065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.592405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.593665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.668011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.669208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.671063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.671904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lazy-loading 'fault' on Instance uuid 6933b3c7-ad8a-4156-b959-f9c145bf08f0 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:10.685954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:10.790131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9d8c2d0a444f659d398db2d9fb72f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1169d053f1348a8830d578267cc0e8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.807707 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2c75190-026e-4481-b757-6c5703d602c7 tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 200 len: 1367 microversion: 2.1 time: 0.260813 Nov 02 12:31:10.809457 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1262/2524] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:10 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:10.830173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.838551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-62100732-3796-4b51-93c0-6abdd125aed5 req-c222c328-cfa1-4970-9064-9a3a6cdeffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6933b3c7-ad8a-4156-b959-f9c145bf08f0", "name": "network-vif-deleted", "tag": "d22f84e2-3fb0-4d88-816d-1d02b67f5815"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:10.844776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.851455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.852430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62100732-3796-4b51-93c0-6abdd125aed5 req-c222c328-cfa1-4970-9064-9a3a6cdeffb0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.853982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62100732-3796-4b51-93c0-6abdd125aed5 req-c222c328-cfa1-4970-9064-9a3a6cdeffb0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.854691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62100732-3796-4b51-93c0-6abdd125aed5 req-c222c328-cfa1-4970-9064-9a3a6cdeffb0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.862458 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6594b2a8-5468-4695-9cfb-f06fa77bc402 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1438 microversion: 2.75 time: 0.417092 Nov 02 12:31:10.871824 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-62100732-3796-4b51-93c0-6abdd125aed5 req-c222c328-cfa1-4970-9064-9a3a6cdeffb0 service nova] Creating event network-vif-deleted:d22f84e2-3fb0-4d88-816d-1d02b67f5815 for instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 on n-h2-855650-5 Nov 02 12:31:10.874463 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1263/2525] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:10 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1438 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:10.880749 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-62100732-3796-4b51-93c0-6abdd125aed5 req-c222c328-cfa1-4970-9064-9a3a6cdeffb0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052355 Nov 02 12:31:10.882104 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1263/2526] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:10.893726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:10.899122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.905200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:10.908186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.911723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.912839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.913535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.915368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.916521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.917529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.927352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.928109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.928409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.929236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.929705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.930281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.031378 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8ed41471-e262-4a20-af69-8c6cdf751c07 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "PUT /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1080 microversion: 2.1 time: 0.139891 Nov 02 12:31:11.032702 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1264/2527] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:31:10 2022] PUT /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1080 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:11.044119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:11.044987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:11.055504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.058241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.059062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.061109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.064353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.065480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.239321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:11.253033 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e7e0047-b7ec-465e-aff0-206b24643f0a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6" status: 200 len: 1517 microversion: 2.1 time: 0.368306 Nov 02 12:31:11.272674 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1264/2528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:10 2022] GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 => generated 1517 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:11.280415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:11.284971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:11.297387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.298005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.298487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.299257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.299743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.300188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.407415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:11.428398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:11.437518 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-46cd916a-0d5d-499e-ac34-674bf6f90201 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1463 microversion: 2.1 time: 0.390040 Nov 02 12:31:11.453511 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1265/2529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:11 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1463 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:11.464348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:11.465641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:11.466715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:11.467625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:11.468382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:11.488531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:11.489511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:11.499511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.500324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.501040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.502156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.502805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.503453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.544487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:11.684033 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:31:11.684350 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 12:31:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c (ip 10.222.0.45) !!! Nov 02 12:31:11.715658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:11.742423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.745920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.749758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.754281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.757533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.760123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.820196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:11.845319 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e41392a3-0a3c-4f68-b1a5-47380c62d599 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1506 microversion: 2.1 time: 0.387807 Nov 02 12:31:11.849323 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1266/2530] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:11 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:11.880165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:11.884641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:11.930078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.932019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.932889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.934386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.935275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.936073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.033665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:12.065869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:12.078183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:12.090297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9a1966a-42bf-4c29-92ae-2305da4ffe40 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "POST /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce/action" status: 202 len: 1495 microversion: 2.75 time: 0.815257 Nov 02 12:31:12.092322 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1265/2531] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:31:11 2022] POST /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce/action => generated 1495 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:31:12.127743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:12.137192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:12.172399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.186761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.187907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.189668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.190906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.191901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.444286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:12.459644 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9f25e994-3522-4248-b14a-5d5fb1ca64d6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 200 len: 1323 microversion: 2.1 time: 0.604351 Nov 02 12:31:12.463536 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1267/2532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:11 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 1323 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:12.470597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-79413061", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "05f0bd24-8c20-4b97-a4ae-2075c823179e"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:12.569244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] validate_networks() for None {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:31:12.641568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:12.686435 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-50e3615e-6c2b-4301-8db5-45f80553f3d5 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.567066 Nov 02 12:31:12.687875 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1266/2533] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:12 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:12.709833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:12.713227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] [instance: 6933b3c7-ad8a-4156-b959-f9c145bf08f0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:12.743396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.744908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.749992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.751382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.752262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.753060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.825923 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] HTTP exception thrown: Instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 could not be found. Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Request method failure captured: Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 HTTP/1.1 Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmJwTpi3kFLaPa0zApp-eJyWnMk9ClL4yhApOJorMh-G22zXOwrvSMRSZzz76d3aYBkX4xOZeetLCBkXm_GUVwp5zLIi-bay5FSITiJzBjrNmYQE-q78HY1P7VJdxa0J4PkwBcW39MtDLzaDFAKzKwN38dW_8iiyQtE6R32rGAzGuJA Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a1169d053f1348a8830d578267cc0e8d Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersTestManualDisk-1617835250 Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1169d053f1348a8830d578267cc0e8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1169d053f1348a8830d578267cc0e8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1169d053f1348a8830d578267cc0e8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1169d053f1348a8830d578267cc0e8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersTestManualDisk-1617835250 Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a1169d053f1348a8830d578267cc0e8d Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersTestManualDisk-1617835250 Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersTestManualDisk-1617835250-project Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: af9d8c2d0a444f659d398db2d9fb72f8 Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersTestManualDisk-1617835250-project Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 could not be found. Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6933b3c7-ad8a-4156-b959-f9c145bf08f0'} Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 could not be found. Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 could not be found. Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:12.831676 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 could not be found. Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Returning 404 to user: Instance 6933b3c7-ad8a-4156-b959-f9c145bf08f0 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:12.836237 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f57f9115-468a-4104-9db1-4939e875907d tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0" status: 404 len: 111 microversion: 2.1 time: 0.143976 Nov 02 12:31:12.845904 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1267/2534] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:12 2022] GET /compute/v2.1/servers/6933b3c7-ad8a-4156-b959-f9c145bf08f0 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:12.862674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:12.863329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:12.873914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.874399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.874859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.875660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.876247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.876654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.191733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:13.193056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:13.193863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:13.194594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:13.195188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:13.235136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.245570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.250311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.251719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.252414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.253064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.312082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Getting quotas for project d36baae805244e6983900973dd6dca37. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:13.347275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Getting quotas for user d27030caf3f740368ba4b588132e2b21 and project d36baae805244e6983900973dd6dca37. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:13.413757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.436171 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e84fa898-137b-4da7-956f-dd4f639dd3b5 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1506 microversion: 2.1 time: 0.590261 Nov 02 12:31:13.447462 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1268/2535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:12 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:13.466059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:13.466982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:13.467726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:13.470552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:31:13.476305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:31:13.502872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.506840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.507587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.508549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.509233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.511213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.671758 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c321b1a4-4c9c-4b05-b210-b6eb628c223e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202830 Nov 02 12:31:13.672492 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1268/2536] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:31:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:31:13.680877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ea5d249-7b3e-41fa-9101-510aa2907aae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] Calling method '.version_select at 0x7f228e1cf790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:13.787969 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ea5d249-7b3e-41fa-9101-510aa2907aae tempest-ServersTestManualDisk-1617835250 tempest-ServersTestManualDisk-1617835250-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443722116" status: 202 len: 0 microversion: 2.1 time: 0.111874 Nov 02 12:31:13.788255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.790210 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1269/2537] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443722116 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:13.805736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:13.811589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.813316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.817662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:13.827917 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a6436324-6d76-4e6e-8d7f-de1a59e9a612 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.365819 Nov 02 12:31:13.830500 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1269/2538] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:13 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:13.837920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:13.838635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:13.856604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.857416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.860634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.861483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.862563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.863214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.863812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.867284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.869487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.870699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.871304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.871869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.947867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:13.988198 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fbaa5715-e205-4ac9-9f1b-0e5fce3f52c9 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "PUT /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1082 microversion: 2.1 time: 0.195899 Nov 02 12:31:13.989748 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1270/2539] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:31:13 2022] PUT /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1082 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:13.996623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9bd51015-fbe8-47d5-8019-4431ae02837d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:13.997337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9bd51015-fbe8-47d5-8019-4431ae02837d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.196559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9bd51015-fbe8-47d5-8019-4431ae02837d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.222915 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9bd51015-fbe8-47d5-8019-4431ae02837d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1212 microversion: 2.1 time: 0.230920 Nov 02 12:31:14.235467 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1271/2540] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:13 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1212 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:14.236953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.247782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:14.249859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.266754 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08f11760-876a-4c7a-b844-c14334380a27 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 200 len: 1517 microversion: 2.1 time: 0.434338 Nov 02 12:31:14.267248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.268508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.269637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.270731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.271489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.272413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.279407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1270/2541] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:13 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 1517 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:14.326583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:14.327200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.346731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.347241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.352878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.353910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.354793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.355268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.639795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.653386 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-605209d5-610b-4586-a5de-9adf891689ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.418961 Nov 02 12:31:14.654059 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1272/2542] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:14 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:14.660412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:14.660740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.678926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.679697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.680390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.682105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.682763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.691501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.766361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:14.860070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.884539 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-792dd6e4-0f4c-4a36-bcf9-0a7db2ce5e8c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1508 microversion: 2.1 time: 0.589428 Nov 02 12:31:14.888128 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1271/2543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:14 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:14.901428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:14.902583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.919392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.930962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.932300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.933416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.934214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.934975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.984330 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-618ff1c1-5943-4f27-92d2-d038bf65b1ff tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 204 len: 0 microversion: 2.1 time: 0.328466 Nov 02 12:31:14.986439 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1273/2544] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:14 2022] DELETE /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:15.012011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.013341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.030087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.031335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.032141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.034334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.036826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.037747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.069045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.079625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.084073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.094153 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38bc825b-d8f0-4d7a-aac2-2547d975def8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.203031 Nov 02 12:31:15.094153 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1272/2545] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:14 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:15.102045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.102045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.110134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.110656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.111120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.112153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.112653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.113082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.343774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.354887 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-44b5d516-f2b1-4734-971c-4d17fa1cf20a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1508 microversion: 2.1 time: 0.364569 Nov 02 12:31:15.355763 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1274/2546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:14 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:15.361661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.362544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.370115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.370782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.371518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.372262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.372817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.373455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.386621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.404264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bef08df9-0dfa-4dcc-ab09-7ffe1079b8e0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 200 len: 1523 microversion: 2.1 time: 0.307113 Nov 02 12:31:15.405360 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1273/2547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:15 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:15.412122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.413055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.432723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.433522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.434253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.435341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.435822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.436269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.470729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.480357 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df9ee965-73e0-4dd6-b66e-49806b699e3b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1208 microversion: 2.1 time: 0.123250 Nov 02 12:31:15.481397 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1275/2548] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:15 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:15.490331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:15.579627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:15.591552 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f839ba2-1d51-4994-b338-09a783eab005 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 204 len: 0 microversion: 2.1 time: 0.184421 Nov 02 12:31:15.592858 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1274/2549] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:15 2022] DELETE /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:15.610465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.611251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.619601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.620363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.620973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.621878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.622563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.623177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.654958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:15.703171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.703939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.711314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.712164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.713512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.714582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.715281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.715930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.716278 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.compute.api [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Instance is already in deleting state, ignoring this request Nov 02 12:31:15.717220 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ffe7bb1-863e-4c1f-972c-3f966c4dc5ef tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 204 len: 0 microversion: 2.1 time: 0.113334 Nov 02 12:31:15.721021 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1276/2550] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:15 2022] DELETE /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:15.727202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.728596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.738103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.738600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.739142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.739897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.740369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.740810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.974176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.982311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.989872 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9a2d33f-57c5-4654-a307-3def735f9df9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.290045 Nov 02 12:31:15.991216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1275/2551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:15 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:15.996363 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-35f08a46-32d6-4a27-bacf-d106b6ba2f47 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1514 microversion: 2.1 time: 0.272510 Nov 02 12:31:16.009995 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1277/2552] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:15 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:16.154437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:16.155830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:16.171979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.171979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.171979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.173102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.174000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.174834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.332215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.359984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.367000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.382406 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dbf06e58-5f19-42eb-8e68-d9c5b3554afd tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.232440 Nov 02 12:31:16.384710 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1276/2553] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:16 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:16.442013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:16.442986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:16.460253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.461339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.463048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.465824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.466933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.467616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.508436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:16.510006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:16.521433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.522461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.523554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.526384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.527709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.528336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.620378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.629914 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c2d7a37-85d2-477e-9784-b25ee5167e09 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1208 microversion: 2.1 time: 0.128170 Nov 02 12:31:16.631247 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1277/2554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:16 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1208 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:16.698474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.714566 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c63a4b4-9180-46c7-a1b2-94cae8424438 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 200 len: 1523 microversion: 2.1 time: 0.280551 Nov 02 12:31:16.715553 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1278/2555] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:16 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:17.049175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:17.051666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:17.053352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:17.054549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:17.078382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.079832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.081007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.082589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.082911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.083926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.084525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.085177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.086035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.087699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.088831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.090125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.618313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.628724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.643139 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef1552fd-be2f-48a7-be26-525af1bf95f3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.618483 Nov 02 12:31:17.654147 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1278/2556] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:17 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:17.658243 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48b12637-7c0d-416b-b304-99932446b69d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1514 microversion: 2.1 time: 0.634645 Nov 02 12:31:17.686019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:17.686019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:17.686428 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1279/2557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:17 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1514 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:17.697717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:17.698880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:17.703863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.704740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.706034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.707342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.708177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.709029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.716002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.716523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.716989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.719421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:17.721598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.722135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.731812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.899849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.925663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.944988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.952987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.960498 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9f6fbc1a-9819-42f7-adda-95fe3cc07e62 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1264 microversion: 2.1 time: 0.276547 Nov 02 12:31:17.961763 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1280/2558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:17 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:17.967509 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1f3ac35-f13e-4aae-9473-ce41187740ef tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.311328 Nov 02 12:31:17.982976 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1279/2559] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:17 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:17.989148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:17.996503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:18.013664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.015532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.017999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.022315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.027284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.029193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.320582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:18.355439 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-25067705-ea0d-4ca0-b898-cf80be89938f tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 200 len: 1523 microversion: 2.1 time: 0.391602 Nov 02 12:31:18.355993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1281/2560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:17 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:18.691459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:18.706701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:18.711768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:18.720010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:18.741163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.742271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.743088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.745086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.745772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.745945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.746754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.747818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.748966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.750922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.752235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.753504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.364078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:19.391948 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df4245c3-bfa7-464e-b7ea-0da2782a0980 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.706513 Nov 02 12:31:19.410431 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1280/2561] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:18 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:19.426284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0aab9eb3-6d4a-4a72-a985-b9272db303ee req-7d9e34d0-1192-4363-9280-b0ec1e3a8cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "name": "network-vif-plugged", "status": "completed", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:19.457882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:19.508782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0aab9eb3-6d4a-4a72-a985-b9272db303ee req-7d9e34d0-1192-4363-9280-b0ec1e3a8cd9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.509351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0aab9eb3-6d4a-4a72-a985-b9272db303ee req-7d9e34d0-1192-4363-9280-b0ec1e3a8cd9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.509821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0aab9eb3-6d4a-4a72-a985-b9272db303ee req-7d9e34d0-1192-4363-9280-b0ec1e3a8cd9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.522019 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ed74ee56-d787-4d33-a6d6-5a1fbebf68ba tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1514 microversion: 2.1 time: 0.817946 Nov 02 12:31:19.523189 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1282/2562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:18 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1514 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:19.541354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.545926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.555602 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0aab9eb3-6d4a-4a72-a985-b9272db303ee req-7d9e34d0-1192-4363-9280-b0ec1e3a8cd9 service nova] Creating event network-vif-plugged:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h1-855650-5 Nov 02 12:31:19.563069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.564400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.564400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.565547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.565547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.565547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.573377 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0aab9eb3-6d4a-4a72-a985-b9272db303ee req-7d9e34d0-1192-4363-9280-b0ec1e3a8cd9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172721 Nov 02 12:31:19.574051 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1281/2563] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:19.584069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.584833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.611870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.612423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.615630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.619136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.620315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.622237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.835768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:19.844019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:19.885895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:19.903178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:19.940197 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-545f7b27-029f-4998-9a73-c0a3be9bc9f8 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.361933 Nov 02 12:31:19.943441 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1282/2564] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:19.952390 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-876b9a81-4594-47ac-9c23-51686cd4e009 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1264 microversion: 2.1 time: 0.427311 Nov 02 12:31:19.954651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.956509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.964822 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1283/2565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1264 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:19.996114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.999824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.002535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.004091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.005602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.007314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.438474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:20.439517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:20.452748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.454242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.455736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.458478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.464965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.465726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.494091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:20.508598 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9942a7c8-59dd-4307-943f-90f3583c5b4d tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 200 len: 1523 microversion: 2.1 time: 0.563611 Nov 02 12:31:20.534120 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1283/2566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 1523 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:20.568616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:20.570341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:20.584065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.586205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.588046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.589576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.590826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.592138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.044474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.056850 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c681fda-855f-43d4-a5e0-5c9ab07774c8 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.622986 Nov 02 12:31:21.074085 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1284/2567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:20 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:21.088978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.093766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:21.099729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:21.124310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.125137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.125623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.126470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.126966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.130597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.141388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:21.163774 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b190421f-5364-487d-b7aa-1f4cccdeae50 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1514 microversion: 2.1 time: 0.585952 Nov 02 12:31:21.165275 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1284/2568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:20 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1514 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:21.194911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:21.199607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:21.219951 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ed567e5-17d7-4fdd-bcde-8e1b64006856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143723 Nov 02 12:31:21.225222 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1285/2569] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:21 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:21.230348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:21.238997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:21.239280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.240142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.241316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.247191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.248071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.250148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.261063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.262013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.262825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.273001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.275479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.278035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.501242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.535533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.545268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.556913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-509e1f5a-46f8-4e6e-8715-ef7121b13b1e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.386102 Nov 02 12:31:21.558352 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1285/2570] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:21 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:21.565500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:21.566448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:21.589082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.590266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.590981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.592970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.594238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.596468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.701428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.717878 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-354ec322-f2f1-4bca-955c-0412be6172e0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1270 microversion: 2.1 time: 0.491855 Nov 02 12:31:21.719652 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1286/2571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:21 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1270 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:21.732045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d11445bd-0df9-40d7-8ba0-c310aca6cd06 req-3144126d-ff50-440b-8171-ac1603660612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59a9a86-b664-4c2f-9dd6-e752c7fb777d", "name": "network-vif-deleted", "tag": "f1ca04f8-5c7b-4c09-a10a-32b43308d7a2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:21.758227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d11445bd-0df9-40d7-8ba0-c310aca6cd06 req-3144126d-ff50-440b-8171-ac1603660612 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.760368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d11445bd-0df9-40d7-8ba0-c310aca6cd06 req-3144126d-ff50-440b-8171-ac1603660612 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.762549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d11445bd-0df9-40d7-8ba0-c310aca6cd06 req-3144126d-ff50-440b-8171-ac1603660612 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.784482 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d11445bd-0df9-40d7-8ba0-c310aca6cd06 req-3144126d-ff50-440b-8171-ac1603660612 service nova] Creating event network-vif-deleted:f1ca04f8-5c7b-4c09-a10a-32b43308d7a2 for instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d on n-h2-855650-5 Nov 02 12:31:21.793073 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d11445bd-0df9-40d7-8ba0-c310aca6cd06 req-3144126d-ff50-440b-8171-ac1603660612 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070821 Nov 02 12:31:21.794825 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1287/2572] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:21.808149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:21.809446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:21.819487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.820575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.821308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.823086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.824037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.824703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.882805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lazy-loading 'services' on Instance uuid 6d42b47d-df80-48cf-a3a2-416031e2a041 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:21.927775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.931796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.934871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.935678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lazy-loading 'fault' on Instance uuid e59a9a86-b664-4c2f-9dd6-e752c7fb777d {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:22.011872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:22.024196 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-abdbf169-5dde-4a9c-b3e9-541ba0a012a6 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 200 len: 1313 microversion: 2.1 time: 0.227589 Nov 02 12:31:22.026335 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1288/2573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:21 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:22.113491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:22.115110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:22.136359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.136880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.140776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.142074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.142274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.142812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.175940 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ff8fda9-67aa-4bfe-98ba-66f00a7531c0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments/83fec4df-eaf4-45a1-86ad-65f8286b4900" status: 202 len: 0 microversion: 2.1 time: 0.611567 Nov 02 12:31:22.177464 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1286/2574] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:31:21 2022] DELETE /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments/83fec4df-eaf4-45a1-86ad-65f8286b4900 => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:22.228926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:22.232409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:22.254702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.255507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.256790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.257920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.260081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.261012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.646221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:22.683940 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f4921687-04df-42c6-8c7c-2a3a48e6139c tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1472 microversion: 2.1 time: 0.470287 Nov 02 12:31:22.707206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1287/2575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:22 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1472 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:22.742595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-5f6ad5d8-9093-44f7-85a6-59bb34dca302 req-e0f1b374-ac57-42a4-b18c-a752bf4246bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e28e472-dbb7-4889-af10-435f3d4f1a5c", "name": "network-vif-deleted", "tag": "0ec07e60-70a5-40b2-ac24-354b03c4039e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:22.776756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5f6ad5d8-9093-44f7-85a6-59bb34dca302 req-e0f1b374-ac57-42a4-b18c-a752bf4246bd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.779777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5f6ad5d8-9093-44f7-85a6-59bb34dca302 req-e0f1b374-ac57-42a4-b18c-a752bf4246bd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.781724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5f6ad5d8-9093-44f7-85a6-59bb34dca302 req-e0f1b374-ac57-42a4-b18c-a752bf4246bd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.813326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:22.825240 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ebb8f5f4-f03b-4554-83a6-a01415ae79c3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1378 microversion: 2.1 time: 0.716719 Nov 02 12:31:22.829405 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1289/2576] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:22 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1378 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:22.840913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:22.841600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:22.856310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-5f6ad5d8-9093-44f7-85a6-59bb34dca302 req-e0f1b374-ac57-42a4-b18c-a752bf4246bd service nova] Creating event network-vif-deleted:0ec07e60-70a5-40b2-ac24-354b03c4039e for instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c on n-h2-855650-5 Nov 02 12:31:22.868247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.871464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.874548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.876129 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-5f6ad5d8-9093-44f7-85a6-59bb34dca302 req-e0f1b374-ac57-42a4-b18c-a752bf4246bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163519 Nov 02 12:31:22.878688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.880181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.881438 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1288/2577] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:22.883868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.904535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:22.906097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:22.936576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.938173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.938894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.940858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.945612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.946359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.118103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.138583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.141520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.160295 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7a4f15e9-8669-46e7-94c2-96d1588295aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.326817 Nov 02 12:31:23.162580 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1290/2578] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:22 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:23.173064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:23.173721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:23.192781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.205047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.208750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.209323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.210796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.211323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.211776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.231653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-226a206c-730a-4f8f-82c1-8d9009ce83a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1270 microversion: 2.1 time: 0.345018 Nov 02 12:31:23.232859 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1289/2579] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:22 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1270 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:23.268661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:23.294385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.295736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.296222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.299086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lazy-loading 'fault' on Instance uuid e59a9a86-b664-4c2f-9dd6-e752c7fb777d {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:23.386406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.420407 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57b620d4-e9a5-4249-9854-a8603d24a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 200 len: 1313 microversion: 2.1 time: 0.246777 Nov 02 12:31:23.422611 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1291/2580] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:23 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:23.741715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:23.746966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:23.773175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.774158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.775814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.789491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.791661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.795157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.876017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:23.876832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:23.893667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.894809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.901510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.902899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.904583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.908450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.913312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.914278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.915904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.916798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lazy-loading 'fault' on Instance uuid 4e28e472-dbb7-4889-af10-435f3d4f1a5c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:24.038689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5def23f73ff644cb8a7625a128b58b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46439c7bf424cb1961085f610858688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:24.084373 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9d1df94-8065-4f5d-8375-49e090ef6c49 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 200 len: 1308 microversion: 2.1 time: 0.353750 Nov 02 12:31:24.094589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1290/2581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:23 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:24.216730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:24.226892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:24.227611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:24.243610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.244657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.245135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.249413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.249953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.250477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.313917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:24.325236 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-40ee24ce-3519-4a82-b983-357db4fee6d1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1528 microversion: 2.1 time: 0.453635 Nov 02 12:31:24.326764 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1292/2582] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:23 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1528 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:24.332858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:24.333990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:24.342978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.343995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.344688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.345798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.347630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.348435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.465926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:24.484957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:24.490323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:24.514326 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5027fa4f-82f1-4053-b085-30f59ef1ceda tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.294761 Nov 02 12:31:24.530182 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1291/2583] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:24 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:24.539702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:24.540879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:24.567318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.568035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.568505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.569268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.590731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.591207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.531352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.575265 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5c8d820f-2cf7-44fc-ac37-f1d24aa93e53 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1312 microversion: 2.1 time: 1.246974 Nov 02 12:31:25.577284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.578809 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1293/2584] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:24 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1312 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:25.587105 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd6f41a4-a1ec-4b8a-9249-9e3b537a2fb2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1528 microversion: 2.1 time: 1.066608 Nov 02 12:31:25.588935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.589777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:25.590658 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1292/2585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:24 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1528 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:25.601212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.602441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 4e28e472-dbb7-4889-af10-435f3d4f1a5c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:25.610388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.610916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.611379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.612130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.612601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.613039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.626911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.627829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.628519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.629583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.630608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.633245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.640827 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] HTTP exception thrown: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Request method failure captured: Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d HTTP/1.1 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmLWaz4GBTpbL9ZnK_MbowIyY0xyTtkQYnElng8Zu8DzcC6zEiKjoeWud0eSejSjGNIggbmB26_2G9NyH7UEFc1WH9Qck8LRBBQvzY5PuuHOf7LgXu76zcSH5tyGEoKyVjYrNFPImAykbqRAzM61UqSabPL9fzrUa4zxb1lg8EXeob8 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 0696fbb6ed5c44ceb8e0c108232e8007 Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'e59a9a86-b664-4c2f-9dd6-e752c7fb777d'} Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.642937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:25.647029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.647029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.647029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:25.647029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:25.647029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:25.647029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:25.647029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:25.647029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.649032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Returning 404 to user: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:25.650988 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e7bd3e3f-8c1c-4e1c-b744-d19540f7fed0 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 404 len: 111 microversion: 2.1 time: 0.070459 Nov 02 12:31:25.652186 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1294/2586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:25.658016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.659059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:25.667859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.669512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.670508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.671681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.672425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.673148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.678751 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] HTTP exception thrown: Instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c could not be found. Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Request method failure captured: Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c HTTP/1.1 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmIrphCejmjtZ-zL7OHkokXTXLRy_CZNITnbaDvlzpfQeWY4zAwAfxLCRgIE12SArazttJrAQOXWdh9jYDS_powNeBJUanAzsjTKCL6tMo81-P5oUAApg_uepW_HVKMkJ3j73yhRUwYMUCryoGrjfmV-vwNElRT5ZnKs8ID0jVaGd-c Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a46439c7bf424cb1961085f610858688"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a46439c7bf424cb1961085f610858688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5def23f73ff644cb8a7625a128b58b73 Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c could not be found. Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4e28e472-dbb7-4889-af10-435f3d4f1a5c'} Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c could not be found. Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c could not be found. Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:25.680731 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c could not be found. Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Returning 404 to user: Instance 4e28e472-dbb7-4889-af10-435f3d4f1a5c could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0e674487-64c6-4342-af33-99fd41c4a572 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c" status: 404 len: 111 microversion: 2.1 time: 0.089523 Nov 02 12:31:25.688110 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1293/2587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers/4e28e472-dbb7-4889-af10-435f3d4f1a5c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:25.689792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9993271e-5354-4103-a01f-84f5cef160ce tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.713377 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9993271e-5354-4103-a01f-84f5cef160ce tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/807d1f59-73f9-465d-b93f-a26d08c17cd2" status: 202 len: 0 microversion: 2.1 time: 0.028319 Nov 02 12:31:25.714523 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1294/2588] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:25 2022] DELETE /compute/v2.1/flavors/807d1f59-73f9-465d-b93f-a26d08c17cd2 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:25.720470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.727247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.729678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:25.736741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.737235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.738172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.739008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.739500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.740685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.812822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.829687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.838540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.840000 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9fe28da-4358-416b-9b30-2aa2c3b92267 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.124238 Nov 02 12:31:25.841147 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1295/2589] 10.222.0.45 () {58 vars in 1230 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:25.847335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.848112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:25.853550 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16a74b7d-cdfd-4d8f-bde3-f9236f48a722 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.199958 Nov 02 12:31:25.866280 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1295/2590] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:25.867492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.868333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.870019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.881861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.882451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.882897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.894452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0cd86151-7a09-4440-a168-1af003190a97 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.904873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] HTTP exception thrown: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Request method failure captured: Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 HTTP/1.1 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmIrphCejmjtZ-zL7OHkokXTXLRy_CZNITnbaDvlzpfQeWY4zAwAfxLCRgIE12SArazttJrAQOXWdh9jYDS_powNeBJUanAzsjTKCL6tMo81-P5oUAApg_uepW_HVKMkJ3j73yhRUwYMUCryoGrjfmV-vwNElRT5ZnKs8ID0jVaGd-c Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a46439c7bf424cb1961085f610858688"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a46439c7bf424cb1961085f610858688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5def23f73ff644cb8a7625a128b58b73 Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '25469484-61f1-46e8-b68c-24a3dde54b61'} Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:25.907394 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:25.911561 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.915189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Returning 404 to user: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:25.920044 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e3bcef49-15b7-464a-a5f4-a0342911740b tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 404 len: 111 microversion: 2.1 time: 0.077480 Nov 02 12:31:25.921510 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1296/2591] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:25 2022] DELETE /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:25.943113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4d3e5ec-13ce-42b5-af44-e5300e9a417c tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.954766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0cd86151-7a09-4440-a168-1af003190a97 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.094002 Nov 02 12:31:25.955867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1296/2592] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:25.961931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.962889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 25469484-61f1-46e8-b68c-24a3dde54b61] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4d3e5ec-13ce-42b5-af44-e5300e9a417c tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Request method failure captured: Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmLWaz4GBTpbL9ZnK_MbowIyY0xyTtkQYnElng8Zu8DzcC6zEiKjoeWud0eSejSjGNIggbmB26_2G9NyH7UEFc1WH9Qck8LRBBQvzY5PuuHOf7LgXu76zcSH5tyGEoKyVjYrNFPImAykbqRAzM61UqSabPL9fzrUa4zxb1lg8EXeob8 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 0696fbb6ed5c44ceb8e0c108232e8007 Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: action_args: {} Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi '2011/01/01' Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 12:31:25.968925 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4d3e5ec-13ce-42b5-af44-e5300e9a417c tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:25.976768 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f4d3e5ec-13ce-42b5-af44-e5300e9a417c tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.038426 Nov 02 12:31:25.982727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.983325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.983690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.984438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.984906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.985485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.987868 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1297/2593] 10.222.0.45 () {58 vars in 1182 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:31:25.999325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.017235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:26.019354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'deleted': False, 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:26.025323 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] HTTP exception thrown: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:26.027976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Request method failure captured: Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 HTTP/1.1 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmIrphCejmjtZ-zL7OHkokXTXLRy_CZNITnbaDvlzpfQeWY4zAwAfxLCRgIE12SArazttJrAQOXWdh9jYDS_powNeBJUanAzsjTKCL6tMo81-P5oUAApg_uepW_HVKMkJ3j73yhRUwYMUCryoGrjfmV-vwNElRT5ZnKs8ID0jVaGd-c Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a46439c7bf424cb1961085f610858688"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a46439c7bf424cb1961085f610858688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5def23f73ff644cb8a7625a128b58b73 Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '25469484-61f1-46e8-b68c-24a3dde54b61'} Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.028546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.036570 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.036570 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.036570 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.036570 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:26.036570 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:26.036570 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. Nov 02 12:31:26.036570 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.038605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.038605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.038605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.038605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.038605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.039433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Returning 404 to user: Instance 25469484-61f1-46e8-b68c-24a3dde54b61 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:26.039433 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-47c7bd28-9750-48d4-b958-8fc369f0b5b0 tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61" status: 404 len: 111 microversion: 2.1 time: 0.078930 Nov 02 12:31:26.047839 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1297/2594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers/25469484-61f1-46e8-b68c-24a3dde54b61 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:26.058602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:26.067571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:26.068585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:31:26.079146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.080969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.082661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.084542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.085677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.086744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.107127 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f18a74f-85da-4af1-bb80-a294b303ebfc tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.118042 Nov 02 12:31:26.108164 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1298/2595] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers => generated 683 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:26.113837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.114366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:26.122691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.123355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.123819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.124561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.125022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.125450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.145395 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] HTTP exception thrown: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Request method failure captured: Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df HTTP/1.1 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmIrphCejmjtZ-zL7OHkokXTXLRy_CZNITnbaDvlzpfQeWY4zAwAfxLCRgIE12SArazttJrAQOXWdh9jYDS_powNeBJUanAzsjTKCL6tMo81-P5oUAApg_uepW_HVKMkJ3j73yhRUwYMUCryoGrjfmV-vwNElRT5ZnKs8ID0jVaGd-c Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a46439c7bf424cb1961085f610858688"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a46439c7bf424cb1961085f610858688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5def23f73ff644cb8a7625a128b58b73 Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '40d9a48d-0d18-4480-a9ae-708b657762df'} Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:26.147826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.153769 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.157311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:26.160794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Returning 404 to user: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:26.161407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Old instance type tempest-test_resize_flavor_-64651846, new instance type m1.heat {{(pid=120723) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:31:26.164274 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2b6fe82f-2d7b-4448-b7c0-264586273b6d tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 404 len: 111 microversion: 2.1 time: 0.054143 Nov 02 12:31:26.167952 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1299/2596] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:26 2022] DELETE /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:26.173824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:26.174335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:26.175044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:26.175501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:26.175924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:26.182701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.195736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:26.197385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.servers [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Removing options 'limit' from query {{(pid=120722) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:31:26.199669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'deleted': False, 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:26.213844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.215586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.218230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.222031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.223539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.224913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.309236 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58b8cc5c-668b-463e-93f3-cd4f2f98fa57 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6/action" status: 202 len: 0 microversion: 2.1 time: 0.261216 Nov 02 12:31:26.309507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:31:26.313489 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1298/2597] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:31:26 2022] POST /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:26.330714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.334376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] [instance: 40d9a48d-0d18-4480-a9ae-708b657762df] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:26.362987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.364082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.366583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.370035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.371039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.373366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.385292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:26.393111 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a8aec0e3-8877-4c5b-abea-57ab3acb13ce tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.222081 Nov 02 12:31:26.395814 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1300/2598] 10.222.0.45 () {58 vars in 1144 bytes} [Wed Nov 2 12:31:26 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:26.404206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.405807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:26.425435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.428952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.430454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.433564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.434497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.437106 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] HTTP exception thrown: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.438137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Request method failure captured: Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df HTTP/1.1 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmIrphCejmjtZ-zL7OHkokXTXLRy_CZNITnbaDvlzpfQeWY4zAwAfxLCRgIE12SArazttJrAQOXWdh9jYDS_powNeBJUanAzsjTKCL6tMo81-P5oUAApg_uepW_HVKMkJ3j73yhRUwYMUCryoGrjfmV-vwNElRT5ZnKs8ID0jVaGd-c Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a46439c7bf424cb1961085f610858688"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a46439c7bf424cb1961085f610858688"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a46439c7bf424cb1961085f610858688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: a46439c7bf424cb1961085f610858688 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1689958350 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5def23f73ff644cb8a7625a128b58b73 Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerDiskConfigTestJSON-1689958350-project Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '40d9a48d-0d18-4480-a9ae-708b657762df'} Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.441438 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.445260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.445260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.445260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.445260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:26.445260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:26.445260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. Nov 02 12:31:26.445260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.448194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] Returning 404 to user: Instance 40d9a48d-0d18-4480-a9ae-708b657762df could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:26.449760 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48a4dd04-7d74-4261-b8e8-2927d7022e1a tempest-ServerDiskConfigTestJSON-1689958350 tempest-ServerDiskConfigTestJSON-1689958350-project] 10.222.0.45 "GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df" status: 404 len: 111 microversion: 2.1 time: 0.131879 Nov 02 12:31:26.462636 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1299/2599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:26 2022] GET /compute/v2.1/servers/40d9a48d-0d18-4480-a9ae-708b657762df => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:26.487277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-398afe25-608b-4b8a-94c8-1cbd63c45546 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-398afe25-608b-4b8a-94c8-1cbd63c45546 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Request method failure captured: Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmLWaz4GBTpbL9ZnK_MbowIyY0xyTtkQYnElng8Zu8DzcC6zEiKjoeWud0eSejSjGNIggbmB26_2G9NyH7UEFc1WH9Qck8LRBBQvzY5PuuHOf7LgXu76zcSH5tyGEoKyVjYrNFPImAykbqRAzM61UqSabPL9fzrUa4zxb1lg8EXeob8 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 0696fbb6ed5c44ceb8e0c108232e8007 Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: action_args: {} Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi '-1' Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 12:31:26.502705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 12:31:26.510824 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.522388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-398afe25-608b-4b8a-94c8-1cbd63c45546 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:26.527620 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-398afe25-608b-4b8a-94c8-1cbd63c45546 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.060874 Nov 02 12:31:26.529588 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1300/2600] 10.222.0.45 () {58 vars in 1142 bytes} [Wed Nov 2 12:31:26 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:31:26.565186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aea501c7-541d-47dc-9f91-653d98bcb43b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aea501c7-541d-47dc-9f91-653d98bcb43b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Request method failure captured: Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmLWaz4GBTpbL9ZnK_MbowIyY0xyTtkQYnElng8Zu8DzcC6zEiKjoeWud0eSejSjGNIggbmB26_2G9NyH7UEFc1WH9Qck8LRBBQvzY5PuuHOf7LgXu76zcSH5tyGEoKyVjYrNFPImAykbqRAzM61UqSabPL9fzrUa4zxb1lg8EXeob8 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 0696fbb6ed5c44ceb8e0c108232e8007 Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: action_args: {} Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'testing' Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 12:31:26.591680 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 12:31:26.610171 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:26.619077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aea501c7-541d-47dc-9f91-653d98bcb43b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:26.626239 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-aea501c7-541d-47dc-9f91-653d98bcb43b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.079960 Nov 02 12:31:26.627909 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1301/2601] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:31:26 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:31:26.648878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.650765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:26.663892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.664770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.665597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.667839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.670160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.671478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.075793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.096209 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e6b52e4-1922-488a-8ec7-bfe749acdbf1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1537 microversion: 2.1 time: 0.696534 Nov 02 12:31:27.110027 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1301/2602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:26 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1537 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:27.110027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb8870f6-dbd3-4a03-9d4f-dda66cbf63b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:27.112247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb8870f6-dbd3-4a03-9d4f-dda66cbf63b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.113643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb8870f6-dbd3-4a03-9d4f-dda66cbf63b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:27.135285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.servers [None req-eb8870f6-dbd3-4a03-9d4f-dda66cbf63b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Flavor 'non_existing_flavor' could not be found {{(pid=120722) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Nov 02 12:31:27.157016 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb8870f6-dbd3-4a03-9d4f-dda66cbf63b3 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.057537 Nov 02 12:31:27.160823 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1302/2603] 10.222.0.45 () {58 vars in 1178 bytes} [Wed Nov 2 12:31:27 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:27.189396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:27.190238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:27.227744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.228663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.229108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.229833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.230322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.230800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.297127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.319502 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-81d5b82b-1354-4d99-ba9d-597a293b26bd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1312 microversion: 2.1 time: 0.683663 Nov 02 12:31:27.322258 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1302/2604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:26 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1312 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:27.330637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5c30b203-5e86-4bac-b932-177673774b9c req-2cf2ae48-807f-4605-9dc8-5ca41cdf00b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb", "tag": "18a89dec-a15f-424b-a75d-6f031e27d317"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:27.345761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5c30b203-5e86-4bac-b932-177673774b9c req-2cf2ae48-807f-4605-9dc8-5ca41cdf00b3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.347779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5c30b203-5e86-4bac-b932-177673774b9c req-2cf2ae48-807f-4605-9dc8-5ca41cdf00b3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.349407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5c30b203-5e86-4bac-b932-177673774b9c req-2cf2ae48-807f-4605-9dc8-5ca41cdf00b3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.369121 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5c30b203-5e86-4bac-b932-177673774b9c req-2cf2ae48-807f-4605-9dc8-5ca41cdf00b3 service nova] Creating event network-changed:18a89dec-a15f-424b-a75d-6f031e27d317 for instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb on n-h2-855650-5 Nov 02 12:31:27.378698 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5c30b203-5e86-4bac-b932-177673774b9c req-2cf2ae48-807f-4605-9dc8-5ca41cdf00b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052505 Nov 02 12:31:27.380798 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1303/2605] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:27.393917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:27.414376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.415862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:27.444608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.446101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.448156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.450530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.451687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.452772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.548762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.573610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.585478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.621156 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2dbe9769-460c-4e5e-8d8f-c6a88e3c2cfb tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.458888 Nov 02 12:31:27.621768 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1303/2606] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:27 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:27.755143 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41fb4670-9c08-48c9-b022-53bb36255d6b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.371696 Nov 02 12:31:27.756163 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1304/2607] 10.222.0.45 () {58 vars in 1174 bytes} [Wed Nov 2 12:31:27 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:27.779223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:27.791144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.792844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:27.806279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.810252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.812006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.814235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.815316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.816770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.104794 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bbf2848b-1de6-47b5-a53c-942dc2c75efa tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.332169 Nov 02 12:31:28.124224 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1304/2608] 10.222.0.45 () {58 vars in 1184 bytes} [Wed Nov 2 12:31:27 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:28.133526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:28.145877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:28.146585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:28.160421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.161104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.161556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.162356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.162819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.163047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:28.163234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.167764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'deleted': False, 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:28.188764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.192810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.193877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.195513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.200497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.201683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.286408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:31:28.403118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:28.416505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.417647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.418299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.041767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.060498 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70d84efc-dafe-4f47-98a2-d4bb588afd2a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1537 microversion: 2.1 time: 0.920479 Nov 02 12:31:29.063358 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1305/2609] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:28 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1537 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:29.069000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:29.069644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:29.079987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.080501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.080955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.083047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.083812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.084485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.205197 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-71fcb970-175c-46d0-b838-c847328bc254 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 1.079482 Nov 02 12:31:29.221386 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1305/2610] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:31:28 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:29.245652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:29.248921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:29.259170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:29.260997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.262614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.263495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.264525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.265187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.266195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.270321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:29.568635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.581215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bfb7518b-1e7d-4c30-8b5c-256b40157a10 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1312 microversion: 2.1 time: 0.516280 Nov 02 12:31:29.582593 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1306/2611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:29 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1312 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:29.589487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f62a6a8-7230-4f8a-85cb-fb97c0db5806 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:29.596571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f62a6a8-7230-4f8a-85cb-fb97c0db5806 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.598297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f62a6a8-7230-4f8a-85cb-fb97c0db5806 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013937 Nov 02 12:31:29.608577 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1307/2612] 10.222.0.45 () {58 vars in 1178 bytes} [Wed Nov 2 12:31:29 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:29.616246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:29.623017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.624200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Searching by: {'deleted': False, 'project_id': '854f4fc2040844d88e9ae160ca83375a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:29.631945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.632438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.632942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.634693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.635425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.636018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.672827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:31:29.698276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.710598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.713638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.721576 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a45245d-dd66-4167-970c-3044a2a21041 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.498675 Nov 02 12:31:29.722549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1306/2613] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:29 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:29.759254 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2f54672-5753-4332-8db9-e8ef73a4a5b2 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.148035 Nov 02 12:31:29.761820 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1308/2614] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:31:29 2022] GET /compute/v2.1/servers => generated 683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:29.782309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:29.783721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:29.813342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.814649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.815823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.817402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.818792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.819794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.854860 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] HTTP exception thrown: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Request method failure captured: Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d HTTP/1.1 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmLWaz4GBTpbL9ZnK_MbowIyY0xyTtkQYnElng8Zu8DzcC6zEiKjoeWud0eSejSjGNIggbmB26_2G9NyH7UEFc1WH9Qck8LRBBQvzY5PuuHOf7LgXu76zcSH5tyGEoKyVjYrNFPImAykbqRAzM61UqSabPL9fzrUa4zxb1lg8EXeob8 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 0696fbb6ed5c44ceb8e0c108232e8007 Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'e59a9a86-b664-4c2f-9dd6-e752c7fb777d'} Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:29.859076 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:29.866813 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.869640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Returning 404 to user: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:29.871372 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f311c73-a57e-4444-9e55-9177063cf406 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 404 len: 111 microversion: 2.1 time: 0.099877 Nov 02 12:31:29.872517 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1307/2615] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:29 2022] DELETE /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:29.888409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:29.889726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:29.902754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.903874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.904881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.906259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.907187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.908049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.960784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:30.107732 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c0f330e-3de1-4ba4-9e66-5d66c72dbc6e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6" status: 204 len: 0 microversion: 2.1 time: 0.227555 Nov 02 12:31:30.109087 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1309/2616] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:29 2022] DELETE /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:30.114022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.115152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.122029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.122774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.130219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.130832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.131354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.132324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.132812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.133236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.148794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.149434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.150049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.151622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.151622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.152268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.168705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:30.292974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:30.309820 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ecd7a4b1-00a2-464d-bd22-23674ecf555a tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 204 len: 0 microversion: 2.1 time: 0.193710 Nov 02 12:31:30.311331 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1310/2617] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:30 2022] DELETE /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:30.325815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.326652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: e59a9a86-b664-4c2f-9dd6-e752c7fb777d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.334668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.335355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.336211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.337489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.338002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.338715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.365445 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] HTTP exception thrown: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Request method failure captured: Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d HTTP/1.1 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmLWaz4GBTpbL9ZnK_MbowIyY0xyTtkQYnElng8Zu8DzcC6zEiKjoeWud0eSejSjGNIggbmB26_2G9NyH7UEFc1WH9Qck8LRBBQvzY5PuuHOf7LgXu76zcSH5tyGEoKyVjYrNFPImAykbqRAzM61UqSabPL9fzrUa4zxb1lg8EXeob8 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 0696fbb6ed5c44ceb8e0c108232e8007 Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'e59a9a86-b664-4c2f-9dd6-e752c7fb777d'} Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:30.369421 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Returning 404 to user: Instance e59a9a86-b664-4c2f-9dd6-e752c7fb777d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a559a6d0-6700-449c-b338-09ec3eb1cbb1 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d" status: 404 len: 111 microversion: 2.1 time: 0.054419 Nov 02 12:31:30.379996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1311/2618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:30 2022] GET /compute/v2.1/servers/e59a9a86-b664-4c2f-9dd6-e752c7fb777d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:30.383882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.383882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.400784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.401603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.402935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.403881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.404463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.405012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.823986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:30.850798 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4b1798e1-b35b-4e6b-83b0-212f6d986503 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1537 microversion: 2.1 time: 0.748145 Nov 02 12:31:30.851840 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1308/2619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:30 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1537 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:30.859911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.861001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.889335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.890263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.903161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.904005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.904509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.904971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.036542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:31.050500 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a0954b46-3956-4c83-b89b-96a71cdc25f4 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6" status: 200 len: 1523 microversion: 2.1 time: 0.672519 Nov 02 12:31:31.057277 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1312/2620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:30 2022] GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 => generated 1523 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:31.063456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:31.070342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.085851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.090707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.091282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.092142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.092619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.093062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.298439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:31.315041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:31.319167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:31.341365 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f073f432-907a-463d-a115-89d98af67f56 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.272637 Nov 02 12:31:31.358020 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1313/2621] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:31 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:31.395306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:31.443434 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e4599074-0ad3-49d1-b827-bf97e94e0cc1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1312 microversion: 2.1 time: 0.589623 Nov 02 12:31:31.453270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1309/2622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:30 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1312 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:31.893220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:31.896772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.920501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.925046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.932806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.939271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.940782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.943167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.086919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:32.088184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:32.102016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:32.103848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:32.104906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.106549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:32.107611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:32.108484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.975883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:32.991401 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6a243a16-0995-4bb6-aae5-c60852c8742b tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6" status: 200 len: 1523 microversion: 2.1 time: 0.911726 Nov 02 12:31:32.992892 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1310/2623] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:32 2022] GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 => generated 1523 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:33.004134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:33.007717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:33.027657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.028973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.029696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.030772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.034769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.035647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.230538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.242767 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-251cc8ea-0f0b-412e-856e-9bcb539a58ef tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1537 microversion: 2.1 time: 1.356463 Nov 02 12:31:33.243403 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1314/2624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:31 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1537 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:33.259434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:33.261805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:33.275832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.283393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.284299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.285299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.286229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.289606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.370868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.436458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.445522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.483585 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bd811fd9-0e52-4a69-bf5c-124b8993772f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.480832 Nov 02 12:31:33.485016 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1311/2625] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:32 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:33.525830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:33.531878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:33.559873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.566173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.567654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.574714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.580412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.589696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.773002 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9c72a897-dfc9-457d-ab83-149fbd4dcb73 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.273407 Nov 02 12:31:33.788228 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1312/2626] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:33 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments => generated 25 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:33.999897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.003860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.019448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.020778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.025678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.031999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.034479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.051255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.199384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.252628 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c36edf9-100a-4250-a432-f26515e50954 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1312 microversion: 2.1 time: 1.001523 Nov 02 12:31:34.269916 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-578e32c5-5650-4b83-ab14-11567dd4de4a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.276374 Nov 02 12:31:34.273425 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1315/2627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:33 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1312 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:34.280092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1313/2628] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:33 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041/os-volume_attachments => generated 25 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:34.288820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.290323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.310480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.311208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.311819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.314631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.317175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.317517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.318166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.324179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.379461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:34.380030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.381151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.382220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.391442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.394929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.395938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.641764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.659168 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b51dafd-1e5c-45bd-8ac9-2f4b98b47d5e tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6" status: 200 len: 1481 microversion: 2.1 time: 0.384024 Nov 02 12:31:34.660158 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1316/2629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:34 2022] GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 => generated 1481 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:34.666150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.678760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.687278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.687793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.688352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.689111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.689952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.690785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.849141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.874069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.880939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.898532 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e47d19b7-d4a0-4e85-a4cb-09931bc11b48 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.236505 Nov 02 12:31:34.900418 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1317/2630] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:34 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:34.911134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.912398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.937160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.939752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.940848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.942510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.943669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.944856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.010610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:35.023822 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-247be1a5-dd4a-40a9-9d26-0687c3ed9a4d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1537 microversion: 2.1 time: 0.738934 Nov 02 12:31:35.054111 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1314/2631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:34 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1537 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:35.072659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b70da73c-2a5b-4ed3-93fc-df5d97ffbabb req-11e2d39d-7ef9-49b7-9d55-3831bd8f2141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0cc60a-b436-4b6c-bf4c-6488ff5602b6", "name": "network-vif-deleted", "tag": "a10fe17d-cc8a-4d6f-89f9-b32f340efbfc"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:35.101521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b70da73c-2a5b-4ed3-93fc-df5d97ffbabb req-11e2d39d-7ef9-49b7-9d55-3831bd8f2141 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.105242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b70da73c-2a5b-4ed3-93fc-df5d97ffbabb req-11e2d39d-7ef9-49b7-9d55-3831bd8f2141 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.106742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b70da73c-2a5b-4ed3-93fc-df5d97ffbabb req-11e2d39d-7ef9-49b7-9d55-3831bd8f2141 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.113892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:35.133403 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b70da73c-2a5b-4ed3-93fc-df5d97ffbabb req-11e2d39d-7ef9-49b7-9d55-3831bd8f2141 service nova] Creating event network-vif-deleted:a10fe17d-cc8a-4d6f-89f9-b32f340efbfc for instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 on n-h1-855650-5 Nov 02 12:31:35.149104 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b70da73c-2a5b-4ed3-93fc-df5d97ffbabb req-11e2d39d-7ef9-49b7-9d55-3831bd8f2141 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088012 Nov 02 12:31:35.155835 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1315/2632] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:35.280399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:35.281364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:35.300735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.303676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.308714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.312296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.313664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.317403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.319812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb95f7ac-1abd-42f6-b444-5dfebe06dcf0 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 204 len: 0 microversion: 2.1 time: 0.417048 Nov 02 12:31:35.321167 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1318/2633] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:34 2022] DELETE /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:35.341634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:35.342627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:35.353373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.354255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.354861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.356879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.359772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.360492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.819916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:35.827506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:35.842797 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f7caaa00-ce38-4b81-bd82-23007731146a tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1680 microversion: 2.1 time: 0.513125 Nov 02 12:31:35.843405 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1319/2634] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:35 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1680 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:35.855726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:35.856665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:35.875748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.876257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.876708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.877433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.877902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.878372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.904961 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-959b57b2-d441-49d8-bbfc-2d9e80006a6a tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1312 microversion: 2.1 time: 0.628717 Nov 02 12:31:35.927498 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1316/2635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:35 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1312 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:35.969098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:35.972093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:36.008072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.008910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.012182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.012988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lazy-loading 'fault' on Instance uuid cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:36.019083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.021678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.023144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.028630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.030020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.031306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.096873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:36.115497 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-418f77fe-daf9-4423-8cad-629e239b8e15 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6" status: 200 len: 1313 microversion: 2.1 time: 0.270755 Nov 02 12:31:36.118435 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1320/2636] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:35 2022] GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:36.125023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:36.125659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:36.166128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.166829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.167339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.168339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.169339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.176730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.415820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:36.448476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:36.450852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:36.466359 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ece410ad-b31a-417e-8ea6-bdb0633211df tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.526223 Nov 02 12:31:36.482399 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1317/2637] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:35 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:36.656089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:36.679865 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a99f2a32-eaa4-47ee-b9af-668a99ac7d86 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1537 microversion: 2.1 time: 0.559516 Nov 02 12:31:36.683307 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1321/2638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:36 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1537 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:36.912615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:36.919527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:36.959913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:36.961036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:36.961171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.962492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.966263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.979373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.980752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.983095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.990786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.991613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.992360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.993620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.002960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.003959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.464554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:37.485451 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1171e29e-33e0-4b97-9740-700a3ab6bbd7 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1680 microversion: 2.1 time: 0.591758 Nov 02 12:31:37.486202 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1318/2639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:36 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1680 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:37.497240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:37.498109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:37.509948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.516847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.518744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.519962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.528089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.528921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.626966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:37.713804 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e152c28-4afd-43e0-a8c0-86a19c31f8a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1312 microversion: 2.1 time: 0.752639 Nov 02 12:31:37.715263 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1322/2640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:36 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1312 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:37.754251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-caf51170-25a1-4e13-8975-fcedcd1d5c0f req-3290e43e-0678-4a16-834c-7d093a95188e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb", "name": "network-vif-plugged", "status": "completed", "tag": "18a89dec-a15f-424b-a75d-6f031e27d317"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:37.808118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.809568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.811467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.812608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lazy-loading 'fault' on Instance uuid cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:37.814587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-caf51170-25a1-4e13-8975-fcedcd1d5c0f req-3290e43e-0678-4a16-834c-7d093a95188e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.819640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-caf51170-25a1-4e13-8975-fcedcd1d5c0f req-3290e43e-0678-4a16-834c-7d093a95188e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.820961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-caf51170-25a1-4e13-8975-fcedcd1d5c0f req-3290e43e-0678-4a16-834c-7d093a95188e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.908616 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-caf51170-25a1-4e13-8975-fcedcd1d5c0f req-3290e43e-0678-4a16-834c-7d093a95188e service nova] Creating event network-vif-plugged:18a89dec-a15f-424b-a75d-6f031e27d317 for instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb on n-h2-855650-5 Nov 02 12:31:37.940051 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-caf51170-25a1-4e13-8975-fcedcd1d5c0f req-3290e43e-0678-4a16-834c-7d093a95188e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212069 Nov 02 12:31:37.942788 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1323/2641] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:37.978484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:37.981014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:37.999423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.008320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.012373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.022322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.023871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.028415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.135206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.168027 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-939f976a-847c-4520-ad2d-f1a7780949b5 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6" status: 200 len: 1313 microversion: 2.1 time: 0.679535 Nov 02 12:31:38.170126 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1319/2642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:37 2022] GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:38.203009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:38.203354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:38.222261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.222879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.223449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.224326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.226543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.246707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.247783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:38.399469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:38.409741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.448473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.454946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.469772 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a77cb886-352f-4442-b72d-eb3016668b01 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.520164 Nov 02 12:31:38.471361 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1324/2643] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:37 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:38.517171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:38.518541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:38.574635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.579413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.581150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.584182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.589359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.590747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.094328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.135847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5ae1afe-66a2-4a4e-b63c-d045df1618dc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1537 microversion: 2.1 time: 0.941439 Nov 02 12:31:39.143052 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1320/2644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:38 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1537 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:39.160831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.162584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.176599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.178037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.178688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.180160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.181377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.183799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.261850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.307685 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40145909-8807-4d0a-8b65-fc67765fca6b tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1680 microversion: 2.1 time: 0.796564 Nov 02 12:31:39.317166 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1325/2645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:38 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1680 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:39.338650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e1761bc4-95a8-40d1-9c8a-9390a085c3d0 req-a88a0f71-c3b0-4331-a896-80ea146e7c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e355fe6-2194-43fc-bc6f-0f17973d4641", "name": "network-vif-deleted", "tag": "528b251f-9fd7-40d7-a288-c4ff066751dc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:39.374376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1761bc4-95a8-40d1-9c8a-9390a085c3d0 req-a88a0f71-c3b0-4331-a896-80ea146e7c06 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.376028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1761bc4-95a8-40d1-9c8a-9390a085c3d0 req-a88a0f71-c3b0-4331-a896-80ea146e7c06 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.383434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1761bc4-95a8-40d1-9c8a-9390a085c3d0 req-a88a0f71-c3b0-4331-a896-80ea146e7c06 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.477666 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e1761bc4-95a8-40d1-9c8a-9390a085c3d0 req-a88a0f71-c3b0-4331-a896-80ea146e7c06 service nova] Creating event network-vif-deleted:528b251f-9fd7-40d7-a288-c4ff066751dc for instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 on n-h2-855650-5 Nov 02 12:31:39.520612 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e1761bc4-95a8-40d1-9c8a-9390a085c3d0 req-a88a0f71-c3b0-4331-a896-80ea146e7c06 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200042 Nov 02 12:31:39.522801 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1326/2646] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:39.541776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.543200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: cf0cc60a-b436-4b6c-bf4c-6488ff5602b6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.560617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.562118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.564612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.566522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.568338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.569469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.617003 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] HTTP exception thrown: Instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 could not be found. Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Request method failure captured: Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 HTTP/1.1 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmLWaz4GBTpbL9ZnK_MbowIyY0xyTtkQYnElng8Zu8DzcC6zEiKjoeWud0eSejSjGNIggbmB26_2G9NyH7UEFc1WH9Qck8LRBBQvzY5PuuHOf7LgXu76zcSH5tyGEoKyVjYrNFPImAykbqRAzM61UqSabPL9fzrUa4zxb1lg8EXeob8 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 0696fbb6ed5c44ceb8e0c108232e8007 Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 could not be found. Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'cf0cc60a-b436-4b6c-bf4c-6488ff5602b6'} Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 could not be found. Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 could not be found. Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:39.620395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 could not be found. Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Returning 404 to user: Instance cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:39.627592 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4696269f-c703-4ad3-8ca1-427c6e95a301 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6" status: 404 len: 111 microversion: 2.1 time: 0.097500 Nov 02 12:31:39.629765 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1327/2647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/cf0cc60a-b436-4b6c-bf4c-6488ff5602b6 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:39.652344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.653845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.660155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.687286 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e7982c9-c364-474b-9e71-d9da548a81ec tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1312 microversion: 2.1 time: 0.541683 Nov 02 12:31:39.689259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=10 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:39.692215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.693125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.693945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.695322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.696734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.697552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.707922 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1321/2648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1312 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:39.730154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.731247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.772219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.773257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.773930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.775892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.776977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.778077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.854194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.854782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.855240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.855989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lazy-loading 'fault' on Instance uuid 4e355fe6-2194-43fc-bc6f-0f17973d4641 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:39.866192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.880512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.885895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.896161 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f34180af-680a-4b1e-9895-f2c0c594a80e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.262229 Nov 02 12:31:39.909499 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1328/2649] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:39.961108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696fbb6ed5c44ceb8e0c108232e8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f4fc2040844d88e9ae160ca83375a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.974688 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e3cce7dc-7043-421d-aba4-df538f679901 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 200 len: 1313 microversion: 2.1 time: 0.261485 Nov 02 12:31:39.976832 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1322/2650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:40.186841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:40.190674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:40.230211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.231991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.236640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.239482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.242198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.243865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.346256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:40.363229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:40.408383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.419006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.424300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.425662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.441261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.444536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.488180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:41.488008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:41.507324 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b09bec6c-0edb-4c65-9179-4b674222f9fc tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1542 microversion: 2.1 time: 1.329452 Nov 02 12:31:41.524736 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1329/2651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:40 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1542 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:41.545303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:41.546952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:41.580938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.582273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.585487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.587486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.591527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.605305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.615379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:41.658738 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a28b6d6f-bdaf-4b4d-a611-78d291ee53f3 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1680 microversion: 2.1 time: 1.319414 Nov 02 12:31:41.663225 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1323/2652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:40 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1680 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:41.702129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:41.703868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:41.731365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.733303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.734432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.742479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.744341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.745437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.056930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:42.069954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:42.070953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:42.080296 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bdb0f046-0a29-4dc8-905b-b87d06f7ade9 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.415044 Nov 02 12:31:42.081772 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1324/2653] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:41 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:42.090225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:42.091111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] [instance: 4e355fe6-2194-43fc-bc6f-0f17973d4641] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:42.100410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.101456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.102179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.103873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.106322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.107304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.129280 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] HTTP exception thrown: Instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 could not be found. Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Request method failure captured: Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 HTTP/1.1 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmLWaz4GBTpbL9ZnK_MbowIyY0xyTtkQYnElng8Zu8DzcC6zEiKjoeWud0eSejSjGNIggbmB26_2G9NyH7UEFc1WH9Qck8LRBBQvzY5PuuHOf7LgXu76zcSH5tyGEoKyVjYrNFPImAykbqRAzM61UqSabPL9fzrUa4zxb1lg8EXeob8 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_854f4fc2040844d88e9ae160ca83375a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 854f4fc2040844d88e9ae160ca83375a Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-632140759 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 0696fbb6ed5c44ceb8e0c108232e8007 Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListServersNegativeTestJSON-632140759-project Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 could not be found. Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '4e355fe6-2194-43fc-bc6f-0f17973d4641'} Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 could not be found. Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 could not be found. Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:42.131465 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:42.135700 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:42.135700 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:42.135700 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:42.135700 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:42.135700 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:42.135700 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:42.135700 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 could not be found. Nov 02 12:31:42.135700 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:31:42.139528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] Returning 404 to user: Instance 4e355fe6-2194-43fc-bc6f-0f17973d4641 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:42.141700 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6f87565-e3fc-4578-971a-e300436cd980 tempest-ListServersNegativeTestJSON-632140759 tempest-ListServersNegativeTestJSON-632140759-project] 10.222.0.45 "GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641" status: 404 len: 111 microversion: 2.1 time: 0.057959 Nov 02 12:31:42.146632 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1325/2654] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:42 2022] GET /compute/v2.1/servers/4e355fe6-2194-43fc-bc6f-0f17973d4641 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:42.372680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:42.396789 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b6712765-909f-4bf9-959c-95571dbadf49 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1462 microversion: 2.1 time: 0.869524 Nov 02 12:31:42.398885 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1330/2655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:41 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1462 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:42.560521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:42.560521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:42.572674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.573203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.573945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.574687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.575159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.575592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.557515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:43.579187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Searching by: {'deleted': False, 'project_id': '4ff947bbe1194320bd19414e6c877f64'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:43.595867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.596373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.596936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.597730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.598232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.598669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.678048 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e7ddc2a3-00ec-442b-a043-27332828cea3 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.252378 Nov 02 12:31:43.711419 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1326/2656] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:31:42 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:43.720970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:43.722212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:43.730272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.731179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.731892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.733012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.733728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.734482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.777271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.777995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.778562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.779144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lazy-loading 'fault' on Instance uuid 6d42b47d-df80-48cf-a3a2-416031e2a041 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:44.334882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:44.350341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3dd671a0-c00f-4407-99a9-bf9dc977c856 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1331 microversion: 2.1 time: 0.635410 Nov 02 12:31:44.373230 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1327/2657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:43 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1331 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:44.380254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b2e69f7a-8e42-4710-9e4c-f0d1051a3c0f req-9d92945a-5719-4796-a002-131ae4fd424d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d42b47d-df80-48cf-a3a2-416031e2a041", "name": "network-vif-deleted", "tag": "01dfabd4-1253-4651-b032-a93021f1cac6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:44.394982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b2e69f7a-8e42-4710-9e4c-f0d1051a3c0f req-9d92945a-5719-4796-a002-131ae4fd424d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.395815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b2e69f7a-8e42-4710-9e4c-f0d1051a3c0f req-9d92945a-5719-4796-a002-131ae4fd424d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.396469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b2e69f7a-8e42-4710-9e4c-f0d1051a3c0f req-9d92945a-5719-4796-a002-131ae4fd424d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.413955 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b2e69f7a-8e42-4710-9e4c-f0d1051a3c0f req-9d92945a-5719-4796-a002-131ae4fd424d service nova] Creating event network-vif-deleted:01dfabd4-1253-4651-b032-a93021f1cac6 for instance 6d42b47d-df80-48cf-a3a2-416031e2a041 on n-h1-855650-5 Nov 02 12:31:44.421815 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b2e69f7a-8e42-4710-9e4c-f0d1051a3c0f req-9d92945a-5719-4796-a002-131ae4fd424d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046590 Nov 02 12:31:44.423153 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1328/2658] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:44.431009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:44.432322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:44.441553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.442593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.443259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.444313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.445078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.445776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.527737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:44.543285 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bd27222b-8087-43ff-aae7-7629d7e198bf tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1542 microversion: 2.1 time: 1.995360 Nov 02 12:31:44.546796 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1331/2659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:42 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1542 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:44.574119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:44.600405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Searching by: {'deleted': False} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:44.620413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.625485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.626136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.627267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.627905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.629781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.678631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:44.700678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:44.702672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:44.725399 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f93888b-2714-4b3b-b7f5-77f1886fdb5c tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1447 microversion: 2.75 time: 0.300436 Nov 02 12:31:44.736374 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1329/2660] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:44 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1447 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:44.916659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:31:44.984457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:45.037098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.038242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.039115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.381280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:45.382752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:45.405213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.405708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.406243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.406841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.407361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.407738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.614938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.615792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.616665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.617430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lazy-loading 'fault' on Instance uuid 6d42b47d-df80-48cf-a3a2-416031e2a041 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:45.823233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b38bf7bb374b426bb140f534be4aa186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f524fd657674a6d983357a1ac57e683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:45.829808 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a829558b-de4e-4918-8e43-cb58dcc72dcc tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 200 len: 1331 microversion: 2.1 time: 0.454185 Nov 02 12:31:45.830482 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1330/2661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:45 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 1331 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:45.844163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:45.847848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:45.866893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.868477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.872018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.873603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.874425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.877165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.481399 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8a15511-b5a5-448a-9ea1-9069f7bd2a87 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12629 microversion: 2.1 time: 1.932728 Nov 02 12:31:46.483331 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1332/2662] 10.222.0.45 () {58 vars in 1171 bytes} [Wed Nov 2 12:31:44 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12629 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:31:46.499885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:46.510382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:46.516970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:46.526443 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c0bcdcd-f0df-4d41-ba4d-d12be1fa3f36 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1542 microversion: 2.1 time: 0.694644 Nov 02 12:31:46.541103 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1331/2663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:45 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1542 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:46.553246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.557549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.558717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.561917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.563328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.564773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.577252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:46.612560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Searching by: {'deleted': False, 'project_id': '4ff947bbe1194320bd19414e6c877f64'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:46.629631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.636851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.640573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.642720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.646269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.650050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.764985 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7b8b58ca-2e0f-45db-9983-a579d7f87042 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?tenant_id=d36baae805244e6983900973dd6dca37" status: 200 len: 15 microversion: 2.1 time: 0.219486 Nov 02 12:31:46.767527 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1332/2664] 10.222.0.45 () {58 vars in 1231 bytes} [Wed Nov 2 12:31:46 2022] GET /compute/v2.1/servers/detail?tenant_id=d36baae805244e6983900973dd6dca37 => generated 15 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:46.810936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:46.851302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Searching by: {'tenant_id': 'd36baae805244e6983900973dd6dca37', 'deleted': False} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:46.876186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.877079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.877883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.887729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.899485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.900407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.965414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:47.008608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:47.016792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:47.021001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:31:47.041930 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7344e9e6-657d-4556-a39a-3fa7d3cdbafe tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1465 microversion: 2.75 time: 0.552917 Nov 02 12:31:47.045327 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1333/2665] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:46 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1465 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:47.069089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:47.077282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:47.109832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.111107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.112189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.115259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.116419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.117956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.164045 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] HTTP exception thrown: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:31:47.167125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.168446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.169755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Request method failure captured: Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 HTTP/1.1 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmIvFvdzONzoGeDZsFKMmq-ZzdfdTYp5nCMB55rJH17ARcyn0VmL-8k9Ql4Zf1YEBEEpxD6gMwwAPKM9gqF0Yq9ACxjJ0merXIauwXAdQtdWa8KUxo-LcPszPjdHSmv8nuBpDRiTDaVHlUutOIgAsXqAI8mkyplcNbn7J0Ct1SiZ-SI Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5f524fd657674a6d983357a1ac57e683 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f524fd657674a6d983357a1ac57e683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5f524fd657674a6d983357a1ac57e683 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachSCSIVolumeTestJSON-1635138153-project Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b38bf7bb374b426bb140f534be4aa186 Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1635138153-project Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6d42b47d-df80-48cf-a3a2-416031e2a041'} Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:47.170011 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Returning 404 to user: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:47.178447 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e1597a8-9bbb-48b6-bd93-2160cc598d91 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 404 len: 111 microversion: 2.1 time: 0.125934 Nov 02 12:31:47.183695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1334/2666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:47 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:47.203177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36d94825-dc8e-4ed2-a6c5-955f9536417d tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '.version_select at 0x7f228e76edc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:47.256771 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36d94825-dc8e-4ed2-a6c5-955f9536417d tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410186928" status: 202 len: 0 microversion: 2.1 time: 0.070728 Nov 02 12:31:47.264954 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1335/2667] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:31:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410186928 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:47.593890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:47.596697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:47.635460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.642242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.649722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.659684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.660746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.662393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.065077 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e50651ff-cd31-4277-ab3e-39e2e302e6ee tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d36baae805244e6983900973dd6dca37" status: 200 len: 4825 microversion: 2.1 time: 1.262679 Nov 02 12:31:48.067015 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1333/2668] 10.222.0.45 () {58 vars in 1257 bytes} [Wed Nov 2 12:31:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d36baae805244e6983900973dd6dca37 => generated 4825 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:48.095734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:48.104840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Searching by: {'tenant_id': '4ff947bbe1194320bd19414e6c877f64', 'deleted': False} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:48.111220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.112187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.112868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.114087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.114746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.115317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.162717 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b18ee901-6efa-4ff9-a00d-cae3b227386f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4ff947bbe1194320bd19414e6c877f64" status: 200 len: 15 microversion: 2.1 time: 0.070584 Nov 02 12:31:48.164072 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1334/2669] 10.222.0.45 () {58 vars in 1257 bytes} [Wed Nov 2 12:31:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4ff947bbe1194320bd19414e6c877f64 => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:48.178067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:48.181260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:48.197143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.200655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.201442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.202536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.203657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.204409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.293220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.323299 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae883fd5-6f0e-46c9-8e68-5c10f52404b1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1542 microversion: 2.1 time: 0.740732 Nov 02 12:31:48.325597 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1336/2670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:47 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1542 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:48.341799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14a8146d-528d-4795-9a74-1a2fd218398b tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:48.373434 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14a8146d-528d-4795-9a74-1a2fd218398b tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.045913 Nov 02 12:31:48.375441 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1337/2671] 10.222.0.45 () {58 vars in 1189 bytes} [Wed Nov 2 12:31:48 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:48.399697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.422288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.424325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:48.426588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.428053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:48.440945 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9f36f7b1-dfb2-4e30-b3f2-8f3733185e6b tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1453 microversion: 2.75 time: 0.272402 Nov 02 12:31:48.454048 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1335/2672] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:48 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1453 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:48.454375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.454375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.466776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.466776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.466776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.467367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.691338 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6f91657-c972-4768-bfe1-30d1ba998b1f tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action" status: 202 len: 0 microversion: 2.1 time: 0.274457 Nov 02 12:31:48.692326 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1338/2673] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:31:48 2022] POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:31:48.703244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:48.708397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.709138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'd36baae805244e6983900973dd6dca37'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:48.716827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.717328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.717776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.718576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.719041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.719617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.897512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:31:49.157559 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c602eac3-e9b4-4d63-be41-80ac558d7871 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.458170 Nov 02 12:31:49.183241 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1336/2674] 10.222.0.45 () {58 vars in 1150 bytes} [Wed Nov 2 12:31:48 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:49.189035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:49.191710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:49.207860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.214035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.214555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.215345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.215831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.216278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.357723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:49.367532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:49.401360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.406180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.407765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.411925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.413623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.415961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.434326 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3bb8de42-9a54-44ce-a70f-9ba0a4daeea4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action" status: 202 len: 0 microversion: 2.1 time: 0.249265 Nov 02 12:31:49.439004 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1339/2675] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:31:49 2022] POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:49.464033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:49.471694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:49.497027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.498506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.499641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.501258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.502155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.503063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.165672 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2c5f8059-9a03-4686-a7ce-c55c0e20efef tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1614 microversion: 2.1 time: 0.721655 Nov 02 12:31:50.169199 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1340/2676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:49 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1614 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:50.180263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:50.183068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:50.187233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.202692 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05f7112f-ecd8-4042-adae-c47bcb72b005 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1542 microversion: 2.1 time: 0.852520 Nov 02 12:31:50.204687 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1337/2677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:49 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1542 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:50.207834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.208758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.209575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.213061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.214336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.215516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.224734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:50.230441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:50.251538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.252303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.256009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.257360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.260223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.266152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.528967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.615683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.631147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.683996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7a587922-67c6-4843-9260-2fdcfc2aaee0 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1453 microversion: 2.75 time: 0.493152 Nov 02 12:31:50.687697 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1341/2678] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:50 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1453 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:50.837075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e0e39e22-aa36-4514-9d0d-33922218c692 req-0fe8fcc2-0932-49a2-a8f5-835d63ab70aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "name": "network-vif-unplugged", "status": "completed", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:50.868759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e0e39e22-aa36-4514-9d0d-33922218c692 req-0fe8fcc2-0932-49a2-a8f5-835d63ab70aa service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.870260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e0e39e22-aa36-4514-9d0d-33922218c692 req-0fe8fcc2-0932-49a2-a8f5-835d63ab70aa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.871392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e0e39e22-aa36-4514-9d0d-33922218c692 req-0fe8fcc2-0932-49a2-a8f5-835d63ab70aa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.918257 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e0e39e22-aa36-4514-9d0d-33922218c692 req-0fe8fcc2-0932-49a2-a8f5-835d63ab70aa service nova] Creating event network-vif-unplugged:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h2-855650-5 Nov 02 12:31:50.934222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-e0e39e22-aa36-4514-9d0d-33922218c692 req-0fe8fcc2-0932-49a2-a8f5-835d63ab70aa service nova] Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:31:50.950323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e0e39e22-aa36-4514-9d0d-33922218c692 req-0fe8fcc2-0932-49a2-a8f5-835d63ab70aa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135701 Nov 02 12:31:50.951398 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1342/2679] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:51.104740 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57d93fb3-3f71-4840-9140-01c6bc77faa4 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1614 microversion: 2.1 time: 0.889462 Nov 02 12:31:51.127172 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1338/2680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:50 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1614 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:51.157834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:51.171005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Searching by: {'host': 'n-h2-855650-5', 'deleted': False} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:51.187629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.188843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.189879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.191667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.192821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.193826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.271486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:51.275374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:51.304899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.309273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.310527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.317261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.320134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.323133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.550705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:31:51.713912 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d7e3b541-e378-4e95-ae47-f88b50624199 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers?host=n-h2-855650-5&all_tenants=1" status: 200 len: 1962 microversion: 2.1 time: 0.565408 Nov 02 12:31:51.733884 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1343/2681] 10.222.0.45 () {58 vars in 1190 bytes} [Wed Nov 2 12:31:51 2022] GET /compute/v2.1/servers?host=n-h2-855650-5&all_tenants=1 => generated 1962 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:51.744773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:51.765179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:51.792823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.802022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.804340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.810692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.811976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.812803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.197034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.235771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.244773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.269854 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5d2a662e-9667-404e-9cca-8b9ca2618033 tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1453 microversion: 2.75 time: 0.533940 Nov 02 12:31:52.274380 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1344/2682] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:51 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1453 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:52.295711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:52.336853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.347119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:31:52.388039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.389696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.391810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.396258 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e7d703a4-c33d-40e4-a2ac-f7c20afa7d5b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1541 microversion: 2.1 time: 1.133868 Nov 02 12:31:52.410304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.413110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.413409 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1339/2683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:51 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1541 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:52.415969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.501322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec283e00-a003-4e3d-a8e8-62bb5764fe54 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.221102 Nov 02 12:31:52.510449 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1345/2684] 10.222.0.45 () {58 vars in 1196 bytes} [Wed Nov 2 12:31:52 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:52.540295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:52.551652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:52.581327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.582557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.584225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.588248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.593276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.594497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.920102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:52.975745 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a866f1cc-3194-43e8-9cb3-742166688719 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action" status: 202 len: 0 microversion: 2.1 time: 0.450260 Nov 02 12:31:52.976775 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1340/2685] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:31:52 2022] POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:52.995065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:53.001726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:53.012115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.013019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.013690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.015309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.016088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.017072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.154758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=97,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:53.160202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:53.161298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:53.162878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:53.163693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:53.165109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:53.284188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:53.305182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:53.306420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:53.317334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.318637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.320215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.320755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.323119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.326698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.327275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.328004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.329062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.330582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.331610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.332377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.450073 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-026809f3-fbe3-4ce3-a7e1-062f7f85f069 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action" status: 202 len: 1067 microversion: 2.1 time: 0.463809 Nov 02 12:31:53.465689 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1346/2686] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:31:52 2022] POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action => generated 1067 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:31:53.478366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:53.487126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:53.504444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.506307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.507614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.510076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.512092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.514257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.601114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:54.425701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:54.468185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:54.472350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:54.494518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:54.503292 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-219b4081-71c6-4370-b224-5fac054f657f tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1438 microversion: 2.75 time: 1.201806 Nov 02 12:31:54.520439 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1341/2687] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:53 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1438 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:54.566552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:54.568089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:54.607855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.609209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.610357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.613063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.614400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.615563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:55.020944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:55.728937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:55.748696 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e232def-354d-4d33-b759-2cc068e9766c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1541 microversion: 2.1 time: 2.274920 Nov 02 12:31:55.753705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1347/2688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:53 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1541 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:55.955848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:55.994035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-80f0691b-7577-44ab-acf1-1f4f886117b1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1471 microversion: 2.1 time: 1.470461 Nov 02 12:31:55.995390 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1342/2689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:54 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1471 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:56.324426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:56.330281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:56.349717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.354036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.354908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.355994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.369079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.370151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.553942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:56.554534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:56.555665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:56.556157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:56.556644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:56.699920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:56.715238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.716402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.717063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.719974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.720685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.721291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.825280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:56.834567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:56.917666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.920741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.925754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.929341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.934998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.936101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:57.144711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:57.432865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:57.548189 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a91e361e-2952-44a6-8efc-34f87370695e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce/action" status: 202 len: 1942 microversion: 2.75 time: 1.790761 Nov 02 12:31:57.563953 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1348/2690] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:31:55 2022] POST /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce/action => generated 1942 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:31:57.633893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:57.635191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:57.718432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:57.735094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:57.744195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:57.753005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:57.756714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:57.759711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.107113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:58.140726 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bd99ea79-d69d-49c6-8154-63eabbf09c7b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1541 microversion: 2.1 time: 1.332344 Nov 02 12:31:58.172736 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1343/2691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:56 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1541 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:58.197736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-20d95e9b-5801-42e0-835b-07cc8ae820a7 req-55f02ca3-1373-44b6-88d5-09c247e204b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:58.249121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-20d95e9b-5801-42e0-835b-07cc8ae820a7 req-55f02ca3-1373-44b6-88d5-09c247e204b9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.249958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-20d95e9b-5801-42e0-835b-07cc8ae820a7 req-55f02ca3-1373-44b6-88d5-09c247e204b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.250734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-20d95e9b-5801-42e0-835b-07cc8ae820a7 req-55f02ca3-1373-44b6-88d5-09c247e204b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.281327 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-20d95e9b-5801-42e0-835b-07cc8ae820a7 req-55f02ca3-1373-44b6-88d5-09c247e204b9 service nova] Creating event network-changed:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h2-855650-5 Nov 02 12:31:58.295696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:58.297478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-20d95e9b-5801-42e0-835b-07cc8ae820a7 req-55f02ca3-1373-44b6-88d5-09c247e204b9 service nova] Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:31:58.308415 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-50911f9c-ca50-445a-8adf-868e4a2500d7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1471 microversion: 2.1 time: 0.721992 Nov 02 12:31:58.329772 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1349/2692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:57 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1471 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:58.336540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:58.340278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:58.357750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.361205 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-20d95e9b-5801-42e0-835b-07cc8ae820a7 req-55f02ca3-1373-44b6-88d5-09c247e204b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181054 Nov 02 12:31:58.362308 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1344/2693] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:58.362793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.363486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.364623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.365326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.366606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.687121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:58.735197 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4861bf7e-55a5-40f4-9a62-824225feebda tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.402964 Nov 02 12:31:58.737082 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1350/2694] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:58 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:59.192131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:59.208491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:59.209253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:59.231917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.233237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.235603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.241402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.247513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.248534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.343241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:59.344480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:59.367365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.376279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.378120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.380445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.384330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.388310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.119476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:00.137207 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e42f93e-456f-484b-bede-b5016d595f0b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1541 microversion: 2.1 time: 0.948857 Nov 02 12:32:00.154552 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1345/2695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:59 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1541 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:00.171504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:00.173586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:00.180207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:00.204716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fbf1b261-870e-41d0-bf79-f867f7b08259 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1471 microversion: 2.1 time: 0.870485 Nov 02 12:32:00.205635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:00.208649 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1351/2696] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:59 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1471 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:00.222603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:00.223606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.226039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:00.230948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:00.231577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.686325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:00.742889 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f87414e-4d8b-4718-ac9a-39f5bf0d6e0f tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.577576 Nov 02 12:32:00.742889 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1346/2697] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:00 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:01.204048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:01.216215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:01.225122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:01.226703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:01.257204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.260652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.264389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.265414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.266109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.266787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.270367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.273005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.275094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.275566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.286445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.287277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.380228 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] HTTP exception thrown: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Request method failure captured: Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 HTTP/1.1 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmIvFvdzONzoGeDZsFKMmq-ZzdfdTYp5nCMB55rJH17ARcyn0VmL-8k9Ql4Zf1YEBEEpxD6gMwwAPKM9gqF0Yq9ACxjJ0merXIauwXAdQtdWa8KUxo-LcPszPjdHSmv8nuBpDRiTDaVHlUutOIgAsXqAI8mkyplcNbn7J0Ct1SiZ-SI Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5f524fd657674a6d983357a1ac57e683 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f524fd657674a6d983357a1ac57e683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5f524fd657674a6d983357a1ac57e683 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachSCSIVolumeTestJSON-1635138153-project Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b38bf7bb374b426bb140f534be4aa186 Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1635138153-project Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '6d42b47d-df80-48cf-a3a2-416031e2a041'} Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:32:01.389923 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Returning 404 to user: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1472df27-5d65-415c-8d52-89629f091ed1 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 404 len: 111 microversion: 2.1 time: 0.174979 Nov 02 12:32:01.396707 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1347/2698] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:32:01 2022] DELETE /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:32:01.419374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:01.426976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:01.441190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.442174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.442802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.443712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.444355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.444964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.802980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:01.807543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:01.830921 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f774519c-2d09-4615-bd29-259f430783be tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1471 microversion: 2.1 time: 0.415154 Nov 02 12:32:01.832550 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1348/2699] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:01 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1471 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:01.842721 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d55b418e-3bde-496c-95aa-c60e90175669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1473 microversion: 2.1 time: 0.674356 Nov 02 12:32:01.844144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:01.845781 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1352/2700] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:01 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1473 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:01.854799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:01.857397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:01.859851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] [instance: 6d42b47d-df80-48cf-a3a2-416031e2a041] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:01.882482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.885255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.887531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.888998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.890575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.891484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.892091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.893105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.893883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.895292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.895841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.897609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.954256 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] HTTP exception thrown: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Request method failure captured: Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 HTTP/1.1 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmIvFvdzONzoGeDZsFKMmq-ZzdfdTYp5nCMB55rJH17ARcyn0VmL-8k9Ql4Zf1YEBEEpxD6gMwwAPKM9gqF0Yq9ACxjJ0merXIauwXAdQtdWa8KUxo-LcPszPjdHSmv8nuBpDRiTDaVHlUutOIgAsXqAI8mkyplcNbn7J0Ct1SiZ-SI Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5f524fd657674a6d983357a1ac57e683 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f524fd657674a6d983357a1ac57e683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f524fd657674a6d983357a1ac57e683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5f524fd657674a6d983357a1ac57e683 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1635138153 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachSCSIVolumeTestJSON-1635138153-project Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b38bf7bb374b426bb140f534be4aa186 Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1635138153-project Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '6d42b47d-df80-48cf-a3a2-416031e2a041'} Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:01.961065 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.968189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:01.968189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:01.968189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:01.968189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:32:01.968189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:32:01.968189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. Nov 02 12:32:01.968189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:01.972823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] Returning 404 to user: Instance 6d42b47d-df80-48cf-a3a2-416031e2a041 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:32:01.976994 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0cd7df91-e95d-43dc-9e7c-deddb6510e34 tempest-AttachSCSIVolumeTestJSON-1635138153 tempest-AttachSCSIVolumeTestJSON-1635138153-project] 10.222.0.45 "GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041" status: 404 len: 111 microversion: 2.1 time: 0.142201 Nov 02 12:32:01.979785 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1349/2701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:01 2022] GET /compute/v2.1/servers/6d42b47d-df80-48cf-a3a2-416031e2a041 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:32:02.026056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:02.094174 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c322762e-26ad-460f-aa37-afb4e2466510 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.240330 Nov 02 12:32:02.097666 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1353/2702] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:01 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:02.872709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:02.873400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:02.873989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:02.874439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:02.892003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.893169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.893480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:02.894204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.895936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.896803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.897657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.902792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.903505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.904116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.904966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.905845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.906581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.296339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:03.304782 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b57a446-40af-4382-becc-d4aa77e648ba tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1473 microversion: 2.1 time: 0.436809 Nov 02 12:32:03.330048 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1350/2703] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:02 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1473 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:03.334466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:03.335379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:03.342338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.350916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.351669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.353130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.353771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.354952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.739610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:03.750838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:03.762976 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4289dfd-807b-4444-a38a-404d4dd20a71 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1471 microversion: 2.1 time: 0.894642 Nov 02 12:32:03.766781 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1354/2704] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:02 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1471 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:03.821504 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cec60bfc-0f5d-4d41-bf0b-956b8d847c6e tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.500740 Nov 02 12:32:03.835821 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1351/2705] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:03 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:04.370806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:04.372250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:04.381875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:04.382806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:04.384295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:04.385999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:04.386700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:04.387565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:04.807837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:04.808469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:04.818159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:04.818672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:04.819125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:04.819871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:04.820328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:04.828411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:04.928558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:04.963931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40542684-f323-4859-bd5e-430f95767e44 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1473 microversion: 2.1 time: 0.597681 Nov 02 12:32:04.995588 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1355/2706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:04 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1473 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:05.010651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:05.012287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:05.024703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.026102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.027675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.028972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.030148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.031383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.250695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:05.280919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:05.290742 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eebe18ca-6e4d-493c-9662-2b040549bf7a tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.292704 Nov 02 12:32:05.293510 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1356/2707] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:04 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:05.305879 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-701c9ffd-0ee1-409c-9f92-7bd0dbf9ccb5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1471 microversion: 2.1 time: 0.501779 Nov 02 12:32:05.319394 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1352/2708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:04 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1471 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:06.017379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:06.018510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:06.025931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.026749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.027418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.028167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.029024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.029024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.410074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:06.411113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:06.432516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.436150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.438402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.439432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.442102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.442988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.912194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:06.984599 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c01bc87c-3094-4804-8da8-7bce27713e74 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.659796 Nov 02 12:32:06.998021 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1353/2709] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:06 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:06.999623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:07.002442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:07.011880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.012465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.013113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.014399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.014903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.015410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.399610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:07.454822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0486f0f0-5e5c-4293-9d9b-0c79337c3e6d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1470 microversion: 2.1 time: 1.427156 Nov 02 12:32:07.458125 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1357/2710] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:06 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1470 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:07.504658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:07.505985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:07.517847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.527122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.528158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.529387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.530173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.530896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.643354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.643354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.643839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.644730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.645295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.646063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.732073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:32:07.760795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for user a5a3010848f74c94bb32b506e184d275 and project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:32:07.979129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:08.111483 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-908a7dd9-1f04-49d3-a756-e323edd2d947 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6/action" status: 202 len: 0 microversion: 2.1 time: 0.610702 Nov 02 12:32:08.116440 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1358/2711] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:32:07 2022] POST /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:32:08.135854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:08.136992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:08.144380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.155055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.155795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.156991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.157858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.158497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.398332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:08.443824 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ca70c1e-cc3a-4925-b3e6-8023480d5e2d tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.324788 Nov 02 12:32:08.446321 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1359/2712] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:08 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:08.465308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:08.466895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:08.478222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:08.480816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.482441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.483487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.485026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.486152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.487177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.492075 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ffb8a7d-d5cb-4ab0-b8c6-9567bf54a79c tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1477 microversion: 2.1 time: 1.499870 Nov 02 12:32:08.506688 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1354/2713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:06 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1477 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:09.158436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-288aa23d-6c74-4027-b88d-f7037c575b22 req-704f8e63-10ee-4949-a3f9-1e75aa4b4c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "name": "network-vif-plugged", "status": "completed", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:09.174411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-288aa23d-6c74-4027-b88d-f7037c575b22 req-704f8e63-10ee-4949-a3f9-1e75aa4b4c23 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.179241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-288aa23d-6c74-4027-b88d-f7037c575b22 req-704f8e63-10ee-4949-a3f9-1e75aa4b4c23 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.188411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-288aa23d-6c74-4027-b88d-f7037c575b22 req-704f8e63-10ee-4949-a3f9-1e75aa4b4c23 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.203511 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-288aa23d-6c74-4027-b88d-f7037c575b22 req-704f8e63-10ee-4949-a3f9-1e75aa4b4c23 service nova] Creating event network-vif-plugged:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h2-855650-5 Nov 02 12:32:09.212082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-288aa23d-6c74-4027-b88d-f7037c575b22 req-704f8e63-10ee-4949-a3f9-1e75aa4b4c23 service nova] Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:32:09.230986 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-288aa23d-6c74-4027-b88d-f7037c575b22 req-704f8e63-10ee-4949-a3f9-1e75aa4b4c23 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076269 Nov 02 12:32:09.231953 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1355/2714] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:32:09.274515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:09.299735 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fc3f18a4-fc20-4147-a40b-9ac708f49939 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1469 microversion: 2.1 time: 0.845463 Nov 02 12:32:09.301354 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1360/2715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:08 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1469 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:09.500484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:09.523086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:09.553384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:09.557012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:09.572530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.578963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.580819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.596570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.598635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.603418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.611636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.618453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.628194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.634556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.643350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.644674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:10.296155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:10.392903 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09cf0493-4d1b-4f22-9b44-f78b9bc6b9a0 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.918954 Nov 02 12:32:10.393827 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1356/2716] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:09 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:32:10.406413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:10.415720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:10.427596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:10.431292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:10.434684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:10.436296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:10.442212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:10.442507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:10.489765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:12.526827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:12.565111 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24d3e169-db3f-44c7-af86-633338163cf5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1477 microversion: 2.1 time: 3.018984 Nov 02 12:32:12.591165 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1361/2717] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:09 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1477 bytes in 3047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:12.645788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:12.652293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:12.680289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:12.685843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:12.687698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:12.689875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:12.694558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:12.703110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.097628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:13.171302 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-50831488-f6fe-4fb5-b3d3-6bd4c7c89887 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.563268 Nov 02 12:32:13.173869 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1362/2718] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:12 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:13.200817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d9c728ac-a861-4632-8328-d41a6c6494b0 req-628e4636-0e05-4bad-9c31-a53ab2334978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0bd24-8c20-4b97-a4ae-2075c823179e", "name": "network-vif-unplugged", "status": "completed", "tag": "6a26b325-c41a-4ba3-9291-36c10956f17c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:13.232618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9c728ac-a861-4632-8328-d41a6c6494b0 req-628e4636-0e05-4bad-9c31-a53ab2334978 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:13.234185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9c728ac-a861-4632-8328-d41a6c6494b0 req-628e4636-0e05-4bad-9c31-a53ab2334978 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:13.235307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9c728ac-a861-4632-8328-d41a6c6494b0 req-628e4636-0e05-4bad-9c31-a53ab2334978 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.305595 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d9c728ac-a861-4632-8328-d41a6c6494b0 req-628e4636-0e05-4bad-9c31-a53ab2334978 service nova] Creating event network-vif-unplugged:6a26b325-c41a-4ba3-9291-36c10956f17c for instance 05f0bd24-8c20-4b97-a4ae-2075c823179e on n-h2-855650-5 Nov 02 12:32:13.343834 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d9c728ac-a861-4632-8328-d41a6c6494b0 req-628e4636-0e05-4bad-9c31-a53ab2334978 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163185 Nov 02 12:32:13.353900 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1363/2719] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:13.618850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:13.631704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:13.660214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:13.670194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:13.671783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.673427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:13.678298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:13.679565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.954090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:13.991458 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5858c86-ba28-4a65-8ef0-49558c893669 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1469 microversion: 2.1 time: 3.592523 Nov 02 12:32:14.024179 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1357/2720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:10 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1469 bytes in 3629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:14.238258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:14.239431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:14.276229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:14.280674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:14.283905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:14.291348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:14.292621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:14.293640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:14.939811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:14.985950 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1cb5364f-102b-485d-bb9b-63e248fe8458 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1929 microversion: 2.75 time: 0.755354 Nov 02 12:32:15.002800 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1358/2721] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:14 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1929 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:15.053446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:15.055726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:15.068824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:15.070860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:15.072041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:15.073763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:15.075082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:15.076222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:15.134459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:15.159502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86b21ea4-2e31-4e12-a9e2-e1f96ac25e84 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1477 microversion: 2.1 time: 1.549689 Nov 02 12:32:15.166656 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1364/2722] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:13 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1477 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:16.074806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:16.075534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:16.106157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:16.106682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:16.107502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:16.110739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:16.111243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:16.114017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:17.110611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:17.149691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:17.171122 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fea9c5a6-220d-49d7-88ed-02432520a3df tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1469 microversion: 2.1 time: 2.125023 Nov 02 12:32:17.176912 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1359/2723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:15 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1469 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:17.244728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:17.245894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:17.275996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:17.277136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:17.278153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:17.288625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:17.290512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:17.291429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:17.332167 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-183c65c5-f545-447d-a112-3c74ef27a746 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1935 microversion: 2.75 time: 1.295972 Nov 02 12:32:17.336298 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1365/2724] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:16 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1935 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:18.226013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:18.227070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:18.229505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:18.250432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:18.251401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:18.252213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:18.253621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:18.257572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:18.258899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:18.572303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:18.594217 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f5d49ed5-3679-4ea3-98ba-ad8c8a7c9997 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1477 microversion: 2.1 time: 1.401219 Nov 02 12:32:18.596631 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1360/2725] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:17 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1477 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:18.613380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:18.615790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:18.631447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:18.633314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:18.635454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:18.641560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:18.644637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:18.646166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:18.994248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:19.029473 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0a3ee850-71aa-41e9-acc0-30a32e114fbb tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1469 microversion: 2.1 time: 0.805335 Nov 02 12:32:19.031564 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1366/2726] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:18 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1469 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:19.088671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:19.133673 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b42a846-87c1-4746-a083-bf496a1b6e66 tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1935 microversion: 2.75 time: 0.533899 Nov 02 12:32:19.137104 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1361/2727] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:18 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1935 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:19.631391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:19.635459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:19.665221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:19.666359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:19.667388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:19.671542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:19.677678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:19.678810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:20.077358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:20.078514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:20.113753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:20.118949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:20.122330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:20.126431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:20.128849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:20.132468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.327918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:21.345566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3abba09-4139-443c-b68c-678b480a7afe tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1477 microversion: 2.1 time: 1.720887 Nov 02 12:32:21.347495 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1367/2728] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:19 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1477 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:21.355577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:21.357430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:21.360154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:21.376106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.383115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:21.386558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.389095 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09c11ec2-4ef0-4d12-ae56-253cd4e40007 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1469 microversion: 2.1 time: 1.319406 Nov 02 12:32:21.389276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.390100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:21.393249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.395175 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1362/2729] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:20 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1469 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:21.416633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3b06c20a-f0c8-438a-a44a-37b955e7dc55 req-398befc3-4291-4f4b-bfa7-c522f63d0b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0bd24-8c20-4b97-a4ae-2075c823179e", "name": "network-vif-plugged", "status": "completed", "tag": "6a26b325-c41a-4ba3-9291-36c10956f17c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:21.440872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3b06c20a-f0c8-438a-a44a-37b955e7dc55 req-398befc3-4291-4f4b-bfa7-c522f63d0b3c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.441642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3b06c20a-f0c8-438a-a44a-37b955e7dc55 req-398befc3-4291-4f4b-bfa7-c522f63d0b3c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:21.442291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3b06c20a-f0c8-438a-a44a-37b955e7dc55 req-398befc3-4291-4f4b-bfa7-c522f63d0b3c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.465585 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3b06c20a-f0c8-438a-a44a-37b955e7dc55 req-398befc3-4291-4f4b-bfa7-c522f63d0b3c service nova] Creating event network-vif-plugged:6a26b325-c41a-4ba3-9291-36c10956f17c for instance 05f0bd24-8c20-4b97-a4ae-2075c823179e on n-h2-855650-5 Nov 02 12:32:21.482395 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3b06c20a-f0c8-438a-a44a-37b955e7dc55 req-398befc3-4291-4f4b-bfa7-c522f63d0b3c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085337 Nov 02 12:32:21.488867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1363/2730] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:21.652390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] Lazy-loading 'services' on Instance uuid d0704c32-834f-4595-b9da-c1b674dc8fce {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:21.718214 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bec4384b-5cbd-4b50-bfc4-b7690c961ffb tempest-ServersAdmin275Test-53884803 tempest-ServersAdmin275Test-53884803-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1920 microversion: 2.75 time: 0.369130 Nov 02 12:32:21.719527 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1368/2731] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:21 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1920 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:21.783991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:21.785867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:21.816104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.822206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:21.824880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.827356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.831446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:21.834618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.931164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:32:22.174562 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-055b6c45-d102-47e5-974b-5fee04f8692d tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 204 len: 0 microversion: 2.75 time: 0.389653 Nov 02 12:32:22.182113 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1364/2732] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:32:21 2022] DELETE /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:32:22.215460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:22.220057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:22.266730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:22.268153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:22.287499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:22.291778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:22.298816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:22.300143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:22.648863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b3f9e39f-f6c4-4254-af72-857386f5d1f7 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Action: 'create', calling method: .version_select at 0x7f228f015e50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:22.724682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b3f9e39f-f6c4-4254-af72-857386f5d1f7 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Getting quotas for project 49ed88643494464ebf3ceb4906486752. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:32:22.758462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b3f9e39f-f6c4-4254-af72-857386f5d1f7 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Getting quotas for user b0f6ae499f5e4fc796a7db037335acc7 and project 49ed88643494464ebf3ceb4906486752. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:32:22.905328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b3f9e39f-f6c4-4254-af72-857386f5d1f7 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Getting quotas for project 49ed88643494464ebf3ceb4906486752. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:32:22.942842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b3f9e39f-f6c4-4254-af72-857386f5d1f7 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Getting quotas for user b0f6ae499f5e4fc796a7db037335acc7 and project 49ed88643494464ebf3ceb4906486752. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:32:23.017061 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b3f9e39f-f6c4-4254-af72-857386f5d1f7 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.697419 Nov 02 12:32:23.018050 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1365/2733] 10.222.0.45 () {62 vars in 1214 bytes} [Wed Nov 2 12:32:22 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:32:23.041856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:23.043094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:23.064920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:23.065766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:23.066577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:23.078182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:23.079290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:23.080064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:23.547345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:23.581847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:23.621665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:23.652193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:23.664305 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c1d5320c-967a-467b-ae10-9e48b61d06aa tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1444 microversion: 2.75 time: 1.479334 Nov 02 12:32:23.666399 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1369/2734] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:22 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1444 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:23.698790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:23.700651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:23.714845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:23.716289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:23.717625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:23.721071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:23.736392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:23.737217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:24.355948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:24.371631 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-633c9d6a-1f5a-42a0-a203-2e0a45fb8985 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1477 microversion: 2.1 time: 1.350843 Nov 02 12:32:24.373713 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1366/2735] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:23 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1477 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:24.385504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3bad4ca6-69e9-4b55-9c50-c09bf6c09c61 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:24.407949 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3bad4ca6-69e9-4b55-9c50-c09bf6c09c61 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.031729 Nov 02 12:32:24.408932 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1367/2736] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Nov 2 12:32:24 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:32:24.418227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-175324f3-3fc8-477f-8c7d-bda1321e182f req-8d46399c-13dc-4a34-b501-8300e5f42e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "name": "network-vif-unplugged", "status": "completed", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:24.432002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-175324f3-3fc8-477f-8c7d-bda1321e182f req-8d46399c-13dc-4a34-b501-8300e5f42e76 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:24.432821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-175324f3-3fc8-477f-8c7d-bda1321e182f req-8d46399c-13dc-4a34-b501-8300e5f42e76 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:24.433452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-175324f3-3fc8-477f-8c7d-bda1321e182f req-8d46399c-13dc-4a34-b501-8300e5f42e76 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:24.450961 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-175324f3-3fc8-477f-8c7d-bda1321e182f req-8d46399c-13dc-4a34-b501-8300e5f42e76 service nova] Creating event network-vif-unplugged:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h1-855650-5 Nov 02 12:32:24.459862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-175324f3-3fc8-477f-8c7d-bda1321e182f req-8d46399c-13dc-4a34-b501-8300e5f42e76 service nova] Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:32:24.478115 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-175324f3-3fc8-477f-8c7d-bda1321e182f req-8d46399c-13dc-4a34-b501-8300e5f42e76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066163 Nov 02 12:32:24.479594 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1368/2737] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:24.489256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-868af67e-0f0e-4a88-889f-effa394dd69e tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:24.496616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:24.517669 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-868af67e-0f0e-4a88-889f-effa394dd69e tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/90360cd8-7177-4abf-9c99-ce619a3636a1" status: 200 len: 235 microversion: 2.64 time: 0.035503 Nov 02 12:32:24.519724 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1369/2738] 10.222.0.45 () {60 vars in 1304 bytes} [Wed Nov 2 12:32:24 2022] GET /compute/v2.1/os-server-groups/90360cd8-7177-4abf-9c99-ce619a3636a1 => generated 235 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:32:24.533378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-130ac939-1148-403c-9166-1ac175ca4c9e tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:24.605244 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-130ac939-1148-403c-9166-1ac175ca4c9e tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/90360cd8-7177-4abf-9c99-ce619a3636a1" status: 204 len: 0 microversion: 2.64 time: 0.077146 Nov 02 12:32:24.606891 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1370/2739] 10.222.0.45 () {60 vars in 1307 bytes} [Wed Nov 2 12:32:24 2022] DELETE /compute/v2.1/os-server-groups/90360cd8-7177-4abf-9c99-ce619a3636a1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 12:32:24.625942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-927e764e-82e7-4b8a-932b-da142d8ea508 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:24.637766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-927e764e-82e7-4b8a-932b-da142d8ea508 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] HTTP exception thrown: Instance group 90360cd8-7177-4abf-9c99-ce619a3636a1 could not be found. Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-927e764e-82e7-4b8a-932b-da142d8ea508 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Request method failure captured: Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-server-groups/90360cd8-7177-4abf-9c99-ce619a3636a1 HTTP/1.1 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmNVB_BPlC5PZ4ha0RG5P6INHdkU3a4obaEF_ANaxNZT2gqY-HREpEk4YWaO1TYfzeu_m1MtMXr_yNP373mKn3MydsPTENkELKoOdVSNlPC7wnm0eIxyZ_B8Yy0LhJbf7FKIcB3c0-RMpkGWvdsc536_SdTH_RUbmo0g7ciAeArtw9M Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.64 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 49ed88643494464ebf3ceb4906486752 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerGroup264TestJSON-64695460 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/49ed88643494464ebf3ceb4906486752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/49ed88643494464ebf3ceb4906486752"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/49ed88643494464ebf3ceb4906486752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_49ed88643494464ebf3ceb4906486752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerGroup264TestJSON-64695460 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 49ed88643494464ebf3ceb4906486752 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerGroup264TestJSON-64695460 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerGroup264TestJSON-64695460-project Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b0f6ae499f5e4fc796a7db037335acc7 Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerGroup264TestJSON-64695460-project Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance group 90360cd8-7177-4abf-9c99-ce619a3636a1 could not be found. Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '90360cd8-7177-4abf-9c99-ce619a3636a1'} Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 90360cd8-7177-4abf-9c99-ce619a3636a1 could not be found. Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 90360cd8-7177-4abf-9c99-ce619a3636a1 could not be found. Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:24.650943 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:24.658409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:24.658409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:24.658409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:32:24.658409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:32:24.658409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 90360cd8-7177-4abf-9c99-ce619a3636a1 could not be found. Nov 02 12:32:24.658409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:24.658409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-927e764e-82e7-4b8a-932b-da142d8ea508 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] Returning 404 to user: Instance group 90360cd8-7177-4abf-9c99-ce619a3636a1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:32:24.659962 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-927e764e-82e7-4b8a-932b-da142d8ea508 tempest-ServerGroup264TestJSON-64695460 tempest-ServerGroup264TestJSON-64695460-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/90360cd8-7177-4abf-9c99-ce619a3636a1" status: 404 len: 117 microversion: 2.64 time: 0.040706 Nov 02 12:32:24.661219 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1371/2740] 10.222.0.45 () {60 vars in 1307 bytes} [Wed Nov 2 12:32:24 2022] DELETE /compute/v2.1/os-server-groups/90360cd8-7177-4abf-9c99-ce619a3636a1 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:32:24.724207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:24.726068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:24.744618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:24.745908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:24.746910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:24.748750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:24.749927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:24.750951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:24.827097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:24.851387 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-307f0493-75f9-4991-8d99-4d6285e3a07f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1535 microversion: 2.1 time: 1.171723 Nov 02 12:32:24.860893 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1370/2741] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:23 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1535 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:25.124170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:25.157180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:25.165436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84844a945f1b40f3b6e4b2206c888025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49aaa4b95944a2494cc2084fc442284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:25.202253 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e3f1a98-f282-4c82-a467-1a93b0f1be1a tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 200 len: 1444 microversion: 2.75 time: 0.491728 Nov 02 12:32:25.255600 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1372/2742] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:24 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 1444 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:25.423659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:25.426622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:25.466074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:25.467372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:25.468129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:25.469096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:25.469756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:25.470394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:25.902813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:25.905934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:25.940873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:25.941534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:25.945674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:25.947349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:25.947774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:25.948263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:27.107087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:27.116033 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d41327a9-891a-4895-a7df-9c0e89bc8a21 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1477 microversion: 2.1 time: 1.702540 Nov 02 12:32:27.138332 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1371/2743] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:25 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1477 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:27.147668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:27.149009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] [instance: d0704c32-834f-4595-b9da-c1b674dc8fce] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:27.167997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:27.168856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:27.172196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:27.173260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:27.173912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:27.174589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:27.228620 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] HTTP exception thrown: Instance d0704c32-834f-4595-b9da-c1b674dc8fce could not be found. Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Request method failure captured: Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce HTTP/1.1 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmMBazxxVrrqD0OTo3cIzMuqoHpYavW1PYO-WExMhZKX5NlRF0fc4DCulX-fD2mJZPunEA0RPcu-K12nVOvOuG5Qk3VgbHxCCQ4SqVLYhPrTbY98k02Frhw-7TqhZOkS2jU7jHPiu0mhsDrwa0x4q3Swcln_INiO0WwOgGVmj0aTj2E Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.75 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c49aaa4b95944a2494cc2084fc442284 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdmin275Test-1982648131 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c49aaa4b95944a2494cc2084fc442284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c49aaa4b95944a2494cc2084fc442284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c49aaa4b95944a2494cc2084fc442284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c49aaa4b95944a2494cc2084fc442284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdmin275Test-1982648131 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c49aaa4b95944a2494cc2084fc442284 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdmin275Test-1982648131 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdmin275Test-1982648131-project Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 84844a945f1b40f3b6e4b2206c888025 Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdmin275Test-1982648131-project Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance d0704c32-834f-4595-b9da-c1b674dc8fce could not be found. Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'd0704c32-834f-4595-b9da-c1b674dc8fce'} Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0704c32-834f-4595-b9da-c1b674dc8fce could not be found. Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0704c32-834f-4595-b9da-c1b674dc8fce could not be found. Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:27.236422 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:32:27.245759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:27.245759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:27.245759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:27.245759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:32:27.245759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:32:27.245759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0704c32-834f-4595-b9da-c1b674dc8fce could not be found. Nov 02 12:32:27.245759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:32:27.250012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] Returning 404 to user: Instance d0704c32-834f-4595-b9da-c1b674dc8fce could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:32:27.253241 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8789974c-18d9-48f9-98a5-1fbb8d80e44e tempest-ServersAdmin275Test-1982648131 tempest-ServersAdmin275Test-1982648131-project] 10.222.0.45 "GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce" status: 404 len: 111 microversion: 2.75 time: 0.113355 Nov 02 12:32:27.263921 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1372/2744] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:27 2022] GET /compute/v2.1/servers/d0704c32-834f-4595-b9da-c1b674dc8fce => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:32:27.815154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:27.832035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ed6e83b-e400-4460-9d9d-8b6acf297058 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1535 microversion: 2.1 time: 1.936022 Nov 02 12:32:27.832646 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1373/2745] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:25 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1535 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:28.146005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:28.147990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:28.168345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:28.173421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:28.174127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:28.177954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:28.181833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:28.184551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:28.878360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:28.880293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:28.902146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:28.903026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:28.903713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:28.904611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:28.905275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:28.905859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:29.620768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:29.642393 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6eac7fb6-ce0c-46af-a51d-eef4ef6d0993 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1463 microversion: 2.1 time: 1.496833 Nov 02 12:32:29.654970 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1373/2746] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:28 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1463 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:29.697756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:29.702745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:29.755096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:29.759469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:29.761385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:29.779364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:29.789592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:29.792016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:29.810180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:30.138814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:30.169597 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-76660c16-a4c0-4493-b707-e4825438e050 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1535 microversion: 2.1 time: 1.297485 Nov 02 12:32:30.171973 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1374/2747] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:28 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1535 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:31.091764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-cbead466-6de1-4b2b-8296-eba116cb4e40 req-d59a39cf-bdef-448d-93f6-c47309fec1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:31.119650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:31.136714 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3234bb6d-d448-4a3d-924b-facd43204ce8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1463 microversion: 2.1 time: 1.468655 Nov 02 12:32:31.140727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cbead466-6de1-4b2b-8296-eba116cb4e40 req-d59a39cf-bdef-448d-93f6-c47309fec1d1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.146403 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1374/2748] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:29 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1463 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:31.147023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cbead466-6de1-4b2b-8296-eba116cb4e40 req-d59a39cf-bdef-448d-93f6-c47309fec1d1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.150655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cbead466-6de1-4b2b-8296-eba116cb4e40 req-d59a39cf-bdef-448d-93f6-c47309fec1d1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:31.190825 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-cbead466-6de1-4b2b-8296-eba116cb4e40 req-d59a39cf-bdef-448d-93f6-c47309fec1d1 service nova] Creating event network-changed:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h1-855650-5 Nov 02 12:32:31.213539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-cbead466-6de1-4b2b-8296-eba116cb4e40 req-d59a39cf-bdef-448d-93f6-c47309fec1d1 service nova] Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:32:31.259386 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-cbead466-6de1-4b2b-8296-eba116cb4e40 req-d59a39cf-bdef-448d-93f6-c47309fec1d1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176403 Nov 02 12:32:31.262033 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1375/2749] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:31.278712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:31.287617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:31.303813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.305370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.308040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:31.312413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.313902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.314658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:31.514963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:32:31.516317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:32:31.517175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:32:31.517846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:32:31.518536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:32:31.570660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1149961328", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "5acee149-6e99-4a45-aa8c-e154de3cfe49"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:31.656671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:31.684886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] validate_networks() for [('5acee149-6e99-4a45-aa8c-e154de3cfe49', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:32:31.717434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:31.733434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.737290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.738167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:31.740827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.743029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.743982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:31.881517 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dee18b8a-63d1-4411-9d38-75397209cd7f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action" status: 202 len: 1067 microversion: 2.1 time: 0.612741 Nov 02 12:32:31.886781 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1376/2750] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:32:31 2022] POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action => generated 1067 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:32:31.909746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:31.910502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:31.940640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.941283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.944242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:31.946691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.947751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.948214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:32.968801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:33.506613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:33.539477 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c687b1eb-0a84-447c-871f-63a3e15b0c75 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1535 microversion: 2.1 time: 1.647602 Nov 02 12:32:33.541512 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1377/2751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:31 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1535 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:33.558227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:33.562642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:33.581897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:33.582869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:33.583741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:33.584836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:33.585663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:33.586362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:35.769047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:35.787259 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30996b44-637f-4aa2-94a7-fa6d4aea8aa5 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 2.242511 Nov 02 12:32:35.802346 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1378/2752] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:33 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:35.843111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:35.843871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:35.869776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:35.870721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:35.890753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:35.892196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:35.893118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:35.893879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:37.252636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:37.307309 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f14deab-4692-424f-89e5-df95874e07d7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1535 microversion: 2.1 time: 1.502490 Nov 02 12:32:37.318004 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1379/2753] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:35 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1535 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:37.369460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:37.372952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:37.375917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:32:37.376728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:32:37.377039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:32:37.377475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:32:37.377905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:32:37.405170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:37.410618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:37.411862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:37.416087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:37.418358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:37.422159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:37.424384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:37.451872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:37.464915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:37.471214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:37.474792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:37.476671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:37.574742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Getting quotas for project 2586620f624946558f8e453b1736a0fd. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:32:37.600032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Getting quotas for user 39cb74b09e854f6186ecbd901d14eed5 and project 2586620f624946558f8e453b1736a0fd. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:32:37.659778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:32:37.663031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:32:37.837574 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11721865-cc58-4a7b-9320-913069abb760 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.687868 Nov 02 12:32:37.841689 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1375/2754] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 6694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:32:37.855128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d18c8d29-5082-4b27-8894-f85b027f585a tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:37.857019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d18c8d29-5082-4b27-8894-f85b027f585a tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:37.944282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:37.959346 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bc57e5f7-2cbe-47a7-8321-a8095740725e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 0.610585 Nov 02 12:32:37.960286 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1380/2755] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:37 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:38.055074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d18c8d29-5082-4b27-8894-f85b027f585a tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:38.073574 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d18c8d29-5082-4b27-8894-f85b027f585a tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1225 microversion: 2.1 time: 0.223326 Nov 02 12:32:38.074744 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1376/2756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:37 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1225 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:38.361799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:38.364653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:38.402174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:38.403403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:38.404405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:38.406370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:38.412316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:38.414184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:38.994552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:38.995460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:39.019799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:39.023471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:39.026589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:39.028072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:39.030685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:39.031578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:40.114844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:40.163591 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5219b4fb-c7eb-4822-8e77-a78186778b66 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 1.172191 Nov 02 12:32:40.198730 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1377/2757] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:38 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:40.212794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:40.214699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:40.228132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:40.229507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:40.231010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:40.232721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:40.233915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:40.235119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:40.763601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:40.846528 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8feae839-c787-42f4-b24a-d4d7f20b4a9b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1229 microversion: 2.1 time: 0.641636 Nov 02 12:32:40.857041 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1378/2758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:40 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1229 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:41.108081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:41.143861 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e32374a-528b-42d8-929a-aa94c0f65815 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1535 microversion: 2.1 time: 2.793867 Nov 02 12:32:41.221176 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1381/2759] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:38 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1535 bytes in 2874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:41.221762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:41.227772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:41.281698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:41.302827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:41.305696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:41.313670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:41.324589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:41.328950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:42.127515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-26163313", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": "none"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:42.385578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:32:42.389960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:32:42.393189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:32:42.395395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:32:42.396319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:32:42.453325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:42.455599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:42.457612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:42.462468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:42.463899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:42.465951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:42.639425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Getting quotas for project 4f141e7a921849d9b7d1f367681f2d54. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:32:42.678252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Getting quotas for user 5b835b6c5d364c299cf3e0dfb5c0899a and project 4f141e7a921849d9b7d1f367681f2d54. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:32:42.758658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:32:42.765063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:32:42.889394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:42.940784 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e72a930f-812c-45e3-bc65-1cd3ce3a6e78 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 1.733352 Nov 02 12:32:42.945185 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1379/2760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:41 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:42.965847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:42.980964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:43.023298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:43.025811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:43.028165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:43.031612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:43.039171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:43.044465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:43.064469 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b6a8147b-bdf1-4065-80a9-a6f14e488fe8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.493313 Nov 02 12:32:43.067229 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1382/2761] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:32:43.089011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:43.095267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:43.121179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:43.122345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:43.123366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:43.124947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:43.135468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:43.136421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:43.542086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:43.564402 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d314a94b-3037-4416-ae8a-6913d0d33548 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1283 microversion: 2.1 time: 0.607120 Nov 02 12:32:43.565354 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1380/2762] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:42 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1283 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:43.582524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d67635bb-ac78-4780-b55f-766137f80916 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:43.583451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d67635bb-ac78-4780-b55f-766137f80916 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:44.431834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d67635bb-ac78-4780-b55f-766137f80916 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:44.465544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d67635bb-ac78-4780-b55f-766137f80916 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:44.477735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d67635bb-ac78-4780-b55f-766137f80916 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:44.510012 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d67635bb-ac78-4780-b55f-766137f80916 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1450 microversion: 2.91 time: 0.932901 Nov 02 12:32:44.514933 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1381/2763] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:43 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1450 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:44.529004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:44.545845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:44.574419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:44.575328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:44.576165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:44.577735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:44.583949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:44.586712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:45.091689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:45.104865 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb7e3bd4-5efe-43e2-9ca9-06c0b6698901 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1528 microversion: 2.1 time: 2.034855 Nov 02 12:32:45.112398 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1383/2764] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:43 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1528 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:45.124120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:45.125237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:45.142439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:45.143226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:45.145883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:45.149014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:45.149801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:45.151381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:45.655214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:45.679593 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dce3258e-6a75-452e-9a3a-1e99ac1f9c7d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 1.158399 Nov 02 12:32:45.681370 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1382/2765] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:44 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:45.692038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:45.693639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:45.703027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:45.709525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:45.713011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:45.714358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:45.714713 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f6aad02d-8b93-4176-95cc-b8c02846b4be tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 0.600810 Nov 02 12:32:45.715850 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1384/2766] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:45 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:45.716660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:45.717792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:45.718939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:45.721647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:45.722639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:45.730611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:45.731480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:45.732201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:45.733353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:45.734201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:45.734892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:45.825942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:45.841136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:45.847242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:45.866530 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e8a1846-dab5-4b80-bee4-ab396d8f50f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1502 microversion: 2.91 time: 0.149175 Nov 02 12:32:45.868374 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1385/2767] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:45 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:46.102497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:46.123173 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fa1f1ff7-4014-4c67-a9cb-5af3bd6c225a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1528 microversion: 2.1 time: 0.439314 Nov 02 12:32:46.124727 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1383/2768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:45 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1528 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:46.165586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c141d848-094e-4524-bc41-ffe5249af039 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:46.176927 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c141d848-094e-4524-bc41-ffe5249af039 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] HTTP exception thrown: Flavor 807d1f59-73f9-465d-b93f-a26d08c17cd2 could not be found. Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c141d848-094e-4524-bc41-ffe5249af039 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Request method failure captured: Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/flavors/807d1f59-73f9-465d-b93f-a26d08c17cd2 HTTP/1.1 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmI4wNmqTcsQn8VFUVQbAAh6nAzJGTzi31sYzoWNFl8caUTBPbBJVjNXVaSRGHV0jvgOzrocNkoOTRBaQ5Rn9caUFIseZNNW5ztOp98KI76jJE4TM7fF-xGCkITFABPCCoILacsPudnH_wiuaQ47YUIlC219DLtGabFwYi_5G-obYoA Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 564a0532b82544df89f251012064ec27 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MigrationsAdminTest-200987859 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/564a0532b82544df89f251012064ec27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/564a0532b82544df89f251012064ec27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/564a0532b82544df89f251012064ec27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_564a0532b82544df89f251012064ec27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MigrationsAdminTest-200987859 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 564a0532b82544df89f251012064ec27 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MigrationsAdminTest-200987859 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MigrationsAdminTest-200987859-project-admin Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 967308c7423c43a59823c37d00c23296 Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MigrationsAdminTest-200987859-project-admin Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: exception: Flavor 807d1f59-73f9-465d-b93f-a26d08c17cd2 could not be found. Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '807d1f59-73f9-465d-b93f-a26d08c17cd2'} Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 807d1f59-73f9-465d-b93f-a26d08c17cd2 could not be found. Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 807d1f59-73f9-465d-b93f-a26d08c17cd2 could not be found. Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:46.189801 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 807d1f59-73f9-465d-b93f-a26d08c17cd2 could not be found. Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c141d848-094e-4524-bc41-ffe5249af039 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Returning 404 to user: Flavor 807d1f59-73f9-465d-b93f-a26d08c17cd2 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c141d848-094e-4524-bc41-ffe5249af039 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/807d1f59-73f9-465d-b93f-a26d08c17cd2" status: 404 len: 109 microversion: 2.1 time: 0.031885 Nov 02 12:32:46.198539 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1386/2769] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:32:46 2022] DELETE /compute/v2.1/flavors/807d1f59-73f9-465d-b93f-a26d08c17cd2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:32:46.442949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-561577699", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:46.555080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:32:46.708313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:46.709053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:46.762409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:46.767914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:46.768952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:46.770477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:46.771241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:46.772029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:47.414335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:32:47.415705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:32:47.416357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:32:47.416954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:32:47.417554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:32:47.436677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:47.446792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:47.447511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:47.448382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:47.448860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:47.449417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:47.499791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:32:47.533077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Getting quotas for user a5a3010848f74c94bb32b506e184d275 and project 5f41e93247724e6ab0b764cd9aee9eb0. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:32:47.589604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:32:47.597106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:32:47.759231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:47.771200 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c333de5-2f00-49c4-8b15-e39982e3e35d tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 1.068373 Nov 02 12:32:47.771575 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34d4dcd5-d42c-4380-ad88-68714032eaae tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333724 Nov 02 12:32:47.771938 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1387/2770] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:46 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:47.784741 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1384/2771] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:32:47.793225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:47.793521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:47.808025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:47.808658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:47.809435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:47.811562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:47.812241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:47.813237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:47.814205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:47.814876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:47.839798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:47.840342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:47.840773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:47.841514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:47.842011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:47.842443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.089632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:48.103062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:48.104042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:48.135075 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c761b51-b6a3-4f76-bf9d-804d7ef20bc5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1508 microversion: 2.91 time: 0.338278 Nov 02 12:32:48.135757 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1388/2772] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:47 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:48.162860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-605cfb6d-978a-4398-8f8b-dd6f93dd65c2 req-c5df62f9-9b4e-4f5d-9355-74a998b113fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "name": "network-vif-plugged", "status": "completed", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:48.207980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-605cfb6d-978a-4398-8f8b-dd6f93dd65c2 req-c5df62f9-9b4e-4f5d-9355-74a998b113fa service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.213467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-605cfb6d-978a-4398-8f8b-dd6f93dd65c2 req-c5df62f9-9b4e-4f5d-9355-74a998b113fa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.215923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-605cfb6d-978a-4398-8f8b-dd6f93dd65c2 req-c5df62f9-9b4e-4f5d-9355-74a998b113fa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.235687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:48.246957 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7751ddfa-df64-45bf-a421-3acc8d1b4fe1 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 0.470690 Nov 02 12:32:48.253150 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1385/2773] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:47 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:48.258739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-16381fcb-3009-4864-9798-4272c742587d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:48.263726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-16381fcb-3009-4864-9798-4272c742587d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:48.265085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-605cfb6d-978a-4398-8f8b-dd6f93dd65c2 req-c5df62f9-9b4e-4f5d-9355-74a998b113fa service nova] Creating event network-vif-plugged:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h1-855650-5 Nov 02 12:32:48.282250 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-605cfb6d-978a-4398-8f8b-dd6f93dd65c2 req-c5df62f9-9b4e-4f5d-9355-74a998b113fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142643 Nov 02 12:32:48.283579 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1389/2774] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:48.405119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-16381fcb-3009-4864-9798-4272c742587d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:48.430998 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-16381fcb-3009-4864-9798-4272c742587d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1212 microversion: 2.1 time: 0.176354 Nov 02 12:32:48.436700 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1386/2775] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:48 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1212 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:48.817621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:48.820531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:48.837035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.839774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.840917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.844714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.846739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.847932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.182758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:49.188561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:49.235084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.237877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.244894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.249041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.252488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.255009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.834317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:49.836892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:49.852674 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c9dd711-5ce6-4f41-b4d1-3fe569dec481 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 1.053317 Nov 02 12:32:49.853330 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1390/2776] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:48 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:49.863103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d2a33324-31bc-45b3-9065-36b78a5b3998 req-ec71a5e6-288b-4c39-983e-edacb3151ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e72888-9df0-4e32-966a-3aa8251ccf6a", "tag": "c01f246f-a05d-4c0c-a684-a2a989a87ce7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:49.880947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d2a33324-31bc-45b3-9065-36b78a5b3998 req-ec71a5e6-288b-4c39-983e-edacb3151ff3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.886061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d2a33324-31bc-45b3-9065-36b78a5b3998 req-ec71a5e6-288b-4c39-983e-edacb3151ff3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.886812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d2a33324-31bc-45b3-9065-36b78a5b3998 req-ec71a5e6-288b-4c39-983e-edacb3151ff3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.908828 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d2a33324-31bc-45b3-9065-36b78a5b3998 req-ec71a5e6-288b-4c39-983e-edacb3151ff3 service nova] Creating event network-changed:c01f246f-a05d-4c0c-a684-a2a989a87ce7 for instance f8e72888-9df0-4e32-966a-3aa8251ccf6a on n-h1-855650-5 Nov 02 12:32:49.917278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:49.918745 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d2a33324-31bc-45b3-9065-36b78a5b3998 req-ec71a5e6-288b-4c39-983e-edacb3151ff3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064057 Nov 02 12:32:49.921954 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1391/2777] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:49.922453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:49.937446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:49.937629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40be371c-b0fb-46c7-9cc6-7262856e1520 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1508 microversion: 2.91 time: 0.767914 Nov 02 12:32:49.938495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:49.939293 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1387/2778] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:49 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1508 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:49.948462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:49.950199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:49.958682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.959189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.959643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.960450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.960922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.961414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.964827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.966130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.967235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.969279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.970536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.972566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:50.206860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:50.232953 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80af4951-5062-4f2f-b3cf-02684f4b3723 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1264 microversion: 2.1 time: 0.291585 Nov 02 12:32:50.248019 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1388/2779] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:49 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1264 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:50.532145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:50.566723 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba884a13-ec25-480e-852d-60e70c0527b9 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 0.642371 Nov 02 12:32:50.583836 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1392/2780] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:49 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:50.906487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:50.908013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:50.917488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:50.918547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:50.919270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:50.920524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:50.921408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:50.921910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:50.992371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:50.993686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:51.003763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:51.004650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:51.005294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:51.006529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:51.007896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:51.008500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:51.181498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:51.207814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:51.209904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:51.221615 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-352e7a77-7aae-4f73-a076-0c6b5389e762 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1508 microversion: 2.91 time: 0.235687 Nov 02 12:32:51.222166 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1393/2781] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:50 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:51.274715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:51.275671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:51.288401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:51.289362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:51.294094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:51.295853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:51.296689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:51.297417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:51.395584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:51.433168 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36b3bb23-d327-4384-beca-9cce9c47e5a1 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 0.529481 Nov 02 12:32:51.443125 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1389/2782] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:50 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:51.536669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:51.551281 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2215273-08de-4a24-8cef-873fc034a5ed tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1270 microversion: 2.1 time: 0.280744 Nov 02 12:32:51.556908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1394/2783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:51 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:51.636151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:51.639355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:51.652066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:51.653586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:51.658942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:51.668037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:51.669682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:51.672058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.264811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:52.266227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:52.277701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.282946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.286037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.287134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.287793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.288513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.472958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:52.501958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:52.536088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:52.554049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:52.583955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:52.589929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:52.610987 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff9a4feb-a658-416c-9613-8725081e9d2b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1508 microversion: 2.91 time: 0.350345 Nov 02 12:32:52.611733 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1395/2784] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:52 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:32:52.618260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:52.626836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:52.631147 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a6b193e-feaf-4278-a558-f01b9d503ac3 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 1.020672 Nov 02 12:32:52.634675 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1390/2785] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:51 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:52.646881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.648354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.649013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.649953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.650624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.651250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.654761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:52.658574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:52.672022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.673047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.674890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.676011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.676835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.678598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.744116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:53.079212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:53.089662 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-462d012a-e951-42ef-8e15-ebfa1d353525 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 0.476698 Nov 02 12:32:53.106579 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1396/2786] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:52 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:53.161509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:53.177109 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb1125c4-949a-44e0-baec-67693d80623b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 0.538666 Nov 02 12:32:53.177726 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1391/2787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:52 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:53.665316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:53.668719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:53.677460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:53.682433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:53.684502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.685737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.686979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.688592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.689733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.691236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.714315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.721025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.721998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.728914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.729888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.735587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.893043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:53.916212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:53.920231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:53.938551 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-75c2d791-9afb-45d6-aeb0-842ecec16a58 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1529 microversion: 2.91 time: 0.281608 Nov 02 12:32:53.945512 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1397/2788] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:53 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1529 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:54.763743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:54.768850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:54.790780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:54.821630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:54.823602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:54.825301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:54.830953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:54.832720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:54.835363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:55.163575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lazy-loading 'services' on Instance uuid f169f400-ea59-48ec-a765-2c8cab7131b9 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:55.215632 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1ec283f-b7f7-4956-bc9c-7ef63666c462 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1934 microversion: 2.91 time: 1.217276 Nov 02 12:32:55.216854 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1398/2789] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:53 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1934 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:55.222618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:55.223676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:55.232207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:55.233239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:55.234510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:55.235993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:55.237023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:55.237730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:55.513157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:55.529514 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e860b7e-e2b5-4a43-936a-bfc29405e9c5 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 1.864093 Nov 02 12:32:55.533254 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1392/2790] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:53 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:55.542747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:55.549550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:55.553692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:55.571859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:55.577303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:55.578616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:55.579917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:55.580704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:55.581477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.039850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:56.065276 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e59d24e-441b-45c6-99ef-82993c1f25a0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 0.843365 Nov 02 12:32:56.067376 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1399/2791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:55 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:56.075853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:56.082905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:56.100904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:56.102112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:56.108180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.116705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:56.117485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:56.120177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.410740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lazy-loading 'services' on Instance uuid f169f400-ea59-48ec-a765-2c8cab7131b9 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:56.477513 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f1bf3897-881c-4435-b957-60262a3a540d tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1934 microversion: 2.91 time: 0.408336 Nov 02 12:32:56.488217 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1400/2792] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:56 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1934 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:56.522833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4dd150ce-ed42-4282-adbe-7ee779e1f8be tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:56.531655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dd150ce-ed42-4282-adbe-7ee779e1f8be tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:56.540172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dd150ce-ed42-4282-adbe-7ee779e1f8be tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:56.546965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dd150ce-ed42-4282-adbe-7ee779e1f8be tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.549989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dd150ce-ed42-4282-adbe-7ee779e1f8be tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:56.551787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dd150ce-ed42-4282-adbe-7ee779e1f8be tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:56.552664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dd150ce-ed42-4282-adbe-7ee779e1f8be tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.605174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:56.627010 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fbd37b09-173b-4aba-882a-45de21e8c678 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 1.089833 Nov 02 12:32:56.629510 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1393/2793] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:55 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:56.648171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:56.649292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:56.687019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:56.690103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:56.693115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.695530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:56.696879 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4dd150ce-ed42-4282-adbe-7ee779e1f8be tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.174617 Nov 02 12:32:56.699144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:56.701580 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1401/2794] 10.222.0.45 () {60 vars in 1217 bytes} [Wed Nov 2 12:32:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:32:56.703089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.717790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:56.726527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:56.753623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:56.754508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:56.755041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.757181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:56.767375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:56.768474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.837250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lazy-loading 'flavor' on Instance uuid f169f400-ea59-48ec-a765-2c8cab7131b9 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:57.429808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:57.449363 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eaf3f05f-da37-4ff5-95bc-e2f7a9173b9e tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 0.818231 Nov 02 12:32:57.450001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1394/2795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:56 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:57.470062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:57.483144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:57.509488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:57.516474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:57.517391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:57.522595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:57.525637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:57.535049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:57.535946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:57.565922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:57.666549 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d6aa0bf-42fa-4462-b3c9-d20fc07e8fbc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "POST /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9/action" status: 202 len: 0 microversion: 2.91 time: 0.955472 Nov 02 12:32:57.675202 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1402/2796] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:32:56 2022] POST /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:32:57.722177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:57.723203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:57.744824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:57.745349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:57.745800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:57.746931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:57.747409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:57.747851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:58.409877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=18 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:58.435149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:58.448385 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f1090581-404c-4273-b237-8520b21e1ef0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 0.991023 Nov 02 12:32:58.449008 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1395/2797] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:57 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:58.465562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:58.468414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:58.487436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:58.489678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:58.492151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:58.498155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:58.499203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:58.502510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:58.704210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:58.717151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:58.721185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:58.738714 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3defebce-a067-4b5d-9d75-c492a68d7df5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.283088 Nov 02 12:32:58.739751 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1396/2798] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:58 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:58.754170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:58.755551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:58.767849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:58.785816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:58.786432 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-aa8a4e96-d8da-4218-8424-803d2b988e22 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 1.106781 Nov 02 12:32:58.787124 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1403/2799] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:57 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:58.787986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:58.791426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:58.796812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:58.797470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:58.797923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:58.807046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-4f9edc0b-ba99-4c16-8a6a-416bcfca2642 req-6ce3eb5d-f70c-43aa-ac23-a6a3f07e83e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:58.841942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4f9edc0b-ba99-4c16-8a6a-416bcfca2642 req-6ce3eb5d-f70c-43aa-ac23-a6a3f07e83e2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:58.842827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4f9edc0b-ba99-4c16-8a6a-416bcfca2642 req-6ce3eb5d-f70c-43aa-ac23-a6a3f07e83e2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:58.843542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4f9edc0b-ba99-4c16-8a6a-416bcfca2642 req-6ce3eb5d-f70c-43aa-ac23-a6a3f07e83e2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:58.885287 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4f9edc0b-ba99-4c16-8a6a-416bcfca2642 req-6ce3eb5d-f70c-43aa-ac23-a6a3f07e83e2 service nova] Creating event network-changed:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h1-855650-5 Nov 02 12:32:58.908011 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-4f9edc0b-ba99-4c16-8a6a-416bcfca2642 req-6ce3eb5d-f70c-43aa-ac23-a6a3f07e83e2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116212 Nov 02 12:32:58.910119 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1404/2800] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:59.479967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:59.480602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:59.512436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:59.514110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:59.516278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:59.522971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:59.524558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:59.529226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:59.879807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:59.895909 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9450b85e-7c1a-4963-b11f-c768cff026f0 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 1.153089 Nov 02 12:32:59.897543 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1397/2801] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:58 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:59.911827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fceed2a1-0466-4b82-a1fa-9e5cc4d72a19 req-0fbf2d4a-d049-4808-93d6-3ab9c6db1781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e72888-9df0-4e32-966a-3aa8251ccf6a", "name": "network-vif-plugged", "status": "completed", "tag": "c01f246f-a05d-4c0c-a684-a2a989a87ce7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:59.940664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fceed2a1-0466-4b82-a1fa-9e5cc4d72a19 req-0fbf2d4a-d049-4808-93d6-3ab9c6db1781 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:59.941635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fceed2a1-0466-4b82-a1fa-9e5cc4d72a19 req-0fbf2d4a-d049-4808-93d6-3ab9c6db1781 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:59.946805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fceed2a1-0466-4b82-a1fa-9e5cc4d72a19 req-0fbf2d4a-d049-4808-93d6-3ab9c6db1781 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:59.986484 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fceed2a1-0466-4b82-a1fa-9e5cc4d72a19 req-0fbf2d4a-d049-4808-93d6-3ab9c6db1781 service nova] Creating event network-vif-plugged:c01f246f-a05d-4c0c-a684-a2a989a87ce7 for instance f8e72888-9df0-4e32-966a-3aa8251ccf6a on n-h1-855650-5 Nov 02 12:33:00.001045 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fceed2a1-0466-4b82-a1fa-9e5cc4d72a19 req-0fbf2d4a-d049-4808-93d6-3ab9c6db1781 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099712 Nov 02 12:33:00.001815 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1398/2802] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:00.024931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:00.025664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:00.039257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:00.040311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:00.040960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:00.044397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:00.045765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:00.046506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:00.375771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:00.392000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:00.397063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:00.422386 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae0032a8-7df5-49d7-956e-e769b215a139 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.410040 Nov 02 12:33:00.426899 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1399/2803] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:00 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:00.434570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:00.437512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:00.454497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:00.455408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:00.456093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:00.457435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:00.458472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:00.459141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:00.494362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:00.521083 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dd85a72b-6a66-4c49-a94d-454022a844c4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1472 microversion: 2.1 time: 1.047439 Nov 02 12:33:00.523177 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1405/2804] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:59 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1472 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:00.957859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:00.961216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:00.975891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:00.982577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:00.983462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:00.987091 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7b63b24-c8e6-42b0-b685-c5d0a7719304 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 0.558622 Nov 02 12:33:00.991667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:00.993446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:00.994614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:01.005255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1400/2805] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:00 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:01.007370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:01.430898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:01.449764 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e1e54f02-f119-454f-9db1-5ccce5375feb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 0.509132 Nov 02 12:33:01.451826 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1406/2806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:00 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:01.490054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:01.490795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:01.504175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:01.505492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:01.506667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:01.507815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:01.508759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:01.509470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:01.575216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:01.578184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:01.606727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:01.608352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:01.631818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:01.640651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:01.643775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:01.644400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:01.692878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:01.709303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:01.734207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:01.760522 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ea80452-6a37-4999-b164-2a52ce76475c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.266999 Nov 02 12:33:01.765044 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1401/2807] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:01 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:02.017777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:02.018928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:02.043662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:02.044565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:02.045289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:02.046060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:02.046697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:02.047456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:02.067461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:02.103180 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ce1cc64-95e2-4818-aef5-c5d76050bcaf tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1478 microversion: 2.1 time: 0.544246 Nov 02 12:33:02.106420 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1407/2808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:01 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1478 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:02.489447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:02.493768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:02.521276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:02.522634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:02.528597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:02.530356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:02.531494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:02.532603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:02.984962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:02.999430 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab6a8f98-1825-41a8-b5ba-45af0852c8ab tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 0.989369 Nov 02 12:33:03.002728 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1402/2809] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:02 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:03.018883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a0010929-0c73-466f-b5fa-ae16db5c6a35 req-8472a4e6-e53d-4048-b8a2-cb0f755cb1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0bd24-8c20-4b97-a4ae-2075c823179e", "name": "network-vif-unplugged", "status": "completed", "tag": "6a26b325-c41a-4ba3-9291-36c10956f17c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:03.051059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0010929-0c73-466f-b5fa-ae16db5c6a35 req-8472a4e6-e53d-4048-b8a2-cb0f755cb1a3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:03.051887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0010929-0c73-466f-b5fa-ae16db5c6a35 req-8472a4e6-e53d-4048-b8a2-cb0f755cb1a3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:03.055244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0010929-0c73-466f-b5fa-ae16db5c6a35 req-8472a4e6-e53d-4048-b8a2-cb0f755cb1a3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:03.087626 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a0010929-0c73-466f-b5fa-ae16db5c6a35 req-8472a4e6-e53d-4048-b8a2-cb0f755cb1a3 service nova] Creating event network-vif-unplugged:6a26b325-c41a-4ba3-9291-36c10956f17c for instance 05f0bd24-8c20-4b97-a4ae-2075c823179e on n-h2-855650-5 Nov 02 12:33:03.102564 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a0010929-0c73-466f-b5fa-ae16db5c6a35 req-8472a4e6-e53d-4048-b8a2-cb0f755cb1a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097557 Nov 02 12:33:03.105696 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1403/2810] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:03.120638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:03.124797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:03.161957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:03.165992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:03.167482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:03.174287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:03.175221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:03.178896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:03.382717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:03.395292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:03.404570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:03.416688 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38fcd1c6-dcc3-4196-b35c-b2f1d6e241c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.308293 Nov 02 12:33:03.424590 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1404/2811] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:03 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:03.439519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:03.443681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:03.461899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:03.463816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:03.465532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:03.467842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:03.468824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:03.473912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:03.524411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:03.543287 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6046a811-1e79-4a00-bf20-c71238b247a2 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1325 microversion: 2.1 time: 1.062163 Nov 02 12:33:03.543897 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1408/2812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:02 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1325 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:03.954487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:03.967866 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a919f68-07a9-4939-bbde-ccca7fa2f2d4 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1478 microversion: 2.1 time: 0.541020 Nov 02 12:33:03.970445 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1405/2813] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:03 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1478 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:04.050480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:04.051655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:04.083501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:04.084958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:04.087696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:04.090185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:04.091408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:04.098049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:04.458458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:04.460625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:04.478540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:04.479361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:04.480087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:04.481137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:04.481789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:04.482804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:05.086590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:05.124779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:05.130786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:05.156767 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5c8d5fb1-c194-4f7e-b70a-d53a0244562b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.699687 Nov 02 12:33:05.158878 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1406/2814] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:04 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:05.181018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:05.181843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:05.198387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:05.201413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:05.210872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:05.215223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:05.216702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:05.219565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:06.052320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:06.068300 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c97f359-61bc-452d-ae88-888a25a85a51 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 2.023482 Nov 02 12:33:06.069827 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1409/2815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:04 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:06.087362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:06.089314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:06.109781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:06.118017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:06.118653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:06.119431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:06.119914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:06.120358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:06.393069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:06.413612 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f34db943-e8c7-4200-b36a-7b27628eb70b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1521 microversion: 2.1 time: 1.243801 Nov 02 12:33:06.434915 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1407/2816] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:05 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1521 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:06.441354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:06.444670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:06.463072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:06.463670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:06.464234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:06.465404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:06.468729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:06.470208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:06.582186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:08.008911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:08.024970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:08.032945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:08.060540 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c65f2f32-aa5a-4ebc-8375-1de5408d7cc8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 1.623975 Nov 02 12:33:08.102316 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1408/2817] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:06 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:08.108798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:08.109611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:08.128311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.129956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.137732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.139862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.140514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.140943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.206957 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] HTTP exception thrown: Action 999 not found Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Request method failure captured: Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a/os-instance-actions/999 HTTP/1.1 Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmNeSupt3SVq8RtAUegx2vBI722S6fjBzSh_XAWQouOQTK7SKsuJ5xAVur2PtVW-rS3b1_KMeU_7Yr5Whzu4oJ7BwbJtGWhblq0o9O5sLyDntQr-0hl7ikp_mmuIL0UAdkr3FRTsIZAeZUaCRgNtXMIQSemlx-Kd5YLcNSWa-rgVYyg Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 2586620f624946558f8e453b1736a0fd Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2586620f624946558f8e453b1736a0fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2586620f624946558f8e453b1736a0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2586620f624946558f8e453b1736a0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2586620f624946558f8e453b1736a0fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 2586620f624946558f8e453b1736a0fd Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-InstanceActionsNegativeTestJSON-1892256892-project Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 39cb74b09e854f6186ecbd901d14eed5 Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1892256892-project Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: exception: Action 999 not found Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': 'f8e72888-9df0-4e32-966a-3aa8251ccf6a', 'id': '999'} Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Nov 02 12:33:08.226400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:08.239410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Returning 404 to user: Action 999 not found {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:08.239410 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59217dec-cab3-46fc-ad3e-6453f36d8375 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.124969 Nov 02 12:33:08.239410 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1409/2818] 10.222.0.45 () {58 vars in 1308 bytes} [Wed Nov 2 12:33:08 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a/os-instance-actions/999 => generated 66 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:33:08.241607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:08.244436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:08.265786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.266353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.268343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.270714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.271459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.272228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.467897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:08.489094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3350169f-dc78-4667-b03d-0d93d6653549 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1478 microversion: 2.1 time: 2.417680 Nov 02 12:33:08.502304 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1410/2819] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:06 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1478 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:08.502304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa2ee69a-6652-4d1d-a037-b8a8d05a457b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '.version_select at 0x7f228f097ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:08.502304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa2ee69a-6652-4d1d-a037-b8a8d05a457b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: e304ab22-054a-4fec-b785-b71e35617092] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:08.516766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-fa2ee69a-6652-4d1d-a037-b8a8d05a457b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] HTTP exception thrown: Instance e304ab22-054a-4fec-b785-b71e35617092 could not be found. Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa2ee69a-6652-4d1d-a037-b8a8d05a457b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Request method failure captured: Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/e304ab22-054a-4fec-b785-b71e35617092/os-instance-actions HTTP/1.1 Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmNeSupt3SVq8RtAUegx2vBI722S6fjBzSh_XAWQouOQTK7SKsuJ5xAVur2PtVW-rS3b1_KMeU_7Yr5Whzu4oJ7BwbJtGWhblq0o9O5sLyDntQr-0hl7ikp_mmuIL0UAdkr3FRTsIZAeZUaCRgNtXMIQSemlx-Kd5YLcNSWa-rgVYyg Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 2586620f624946558f8e453b1736a0fd Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2586620f624946558f8e453b1736a0fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2586620f624946558f8e453b1736a0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2586620f624946558f8e453b1736a0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2586620f624946558f8e453b1736a0fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 2586620f624946558f8e453b1736a0fd Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-InstanceActionsNegativeTestJSON-1892256892-project Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 39cb74b09e854f6186ecbd901d14eed5 Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1892256892-project Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance e304ab22-054a-4fec-b785-b71e35617092 could not be found. Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': 'e304ab22-054a-4fec-b785-b71e35617092'} Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e304ab22-054a-4fec-b785-b71e35617092 could not be found. Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:08.518926 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e304ab22-054a-4fec-b785-b71e35617092 could not be found. Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e304ab22-054a-4fec-b785-b71e35617092 could not be found. Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:08.523029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa2ee69a-6652-4d1d-a037-b8a8d05a457b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Returning 404 to user: Instance e304ab22-054a-4fec-b785-b71e35617092 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:08.524390 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa2ee69a-6652-4d1d-a037-b8a8d05a457b tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/e304ab22-054a-4fec-b785-b71e35617092/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.032266 Nov 02 12:33:08.524390 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1411/2820] 10.222.0.45 () {58 vars in 1296 bytes} [Wed Nov 2 12:33:08 2022] GET /compute/v2.1/servers/e304ab22-054a-4fec-b785-b71e35617092/os-instance-actions => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:08.548247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:08.549235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:08.561264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.562383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.563113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.564854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.565838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.566655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.600638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:08.607783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:08.774416 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bf898afa-78c9-4a17-bb1d-56c497247301 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 204 len: 0 microversion: 2.1 time: 0.236132 Nov 02 12:33:08.775774 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1412/2821] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:08 2022] DELETE /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:33:08.809450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:08.811137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:08.842513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.843390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.844730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.846348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.847614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.849013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:09.229925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:09.269905 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-63668440-abd8-4efc-94c1-62598b0b6f18 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 1.033931 Nov 02 12:33:09.275844 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1410/2822] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:08 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:09.312697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:09.313939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:09.372639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:09.373397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:09.374094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:09.375253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:09.375941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:09.395016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:09.769721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:09.796418 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-73d0a9ea-3be9-42a7-a892-e4bc5ef4a0eb tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1527 microversion: 2.1 time: 1.014401 Nov 02 12:33:09.797831 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1413/2823] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:08 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1527 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:09.825901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:09.825901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:09.836813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:09.837316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:09.837755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:09.838530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:09.839131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:09.839519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:10.236585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:10.255550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:10.259442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:10.266925 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fcfff022-e266-4d0b-ae65-5aeabd47367c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.987257 Nov 02 12:33:10.296285 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1411/2824] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:09 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:10.707024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-246710696", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "8e110324-35d4-44e4-b528-a32c37a46ad1"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:10.839221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] validate_networks() for [('8e110324-35d4-44e4-b528-a32c37a46ad1', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:33:10.983954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:11.015709 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b3cef55-ca83-4d1a-bfd6-fb86113bb385 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1478 microversion: 2.1 time: 1.215530 Nov 02 12:33:11.016796 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1414/2825] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:09 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1478 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:11.047149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:11.048307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:11.086740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:11.088132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:11.089124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:11.090410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:11.091470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:11.092206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:12.988401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:13.003279 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7defa5c9-d8c8-4d22-91e0-3f844f4e439f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 1.982430 Nov 02 12:33:13.007972 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1415/2826] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:11 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:13.024757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:13.030995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:13.058333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:13.059436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:13.062675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:13.064897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:13.066574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:13.067700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:13.169567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:13.171330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:13.174641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:13.177053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lazy-loading 'fault' on Instance uuid f8e72888-9df0-4e32-966a-3aa8251ccf6a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:14.306600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb74b09e854f6186ecbd901d14eed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2586620f624946558f8e453b1736a0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:14.373808 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-81a67f73-14ad-46f0-8287-d53e7cd01525 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 200 len: 1315 microversion: 2.1 time: 1.363091 Nov 02 12:33:14.375002 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1416/2827] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:13 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 1315 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:14.394327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0efe5eb0-7532-4977-9ac6-ab0e9a21fa19 req-c9f109bb-f986-405b-8e63-72787ce934ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "name": "network-vif-plugged", "status": "completed", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:14.456375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0efe5eb0-7532-4977-9ac6-ab0e9a21fa19 req-c9f109bb-f986-405b-8e63-72787ce934ca service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.460050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0efe5eb0-7532-4977-9ac6-ab0e9a21fa19 req-c9f109bb-f986-405b-8e63-72787ce934ca service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.461109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0efe5eb0-7532-4977-9ac6-ab0e9a21fa19 req-c9f109bb-f986-405b-8e63-72787ce934ca service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:14.525789 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0efe5eb0-7532-4977-9ac6-ab0e9a21fa19 req-c9f109bb-f986-405b-8e63-72787ce934ca service nova] Creating event network-vif-plugged:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h1-855650-5 Nov 02 12:33:14.555194 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0efe5eb0-7532-4977-9ac6-ab0e9a21fa19 req-c9f109bb-f986-405b-8e63-72787ce934ca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173917 Nov 02 12:33:14.558827 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1417/2828] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:14.587545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:14.593597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:14.617244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.625094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.625948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:14.630808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.632233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.634021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:14.844218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:33:14.845280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:33:14.846456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:33:14.847640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:33:14.848834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:33:14.885270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.887301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.890237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:14.893178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.896068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.898277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.054169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Getting quotas for project e18d3fa3bae4432a80b1a1fa20f6c04b. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:33:15.079203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Getting quotas for user b11008ce44ae4a438dfbd350e67d1232 and project e18d3fa3bae4432a80b1a1fa20f6c04b. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:33:15.115793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:15.118498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:33:15.137042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:33:15.140713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:15.148547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:15.168254 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bbbdd796-641c-4440-a958-45f74460dc68 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.598765 Nov 02 12:33:15.169429 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1418/2829] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:14 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:15.181593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-289b4655-a6b0-465e-ad3e-3cc24baa0ada req-3784348c-ad42-4a5c-8db5-9edb61933dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e72888-9df0-4e32-966a-3aa8251ccf6a", "name": "network-vif-deleted", "tag": "c01f246f-a05d-4c0c-a684-a2a989a87ce7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:15.238297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-289b4655-a6b0-465e-ad3e-3cc24baa0ada req-3784348c-ad42-4a5c-8db5-9edb61933dbb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.239327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-289b4655-a6b0-465e-ad3e-3cc24baa0ada req-3784348c-ad42-4a5c-8db5-9edb61933dbb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.239769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-289b4655-a6b0-465e-ad3e-3cc24baa0ada req-3784348c-ad42-4a5c-8db5-9edb61933dbb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.276133 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-289b4655-a6b0-465e-ad3e-3cc24baa0ada req-3784348c-ad42-4a5c-8db5-9edb61933dbb service nova] Creating event network-vif-deleted:c01f246f-a05d-4c0c-a684-a2a989a87ce7 for instance f8e72888-9df0-4e32-966a-3aa8251ccf6a on n-h1-855650-5 Nov 02 12:33:15.291661 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-289b4655-a6b0-465e-ad3e-3cc24baa0ada req-3784348c-ad42-4a5c-8db5-9edb61933dbb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119282 Nov 02 12:33:15.292688 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1419/2830] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:15.306848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:15.313053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:15.333282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.336185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.337520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.341817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.342847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.344694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.443323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f0fa93b-8230-4b93-8ec4-aec7115995fa tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.137424 Nov 02 12:33:15.445385 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1412/2831] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 5142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:33:15.468420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:15.470148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:15.524158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.528400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.529234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.532028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.534552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.535729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.417917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:16.440558 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ec34a9a6-1ea8-493f-b8a4-74758879281e tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1478 microversion: 2.1 time: 1.139556 Nov 02 12:33:16.441218 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1420/2832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:15 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1478 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:16.466606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:16.467714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] [instance: f8e72888-9df0-4e32-966a-3aa8251ccf6a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:16.484951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.485526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.486045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.491227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.491722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.492169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.534100 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] HTTP exception thrown: Instance f8e72888-9df0-4e32-966a-3aa8251ccf6a could not be found. Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Request method failure captured: Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a HTTP/1.1 Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmNeSupt3SVq8RtAUegx2vBI722S6fjBzSh_XAWQouOQTK7SKsuJ5xAVur2PtVW-rS3b1_KMeU_7Yr5Whzu4oJ7BwbJtGWhblq0o9O5sLyDntQr-0hl7ikp_mmuIL0UAdkr3FRTsIZAeZUaCRgNtXMIQSemlx-Kd5YLcNSWa-rgVYyg Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 2586620f624946558f8e453b1736a0fd Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2586620f624946558f8e453b1736a0fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2586620f624946558f8e453b1736a0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2586620f624946558f8e453b1736a0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2586620f624946558f8e453b1736a0fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 2586620f624946558f8e453b1736a0fd Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1892256892 Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-InstanceActionsNegativeTestJSON-1892256892-project Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 39cb74b09e854f6186ecbd901d14eed5 Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1892256892-project Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f8e72888-9df0-4e32-966a-3aa8251ccf6a could not be found. Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f8e72888-9df0-4e32-966a-3aa8251ccf6a'} Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e72888-9df0-4e32-966a-3aa8251ccf6a could not be found. Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e72888-9df0-4e32-966a-3aa8251ccf6a could not be found. Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:16.542069 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e72888-9df0-4e32-966a-3aa8251ccf6a could not be found. Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] Returning 404 to user: Instance f8e72888-9df0-4e32-966a-3aa8251ccf6a could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:16.546856 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-70da9817-09c0-40a0-b2af-ff28f1f893a6 tempest-InstanceActionsNegativeTestJSON-1892256892 tempest-InstanceActionsNegativeTestJSON-1892256892-project] 10.222.0.45 "GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a" status: 404 len: 111 microversion: 2.1 time: 0.084844 Nov 02 12:33:16.548123 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1421/2833] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:16 2022] GET /compute/v2.1/servers/f8e72888-9df0-4e32-966a-3aa8251ccf6a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:16.555340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c381dc71-77e1-452e-8ced-32d375687044 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:16.561024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c381dc71-77e1-452e-8ced-32d375687044 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:16.648962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:16.696889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:16.726295 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ab9d419-016b-4980-a398-601ff9bac4e1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1312 microversion: 2.1 time: 1.276740 Nov 02 12:33:16.727466 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1413/2834] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:15 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1312 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:16.752902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:16.760001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:16.802279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.809005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.814200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.819983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.823912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.825793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.868739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c381dc71-77e1-452e-8ced-32d375687044 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:16.883453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c381dc71-77e1-452e-8ced-32d375687044 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1215 microversion: 2.1 time: 0.333459 Nov 02 12:33:16.892325 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1422/2835] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:16 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:16.898746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1a52eaf6-1d4c-4a29-b93c-1ed139d42c25 req-f54cd93b-b786-4531-87c4-ce50aeb1bf7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0bd24-8c20-4b97-a4ae-2075c823179e", "name": "network-vif-plugged", "status": "completed", "tag": "6a26b325-c41a-4ba3-9291-36c10956f17c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:16.956063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1a52eaf6-1d4c-4a29-b93c-1ed139d42c25 req-f54cd93b-b786-4531-87c4-ce50aeb1bf7f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.975662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1a52eaf6-1d4c-4a29-b93c-1ed139d42c25 req-f54cd93b-b786-4531-87c4-ce50aeb1bf7f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.982522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1a52eaf6-1d4c-4a29-b93c-1ed139d42c25 req-f54cd93b-b786-4531-87c4-ce50aeb1bf7f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:17.007626 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1a52eaf6-1d4c-4a29-b93c-1ed139d42c25 req-f54cd93b-b786-4531-87c4-ce50aeb1bf7f service nova] Creating event network-vif-plugged:6a26b325-c41a-4ba3-9291-36c10956f17c for instance 05f0bd24-8c20-4b97-a4ae-2075c823179e on n-h2-855650-5 Nov 02 12:33:17.017620 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1a52eaf6-1d4c-4a29-b93c-1ed139d42c25 req-f54cd93b-b786-4531-87c4-ce50aeb1bf7f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123357 Nov 02 12:33:17.019376 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1423/2836] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:17.245635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:17.266645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:17.272859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:17.296117 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15e81aac-5894-475e-89fa-149edbe2c021 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.560027 Nov 02 12:33:17.296752 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1414/2837] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:16 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:17.472329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:17.473157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:17.487727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:17.494882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:17.495750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:17.498586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:17.501143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:17.503491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:17.762021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:17.765144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:17.788122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:17.803974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:17.804474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:17.805246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:17.805717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:17.810235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:18.199211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:18.210320 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8cf049a8-691a-4ee0-90ad-7cd6b87f0bc2 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1478 microversion: 2.1 time: 0.744526 Nov 02 12:33:18.230994 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1424/2838] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:17 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1478 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:18.241811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:18.243389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:18.250546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:18.252056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:18.252762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:18.253847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:18.254602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:18.255326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:18.606506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:18.627320 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c1614edf-1df1-4808-8cfb-d6309aa93f60 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1267 microversion: 2.1 time: 0.394768 Nov 02 12:33:18.632608 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1425/2839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:18 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1267 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:18.639279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:18.647650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:18.661058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:18.666333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:18.667360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:18.669634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:18.672750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:18.673505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:18.825030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:18.835017 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-103d2316-3bd5-4691-b14b-9a787cb7e54f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1461 microversion: 2.1 time: 1.081868 Nov 02 12:33:18.835516 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1415/2840] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:17 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1461 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:18.849897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:18.875424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:18.877014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:18.901465 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-28325786-1964-4602-b30c-46f7e13589f7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.267201 Nov 02 12:33:18.902970 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1426/2841] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:18 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:19.253838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:19.253838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:19.262964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.263812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.264382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.265265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.273882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.274835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.665535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:19.666393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:19.682996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.687306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.689251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.693375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.694278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.696236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.276879 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d87ec5c6-69a4-4935-ab1e-29f7d81263ac tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1612 microversion: 2.1 time: 1.417172 Nov 02 12:33:20.299221 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1416/2842] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:18 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1612 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:20.307142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:20.308089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:20.315950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.316455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.316907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.317017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:20.317658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.318950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.319623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.328078 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f7f0489-9557-4e8d-addc-b2a24bc57bb7 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1478 microversion: 2.1 time: 1.087381 Nov 02 12:33:20.343286 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1427/2843] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:19 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1478 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:20.359426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:20.360433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:20.373375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.382983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.383622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.385248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.385898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.386617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.471696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:20.496026 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6011312-ff6b-463a-bd8b-a0feb6e3953f tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1273 microversion: 2.1 time: 0.195186 Nov 02 12:33:20.524899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:20.532113 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1417/2844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:20 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:20.548215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:20.550198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:20.567022 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7b45a00c-1286-4e42-9963-df84f592d383 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.222158 Nov 02 12:33:20.567700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:20.573694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:20.582465 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1428/2845] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:20 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:20.607763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.614983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.620353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.623749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.628481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.631254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.783605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '967308c7423c43a59823c37d00c23296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '564a0532b82544df89f251012064ec27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:20.784482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] flavor_id is None. Assuming migration. {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 12:33:20.784949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:33:21.357679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:21.359154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:21.368419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:21.369510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:21.370323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:21.371274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:21.371904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:21.372860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:21.512481 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-49abb8af-8dc2-4c0f-8d9b-74d9829ae55b tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53/action" status: 202 len: 0 microversion: 2.1 time: 0.971230 Nov 02 12:33:21.520770 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1418/2846] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:33:20 2022] POST /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53/action => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:21.533156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:21.535990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:21.553239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:21.554400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:21.556063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:21.557607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:21.558696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:21.559692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:22.603667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:22.614922 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b00b4149-f818-4c51-b466-21d9efd1c0b8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1463 microversion: 2.1 time: 1.261802 Nov 02 12:33:22.623407 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1429/2847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:21 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1463 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:22.634828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:22.635862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:22.660192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:22.662484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:22.664053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:22.669991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:22.672017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:22.673495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:22.736592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:22.850722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:22.863238 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f7b2eb8-62f3-43b7-9502-62e20e190722 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1470 microversion: 2.1 time: 1.339828 Nov 02 12:33:22.864678 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1419/2848] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:21 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1470 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:22.884669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:22.889902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:22.913311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:22.914903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:22.919225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:22.926231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:22.931107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:22.933539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:23.227339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:23.246230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:23.251949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:23.273181 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4810f507-96c2-4c34-b31a-78cf9cbed678 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.406084 Nov 02 12:33:23.275854 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1420/2849] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:22 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:23.294960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:23.299816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:23.332020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:23.335224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:23.336093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:23.337051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:23.343421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:23.344140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:23.573997 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ba32b0d-9007-4deb-9352-8a2e40aef0a8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action" status: 202 len: 0 microversion: 2.1 time: 0.294923 Nov 02 12:33:23.580092 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1421/2850] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:33:23 2022] POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:23.594589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:23.596371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:23.617281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:23.618220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:23.619022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:23.620334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:23.621162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:23.621944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:23.735935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:23.738226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:23.739469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:23.740578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lazy-loading 'fault' on Instance uuid 05f0bd24-8c20-4b97-a4ae-2075c823179e {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:24.101012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:24.119772 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eda79e4b-a4c2-45fb-8121-d50bcbfc2b68 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 1.494668 Nov 02 12:33:24.120625 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1430/2851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:22 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:24.133788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:24.137746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:24.156607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.157911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.159034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.160828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.162547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.163538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.961769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:25.109791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:25.294074 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bf8dd98f-aa31-4575-b432-8bb3249f900a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1597 microversion: 2.1 time: 1.702807 Nov 02 12:33:25.295805 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1422/2852] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:23 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1597 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:25.309163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:25.310437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:25.329783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.331108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.331589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.332360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.332837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.333273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.534085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:25.574759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:25.577468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:25.605485 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7926aed5-5cde-4d2c-a4be-b6a35ccf629f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.307535 Nov 02 12:33:25.624017 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1423/2853] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:25 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:25.646913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:25.648210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:25.667889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:25.673915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.679234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.680030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.681240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.681926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.683562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.753246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:25.765370 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a124f38-04f3-4d40-91bd-b04ef4e4f15b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1470 microversion: 2.1 time: 1.643066 Nov 02 12:33:25.769791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1431/2854] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:24 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1470 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:25.781716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:25.788355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:25.808150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:25.818813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.821897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.822576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.823518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.824164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.824761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.981526 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b2a869d1-a78a-49c9-bf35-babd8bcacab8 tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action" status: 202 len: 0 microversion: 2.1 time: 0.209726 Nov 02 12:33:25.982604 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1432/2855] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:33:25 2022] POST /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:25.993205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:25.994090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:26.013325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.014069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.019107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.026972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.027972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.028823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.657360 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d368aef4-4d07-47cd-9fac-79b00a69ed7a tempest-ServersAdminTestJSON-1570011583 tempest-ServersAdminTestJSON-1570011583-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1614 microversion: 2.1 time: 0.668525 Nov 02 12:33:26.663994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:26.686136 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1433/2856] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:25 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1614 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:26.686441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a5f1c49-f186-4c43-94c2-13b03f85d069 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 1.050247 Nov 02 12:33:26.700976 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1424/2857] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:25 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:26.701341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:26.703779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:26.718090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.718998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.719948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.725125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.731716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:26.732849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:26.739348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.740960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.743825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.747570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.748431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.753216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.754147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.754873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.833393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:26.873247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:26.923138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:26.994973 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af4b780f-2616-4768-b5db-b25fc5ff2d6f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 204 len: 0 microversion: 2.1 time: 0.267303 Nov 02 12:33:26.995938 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1425/2858] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:26 2022] DELETE /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:33:27.005859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:27.018995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:27.027191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:27.028307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:27.028307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:27.029000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:27.030803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:27.034668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:27.137646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:27.153140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:27.179715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:27.196151 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-47e68910-e168-40b1-afe2-f0a8496e6be1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.521361 Nov 02 12:33:27.200533 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1434/2859] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:26 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:27.210868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:27.212095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:27.234478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:27.237773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:27.238630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:27.241515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:27.243533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:27.244132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.135769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:28.153948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:28.157515 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55180d4a-4271-435d-bb56-f5be20b53116 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1470 microversion: 2.1 time: 1.156974 Nov 02 12:33:28.159187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1426/2860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:26 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1470 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:28.176557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:28.180592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:28.186501 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-545f9833-3389-4755-8b3f-bf8980aea6dd tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1468 microversion: 2.1 time: 0.983987 Nov 02 12:33:28.187344 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1435/2861] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:27 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1468 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:28.190918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.191782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.192797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.194523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.195553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.196333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.234416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:28.235408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:28.252212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.253009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.253755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.254762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.255427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.256121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.484669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:28.509559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:28.511223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:28.528027 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb453429-6e53-4aa2-a441-4f717458c3e0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.298662 Nov 02 12:33:28.528665 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1436/2862] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:28 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:33:28.532809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:28.559840 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f8dcdab-abad-41ce-9ee9-86acbea9e024 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 0.392633 Nov 02 12:33:28.570416 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1427/2863] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:28 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:28.746941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-87758ef2-27d2-419d-9cd3-654f99c21295 req-46c60c75-9632-4946-a533-01d7e21e31b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23217e96-4f58-4172-a45d-9efd3f7996ab", "tag": "c98dda07-76d1-4390-8db0-7ae8ff50a736"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:28.768551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-87758ef2-27d2-419d-9cd3-654f99c21295 req-46c60c75-9632-4946-a533-01d7e21e31b9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.777020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-87758ef2-27d2-419d-9cd3-654f99c21295 req-46c60c75-9632-4946-a533-01d7e21e31b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.777851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-87758ef2-27d2-419d-9cd3-654f99c21295 req-46c60c75-9632-4946-a533-01d7e21e31b9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.823155 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-87758ef2-27d2-419d-9cd3-654f99c21295 req-46c60c75-9632-4946-a533-01d7e21e31b9 service nova] Creating event network-changed:c98dda07-76d1-4390-8db0-7ae8ff50a736 for instance 23217e96-4f58-4172-a45d-9efd3f7996ab on n-h1-855650-5 Nov 02 12:33:28.830659 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-87758ef2-27d2-419d-9cd3-654f99c21295 req-46c60c75-9632-4946-a533-01d7e21e31b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088063 Nov 02 12:33:28.832730 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1437/2864] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:29.188697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:29.190141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:29.216430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.231733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:29.237047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:29.241904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.242865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.249399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.250331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.254167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.280938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.281871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.282771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.293526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.296769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.296987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.885622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:30.901869 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c106b45b-31ad-4f5e-9537-8065975d0191 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 1.717724 Nov 02 12:33:30.914154 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1428/2865] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:29 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:30.916279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:30.917686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:30.930455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.934055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.934878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.935837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.936549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.937380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.941858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:30.955400 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-25336ad3-813e-4551-9411-bde0d92a0eba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1468 microversion: 2.1 time: 1.733935 Nov 02 12:33:30.957216 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1438/2866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:29 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1468 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:30.973916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:30.983487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:30.999072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:31.006790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:31.007482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:31.008490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:31.009152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:31.009704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:31.145141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:31.157133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:31.159409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:31.170026 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9abb9b1e-bd39-42c5-a4c1-528c3302da34 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1556 microversion: 2.91 time: 0.265630 Nov 02 12:33:31.189569 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1429/2867] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:30 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1556 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:31.977721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8b2a455-26dc-4c00-a6ce-fae8538df083 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Action: 'create', calling method: .version_select at 0x7f228dce0310>, body: {"keypair": {"name": "tempest-keypair-1971258558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb19M4NFg9MXT4Z4p0o1Q5ZY3yOTS4qpMt+c6Rxz4F0nHzQHPj73anHqd1lR5eKp9fVNFxWQCD+9f2AOgsIY9sRdL6Rs4NwIzBhSVrYiOguTApEGhyQDvibpzgDZ/yPYA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:32.137938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-e8b2a455-26dc-4c00-a6ce-fae8538df083 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Getting quotas for project 60b7340637d745b5875c43f1589869ea. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:33:32.179120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-e8b2a455-26dc-4c00-a6ce-fae8538df083 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Getting quotas for user 5446fad0c7a74bfd936b34867a943bfa and project 60b7340637d745b5875c43f1589869ea. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:33:32.342729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8b2a455-26dc-4c00-a6ce-fae8538df083 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.731228 Nov 02 12:33:32.345401 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1430/2868] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:33:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:32.359546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:32.360305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:32.371639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.372843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.373428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.374513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.375015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.375463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.779553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:32.828920 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16bab5c3-deab-447c-b3ff-6b0ac6f69310 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 1.864684 Nov 02 12:33:32.834495 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1439/2869] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:30 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:32.855008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:32.867299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:32.872938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:32.893205 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aebc49f7-1558-4821-9848-adc6fc79ecb3 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 0.545745 Nov 02 12:33:32.904293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.913334 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1431/2870] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:32 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:32.914365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.920913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.927172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.932214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.933308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.939602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:32.945045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:32.955696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.959695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.960847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.964500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.967092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.967802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.071328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.071943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.072608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.075256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lazy-loading 'fault' on Instance uuid b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:33.285234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:33.314740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:33.318701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:33.324858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:33.332594 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-211a58c0-3121-4f05-9391-94bfe7230010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1556 microversion: 2.91 time: 0.417989 Nov 02 12:33:33.361426 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1432/2871] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:32 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1556 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:33.372631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3f5727e9-0a9a-414c-8fc4-0378bc909fc1 req-cae2f62f-b3c3-44c7-9549-a4a99a6ad17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb", "name": "network-vif-deleted", "tag": "18a89dec-a15f-424b-a75d-6f031e27d317"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:33.400716 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b47abd9-9b98-4b29-9a96-eef17312fad0 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 200 len: 1302 microversion: 2.1 time: 0.534145 Nov 02 12:33:33.403583 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1440/2872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:32 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 1302 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:33.406172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3f5727e9-0a9a-414c-8fc4-0378bc909fc1 req-cae2f62f-b3c3-44c7-9549-a4a99a6ad17c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.406950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3f5727e9-0a9a-414c-8fc4-0378bc909fc1 req-cae2f62f-b3c3-44c7-9549-a4a99a6ad17c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.407733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3f5727e9-0a9a-414c-8fc4-0378bc909fc1 req-cae2f62f-b3c3-44c7-9549-a4a99a6ad17c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.447521 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3f5727e9-0a9a-414c-8fc4-0378bc909fc1 req-cae2f62f-b3c3-44c7-9549-a4a99a6ad17c service nova] Creating event network-vif-deleted:18a89dec-a15f-424b-a75d-6f031e27d317 for instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb on n-h2-855650-5 Nov 02 12:33:33.477783 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3f5727e9-0a9a-414c-8fc4-0378bc909fc1 req-cae2f62f-b3c3-44c7-9549-a4a99a6ad17c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110818 Nov 02 12:33:33.481389 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1433/2873] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:33.865851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:33.867136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:33.905609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.908109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.909724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.919475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.923216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.925795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.945424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:33.948096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:33.979554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.980105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.982992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.988148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.991558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.993933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.563708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:34.579259 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-550ad159-301f-4bd4-80f8-108f05523de7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 0.647829 Nov 02 12:33:34.593076 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1434/2874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:33 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:34.614278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:34.618589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:34.644669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.647457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.649029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.653648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.656032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.659653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.773553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:34.823378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:34.835677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:34.838675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:34.846917 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4458a1b4-a6c4-442f-b84e-01ae40f0589c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1556 microversion: 2.91 time: 0.251162 Nov 02 12:33:34.848346 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1435/2875] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:34 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1556 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:34.850464 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-79a7d60b-78b1-4fea-b72f-b750e183cd70 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 0.988185 Nov 02 12:33:34.852778 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1441/2876] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:33 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:34.873906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:34.874877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:34.882305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.883110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.883722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.884679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.885379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.885995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.905302 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] HTTP exception thrown: Instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb could not be found. Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Request method failure captured: Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb HTTP/1.1 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmLXBvDPFR8NvB0oSEvMcQOCs6jm5bpzAZcUIwAymv6D4X1EfHFeHX14S25rPvmEObftZRwyRhoXgj72oFcdR0KhBwZoD66whaYIrI3d2DKQN7qEKvWOAC6yk_RM5CXIJihWKFQ5ZKcTcslTUvnZut6D8w15c2Wc5rXx6LPwxp0nh2E Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d36baae805244e6983900973dd6dca37 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d36baae805244e6983900973dd6dca37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d36baae805244e6983900973dd6dca37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d36baae805244e6983900973dd6dca37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d36baae805244e6983900973dd6dca37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d36baae805244e6983900973dd6dca37 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdminTestJSON-1152639591-project Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d27030caf3f740368ba4b588132e2b21 Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdminTestJSON-1152639591-project Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb could not be found. Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb'} Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb could not be found. Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb could not be found. Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:34.908133 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:34.914611 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:34.914611 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:34.914611 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:34.914611 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:34.914611 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:34.914611 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb could not be found. Nov 02 12:33:34.914611 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:34.916500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Returning 404 to user: Instance b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:34.924080 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78b3c731-e366-40a9-9fda-1d1e6c3a2a69 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb" status: 404 len: 111 microversion: 2.1 time: 0.071473 Nov 02 12:33:34.931961 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1436/2877] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:34 2022] GET /compute/v2.1/servers/b3a5ca38-ebc9-45d6-a8f4-6d9d88f329fb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:34.946717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:34.947655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:34.973746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.979184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.981011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.983745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.985308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.986546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.052914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:35.313478 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94449448-5737-46d4-ada3-9723f4661b7b tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 204 len: 0 microversion: 2.1 time: 0.371777 Nov 02 12:33:35.315160 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1442/2878] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:34 2022] DELETE /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:33:35.331040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:35.336344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:35.369644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.371149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.374140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.376046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.377346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.378724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.648962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:35.654305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:35.692629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.694103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.705611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.707723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.708949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.710040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.034913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:36.053896 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d67c3b6-5f2f-430a-9fcc-94cc80cf08a8 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1470 microversion: 2.1 time: 0.733189 Nov 02 12:33:36.054630 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1437/2879] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:35 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1470 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:36.060301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.060930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.080431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.080935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.081386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.082143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.083069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.084231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.691473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:36.703025 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-68bf06b5-2ecb-49a8-98d4-16c09735da38 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 1.063947 Nov 02 12:33:36.726269 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1443/2880] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:35 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:36.747981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.748944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.764878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.765939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.768346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.770979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.772784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.775051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.848895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:36.868053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:36.876853 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e1d74aa-6244-491c-b706-18d8c9272609 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 0.820839 Nov 02 12:33:36.883981 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1438/2881] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:36 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:36.935315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:36.945816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:36.947912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:36.954349 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6cbbf39a-0d8d-45f1-98f6-409e17bee20e tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.218573 Nov 02 12:33:36.970924 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1444/2882] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:36 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:37.088324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:37.089277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:37.107115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.116428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.118795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.120399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.127018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.128082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.736815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:37.740341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:37.772449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.773708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.774621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.776691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.781194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.782938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.696959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:38.733233 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c97e483e-1e4b-40d8-95bf-fa691abb8f72 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1470 microversion: 2.1 time: 1.653457 Nov 02 12:33:38.737512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1439/2883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:37 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1470 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:38.756483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:38.757543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:38.784919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.787761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.793176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.795659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.799450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.806311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.835419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:38.848846 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d6bb8e4-ca23-4901-b152-406760c18934 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 1.119671 Nov 02 12:33:38.891493 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1445/2884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:37 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:38.917197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:38.917882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:38.976348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.977096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.977569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.986697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.987209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.987674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.297354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.343242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.345718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.385981 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fc5588c3-bdaa-48ca-bc71-5514b39182ee tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.492952 Nov 02 12:33:39.402005 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1446/2885] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:38 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:39.451866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.468123 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-138260e9-2ba7-4e76-b34d-83e78fbc8d12 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 0.725187 Nov 02 12:33:39.483270 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1440/2886] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:38 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:39.553924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5ffdc106-f1aa-48d6-b065-47d46cd863b0 req-e37591e6-6c3b-4666-bb87-5c2a3c3dfbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9781c413-fe30-4c8b-9f72-498daa9ee767", "name": "network-vif-deleted", "tag": "d99043bf-664c-4d91-934b-b6c983cb2e5b"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:39.583865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5ffdc106-f1aa-48d6-b065-47d46cd863b0 req-e37591e6-6c3b-4666-bb87-5c2a3c3dfbd4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.584647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5ffdc106-f1aa-48d6-b065-47d46cd863b0 req-e37591e6-6c3b-4666-bb87-5c2a3c3dfbd4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.585276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5ffdc106-f1aa-48d6-b065-47d46cd863b0 req-e37591e6-6c3b-4666-bb87-5c2a3c3dfbd4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.619966 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5ffdc106-f1aa-48d6-b065-47d46cd863b0 req-e37591e6-6c3b-4666-bb87-5c2a3c3dfbd4 service nova] Creating event network-vif-deleted:d99043bf-664c-4d91-934b-b6c983cb2e5b for instance 9781c413-fe30-4c8b-9f72-498daa9ee767 on n-h2-855650-5 Nov 02 12:33:39.642039 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5ffdc106-f1aa-48d6-b065-47d46cd863b0 req-e37591e6-6c3b-4666-bb87-5c2a3c3dfbd4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092983 Nov 02 12:33:39.649233 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1447/2887] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:33:39.768669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:39.770165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:39.793517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.795631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.799923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.803987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.807818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.812586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.921496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:39.923621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:39.925388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.926612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.929706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.931387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lazy-loading 'fault' on Instance uuid 9781c413-fe30-4c8b-9f72-498daa9ee767 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:39.939148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.941852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.942711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.949356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.950230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.950864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.266110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.276921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc2f4d92-66d7-4b4e-8e13-f775225e842f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 200 len: 1304 microversion: 2.1 time: 0.513171 Nov 02 12:33:40.290554 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1441/2888] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:39 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 1304 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:40.499812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.520285 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f153010-8ca4-412a-a93d-d7dfffdfd0ac tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 0.604780 Nov 02 12:33:40.522366 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1448/2889] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:39 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:40.533686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:40.535866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:40.552712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.554249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.555508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.557240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.558525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.560620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.649778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e78f3620-5f25-4135-9015-a550a30c665f tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1931382858", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:40.664324 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e78f3620-5f25-4135-9015-a550a30c665f tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] HTTP exception thrown: min_count must be <= max_count Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e78f3620-5f25-4135-9015-a550a30c665f tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Request method failure captured: Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 184 Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmOjQlW_3m3SWs3kU-n542Wjbelw9D6qI8zN4B3r2lz6wKuwmUm_Icx1anAJtGp5RrY1-ReKPpFAqNPr3rFdTIzqskglcZ7fqomHQs-f_jaI1o45DTT3dyNWFMnbQBiO7nd2N2Evav-FE619M6EM29hu7TiQLjqX5ArWAv_3V87VFJQ Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f3d3fb05846845b795a43cee0f0b2039 Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1931382858", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: exception: min_count must be <= max_count Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1931382858', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Nov 02 12:33:40.669232 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.678972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e78f3620-5f25-4135-9015-a550a30c665f tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Returning 400 to user: min_count must be <= max_count {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:40.680317 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e78f3620-5f25-4135-9015-a550a30c665f tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.388471 Nov 02 12:33:40.686896 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1442/2890] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:40 2022] POST /compute/v2.1/servers => generated 74 bytes in 396 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:33:40.698507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:40.708941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:40.723354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.724294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.729886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.731430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.734224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.735030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.812810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.864218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.874046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.893896 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5382ebd6-ae71-420f-87c9-d109f3ffc6e3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.368209 Nov 02 12:33:40.895590 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1449/2891] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:40 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:40.902763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57af2843-5c46-469b-bce1-f0adb4ae8cff tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1567175127", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "max_count": 0}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57af2843-5c46-469b-bce1-f0adb4ae8cff tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Request method failure captured: Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 168 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmOjQlW_3m3SWs3kU-n542Wjbelw9D6qI8zN4B3r2lz6wKuwmUm_Icx1anAJtGp5RrY1-ReKPpFAqNPr3rFdTIzqskglcZ7fqomHQs-f_jaI1o45DTT3dyNWFMnbQBiO7nd2N2Evav-FE619M6EM29hu7TiQLjqX5ArWAv_3V87VFJQ Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f3d3fb05846845b795a43cee0f0b2039 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1567175127", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "max_count": 0}} Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1567175127', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'max_count': 0}}} Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 0 Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:33:40.907742 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:33:40.913175 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:40.919760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57af2843-5c46-469b-bce1-f0adb4ae8cff tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:40.923754 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57af2843-5c46-469b-bce1-f0adb4ae8cff tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025098 Nov 02 12:33:40.926253 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1450/2892] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:33:41.082792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c3c60ae-a21f-458e-b2c9-238a1146e27e tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-62560017", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "max_count": 2.5}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c3c60ae-a21f-458e-b2c9-238a1146e27e tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Request method failure captured: Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 168 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmOjQlW_3m3SWs3kU-n542Wjbelw9D6qI8zN4B3r2lz6wKuwmUm_Icx1anAJtGp5RrY1-ReKPpFAqNPr3rFdTIzqskglcZ7fqomHQs-f_jaI1o45DTT3dyNWFMnbQBiO7nd2N2Evav-FE619M6EM29hu7TiQLjqX5ArWAv_3V87VFJQ Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f3d3fb05846845b795a43cee0f0b2039 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-62560017", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "max_count": 2.5}} Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-62560017', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'max_count': 2.5}}} Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:33:41.095299 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:33:41.105364 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.110172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c3c60ae-a21f-458e-b2c9-238a1146e27e tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:41.116923 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c3c60ae-a21f-458e-b2c9-238a1146e27e tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.040905 Nov 02 12:33:41.117908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1451/2893] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:33:41.149156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:41.167821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8086cdf-6cb3-41b5-9f8f-0b17bf6f3e52 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 0.479302 Nov 02 12:33:41.182067 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1443/2894] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:40 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:41.225125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c990a92-69e1-45bc-91bc-11762754ae82 tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1934087932", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 0}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c990a92-69e1-45bc-91bc-11762754ae82 tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Request method failure captured: Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 168 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmOjQlW_3m3SWs3kU-n542Wjbelw9D6qI8zN4B3r2lz6wKuwmUm_Icx1anAJtGp5RrY1-ReKPpFAqNPr3rFdTIzqskglcZ7fqomHQs-f_jaI1o45DTT3dyNWFMnbQBiO7nd2N2Evav-FE619M6EM29hu7TiQLjqX5ArWAv_3V87VFJQ Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f3d3fb05846845b795a43cee0f0b2039 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1934087932", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 0}} Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1934087932', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'min_count': 0}}} Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 0 Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:33:41.230008 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:33:41.235350 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.237572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c990a92-69e1-45bc-91bc-11762754ae82 tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:41.238810 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9c990a92-69e1-45bc-91bc-11762754ae82 tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018451 Nov 02 12:33:41.240084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1452/2895] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:41 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:33:41.306436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.307381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 9781c413-fe30-4c8b-9f72-498daa9ee767] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.323141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.329590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d291a19-9927-4b5c-91fd-80682935635b tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-697917733", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 2.5}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:41.334469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d291a19-9927-4b5c-91fd-80682935635b tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Request method failure captured: Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 169 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmOjQlW_3m3SWs3kU-n542Wjbelw9D6qI8zN4B3r2lz6wKuwmUm_Icx1anAJtGp5RrY1-ReKPpFAqNPr3rFdTIzqskglcZ7fqomHQs-f_jaI1o45DTT3dyNWFMnbQBiO7nd2N2Evav-FE619M6EM29hu7TiQLjqX5ArWAv_3V87VFJQ Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8192b5a214d04795a6ab45354f9dcead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 8192b5a214d04795a6ab45354f9dcead Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1757930099 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f3d3fb05846845b795a43cee0f0b2039 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1757930099-project Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-697917733", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 2.5}} Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-697917733', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'min_count': 2.5}}} Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:33:41.336692 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:33:41.341622 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.342913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.343811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.344385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.352145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d291a19-9927-4b5c-91fd-80682935635b tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:41.352145 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d291a19-9927-4b5c-91fd-80682935635b tempest-MultipleCreateNegativeTestJSON-1757930099 tempest-MultipleCreateNegativeTestJSON-1757930099-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026483 Nov 02 12:33:41.352963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.356163 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1453/2896] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:33:41.381550 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] HTTP exception thrown: Instance 9781c413-fe30-4c8b-9f72-498daa9ee767 could not be found. Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Request method failure captured: Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 HTTP/1.1 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmLXBvDPFR8NvB0oSEvMcQOCs6jm5bpzAZcUIwAymv6D4X1EfHFeHX14S25rPvmEObftZRwyRhoXgj72oFcdR0KhBwZoD66whaYIrI3d2DKQN7qEKvWOAC6yk_RM5CXIJihWKFQ5ZKcTcslTUvnZut6D8w15c2Wc5rXx6LPwxp0nh2E Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d36baae805244e6983900973dd6dca37 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d36baae805244e6983900973dd6dca37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d36baae805244e6983900973dd6dca37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d36baae805244e6983900973dd6dca37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d36baae805244e6983900973dd6dca37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d36baae805244e6983900973dd6dca37 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdminTestJSON-1152639591-project Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d27030caf3f740368ba4b588132e2b21 Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdminTestJSON-1152639591-project Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 9781c413-fe30-4c8b-9f72-498daa9ee767 could not be found. Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9781c413-fe30-4c8b-9f72-498daa9ee767'} Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9781c413-fe30-4c8b-9f72-498daa9ee767 could not be found. Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9781c413-fe30-4c8b-9f72-498daa9ee767 could not be found. Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:41.384253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.389206 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:41.389206 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:41.389206 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:41.389206 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:41.389206 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:41.389206 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9781c413-fe30-4c8b-9f72-498daa9ee767 could not be found. Nov 02 12:33:41.389206 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:33:41.390853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Returning 404 to user: Instance 9781c413-fe30-4c8b-9f72-498daa9ee767 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:41.392173 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11d2a56e-0444-4823-a0de-c65ba7a0ed4f tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767" status: 404 len: 111 microversion: 2.1 time: 0.091179 Nov 02 12:33:41.394280 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1444/2897] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:41 2022] GET /compute/v2.1/servers/9781c413-fe30-4c8b-9f72-498daa9ee767 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:41.406105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.406994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.419163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.420635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.421441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.441486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89774db6-f701-4994-83be-1cf2f86692d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Action: 'create', calling method: .version_select at 0x7f228e4d23a0>, body: {"keypair": {"name": "tempest-keypair-1248003859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4zgtHz4/N2nccBtr9QwojwOxkGYokijY6AhyLd+Z9mvGeKmS9wvh/hmRB//V6Eqn7sBoWgkITO35E9+Ev4XfFmDn1cJctQHxMgJ3mqu1kZ9Qgq76qRM2Lvd5iAfOjfmA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:41.442272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.443596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.444370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.488965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:41.508929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-89774db6-f701-4994-83be-1cf2f86692d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Getting quotas for project 4f7d4ee77f204c59a152667c634974d5. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:33:41.542272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-89774db6-f701-4994-83be-1cf2f86692d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Getting quotas for user 488c08ed761140ffbfd18033118772f6 and project 4f7d4ee77f204c59a152667c634974d5. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:33:41.654006 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-90cd3eac-d7ff-4ce1-a3d2-89d93dbc7b20 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "DELETE /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 204 len: 0 microversion: 2.1 time: 0.253496 Nov 02 12:33:41.656227 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1454/2898] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:41 2022] DELETE /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:33:41.663119 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89774db6-f701-4994-83be-1cf2f86692d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.224210 Nov 02 12:33:41.664935 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1445/2899] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 12:33:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 230 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:33:41.684027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.684722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.688148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.698651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.701812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.705067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.710058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.712489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.714666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.717353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.718367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.721951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.722727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.726380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.727223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.728379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.400527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.404802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:42.428738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.457027 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-579e44c4-1d4c-48f1-a642-c3335aa354ab tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1469 microversion: 2.1 time: 0.781682 Nov 02 12:33:42.460329 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f72e87de-c360-480d-942d-c9322536da0e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 0.797574 Nov 02 12:33:42.475794 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1455/2900] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:41 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:42.480920 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1446/2901] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:41 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1469 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:42.487239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6a18ede3-f64f-4529-b1d1-e9737d9d69a2 req-beb9f220-ae8e-4603-97f7-fee95a045322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23217e96-4f58-4172-a45d-9efd3f7996ab", "name": "network-vif-plugged", "status": "completed", "tag": "c98dda07-76d1-4390-8db0-7ae8ff50a736"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:42.496289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:42.497573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:42.511308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.517149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.518079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.518661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6a18ede3-f64f-4529-b1d1-e9737d9d69a2 req-beb9f220-ae8e-4603-97f7-fee95a045322 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.519656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6a18ede3-f64f-4529-b1d1-e9737d9d69a2 req-beb9f220-ae8e-4603-97f7-fee95a045322 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.521389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.522255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6a18ede3-f64f-4529-b1d1-e9737d9d69a2 req-beb9f220-ae8e-4603-97f7-fee95a045322 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.527362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.528271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.560038 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6a18ede3-f64f-4529-b1d1-e9737d9d69a2 req-beb9f220-ae8e-4603-97f7-fee95a045322 service nova] Creating event network-vif-plugged:c98dda07-76d1-4390-8db0-7ae8ff50a736 for instance 23217e96-4f58-4172-a45d-9efd3f7996ab on n-h1-855650-5 Nov 02 12:33:42.571883 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6a18ede3-f64f-4529-b1d1-e9737d9d69a2 req-beb9f220-ae8e-4603-97f7-fee95a045322 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087726 Nov 02 12:33:42.575981 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1447/2902] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:42.590807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:42.598678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:42.613843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.619359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.620309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.621492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.622524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.623229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.826441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.838697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.838697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.869048 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7b2d22bf-3a6f-4b65-8505-4fd1c4a3e16c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.391990 Nov 02 12:33:42.902003 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1456/2903] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:42 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:43.162652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1626305198", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "5b2cf652-d65e-4f87-b37e-f8a905f9e329"}], "security_groups": [{"name": "tempest-securitygroup--1350116307"}], "key_name": "tempest-keypair-1971258558", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:43.530154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:43.536349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] validate_networks() for [('5b2cf652-d65e-4f87-b37e-f8a905f9e329', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:33:43.584075 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fabda09c-09bf-4453-a430-4d42c6901cd8 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1315 microversion: 2.1 time: 0.998814 Nov 02 12:33:43.585856 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1448/2904] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:42 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1315 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:43.611796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:43.619021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:43.637122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.638529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.640003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.641802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.643921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.645065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.834657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:44.868520 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fa804d3d-edba-4b76-993e-12731f07ffa3 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1469 microversion: 2.1 time: 1.279753 Nov 02 12:33:44.918303 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1449/2905] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:43 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1469 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:44.941270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:44.967422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:44.995847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.015071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.016447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.017953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.019365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.020326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.104958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:46.146250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-116d8a33-e630-4fcb-adb4-ce121defbf14 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 1.217490 Nov 02 12:33:46.148392 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1450/2906] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:44 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:46.169336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:46.172617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:46.190131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.191434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.193277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.198287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.208667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.211761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.523388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:46.588506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:46.595094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:46.621728 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08df9f0b-6307-424f-bfd3-06acf18f22b4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.470805 Nov 02 12:33:46.638416 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1451/2907] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:46 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:46.658120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:46.658120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:46.693404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.701647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.703105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.704865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.715512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.717543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.023825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:33:47.024385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:33:47.024725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:33:47.025404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:33:47.028065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:33:47.051163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.053555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.054272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.055308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.056549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.057269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.085437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Getting quotas for project 60b7340637d745b5875c43f1589869ea. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:33:47.093234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Getting quotas for user 5446fad0c7a74bfd936b34867a943bfa and project 60b7340637d745b5875c43f1589869ea. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:33:47.110711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:33:47.113747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:33:47.184991 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9e52381b-4863-40b1-a054-6b261bddaf3e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.027478 Nov 02 12:33:47.186468 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1457/2908] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 4030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:33:47.192267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:47.194235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:47.203628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.205088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.205910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.207068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.207905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.209113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.321728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.324480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.325333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.327943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lazy-loading 'fault' on Instance uuid 05f0bd24-8c20-4b97-a4ae-2075c823179e {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:47.436524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:47.487452 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25e920b7-699a-41e5-a99e-9c885a9da0e4 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1503 microversion: 2.1 time: 0.849588 Nov 02 12:33:47.489825 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1452/2909] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:46 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1503 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:47.513498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27030caf3f740368ba4b588132e2b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36baae805244e6983900973dd6dca37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:47.546712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-5c6872a2-8881-42b8-a68a-1683331c42a9 req-f30955b9-0daa-4753-906a-68d31d6f6aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f0bd24-8c20-4b97-a4ae-2075c823179e", "name": "network-vif-deleted", "tag": "6a26b325-c41a-4ba3-9291-36c10956f17c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:47.564828 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e151163a-ed0a-413a-ae86-4d2a8c2521ba tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 200 len: 1304 microversion: 2.1 time: 0.376565 Nov 02 12:33:47.577204 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1458/2910] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:47 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 1304 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:47.607284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:47.608077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5c6872a2-8881-42b8-a68a-1683331c42a9 req-f30955b9-0daa-4753-906a-68d31d6f6aef service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.609212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:47.610686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5c6872a2-8881-42b8-a68a-1683331c42a9 req-f30955b9-0daa-4753-906a-68d31d6f6aef service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.613321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5c6872a2-8881-42b8-a68a-1683331c42a9 req-f30955b9-0daa-4753-906a-68d31d6f6aef service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.632765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.634712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.637211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.647723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.649340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.650174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.677569 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-5c6872a2-8881-42b8-a68a-1683331c42a9 req-f30955b9-0daa-4753-906a-68d31d6f6aef service nova] Creating event network-vif-deleted:6a26b325-c41a-4ba3-9291-36c10956f17c for instance 05f0bd24-8c20-4b97-a4ae-2075c823179e on n-h2-855650-5 Nov 02 12:33:47.687340 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-5c6872a2-8881-42b8-a68a-1683331c42a9 req-f30955b9-0daa-4753-906a-68d31d6f6aef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192195 Nov 02 12:33:47.690184 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1453/2911] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:47.702177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7849f5eb-edc5-4a00-baf3-506f323d6bec tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:47.705459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7849f5eb-edc5-4a00-baf3-506f323d6bec tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:47.820833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7849f5eb-edc5-4a00-baf3-506f323d6bec tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:47.834169 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7849f5eb-edc5-4a00-baf3-506f323d6bec tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1242 microversion: 2.1 time: 0.142415 Nov 02 12:33:47.835477 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1454/2912] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:47 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1242 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:47.846261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:47.848059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:47.863995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.870934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.871683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.872701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.873561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.883062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.047961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:48.075361 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-af9ddc35-bef2-4039-8aab-cbf8ae3808b6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 0.482798 Nov 02 12:33:48.077796 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1459/2913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:47 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:48.092094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:48.105583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:48.114876 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-337b7394-aab3-45c8-b990-64060d6b0cf7 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.273878 Nov 02 12:33:48.117821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1455/2914] 10.222.0.45 () {58 vars in 1296 bytes} [Wed Nov 2 12:33:47 2022] DELETE /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab/os-server-password => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:33:48.146467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.148630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.150563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.152348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:48.154107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.156069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:48.156649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.158550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.172609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:48.199254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.202058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.202978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.207164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.209838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.212540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.364057 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e26ce0e8-ace1-4e29-b8bc-dfcb94c7fc3a tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.233030 Nov 02 12:33:48.382660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1456/2915] 10.222.0.45 () {58 vars in 1293 bytes} [Wed Nov 2 12:33:48 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab/os-server-password => generated 16 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:33:48.398317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1250578781", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "933837ac-15f4-49f3-9154-d1e111096373"}, {"port": "712161f6-8da6-4c4e-85f6-1af79acf041a", "tag": "port-1"}, {"port": "b21a0968-4bb4-4e3b-88bf-c5752d860906", "tag": "port-2"}, {"uuid": "48dfd6a1-5f52-4778-8651-2fcfc9a9bb34", "tag": "net-1"}, {"uuid": "48dfd6a1-5f52-4778-8651-2fcfc9a9bb34"}, {"uuid": "fb5e5edc-ed53-4f18-9ce0-7b8288062aba", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fb5e5edc-ed53-4f18-9ce0-7b8288062aba", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0efe3063-01fb-4d87-88e5-820d0764b849", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "de6deb28-82be-4031-8ec6-5d6d2b5c7443", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "15e70216-5b26-4a32-9d6f-192a3fd57d17", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--935418638"}], "key_name": "tempest-keypair-1248003859", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:48.463117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:48.507485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:48.516963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:48.555020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8463868-9c85-4445-899f-47349932c1b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.466304 Nov 02 12:33:48.556119 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1460/2916] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:48 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:48.576175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:48.577520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:48.602797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.603589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.604344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.605474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.606377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.607043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.652742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:48.823868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:48.854767 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c23e0952-b988-4a0c-99c4-7afc01b1a828 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 204 len: 0 microversion: 2.1 time: 0.291688 Nov 02 12:33:48.855881 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1461/2917] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:48 2022] DELETE /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:33:48.867884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:48.869795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] [instance: 05f0bd24-8c20-4b97-a4ae-2075c823179e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:48.880644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] validate_networks() for [('933837ac-15f4-49f3-9154-d1e111096373', None, None, None, None, None), (None, None, '712161f6-8da6-4c4e-85f6-1af79acf041a', None, None, None), (None, None, 'b21a0968-4bb4-4e3b-88bf-c5752d860906', None, None, None), ('48dfd6a1-5f52-4778-8651-2fcfc9a9bb34', None, None, None, None, None), ('48dfd6a1-5f52-4778-8651-2fcfc9a9bb34', None, None, None, None, None), ('fb5e5edc-ed53-4f18-9ce0-7b8288062aba', '10.2.2.100', None, None, None, None), ('fb5e5edc-ed53-4f18-9ce0-7b8288062aba', '10.2.2.200', None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:33:48.896074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.896843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.897456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.898734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.899435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.900074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.929740 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] HTTP exception thrown: Instance 05f0bd24-8c20-4b97-a4ae-2075c823179e could not be found. Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Request method failure captured: Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e HTTP/1.1 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmLXBvDPFR8NvB0oSEvMcQOCs6jm5bpzAZcUIwAymv6D4X1EfHFeHX14S25rPvmEObftZRwyRhoXgj72oFcdR0KhBwZoD66whaYIrI3d2DKQN7qEKvWOAC6yk_RM5CXIJihWKFQ5ZKcTcslTUvnZut6D8w15c2Wc5rXx6LPwxp0nh2E Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d36baae805244e6983900973dd6dca37 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d36baae805244e6983900973dd6dca37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d36baae805244e6983900973dd6dca37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d36baae805244e6983900973dd6dca37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d36baae805244e6983900973dd6dca37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d36baae805244e6983900973dd6dca37 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersAdminTestJSON-1152639591 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersAdminTestJSON-1152639591-project Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d27030caf3f740368ba4b588132e2b21 Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersAdminTestJSON-1152639591-project Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 05f0bd24-8c20-4b97-a4ae-2075c823179e could not be found. Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '05f0bd24-8c20-4b97-a4ae-2075c823179e'} Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f0bd24-8c20-4b97-a4ae-2075c823179e could not be found. Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f0bd24-8c20-4b97-a4ae-2075c823179e could not be found. Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:48.931816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f0bd24-8c20-4b97-a4ae-2075c823179e could not be found. Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] Returning 404 to user: Instance 05f0bd24-8c20-4b97-a4ae-2075c823179e could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c24dc686-5394-43a3-9707-23fe64d20181 tempest-ServersAdminTestJSON-1152639591 tempest-ServersAdminTestJSON-1152639591-project] 10.222.0.45 "GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e" status: 404 len: 111 microversion: 2.1 time: 0.074175 Nov 02 12:33:48.941412 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1462/2918] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:48 2022] GET /compute/v2.1/servers/05f0bd24-8c20-4b97-a4ae-2075c823179e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:48.952110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:48.952754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:48.976786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.980510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.981649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.983458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.984613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.985288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:49.061098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:49.870007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:49.885943 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bcd9837c-3e63-4839-98d8-b9c73ecacb22 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1509 microversion: 2.1 time: 0.949524 Nov 02 12:33:49.887098 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1463/2919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:48 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1509 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:49.904231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:49.904231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:49.932383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:49.932902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:49.933414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:49.934208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:49.934676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:49.935110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.091768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:50.112153 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1bf54bd-0416-43d5-a127-727fcbeebb1a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1294 microversion: 2.1 time: 0.224260 Nov 02 12:33:50.112767 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1464/2920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:49 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1294 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:50.143053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:50.144111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:50.159634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.164951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.165876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.167402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.172147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.172831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.885568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:50.921776 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1b9f9871-fb2a-44fd-8bc4-c45c1321904c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1475 microversion: 2.1 time: 0.807291 Nov 02 12:33:50.923534 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1465/2921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:50 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1475 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:50.946326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:50.947992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:50.982188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.983470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.984639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.986374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.991224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.992499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:51.442857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:51.483906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:51.497617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:51.521823 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c0be854e-7e49-4e68-902f-fd7732f686a7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.594622 Nov 02 12:33:51.542052 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1466/2922] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:50 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:51.569111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:51.570889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:51.590569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:51.591077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:51.591540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:51.592778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:51.593283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:51.593722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:52.816897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:52.833772 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-80a587a8-92fc-475f-a63b-89ce04fa186e tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1509 microversion: 2.1 time: 1.289780 Nov 02 12:33:52.837316 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1467/2923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:51 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1509 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:52.857407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:52.858647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:52.879174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:52.880151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:52.880792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:52.881822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:52.887170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:52.889011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:53.104649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:53.127935 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b6acca6-f8a1-452b-bd98-4f69cecca087 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1300 microversion: 2.1 time: 0.279447 Nov 02 12:33:53.128934 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1468/2924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:52 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1300 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:53.157125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:53.158801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:53.184839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:53.193630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:53.194456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:53.195609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:53.196094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:53.196526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.529526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:54.549247 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b235ddf0-4316-4101-943e-27f49c454bda tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1474 microversion: 2.1 time: 1.418765 Nov 02 12:33:54.551667 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1469/2925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:53 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1474 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:54.557749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:54.558892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:54.600086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:54.607722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:54.608713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.609747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:54.610600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:54.612661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.985406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:55.009250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:55.027573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:55.053795 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e09d8798-f753-4ace-8688-7ddfb150a541 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.496607 Nov 02 12:33:55.066011 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1470/2926] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:54 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:55.082649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:55.083449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:55.104855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.105900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.119478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.120915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.121872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.123718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.013119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11008ce44ae4a438dfbd350e67d1232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18d3fa3bae4432a80b1a1fa20f6c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:56.029365 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7045d14a-20f4-4376-b6d4-37ca5755eba3 tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 200 len: 1509 microversion: 2.1 time: 0.971219 Nov 02 12:33:56.030350 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1471/2927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:55 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 1509 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:56.036951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:56.037735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:56.060360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.060894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.061538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.062479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.063178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.068737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.434035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:56.452179 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-14d40306-84b4-4c4c-9799-a2367811f2e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1300 microversion: 2.1 time: 0.420573 Nov 02 12:33:56.478105 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1472/2928] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:56 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1300 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:56.522155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-099f581b-f2d5-46cc-94ea-52fc7d2ac20e req-08a6682e-972b-4e94-ad73-144ae23d650c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "name": "network-vif-unplugged", "status": "completed", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:56.589272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-099f581b-f2d5-46cc-94ea-52fc7d2ac20e req-08a6682e-972b-4e94-ad73-144ae23d650c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.597055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-099f581b-f2d5-46cc-94ea-52fc7d2ac20e req-08a6682e-972b-4e94-ad73-144ae23d650c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.602336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-099f581b-f2d5-46cc-94ea-52fc7d2ac20e req-08a6682e-972b-4e94-ad73-144ae23d650c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.664577 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-099f581b-f2d5-46cc-94ea-52fc7d2ac20e req-08a6682e-972b-4e94-ad73-144ae23d650c service nova] Creating event network-vif-unplugged:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h2-855650-5 Nov 02 12:33:56.679994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-099f581b-f2d5-46cc-94ea-52fc7d2ac20e req-08a6682e-972b-4e94-ad73-144ae23d650c service nova] Instance ae270dc8-58c1-4da4-ab86-771f11167f53 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:33:56.715248 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-099f581b-f2d5-46cc-94ea-52fc7d2ac20e req-08a6682e-972b-4e94-ad73-144ae23d650c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.234521 Nov 02 12:33:56.716200 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1473/2929] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:56.739776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-81cd5cac-3af9-4993-a4d4-91b2a0b8e7eb req-d6581638-a450-4c18-a66a-4067d0dd0487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23217e96-4f58-4172-a45d-9efd3f7996ab", "name": "network-vif-unplugged", "status": "completed", "tag": "c98dda07-76d1-4390-8db0-7ae8ff50a736"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:56.763698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-81cd5cac-3af9-4993-a4d4-91b2a0b8e7eb req-d6581638-a450-4c18-a66a-4067d0dd0487 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.764631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-81cd5cac-3af9-4993-a4d4-91b2a0b8e7eb req-d6581638-a450-4c18-a66a-4067d0dd0487 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.765279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-81cd5cac-3af9-4993-a4d4-91b2a0b8e7eb req-d6581638-a450-4c18-a66a-4067d0dd0487 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.814995 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-81cd5cac-3af9-4993-a4d4-91b2a0b8e7eb req-d6581638-a450-4c18-a66a-4067d0dd0487 service nova] Creating event network-vif-unplugged:c98dda07-76d1-4390-8db0-7ae8ff50a736 for instance 23217e96-4f58-4172-a45d-9efd3f7996ab on n-h1-855650-5 Nov 02 12:33:56.826794 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-81cd5cac-3af9-4993-a4d4-91b2a0b8e7eb req-d6581638-a450-4c18-a66a-4067d0dd0487 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107346 Nov 02 12:33:56.829908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1474/2930] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:56.857107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:56.858830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:56.898772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.900277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.901456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.903160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.904339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.905447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:57.074965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:57.104977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:57.826037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=10 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:58.326453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:58.350840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.364798 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f5a127b-6180-47cd-8b00-229454f1db6b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1474 microversion: 2.1 time: 1.526196 Nov 02 12:33:58.366591 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1475/2931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:56 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1474 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:58.390103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:58.398489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:58.423254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.424196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.427712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.432764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.433806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.434555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.675882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.696186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.698144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.714897 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-10cacf3d-2564-4b9a-9202-c4448f30505c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.342769 Nov 02 12:33:58.715866 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1476/2932] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:58 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:58.720983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e4f1d962-e6a5-4413-a5ca-f473ad93477e req-69ecdf24-7da5-4fa3-88d9-6fe0d96a61ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23217e96-4f58-4172-a45d-9efd3f7996ab", "name": "network-vif-deleted", "tag": "c98dda07-76d1-4390-8db0-7ae8ff50a736"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:58.750354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e4f1d962-e6a5-4413-a5ca-f473ad93477e req-69ecdf24-7da5-4fa3-88d9-6fe0d96a61ec service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.763207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e4f1d962-e6a5-4413-a5ca-f473ad93477e req-69ecdf24-7da5-4fa3-88d9-6fe0d96a61ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.764377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e4f1d962-e6a5-4413-a5ca-f473ad93477e req-69ecdf24-7da5-4fa3-88d9-6fe0d96a61ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.802488 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e4f1d962-e6a5-4413-a5ca-f473ad93477e req-69ecdf24-7da5-4fa3-88d9-6fe0d96a61ec service nova] Creating event network-vif-deleted:c98dda07-76d1-4390-8db0-7ae8ff50a736 for instance 23217e96-4f58-4172-a45d-9efd3f7996ab on n-h1-855650-5 Nov 02 12:33:58.819362 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e4f1d962-e6a5-4413-a5ca-f473ad93477e req-69ecdf24-7da5-4fa3-88d9-6fe0d96a61ec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101448 Nov 02 12:33:58.828974 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1477/2933] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:58.850116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:58.855853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] [instance: 23217e96-4f58-4172-a45d-9efd3f7996ab] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:58.879636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.881256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.882512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.892485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.893860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.895000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.949902 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] HTTP exception thrown: Instance 23217e96-4f58-4172-a45d-9efd3f7996ab could not be found. Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Request method failure captured: Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab HTTP/1.1 Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmOF11pIN_j60NlQg_XHY3x2tB65ZlZeOl5IsJG9_E82dnViYvyO3u88Af1Yqh3awnVBVRJpuyyIXeO0dL48e2J4gC2N9hkxE4Ls_rZvhGF-tKDrKZI7XQ24S5ml002J9czyWroK33Mv6NlsuQYocelHkCFgOr6ezfRsUxNlQcdimiE Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: e18d3fa3bae4432a80b1a1fa20f6c04b Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerPasswordTestJSON-1920234171 Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e18d3fa3bae4432a80b1a1fa20f6c04b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e18d3fa3bae4432a80b1a1fa20f6c04b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e18d3fa3bae4432a80b1a1fa20f6c04b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e18d3fa3bae4432a80b1a1fa20f6c04b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerPasswordTestJSON-1920234171 Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: e18d3fa3bae4432a80b1a1fa20f6c04b Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1920234171 Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerPasswordTestJSON-1920234171-project Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b11008ce44ae4a438dfbd350e67d1232 Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerPasswordTestJSON-1920234171-project Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 23217e96-4f58-4172-a45d-9efd3f7996ab could not be found. Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '23217e96-4f58-4172-a45d-9efd3f7996ab'} Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23217e96-4f58-4172-a45d-9efd3f7996ab could not be found. Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23217e96-4f58-4172-a45d-9efd3f7996ab could not be found. Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:58.953885 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:58.963603 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:58.963603 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:58.963603 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:58.963603 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:58.963603 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:58.963603 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23217e96-4f58-4172-a45d-9efd3f7996ab could not be found. Nov 02 12:33:58.963603 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:33:58.976564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] Returning 404 to user: Instance 23217e96-4f58-4172-a45d-9efd3f7996ab could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:58.976564 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66ec0191-4e74-4721-8890-7a0b1cbab2bc tempest-ServerPasswordTestJSON-1920234171 tempest-ServerPasswordTestJSON-1920234171-project] 10.222.0.45 "GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab" status: 404 len: 111 microversion: 2.1 time: 0.136510 Nov 02 12:33:58.976564 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1478/2934] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:58 2022] GET /compute/v2.1/servers/23217e96-4f58-4172-a45d-9efd3f7996ab => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:58.986614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:58.988364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:59.001421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:59.003084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:59.004288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:59.006707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:59.008528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:59.009702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:01.006693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=5 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:01.188494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:01.201071 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d05a53b-b9c2-4eba-b5a1-0b329cf31ec6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1368 microversion: 2.1 time: 2.222018 Nov 02 12:34:01.201793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1479/2935] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:58 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1368 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:01.219764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-2b0b1e54-d7cf-4466-a0c3-b4c618931d30 req-1f8d3892-3126-4168-abde-991712079bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:01.255418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2b0b1e54-d7cf-4466-a0c3-b4c618931d30 req-1f8d3892-3126-4168-abde-991712079bb6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:01.265629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2b0b1e54-d7cf-4466-a0c3-b4c618931d30 req-1f8d3892-3126-4168-abde-991712079bb6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:01.267462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2b0b1e54-d7cf-4466-a0c3-b4c618931d30 req-1f8d3892-3126-4168-abde-991712079bb6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:01.297456 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-2b0b1e54-d7cf-4466-a0c3-b4c618931d30 req-1f8d3892-3126-4168-abde-991712079bb6 service nova] Creating event network-changed:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h2-855650-5 Nov 02 12:34:01.315393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-2b0b1e54-d7cf-4466-a0c3-b4c618931d30 req-1f8d3892-3126-4168-abde-991712079bb6 service nova] Instance ae270dc8-58c1-4da4-ab86-771f11167f53 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:34:01.344773 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-2b0b1e54-d7cf-4466-a0c3-b4c618931d30 req-1f8d3892-3126-4168-abde-991712079bb6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138226 Nov 02 12:34:01.351194 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1480/2936] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:01.374364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:01.378233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:01.402394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:01.402971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:01.403363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:01.404339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:01.404817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:01.405256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.387540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:02.401926 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8b2f9f2-7b31-41c9-92c9-d2a293e857fe tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1472 microversion: 2.1 time: 1.048326 Nov 02 12:34:02.403244 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1481/2937] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:01 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1472 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:02.409442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:02.410421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:02.419838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.421798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.422755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.429612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.430137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.430592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.789942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:02.793102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:02.818478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:02.820143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:02.832401 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4af6f2a3-e7dd-4d6b-a79f-52cddbf53133 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.426888 Nov 02 12:34:02.835776 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1482/2938] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:02 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:02.845660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:02.847568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:02.860046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.863004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.864470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.866345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.867647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.870068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:03.651038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:03.662552 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9262f548-d815-4c2e-8180-669702649c30 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1368 microversion: 2.1 time: 0.824508 Nov 02 12:34:03.663156 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1483/2939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:02 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1368 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:03.674302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:03.679358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:03.695243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:03.705025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:03.709619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:03.710434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:03.723589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:03.724500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.318139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:05.333513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:34:05.333513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:34:05.333513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:34:05.333513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:34:05.333513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:34:05.358764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.360795 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ed9de8cb-d6c5-40ed-8aeb-237c73b5a29c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1472 microversion: 2.1 time: 1.686862 Nov 02 12:34:05.361663 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1484/2940] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:03 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1472 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:05.367170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.368000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.375181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:05.376491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:05.378698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.386468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.387470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.398387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.399043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.399637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.400568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.401173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.401722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.517454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Getting quotas for project 4f7d4ee77f204c59a152667c634974d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:05.527542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Getting quotas for user 488c08ed761140ffbfd18033118772f6 and project 4f7d4ee77f204c59a152667c634974d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:05.759840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:05.774943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:05.777374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:05.795277 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e6eae088-c0e5-475d-a8a8-e1afe779ee09 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1533 microversion: 2.91 time: 0.432184 Nov 02 12:34:05.822399 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1485/2941] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:05 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1533 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:05.828011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:05.837420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:05.845023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.854182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.856937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.858103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.859744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.860266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.914615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:34:05.918244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0efe3063-01fb-4d87-88e5-820d0764b849',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='de6deb28-82be-4031-8ec6-5d6d2b5c7443',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15e70216-5b26-4a32-9d6f-192a3fd57d17',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:34:06.556497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:06.578771 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6f6605f-54dd-4551-b54d-9024826302e3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1368 microversion: 2.1 time: 0.754925 Nov 02 12:34:06.594488 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1486/2942] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:05 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1368 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:06.608411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d349d1b8-e0dd-4e17-9e3e-744ec2f87fa7 req-f3d85375-432d-440d-92d3-c11114b8dc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d093add-0a0f-44b6-b83f-f461c5488003", "tag": "f6222d7a-ac1c-41cc-8cfc-e37b6012d5ee"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:06.643033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d349d1b8-e0dd-4e17-9e3e-744ec2f87fa7 req-f3d85375-432d-440d-92d3-c11114b8dc2d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:06.643894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d349d1b8-e0dd-4e17-9e3e-744ec2f87fa7 req-f3d85375-432d-440d-92d3-c11114b8dc2d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:06.644770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d349d1b8-e0dd-4e17-9e3e-744ec2f87fa7 req-f3d85375-432d-440d-92d3-c11114b8dc2d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:06.667933 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6c4fd82f-805c-4438-a19e-f5659111d245 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 18.283580 Nov 02 12:34:06.670273 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1457/2943] 10.222.0.45 () {62 vars in 1189 bytes} [Wed Nov 2 12:33:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 18287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:34:06.677576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:06.679691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:06.686771 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d349d1b8-e0dd-4e17-9e3e-744ec2f87fa7 req-f3d85375-432d-440d-92d3-c11114b8dc2d service nova] Creating event network-changed:f6222d7a-ac1c-41cc-8cfc-e37b6012d5ee for instance 4d093add-0a0f-44b6-b83f-f461c5488003 on n-h2-855650-5 Nov 02 12:34:06.689808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:06.690757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:06.691465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:06.693271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:06.694049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:06.694762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:06.711797 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d349d1b8-e0dd-4e17-9e3e-744ec2f87fa7 req-f3d85375-432d-440d-92d3-c11114b8dc2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111735 Nov 02 12:34:06.715542 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1487/2944] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:06.748577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c9c4b2a-6ad1-4117-8f87-1ed872db9bfa tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:06.757065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c9c4b2a-6ad1-4117-8f87-1ed872db9bfa tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:07.051984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c9c4b2a-6ad1-4117-8f87-1ed872db9bfa tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.060846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c9c4b2a-6ad1-4117-8f87-1ed872db9bfa tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.069530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c9c4b2a-6ad1-4117-8f87-1ed872db9bfa tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.070940 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c9c4b2a-6ad1-4117-8f87-1ed872db9bfa tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1286 microversion: 2.32 time: 0.352506 Nov 02 12:34:07.071451 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1488/2945] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:06 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1286 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:07.096508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:07.097489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:07.106738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:07.107568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:07.108239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.109172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:07.109913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:07.110650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.539015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.555565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.557218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.588091 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-01158477-31f2-4476-aeb3-f5413943692d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1533 microversion: 2.91 time: 0.504568 Nov 02 12:34:07.588711 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1489/2946] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:07 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1533 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:07.599905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6448c3c5-0a65-4232-b68c-45b530eedcd0 req-8fe6c6d5-2c44-4695-af6d-10c179a1dfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "name": "network-vif-plugged", "status": "completed", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:07.646392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6448c3c5-0a65-4232-b68c-45b530eedcd0 req-8fe6c6d5-2c44-4695-af6d-10c179a1dfcc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:07.657430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6448c3c5-0a65-4232-b68c-45b530eedcd0 req-8fe6c6d5-2c44-4695-af6d-10c179a1dfcc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:07.658112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6448c3c5-0a65-4232-b68c-45b530eedcd0 req-8fe6c6d5-2c44-4695-af6d-10c179a1dfcc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.678333 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6448c3c5-0a65-4232-b68c-45b530eedcd0 req-8fe6c6d5-2c44-4695-af6d-10c179a1dfcc service nova] Creating event network-vif-plugged:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h2-855650-5 Nov 02 12:34:07.697849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-6448c3c5-0a65-4232-b68c-45b530eedcd0 req-8fe6c6d5-2c44-4695-af6d-10c179a1dfcc service nova] Instance ae270dc8-58c1-4da4-ab86-771f11167f53 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:34:07.724927 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6448c3c5-0a65-4232-b68c-45b530eedcd0 req-8fe6c6d5-2c44-4695-af6d-10c179a1dfcc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133682 Nov 02 12:34:07.729449 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1490/2947] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:07.760848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:07.765069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:07.846409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:07.848815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.862579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:07.868157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.872829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:07.873892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:07.874747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.892564 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-faecf51d-e226-48d0-8c2e-58a6282919f7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1469 microversion: 2.1 time: 1.220156 Nov 02 12:34:07.899290 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1458/2948] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:06 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1469 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:07.941777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:07.945940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:07.988252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.005646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.022402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.029134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.040874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.048026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.472369 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3ead13a-cda6-465c-abea-40ba0b6e86c6 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "POST /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53/action" status: 202 len: 0 microversion: 2.1 time: 0.546766 Nov 02 12:34:08.473067 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1459/2949] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:34:07 2022] POST /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:34:08.502207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-28c0d269-b0f1-43c9-8936-bf3cb490b1c3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:08.503047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-28c0d269-b0f1-43c9-8936-bf3cb490b1c3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:08.872142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-28c0d269-b0f1-43c9-8936-bf3cb490b1c3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:08.896856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-28c0d269-b0f1-43c9-8936-bf3cb490b1c3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:08.906645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-28c0d269-b0f1-43c9-8936-bf3cb490b1c3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:08.908039 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-28c0d269-b0f1-43c9-8936-bf3cb490b1c3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1286 microversion: 2.32 time: 0.426658 Nov 02 12:34:08.908653 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1460/2950] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:08 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1286 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:08.960735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:08.963501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:08.988595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.989628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.990332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.992499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.998499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.999135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:09.836689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:09.851193 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0cb47ae7-70f4-4e2e-8c08-0919ebbc6df4 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1368 microversion: 2.1 time: 2.119956 Nov 02 12:34:09.851847 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1491/2951] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:07 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1368 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:09.862535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:09.863419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:09.887869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:09.888732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:09.889239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:09.895946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:09.896652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:09.897145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.335593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:10.384733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:10.389324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:10.433755 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-14472a7b-36c5-49f3-be8a-4824ee00c6ae tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1476 microversion: 2.91 time: 0.577711 Nov 02 12:34:10.477254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:10.497242 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1492/2952] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:09 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1476 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:10.499015 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71a11243-2a45-45a1-9a6a-db2de61cf950 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1468 microversion: 2.1 time: 1.558118 Nov 02 12:34:10.499643 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1461/2953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:08 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1468 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:10.516051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:10.517199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:10.526024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:10.549101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:10.583574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:10.588818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:10.591595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:10.592554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.594609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:10.595327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:10.596048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.599617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:10.600221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.607617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:10.615215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:10.616360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.811651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-855650-5". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:34:10.970534 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3856554d-e483-4e9e-9846-4de4a0f2d00f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9/action" status: 202 len: 0 microversion: 2.91 time: 0.458576 Nov 02 12:34:10.973904 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1462/2954] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:34:10 2022] POST /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:34:10.989150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:10.995199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:11.011593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:11.013071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:11.017787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:11.020900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:11.021718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:11.025503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:11.723728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:11.770048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:11.775177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:11.779117 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-560378f6-f268-43dd-b174-3f32ce586b8c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1584 microversion: 2.32 time: 1.279900 Nov 02 12:34:11.786601 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1493/2955] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:10 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1584 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:11.816757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:11.820656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:11.846022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:11.854661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:11.856706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:11.858805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:11.867786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:11.868680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:12.939170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:12.962387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:12.964329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:12.981661 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e256d83f-0bdc-49c1-b8ed-b8244fa7a010 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1484 microversion: 2.91 time: 1.193498 Nov 02 12:34:12.982982 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1494/2956] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:11 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1484 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:13.000155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:13.001332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:13.032084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:13.033086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:13.036233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:13.039652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:13.043642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:13.046061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:13.227396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:13.242527 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05193976-b097-4325-a64e-156a456bec25 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1368 microversion: 2.1 time: 2.266880 Nov 02 12:34:13.245890 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1463/2957] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:10 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1368 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:13.260728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:13.271322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:13.297254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:13.297872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:13.307065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:13.307936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:13.308439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:13.308906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:14.171883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:14.226670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:14.252080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:14.260034 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3cc08222-f27c-48f9-b393-fe12f6f9e3eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1594 microversion: 2.32 time: 1.006832 Nov 02 12:34:14.263650 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1464/2958] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:13 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1594 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:14.293858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:14.296064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:14.330420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:14.334300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:14.337497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:14.340865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:14.343993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:14.344852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:15.045917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:15.063059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:15.065188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:15.082897 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f419097e-3eb4-49c6-8809-03f9403c4876 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.814678 Nov 02 12:34:15.084215 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1465/2959] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:14 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:15.101087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:15.102180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:15.116720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:15.118177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:15.122155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:15.124062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:15.125146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:15.130158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:15.433758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:16.386946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:16.404350 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f27f7b1-739d-4b19-8c99-820bfd7c4fb6 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1368 microversion: 2.1 time: 1.316045 Nov 02 12:34:16.411462 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1466/2960] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:15 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1368 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:16.429851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:16.431764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:16.452903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:16.454751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:16.455606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:16.456764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:16.460618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:16.461841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:17.023259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:17.069809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:17.077569 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eafbfaba-a3cc-4f2c-98f6-2bdf1b023af4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1468 microversion: 2.1 time: 4.092701 Nov 02 12:34:17.098018 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1495/2961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:12 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1468 bytes in 4102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:17.111405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:17.115006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:17.147907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:17.148635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:17.149546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:17.150305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:17.152556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:17.158445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:17.159454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:17.208131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:17.217018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:17.242102 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bd8b9f33-4070-4719-a998-018fe4286991 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1594 microversion: 2.32 time: 0.828255 Nov 02 12:34:17.262436 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1467/2962] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:16 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1594 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:17.465676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:17.471792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:17.508962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:17.518886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:17.519602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:17.525656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:17.538465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:17.539126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:17.795810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:17.819380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:17.822043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:17.848507 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dcd18260-8be1-4552-88b3-3689de81b02a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.746763 Nov 02 12:34:17.858072 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1496/2963] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:17 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:18.131935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:18.133258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:18.185214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:18.185747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:18.188217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:18.189026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:18.189577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:18.190263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:18.876609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:19.904834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:19.934796 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ed772ed0-7f44-4770-8eb6-f537eba5b7ce tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1368 microversion: 2.1 time: 2.478316 Nov 02 12:34:19.938670 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1468/2964] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:17 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1368 bytes in 2488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:19.957390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:19.958986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:19.993560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:20.000796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:20.001691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:20.004733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:20.005562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:20.009227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:20.283924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:20.321581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:20.329421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:20.331263 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5a68d3a1-7fb4-438f-8752-1f1f01297a6f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1594 microversion: 2.32 time: 0.390336 Nov 02 12:34:20.354517 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1469/2965] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:19 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1594 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:20.365668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9086c6a2-1b0e-4c62-acd7-838bca4f3f71 req-7f378788-0566-4e52-adbc-f343a4081f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d093add-0a0f-44b6-b83f-f461c5488003", "name": "network-vif-plugged", "status": "completed", "tag": "f6222d7a-ac1c-41cc-8cfc-e37b6012d5ee"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:20.390020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9086c6a2-1b0e-4c62-acd7-838bca4f3f71 req-7f378788-0566-4e52-adbc-f343a4081f04 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:20.396257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9086c6a2-1b0e-4c62-acd7-838bca4f3f71 req-7f378788-0566-4e52-adbc-f343a4081f04 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:20.397132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9086c6a2-1b0e-4c62-acd7-838bca4f3f71 req-7f378788-0566-4e52-adbc-f343a4081f04 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:20.437042 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9086c6a2-1b0e-4c62-acd7-838bca4f3f71 req-7f378788-0566-4e52-adbc-f343a4081f04 service nova] Creating event network-vif-plugged:f6222d7a-ac1c-41cc-8cfc-e37b6012d5ee for instance 4d093add-0a0f-44b6-b83f-f461c5488003 on n-h2-855650-5 Nov 02 12:34:20.454163 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9086c6a2-1b0e-4c62-acd7-838bca4f3f71 req-7f378788-0566-4e52-adbc-f343a4081f04 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097835 Nov 02 12:34:20.455802 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1470/2966] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:20.478277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:20.481193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:20.499874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:20.500578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:20.501169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:20.502167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:20.508252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:20.508877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:21.524680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:21.527460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:21.536304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:21.538333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:21.561780 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4af0d969-d6b1-40a1-b2f2-a390915f9bf9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 1.103889 Nov 02 12:34:21.562783 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1471/2967] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:20 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:21.564013 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f3e30647-6820-48cf-a88b-1f8c648328c4 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1468 microversion: 2.1 time: 3.436451 Nov 02 12:34:21.565096 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1497/2968] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:18 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1468 bytes in 3439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:21.585382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:21.588099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:21.601026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:21.603750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:21.611435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:21.624116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:21.627940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:21.629291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:21.638784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:21.640046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:21.641156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:21.642170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:21.643152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:21.653822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:21.657424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:21.661823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:21.663234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:22.541283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:22.560492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:22.565364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:22.567485 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-13773cda-8bf1-4b18-bbd7-4d87d680eadf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1594 microversion: 2.32 time: 0.997523 Nov 02 12:34:22.571209 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1498/2969] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:21 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1594 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:22.592392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f034eec8-a7a5-4541-b2d3-41fe2aa3299c req-df293e83-3689-45dc-9048-09253ff09e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "name": "network-vif-unplugged", "status": "completed", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:22.619680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f034eec8-a7a5-4541-b2d3-41fe2aa3299c req-df293e83-3689-45dc-9048-09253ff09e45 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:22.623858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f034eec8-a7a5-4541-b2d3-41fe2aa3299c req-df293e83-3689-45dc-9048-09253ff09e45 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:22.630690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f034eec8-a7a5-4541-b2d3-41fe2aa3299c req-df293e83-3689-45dc-9048-09253ff09e45 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:22.664883 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f034eec8-a7a5-4541-b2d3-41fe2aa3299c req-df293e83-3689-45dc-9048-09253ff09e45 service nova] Creating event network-vif-unplugged:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h1-855650-5 Nov 02 12:34:22.674224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-f034eec8-a7a5-4541-b2d3-41fe2aa3299c req-df293e83-3689-45dc-9048-09253ff09e45 service nova] Instance ae270dc8-58c1-4da4-ab86-771f11167f53 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:34:22.692036 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f034eec8-a7a5-4541-b2d3-41fe2aa3299c req-df293e83-3689-45dc-9048-09253ff09e45 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118923 Nov 02 12:34:22.693281 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1499/2970] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:22.699647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:22.700759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:22.708835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:22.709920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:22.710623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:22.711725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:22.712570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:22.713181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:22.992756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:23.027016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:23.076337 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f7d593ee-0e79-47a1-8bfd-0907bf174c17 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1368 microversion: 2.1 time: 1.492594 Nov 02 12:34:23.077769 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1472/2971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:21 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1368 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:23.114934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:23.139974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:23.176863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:23.182659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:23.183169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:23.184451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:23.185040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:23.185620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:23.589771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:23.615680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:23.628268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:23.654418 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f6cf79d-aa20-42a2-b24c-adef78652928 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.568789 Nov 02 12:34:23.660573 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1473/2972] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:23 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:23.708450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:23.709445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:23.732175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:23.732601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:23.733064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:23.747553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:23.748972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:23.754850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:24.014661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:24.037875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-276055de-e6b5-4f32-a5bc-c6a1eefc611c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1468 microversion: 2.1 time: 1.342652 Nov 02 12:34:24.057404 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1500/2973] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:22 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1468 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:24.148966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:24.153608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:24.180587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:24.181930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:24.183617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:24.185436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:24.186585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:24.189797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:25.662788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:25.715360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:25.719302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:25.723297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bc0c5757-5f81-4cc2-8243-10734579cc65 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1661 microversion: 2.32 time: 2.055256 Nov 02 12:34:25.732888 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1474/2974] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:23 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1661 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:25.747059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:25.762522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:25.797404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:25.798287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:25.800225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:25.802021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:25.803204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:25.804267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:26.188268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:26.240836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:26.246344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:26.266231 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b2b996de-c66e-45d7-8da5-1a1fcf3b026b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.524257 Nov 02 12:34:26.268616 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1475/2975] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:25 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:26.283379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ac445bb2-32be-4f3a-8987-23e9ce5865b1 req-7c924d02-bc50-4f60-95f4-d4daaa1aebd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:26.310314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ac445bb2-32be-4f3a-8987-23e9ce5865b1 req-7c924d02-bc50-4f60-95f4-d4daaa1aebd3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:26.311124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ac445bb2-32be-4f3a-8987-23e9ce5865b1 req-7c924d02-bc50-4f60-95f4-d4daaa1aebd3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:26.312054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ac445bb2-32be-4f3a-8987-23e9ce5865b1 req-7c924d02-bc50-4f60-95f4-d4daaa1aebd3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:26.355116 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ac445bb2-32be-4f3a-8987-23e9ce5865b1 req-7c924d02-bc50-4f60-95f4-d4daaa1aebd3 service nova] Creating event network-changed:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h1-855650-5 Nov 02 12:34:26.377657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-ac445bb2-32be-4f3a-8987-23e9ce5865b1 req-7c924d02-bc50-4f60-95f4-d4daaa1aebd3 service nova] Instance ae270dc8-58c1-4da4-ab86-771f11167f53 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:34:26.405558 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ac445bb2-32be-4f3a-8987-23e9ce5865b1 req-7c924d02-bc50-4f60-95f4-d4daaa1aebd3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135275 Nov 02 12:34:26.411561 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1476/2976] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:26.426665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:26.427900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:26.444491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:26.445486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:26.447043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:26.466759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:26.467429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:26.471983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:27.429210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:27.433885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:27.451263 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f88ae72-cae9-49c1-bca5-1f6d7bc9da0f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1559 microversion: 2.1 time: 3.345971 Nov 02 12:34:27.470650 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1501/2977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:24 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1559 bytes in 3354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:27.493070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:27.498123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:27.538018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:27.543488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:27.550514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:27.552699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:27.553546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:27.557348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:28.421697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:28.436664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:28.443180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:28.444446 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f4d3197a-2f04-4d17-9444-0bdf33b46c8f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1661 microversion: 2.32 time: 0.969626 Nov 02 12:34:28.470368 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1502/2978] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:27 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1661 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:28.485157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:28.486080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:28.507930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:28.509025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:28.510261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:28.512620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:28.513558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:28.519740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:28.621736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:28.636192 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44ac9c0e-72ab-4ea0-95e2-466c47eae52b tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1468 microversion: 2.1 time: 2.222612 Nov 02 12:34:28.667891 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1477/2979] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:26 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1468 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:28.681692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:28.695059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:28.696600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:28.706327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:28.706895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:28.746981 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c229e5b-d1aa-4cf0-92b4-9500d92fbff7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.274913 Nov 02 12:34:28.762161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:28.762161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:28.762161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:28.762161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:28.762161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:28.762161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:28.769644 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1503/2980] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:28 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:28.987520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1104850785", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:29.204858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] validate_networks() for [('de8a7cdb-8f38-41d3-8d17-70b1d4cfb99a', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:34:30.042467 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac024020-47cf-421a-a018-9c3af1f0c986 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.372231 Nov 02 12:34:30.045688 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1478/2981] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:34:28 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-interface => generated 285 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:30.081114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:30.086781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:30.138585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:30.140240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:30.141923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:30.147637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:30.149607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:30.152323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:33.244690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:33.293590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:33.297674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:33.308874 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2d80d39d-c609-470e-80d0-613e2539a0df tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1661 microversion: 2.32 time: 3.260660 Nov 02 12:34:33.312048 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1479/2982] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:30 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1661 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:33.334696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:33.336570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:33.361912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:33.365220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:33.366175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:33.366994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:33.373164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:33.374490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:33.378239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:35.304089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:35.324865 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2da296a1-81fc-41c1-8249-bf6694fafd88 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1461 microversion: 2.1 time: 2.007792 Nov 02 12:34:35.329178 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1480/2983] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:33 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1461 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:35.359089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:35.368112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:35.394477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:35.395228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:35.395758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:35.400854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:35.401524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:35.402026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:35.700430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:34:35.702651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:34:35.703621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:34:35.706043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:34:35.706971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:34:35.739538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:35.741475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:35.743008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:35.745244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:35.748747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:35.749613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:35.783556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:35.819705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Getting quotas for project 9aa7b3d114c047f69065d9c988516e24. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:35.820714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:35.824493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:35.836405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Getting quotas for user 72fcc9334808464092f16556a8e50fef and project 9aa7b3d114c047f69065d9c988516e24. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:35.850836 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-584710b5-2dce-4022-ac54-892376c4eea6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.513052 Nov 02 12:34:35.851985 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1481/2984] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:35 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:35.873384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:35.874398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:35.881591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:34:35.898971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:35.899824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:34:35.900437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:35.901211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:35.902390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:35.903095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:35.903734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:36.012019 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9803734b-23d1-48af-9791-2ced759797c9 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.216260 Nov 02 12:34:36.013170 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1504/2985] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:34:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 7219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:34:36.019402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:36.020850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:36.030346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:36.031056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:36.031524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:36.032731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:36.033416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:36.034354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:37.215294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:37.255284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:37.274104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:37.290832 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a94f34e8-7515-46bb-823d-ccc41fa9cc3d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1707 microversion: 2.32 time: 1.436781 Nov 02 12:34:37.292937 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1482/2986] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:35 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1707 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:37.319437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7de6393d-dfc1-47dc-8561-dbdfba991705 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:37.321209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7de6393d-dfc1-47dc-8561-dbdfba991705 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:37.333416 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bb34e93d-cb2e-43f5-ac1e-3edb9a2eeee4 tempest-MigrationsAdminTest-200987859 tempest-MigrationsAdminTest-200987859-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1612 microversion: 2.1 time: 1.318748 Nov 02 12:34:37.370196 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1505/2987] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:36 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1612 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:37.403102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:37.418017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:37.451104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:37.452217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:37.455487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:37.458051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:37.459881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:37.461153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:38.179676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:38.224990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:38.236536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:38.274423 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c6bb3b4-0ee0-42a8-bfeb-89732fbb07aa tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.901738 Nov 02 12:34:38.279858 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1506/2988] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:37 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:38.301633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a54d8797-8786-410f-9ebd-516750e2dadc req-66aae7b3-aa00-4780-9557-7cc96529ef4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "name": "network-vif-plugged", "status": "completed", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:38.321914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7de6393d-dfc1-47dc-8561-dbdfba991705 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:38.357495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a54d8797-8786-410f-9ebd-516750e2dadc req-66aae7b3-aa00-4780-9557-7cc96529ef4c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:38.358454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a54d8797-8786-410f-9ebd-516750e2dadc req-66aae7b3-aa00-4780-9557-7cc96529ef4c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:38.363996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a54d8797-8786-410f-9ebd-516750e2dadc req-66aae7b3-aa00-4780-9557-7cc96529ef4c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:38.381041 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7de6393d-dfc1-47dc-8561-dbdfba991705 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1223 microversion: 2.1 time: 1.085620 Nov 02 12:34:38.424145 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1483/2989] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:37 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1223 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:38.428048 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a54d8797-8786-410f-9ebd-516750e2dadc req-66aae7b3-aa00-4780-9557-7cc96529ef4c service nova] Creating event network-vif-plugged:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h1-855650-5 Nov 02 12:34:38.450294 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a54d8797-8786-410f-9ebd-516750e2dadc req-66aae7b3-aa00-4780-9557-7cc96529ef4c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168139 Nov 02 12:34:38.473285 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1507/2990] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:38.484425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:38.494755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:38.523177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:38.524011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:38.524759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:38.525734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:38.527513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:38.528235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:38.626877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:34:38.941687 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09039970-b892-424f-bb5b-cff4a21747e7 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 204 len: 0 microversion: 2.1 time: 0.461176 Nov 02 12:34:38.942823 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1508/2991] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:34:38 2022] DELETE /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:34:38.954495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:38.955477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:38.976658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:38.980479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:38.982249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:38.986013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:38.986839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:38.988205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:39.020638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-814226da-3d03-44e4-8f83-adf77f684f38 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Action: 'create', calling method: .version_select at 0x7f228e759430>, body: {"keypair": {"name": "tempest-keypair-935910656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr9o6Uj2YzYzGOE3rTsC4dHL4am+eLiHRVF8dEgRjelO0qNa33d5AgLHYlQp/I1GMkGlNjhW96b6kqXo51g/cCtz03ZvseV5AeGtOgmfOeUkPc6sfKcLBWm1WA1Veka2w=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:39.109110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-814226da-3d03-44e4-8f83-adf77f684f38 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Getting quotas for project 97e284749b1d45a4b0748e50601b4efd. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:39.138399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-814226da-3d03-44e4-8f83-adf77f684f38 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Getting quotas for user c71e15a35de14ba691ec72cddac6a1a8 and project 97e284749b1d45a4b0748e50601b4efd. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:39.227505 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-814226da-3d03-44e4-8f83-adf77f684f38 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.787764 Nov 02 12:34:39.228625 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1484/2992] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:34:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:39.249319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:39.250323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:39.258428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:39.260148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:39.260885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:39.261834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:39.262510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:39.263144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:40.282144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:40.344469 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-430536fc-7d0a-4da4-81e9-9e50fa01f9af tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1467 microversion: 2.1 time: 1.102535 Nov 02 12:34:40.368345 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1485/2993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:39 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1467 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:40.393444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:40.394169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:40.412876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:40.414975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:40.415570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:40.416386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:40.418316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:40.420936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:41.284324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:41.339601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:41.345283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:41.381724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25c6a80e-2c74-45da-a25d-9b63eaaab51b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 1.011823 Nov 02 12:34:41.406028 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1486/2994] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:40 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:41.431985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:41.435557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:41.458878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:41.459381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:41.459904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:41.460735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:41.461409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:41.462090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:41.786251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:41.806807 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fffbd278-bf5f-41ff-b809-1c4ca72d65e3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1283 microversion: 2.1 time: 0.409465 Nov 02 12:34:41.822421 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1487/2995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:41 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1283 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:41.842851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:41.849287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:41.869061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:41.879090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:41.881244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:41.882255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:41.882780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:41.886604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:42.578076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:42.624789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:42.626647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:42.632729 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-296d82a5-598e-4049-bd93-0b223b6ae4b2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1707 microversion: 2.32 time: 3.683915 Nov 02 12:34:42.651727 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1509/2996] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:38 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1707 bytes in 3693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:42.657205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:42.658906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:42.678246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:42.678777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:42.679231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:42.680082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:42.680453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:42.691223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:42.958037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:43.034680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:43.046760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fbe322c7-96a7-4b03-aeab-eb12f36aa260 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1467 microversion: 2.1 time: 1.220722 Nov 02 12:34:43.051187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1488/2997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:41 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1467 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:43.056335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:43.058009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:43.088441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:43.090812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:43.100024 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d9e12b13-2e58-42c4-9636-d338c6f5a92b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.461688 Nov 02 12:34:43.129711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:43.130284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:43.133398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:43.135016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:43.141771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:43.142438 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1510/2998] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:42 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:43.143027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:43.151746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7217fcea-5ee4-4142-bc5b-648e63577a0b req-d6775cb0-1589-4a08-8869-e2fb744e7d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d093add-0a0f-44b6-b83f-f461c5488003", "tag": "f6222d7a-ac1c-41cc-8cfc-e37b6012d5ee"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:43.205222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7217fcea-5ee4-4142-bc5b-648e63577a0b req-d6775cb0-1589-4a08-8869-e2fb744e7d14 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:43.206476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7217fcea-5ee4-4142-bc5b-648e63577a0b req-d6775cb0-1589-4a08-8869-e2fb744e7d14 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:43.210167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7217fcea-5ee4-4142-bc5b-648e63577a0b req-d6775cb0-1589-4a08-8869-e2fb744e7d14 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:43.243856 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7217fcea-5ee4-4142-bc5b-648e63577a0b req-d6775cb0-1589-4a08-8869-e2fb744e7d14 service nova] Creating event network-changed:f6222d7a-ac1c-41cc-8cfc-e37b6012d5ee for instance 4d093add-0a0f-44b6-b83f-f461c5488003 on n-h2-855650-5 Nov 02 12:34:43.279688 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7217fcea-5ee4-4142-bc5b-648e63577a0b req-d6775cb0-1589-4a08-8869-e2fb744e7d14 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135356 Nov 02 12:34:43.280882 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1511/2999] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:43.674609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:43.675761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:43.692730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:43.693412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:43.694071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:43.699789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:43.704706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:43.710409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:43.925723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:43.943819 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2bf242c-5a8e-4431-96e1-0d5aee1e02b5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1281 microversion: 2.1 time: 0.888460 Nov 02 12:34:43.944564 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1489/3000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:43 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1281 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:44.087472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:44.093751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:44.118521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:44.119513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:44.120210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:44.121177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:44.121890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:44.124450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.275931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:45.300538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:45.306587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:45.309757 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3a851c5d-5023-4adc-ac15-60f7329a5b6a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1753 microversion: 2.32 time: 1.639920 Nov 02 12:34:45.311739 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1512/3001] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:43 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1753 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:34:45.322206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:45.323770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:45.339848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:45.340773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:45.341463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.342638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:45.343435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:45.344097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.792570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:45.863967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:46.113828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:46.140458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:46.163223 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa16760c-6a4b-408d-b82d-32710d050ec2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 200 len: 1467 microversion: 2.1 time: 2.085325 Nov 02 12:34:46.163856 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1490/3002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:44 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 1467 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:46.173278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:46.183459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:46.203586 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5c0c9e0-33cf-42ab-a3cf-67207d5724c3 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1529 microversion: 2.91 time: 0.889516 Nov 02 12:34:46.208221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:46.212984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:46.219012 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1513/3003] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:45 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1529 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:46.261837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.265125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.266545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.268367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.269570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.270677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.299610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:46.300845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:46.371842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.372766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.384041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.385745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.386870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.387890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:47.009543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lazy-loading 'services' on Instance uuid f169f400-ea59-48ec-a765-2c8cab7131b9 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:47.091949 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a5bc2aa-7612-4177-bd94-d995a996910f tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1934 microversion: 2.91 time: 0.830181 Nov 02 12:34:47.107433 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1514/3004] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:46 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1934 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:47.381996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-61fee97e-c58e-44b4-b458-68fbdfc0eddd req-e1049928-72d3-4280-89b2-0c09b742f5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae270dc8-58c1-4da4-ab86-771f11167f53", "name": "network-vif-deleted", "tag": "ee47a78b-30ee-44fe-bf83-fb3681c51b66"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:47.421391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-61fee97e-c58e-44b4-b458-68fbdfc0eddd req-e1049928-72d3-4280-89b2-0c09b742f5ab service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.424037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-61fee97e-c58e-44b4-b458-68fbdfc0eddd req-e1049928-72d3-4280-89b2-0c09b742f5ab service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.426115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-61fee97e-c58e-44b4-b458-68fbdfc0eddd req-e1049928-72d3-4280-89b2-0c09b742f5ab service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:47.476094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-61fee97e-c58e-44b4-b458-68fbdfc0eddd req-e1049928-72d3-4280-89b2-0c09b742f5ab service nova] Creating event network-vif-deleted:ee47a78b-30ee-44fe-bf83-fb3681c51b66 for instance ae270dc8-58c1-4da4-ab86-771f11167f53 on n-h1-855650-5 Nov 02 12:34:47.503517 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-61fee97e-c58e-44b4-b458-68fbdfc0eddd req-e1049928-72d3-4280-89b2-0c09b742f5ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382370 Nov 02 12:34:47.504806 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1515/3005] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:47.519465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:47.521885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:47.545260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.547042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.548280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:47.550732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.555623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.556946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.163977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:49.380831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.398632 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-707d31c3-745d-45fa-b5e6-978a62c71d01 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1323 microversion: 2.1 time: 3.216705 Nov 02 12:34:49.430579 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1491/3006] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:46 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1323 bytes in 3241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:49.447024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:49.452556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:49.463836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.466484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.467557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.468549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.470038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.471100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.472766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.481514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:49.505169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.515921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.521714 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-23b2215a-ae47-4266-8b87-3e3b09c13e04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1753 microversion: 2.32 time: 2.011148 Nov 02 12:34:49.524293 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1516/3007] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:47 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1753 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:49.526209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lazy-loading 'flavor' on Instance uuid f169f400-ea59-48ec-a765-2c8cab7131b9 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:49.538021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.540802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: ae270dc8-58c1-4da4-ab86-771f11167f53] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:49.567301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.570099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.576443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.578319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.582042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.584730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.641110 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] HTTP exception thrown: Instance ae270dc8-58c1-4da4-ab86-771f11167f53 could not be found. Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Request method failure captured: Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 HTTP/1.1 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmI2bMygi6WhRoQZYUnBURwoz_gMvkDMakwEamdjUnQ7HPS0G80T1wEv-rQgbgT6AobEYgbdOuuxAi5855zt-BoN3ea98w-E-s4n_lUBCtaP2mmSpwC3z0W00pjSG8xPNr02yUgY2jqFZCFXgPWlr1vdrXfoDoJ-zUmYx9UIx4YRVUk Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5f41e93247724e6ab0b764cd9aee9eb0 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MigrationsAdminTest-703397273 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MigrationsAdminTest-703397273 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5f41e93247724e6ab0b764cd9aee9eb0 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MigrationsAdminTest-703397273 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MigrationsAdminTest-703397273-project Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a5a3010848f74c94bb32b506e184d275 Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MigrationsAdminTest-703397273-project Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance ae270dc8-58c1-4da4-ab86-771f11167f53 could not be found. Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'ae270dc8-58c1-4da4-ab86-771f11167f53'} Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae270dc8-58c1-4da4-ab86-771f11167f53 could not be found. Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae270dc8-58c1-4da4-ab86-771f11167f53 could not be found. Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:49.647304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:34:49.657444 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:49.657444 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:49.657444 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:49.657444 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:49.657444 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:49.657444 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae270dc8-58c1-4da4-ab86-771f11167f53 could not be found. Nov 02 12:34:49.657444 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:34:49.662072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Returning 404 to user: Instance ae270dc8-58c1-4da4-ab86-771f11167f53 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:49.664050 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eda423b1-a3b5-47ce-9917-741830d09665 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53" status: 404 len: 111 microversion: 2.1 time: 0.137573 Nov 02 12:34:49.665662 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1517/3008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/servers/ae270dc8-58c1-4da4-ab86-771f11167f53 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:49.696847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.699148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:49.717825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.718501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.719169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.720256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.720838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.722388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.810942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:34:49.914818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:50.064662 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ecb6445-c7cc-4e6e-838c-4e7760776053 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "DELETE /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 204 len: 0 microversion: 2.1 time: 0.392632 Nov 02 12:34:50.069224 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1518/3009] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:34:49 2022] DELETE /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:34:50.083004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:50.083862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:50.104213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.109591 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6d8dfc2-c396-4dd9-a23e-0c993a746fcc tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "POST /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9/action" status: 202 len: 0 microversion: 2.91 time: 0.676188 Nov 02 12:34:50.110532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.111649 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1492/3010] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:34:49 2022] POST /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:34:50.133713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.138721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.139292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.141891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:50.142349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.144225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:50.168997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.171306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.183205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.185028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.186253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.187394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.435410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:50.482639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:50.489785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:50.502158 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ffad1044-e1ff-46db-9fe6-201484865e47 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.368872 Nov 02 12:34:50.504865 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1493/3011] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:50 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:50.519294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:50.523149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:50.548456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.557908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.559193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.562088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.563578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.569442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.839716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:50.855848 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e8b6780-7c00-4dc5-b146-b4e5501ea68a tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1534 microversion: 2.1 time: 0.785010 Nov 02 12:34:50.863067 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1519/3012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:50 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1534 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:50.879435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:50.880348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:50.899546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.903884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.910255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.912775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.913567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.914264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.076131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.097904 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e09fc51-da7a-4068-a8bf-cee42bcd9983 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1323 microversion: 2.1 time: 0.589970 Nov 02 12:34:51.100043 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1494/3013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:50 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1323 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:51.111677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fd70f75b-e2dd-4f45-9f96-fb935001602a req-125ed07b-7849-43b0-b547-d6cda3649219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3803cb1-6c47-450a-b0c5-275f54247723", "tag": "13927f43-c5a3-490b-b220-7b73cbc8aa68"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:51.133891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fd70f75b-e2dd-4f45-9f96-fb935001602a req-125ed07b-7849-43b0-b547-d6cda3649219 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.135238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fd70f75b-e2dd-4f45-9f96-fb935001602a req-125ed07b-7849-43b0-b547-d6cda3649219 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.136478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fd70f75b-e2dd-4f45-9f96-fb935001602a req-125ed07b-7849-43b0-b547-d6cda3649219 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.169464 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fd70f75b-e2dd-4f45-9f96-fb935001602a req-125ed07b-7849-43b0-b547-d6cda3649219 service nova] Creating event network-changed:13927f43-c5a3-490b-b220-7b73cbc8aa68 for instance f3803cb1-6c47-450a-b0c5-275f54247723 on n-h1-855650-5 Nov 02 12:34:51.181471 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fd70f75b-e2dd-4f45-9f96-fb935001602a req-125ed07b-7849-43b0-b547-d6cda3649219 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078308 Nov 02 12:34:51.183306 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1495/3014] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:51.288353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.318436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.322930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.361310 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e4ecf6f-a8e8-4b80-b98b-130392b79c48 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1799 microversion: 2.32 time: 0.496661 Nov 02 12:34:51.375423 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1520/3015] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:50 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1799 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:51.543294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:51.545189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:51.558474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.559928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.561144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.564494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.566923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.568092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.816432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-570121683", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7330e733-98bd-42dc-9d0b-f2ce63fef274"}], "security_groups": [{"name": "tempest-securitygroup--445011266"}], "key_name": "tempest-keypair-935910656", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:51.879124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:51.884467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.906566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.909097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.924440 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e4d2836-66e2-4166-a19b-888520491bd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.390680 Nov 02 12:34:51.934467 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1496/3016] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:51 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:51.962405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:51.963318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:51.982354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.982930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.983388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.984134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.984602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.985034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.372505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] validate_networks() for [('7330e733-98bd-42dc-9d0b-f2ce63fef274', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:34:52.602522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:52.629278 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9a67fc0-d24b-43b8-ac5f-f24572f63695 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1534 microversion: 2.1 time: 0.692949 Nov 02 12:34:52.632231 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1497/3017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:51 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1534 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:52.656714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:52.658272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:52.678466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.679720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.685469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.687541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.688759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.691390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.252909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:53.290220 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94fb547d-2eeb-4993-8bec-3b7137afaf53 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1323 microversion: 2.1 time: 0.651206 Nov 02 12:34:53.295191 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1498/3018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:52 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1323 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:53.317240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:53.318670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:53.351460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.352393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.353112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.354346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.357667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.364691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.510905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.532660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.537303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.540298 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d55afb3-cf01-4a17-b4af-a53cd8709912 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1799 microversion: 2.32 time: 1.241741 Nov 02 12:34:54.560036 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1499/3019] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:53 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1799 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:54.599848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:54.609605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:54.636428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.641561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.647244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.648822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.649841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.654188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.867547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Getting quotas for project 97e284749b1d45a4b0748e50601b4efd. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:54.907870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Getting quotas for user c71e15a35de14ba691ec72cddac6a1a8 and project 97e284749b1d45a4b0748e50601b4efd. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:54.917708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.945750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.951916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.993162 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0027c4a1-681b-45ec-b4b9-7d96d09119b1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.430947 Nov 02 12:34:55.009192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:34:55.011484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:34:55.014241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:34:55.014455 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1500/3020] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:54 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:55.018778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:34:55.019327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:34:55.025932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.027192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.035693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.036588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.037302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.038350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.039079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.039877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.092467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.098386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.100388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.110391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.115864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.116478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.203604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Getting quotas for project 97e284749b1d45a4b0748e50601b4efd. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:55.245254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Getting quotas for user c71e15a35de14ba691ec72cddac6a1a8 and project 97e284749b1d45a4b0748e50601b4efd. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:55.275893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:34:55.283250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:34:55.432892 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7da7ac72-bad2-400c-bb03-ceb75b2451e9 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.626008 Nov 02 12:34:55.441253 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1521/3021] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:34:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 3635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:34:55.446991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.448011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.456390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.457267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.458030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.459057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.459725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.460363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.497592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:55.511823 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fe74cf5-eada-4044-aebb-8e2435485f54 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1492 microversion: 2.1 time: 0.496018 Nov 02 12:34:55.514843 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1501/3022] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1492 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:55.548878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ce1ff83a-3d65-4cf2-b8cd-d703d91f1a65 req-0085f013-d235-4b17-b645-398a6c0c874c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6", "name": "network-vif-deleted", "tag": "4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:55.581340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ce1ff83a-3d65-4cf2-b8cd-d703d91f1a65 req-0085f013-d235-4b17-b645-398a6c0c874c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.582019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ce1ff83a-3d65-4cf2-b8cd-d703d91f1a65 req-0085f013-d235-4b17-b645-398a6c0c874c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.582793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ce1ff83a-3d65-4cf2-b8cd-d703d91f1a65 req-0085f013-d235-4b17-b645-398a6c0c874c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.631310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ce1ff83a-3d65-4cf2-b8cd-d703d91f1a65 req-0085f013-d235-4b17-b645-398a6c0c874c service nova] Creating event network-vif-deleted:4f46a4a0-ee84-4ec0-b8ff-f6b4197b0a51 for instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 on n-h1-855650-5 Nov 02 12:34:55.640121 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ce1ff83a-3d65-4cf2-b8cd-d703d91f1a65 req-0085f013-d235-4b17-b645-398a6c0c874c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123105 Nov 02 12:34:55.641038 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1502/3023] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:55.648158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24b75eba-9c00-4444-a3e4-f649f5c499ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.649433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24b75eba-9c00-4444-a3e4-f649f5c499ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.853462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24b75eba-9c00-4444-a3e4-f649f5c499ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:55.880508 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24b75eba-9c00-4444-a3e4-f649f5c499ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1268 microversion: 2.1 time: 0.237477 Nov 02 12:34:55.882174 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1503/3024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1268 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:55.900967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.908464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.933591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.939101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.939854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.941204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.942080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.942859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.402483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.432352 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-103601c9-ef6a-4502-bf4e-4143541d1670 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1323 microversion: 2.1 time: 0.989080 Nov 02 12:34:56.438866 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1522/3025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1323 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:56.462972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:56.473201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:56.496146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.504268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.505462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.510794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.511986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.516492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.638519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.700501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.712474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.718391 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2639510a-cc84-47e7-b07b-1f41899854ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1833 microversion: 2.32 time: 0.830076 Nov 02 12:34:56.726675 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1504/3026] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1833 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:56.755217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:56.756429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:56.803596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.805121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.808450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.809564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.810101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.810580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.936188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.936894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.937470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.938921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lazy-loading 'fault' on Instance uuid aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:57.027319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.073760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.077823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.096143 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a1f2e84c-9de2-4025-8b58-f715dd25af16 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.650022 Nov 02 12:34:57.098410 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1523/3027] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:56 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:57.131256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.134773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:57.150944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.152242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.153727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.155221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.156343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.157475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.212062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.263609 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98f963da-2a70-46f5-b1d9-e21ede033552 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1368 microversion: 2.1 time: 0.533400 Nov 02 12:34:57.291628 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1505/3028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:56 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1368 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:57.381877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.419750 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8c8b3b28-cb23-4065-b932-d9d023b1ca46 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1272 microversion: 2.1 time: 0.316858 Nov 02 12:34:57.422913 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1524/3029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:57.490055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.505821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:57.538542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.542578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.543706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.545038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.546220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.555079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.786698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.787894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:57.819352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.820697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.821482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.823142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.824288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.829593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.036783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.093939 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7fcf46f-825e-434a-84ae-6a031478a3d2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1323 microversion: 2.1 time: 0.595822 Nov 02 12:34:58.095397 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1506/3030] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1323 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:58.173310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:58.175534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:58.190186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.191471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.192309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.194289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.195209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.196146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.230586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.247729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.251832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.256180 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f8e6450a-685e-4a62-82b8-8de8e1467ec9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1833 microversion: 2.32 time: 0.486954 Nov 02 12:34:58.259336 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1525/3031] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1833 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:34:58.327416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:58.347032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:58.357476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.358425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.359153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.360195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.360991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.361611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.387045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.435175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.440109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.453474 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c23402c-50e4-49dc-9192-f72a05d6cd5c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.304254 Nov 02 12:34:58.454743 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1507/3032] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:58 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:58.475241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:58.480157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:58.497924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.507143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.508087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.513886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.515120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.516675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.528598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.529223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.542134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.544233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lazy-loading 'fault' on Instance uuid aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:58.714008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.738733 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-11d7cd6a-fea6-435a-a9f6-5d0b5bf7392f tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 200 len: 1368 microversion: 2.1 time: 0.416895 Nov 02 12:34:58.744484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1526/3033] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:58 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 1368 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:58.764809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-8378cacf-b1c8-4f99-bb02-4bba8cf33e9c req-9208cff5-59ed-4fc7-a3b7-d69d6f0c8c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "tag": "22fd6bd7-c6b4-4d2a-8460-2167ba242deb"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:58.801303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8378cacf-b1c8-4f99-bb02-4bba8cf33e9c req-9208cff5-59ed-4fc7-a3b7-d69d6f0c8c9c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.815701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8378cacf-b1c8-4f99-bb02-4bba8cf33e9c req-9208cff5-59ed-4fc7-a3b7-d69d6f0c8c9c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.816665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8378cacf-b1c8-4f99-bb02-4bba8cf33e9c req-9208cff5-59ed-4fc7-a3b7-d69d6f0c8c9c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.848303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-8378cacf-b1c8-4f99-bb02-4bba8cf33e9c req-9208cff5-59ed-4fc7-a3b7-d69d6f0c8c9c service nova] Creating event network-changed:22fd6bd7-c6b4-4d2a-8460-2167ba242deb for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:34:58.878124 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-8378cacf-b1c8-4f99-bb02-4bba8cf33e9c req-9208cff5-59ed-4fc7-a3b7-d69d6f0c8c9c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129902 Nov 02 12:34:58.880860 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1527/3034] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:58.947015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.979959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:58.988110 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dea9c00a-3892-4230-805d-eb987b436a7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1320 microversion: 2.1 time: 0.525352 Nov 02 12:34:58.989854 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1508/3035] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:58 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1320 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:59.147511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:59.148995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:59.161898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.162424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.162956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.163951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.164514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.165049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.303606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:59.304301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:59.311210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.312753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.313434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.314379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.316318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.317206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.018853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.028102 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66bc363a-ef41-48f1-925c-76d284548692 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1323 microversion: 2.1 time: 0.887622 Nov 02 12:35:00.028747 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1528/3036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:59 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1323 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:00.034816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:00.035859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:00.043171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.044210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.044926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.046255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.046981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.047639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.253136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.266628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.269236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.270796 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-60c9027c-2db5-4b66-a381-39cefff4343f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1833 microversion: 2.32 time: 0.972484 Nov 02 12:35:00.282046 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1509/3037] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:59 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1833 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:00.282046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:00.282046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:00.290612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.291316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.291774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.292523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.292983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.293726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.321124 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] HTTP exception thrown: Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 could not be found. Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Request method failure captured: Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 HTTP/1.1 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmI2bMygi6WhRoQZYUnBURwoz_gMvkDMakwEamdjUnQ7HPS0G80T1wEv-rQgbgT6AobEYgbdOuuxAi5855zt-BoN3ea98w-E-s4n_lUBCtaP2mmSpwC3z0W00pjSG8xPNr02yUgY2jqFZCFXgPWlr1vdrXfoDoJ-zUmYx9UIx4YRVUk Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5f41e93247724e6ab0b764cd9aee9eb0 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5f41e93247724e6ab0b764cd9aee9eb0 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-MigrationsAdminTest-703397273-project Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a5a3010848f74c94bb32b506e184d275 Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-MigrationsAdminTest-703397273-project Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 could not be found. Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6'} Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 could not be found. Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 could not be found. Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:00.324664 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 could not be found. Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Returning 404 to user: Instance aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b4c38798-ca49-40d3-b8fb-f6d056d38952 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6" status: 404 len: 111 microversion: 2.1 time: 0.054296 Nov 02 12:35:00.329706 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1510/3038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:00 2022] GET /compute/v2.1/servers/aab422c9-a7d9-4e7e-b364-5ae6aed1c4e6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:00.339514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:00.340678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:00.358229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.360199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.374577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.375493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.375995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.376444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.404273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.417782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.419625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.435216 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-34ca469e-40d7-4f62-b8f5-87268c13ee89 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.405088 Nov 02 12:35:00.436119 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1529/3039] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:00 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:00.442252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c1982717-1c9c-41e6-ab82-48c5d977d28e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '.version_select at 0x7f228dd3c4c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:00.473609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c1982717-1c9c-41e6-ab82-48c5d977d28e tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437839530" status: 202 len: 0 microversion: 2.1 time: 0.036116 Nov 02 12:35:00.476270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1530/3040] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:35:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437839530 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:00.637583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.652117 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-403bfea4-9834-4fe0-89d6-6e51b21a9496 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1326 microversion: 2.1 time: 0.321079 Nov 02 12:35:00.654165 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1511/3041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:00 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1326 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:01.073759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:01.074708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:01.082701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.084273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.084273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.084816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.085045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.086261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.318790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:01.321203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:01.356369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.358613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.359426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.363442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.364790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.365957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.365626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.379386 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c7c5482-1a00-45a7-8f04-ef5ce05f629a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1323 microversion: 2.1 time: 1.308930 Nov 02 12:35:02.381662 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1531/3042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:01 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1323 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:02.395142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:02.397485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:02.421592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.424292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.426888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.431500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.432738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.433804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.527068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.555476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.559194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.562400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea7d7d12-79ac-4660-96f3-0dff64b8ea77 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1854 microversion: 2.32 time: 1.248178 Nov 02 12:35:02.580267 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1512/3043] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:01 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1854 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:02.619273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:02.620798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:02.637087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.638461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.639544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.641293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.642904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.644594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.695612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.713224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.720820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.738991 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9f1928eb-d4d0-451f-ad63-3c6c0887d536 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.352834 Nov 02 12:35:02.759287 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1532/3044] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:02 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:02.887927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7f50e8c0-ba21-4d92-9bfb-17bd864578bf req-dd08fcf2-8174-43d5-b1b8-3178f7dd7ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3803cb1-6c47-450a-b0c5-275f54247723", "name": "network-vif-plugged", "status": "completed", "tag": "13927f43-c5a3-490b-b220-7b73cbc8aa68"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:02.921268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f50e8c0-ba21-4d92-9bfb-17bd864578bf req-dd08fcf2-8174-43d5-b1b8-3178f7dd7ce2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.921763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f50e8c0-ba21-4d92-9bfb-17bd864578bf req-dd08fcf2-8174-43d5-b1b8-3178f7dd7ce2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.922244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f50e8c0-ba21-4d92-9bfb-17bd864578bf req-dd08fcf2-8174-43d5-b1b8-3178f7dd7ce2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.967795 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7f50e8c0-ba21-4d92-9bfb-17bd864578bf req-dd08fcf2-8174-43d5-b1b8-3178f7dd7ce2 service nova] Creating event network-vif-plugged:13927f43-c5a3-490b-b220-7b73cbc8aa68 for instance f3803cb1-6c47-450a-b0c5-275f54247723 on n-h1-855650-5 Nov 02 12:35:02.971313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.977892 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7f50e8c0-ba21-4d92-9bfb-17bd864578bf req-dd08fcf2-8174-43d5-b1b8-3178f7dd7ce2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216899 Nov 02 12:35:02.983431 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1533/3045] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:02.987211 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e791f9bf-62bf-4e4c-87f2-b935bc5815ba tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1393 microversion: 2.1 time: 0.391281 Nov 02 12:35:02.992347 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1513/3046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:02 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1393 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:03.114465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1162208576", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:03.239652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] validate_networks() for [('c068488f-a377-46be-b121-31cbe9651f21', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:03.414534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:03.426689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:03.451201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.452157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.457587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.465086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.466343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.467396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.067178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:04.094193 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2c4e5add-661b-4d1f-a045-7e55195a0f91 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1323 microversion: 2.1 time: 0.688796 Nov 02 12:35:04.110930 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1514/3047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:03 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1323 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:04.122836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e8b5331d-c246-498b-8d01-10385f072f65 req-d3184b0c-71f0-4845-9c43-d912e47398ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "tag": "712161f6-8da6-4c4e-85f6-1af79acf041a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:04.162828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:04.167742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8b5331d-c246-498b-8d01-10385f072f65 req-d3184b0c-71f0-4845-9c43-d912e47398ea service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.169650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8b5331d-c246-498b-8d01-10385f072f65 req-d3184b0c-71f0-4845-9c43-d912e47398ea service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.171308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8b5331d-c246-498b-8d01-10385f072f65 req-d3184b0c-71f0-4845-9c43-d912e47398ea service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.200166 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e8b5331d-c246-498b-8d01-10385f072f65 req-d3184b0c-71f0-4845-9c43-d912e47398ea service nova] Creating event network-changed:712161f6-8da6-4c4e-85f6-1af79acf041a for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:35:04.211034 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e8b5331d-c246-498b-8d01-10385f072f65 req-d3184b0c-71f0-4845-9c43-d912e47398ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097682 Nov 02 12:35:04.212149 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1515/3048] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:04.223904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:04.225723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:04.240644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.241910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.243069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.244819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.246058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.247545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.168986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:05.263694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:05.405473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.433050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.435713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.437294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96abf1ce-613e-4f3a-b9cd-c8ababaae769 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1854 microversion: 2.32 time: 1.223070 Nov 02 12:35:05.438096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1516/3049] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:04 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1854 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:05.479632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:05.480475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:05.488467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.489281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.489940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.490985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.491746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.492570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.496924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:05.499697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:05.499697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:05.499697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:05.500119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:05.522776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.526002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.526741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.527451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:35:05.528467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.528961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.529404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.582152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Getting quotas for project 29944ce70b2d4abea5c2f205a3814881. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:05.590693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Getting quotas for user 11f2191cdfa640ed9a7f71d4744c9999 and project 29944ce70b2d4abea5c2f205a3814881. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:05.622217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:05.629118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:05.664092 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4edc2637-9f9a-44de-af18-8d4802287de1 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 204 len: 0 microversion: 2.1 time: 0.188327 Nov 02 12:35:05.670419 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1517/3050] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:05 2022] DELETE /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:05.678674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:05.679948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:05.688129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.689272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.690485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.691842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.692533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.693357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.723685 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-caedb8cc-efac-4180-94a6-429de489be27 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.738626 Nov 02 12:35:05.724463 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1534/3051] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:05.736966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:05.737924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:05.762539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.763384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.764134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.765302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.765904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.767372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.844161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.863177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:05.868775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.872238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.882439 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6b2ae8e-bee4-4192-b83d-d5910f729db6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.208534 Nov 02 12:35:05.889402 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1518/3052] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:05 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:05.898218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:05.898921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:05.907556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.908155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.911582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.911582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.911582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.911582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.501375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.519797 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f9ed993-8461-4cae-b180-ee07d1a2978e tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1393 microversion: 2.1 time: 0.782192 Nov 02 12:35:06.521314 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1535/3053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:05 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1393 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:06.531000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:06.536666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:06.538782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.546106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.547486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.548570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.550055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.551222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.552213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.557096 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d100080-3746-478b-bfa1-a1e8aa21bc64 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1518 microversion: 2.1 time: 0.663945 Nov 02 12:35:06.557955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1519/3054] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:05 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1518 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:06.577857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b82fb04-0228-4dfe-b298-10b4b510df8c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:06.579818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b82fb04-0228-4dfe-b298-10b4b510df8c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.097832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b82fb04-0228-4dfe-b298-10b4b510df8c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.114832 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b82fb04-0228-4dfe-b298-10b4b510df8c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1222 microversion: 2.1 time: 0.548115 Nov 02 12:35:07.118432 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1520/3055] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:06 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1222 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:07.133259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.136234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.153619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.156621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.157215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.159401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.160029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.160532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.380245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.393827 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-acbba00a-26e4-4f24-baa8-1e37cb84ec77 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1469 microversion: 2.1 time: 0.868793 Nov 02 12:35:07.394786 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1536/3056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:06 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1469 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:07.400626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:07.403940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.412934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.413472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.413924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.414713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.415175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.415613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.446783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lazy-loading 'flavor' on Instance uuid f3803cb1-6c47-450a-b0c5-275f54247723 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:07.464758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:07.570858 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-85c20929-18d2-45e0-b9d0-0752a2608eab tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action" status: 200 len: 32 microversion: 2.1 time: 0.174201 Nov 02 12:35:07.578217 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1537/3057] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:35:07 2022] POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:35:07.585496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.586881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.596732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.597757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.598807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.600039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.600759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.601771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.812017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.835640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.843691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.851407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.858941 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-644e5c12-e6cd-40ed-b5ba-39cd99f20f3d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.278633 Nov 02 12:35:07.863611 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1538/3058] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:07.885542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.888353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-938133479", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:07.891734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.897231 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b94b2cb-2ea3-42d1-ba55-fba25e86fb70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.775533 Nov 02 12:35:07.910236 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1521/3059] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:07.928724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.930554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.944280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.945516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.950037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.952128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.953105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.954236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.028693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] validate_networks() for [('c068488f-a377-46be-b121-31cbe9651f21', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:08.841479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:08.857315 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0560544-6635-4ec9-bd4f-eb0a7f9d088d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1393 microversion: 2.1 time: 0.942477 Nov 02 12:35:08.858606 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1522/3060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1393 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:08.868591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.874472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:08.882694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.883226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.883712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.884946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.885776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.886599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.723686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.765636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-79abac36-2bb8-4ffd-a03f-12b6834dc506 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 0.904991 Nov 02 12:35:09.770769 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1523/3061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:09.782698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c832fa0e-7cdb-4909-885a-edfc56509e8a req-e9e05258-62f3-4bfd-b25b-82e21ee0202d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593a5f54-ab59-4a5c-969e-e8c45d008744", "tag": "2604b6b7-09e9-464c-a883-2e9cbc79e103"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:09.795971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c832fa0e-7cdb-4909-885a-edfc56509e8a req-e9e05258-62f3-4bfd-b25b-82e21ee0202d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.797064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c832fa0e-7cdb-4909-885a-edfc56509e8a req-e9e05258-62f3-4bfd-b25b-82e21ee0202d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.797767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c832fa0e-7cdb-4909-885a-edfc56509e8a req-e9e05258-62f3-4bfd-b25b-82e21ee0202d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.814785 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c832fa0e-7cdb-4909-885a-edfc56509e8a req-e9e05258-62f3-4bfd-b25b-82e21ee0202d service nova] Creating event network-changed:2604b6b7-09e9-464c-a883-2e9cbc79e103 for instance 593a5f54-ab59-4a5c-969e-e8c45d008744 on n-h2-855650-5 Nov 02 12:35:09.821001 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c832fa0e-7cdb-4909-885a-edfc56509e8a req-e9e05258-62f3-4bfd-b25b-82e21ee0202d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048100 Nov 02 12:35:09.821959 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1524/3062] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:09.833006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:09.834266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:09.842413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.843078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.843533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.844278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.844752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.845229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.992903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.011278 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db710926-ca38-41c7-a04b-2adf90b7447d tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1427 microversion: 2.1 time: 0.186773 Nov 02 12:35:10.012705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1525/3063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:09 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1427 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:10.026153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.028792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.042493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.043998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.044806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.046281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.047307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.052042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.136881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:10.138718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:10.142734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:10.148728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:10.150083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:10.195208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.196983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.198107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.199505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.200528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.201195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.247176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Getting quotas for project 29944ce70b2d4abea5c2f205a3814881. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:10.261415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Getting quotas for user 11f2191cdfa640ed9a7f71d4744c9999 and project 29944ce70b2d4abea5c2f205a3814881. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:10.282676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:10.290015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:10.322509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:10.384557 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bbb58ee8-3c6a-4800-978d-e2a4e1fdca5e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.518247 Nov 02 12:35:10.385227 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1539/3064] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:10.404685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.405452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.421614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.424983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.425817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.429029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.429497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.430088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.430567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.432968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:10.456789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.467026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.488049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-54251616-445e-438e-bac2-f6cf6921bce6 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.472983 Nov 02 12:35:10.489342 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1526/3065] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:10.504622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.511377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.522301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.526664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.527453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.528658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.531717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.532441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.719456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.746732 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1106e1bf-56ee-44ab-b06c-60cb4ad24e32 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1393 microversion: 2.1 time: 1.250169 Nov 02 12:35:11.757216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.758514 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1527/3066] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1393 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:11.770342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-dc5e14de-a0ff-4aa9-abb6-18030970355a req-f290964a-0312-444d-a9a1-ecc82483073e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1", "name": "network-vif-deleted", "tag": "8096feea-680d-4ef5-8cb4-92af700234d1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:11.778933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.782833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.787606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dc5e14de-a0ff-4aa9-abb6-18030970355a req-f290964a-0312-444d-a9a1-ecc82483073e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.787821 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64bb5d7c-7a82-464d-ace6-3c99ec915308 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.401261 Nov 02 12:35:11.788335 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1540/3067] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:11.802419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dc5e14de-a0ff-4aa9-abb6-18030970355a req-f290964a-0312-444d-a9a1-ecc82483073e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.802419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dc5e14de-a0ff-4aa9-abb6-18030970355a req-f290964a-0312-444d-a9a1-ecc82483073e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.817309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:11.817955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:11.829927 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-dc5e14de-a0ff-4aa9-abb6-18030970355a req-f290964a-0312-444d-a9a1-ecc82483073e service nova] Creating event network-vif-deleted:8096feea-680d-4ef5-8cb4-92af700234d1 for instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 on n-h2-855650-5 Nov 02 12:35:11.845219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.846469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.846941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.847729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.848204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.848644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.850847 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-dc5e14de-a0ff-4aa9-abb6-18030970355a req-f290964a-0312-444d-a9a1-ecc82483073e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084733 Nov 02 12:35:11.851718 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1528/3068] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:11.858478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:11.869288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:11.900954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.901836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.902595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.903815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.904743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.906259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.107725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.118594 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5a4d7f8d-15eb-4bae-b82c-e9e023847075 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1225 microversion: 2.1 time: 0.314857 Nov 02 12:35:12.119244 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1541/3069] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:11 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1225 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:12.124463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:12.125520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:12.132885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.133728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.134414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.135395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.135866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.136325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.367318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.379543 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e34b7d02-2667-4393-bdae-eedb53213a04 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 0.526032 Nov 02 12:35:12.387376 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1529/3070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:11 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:12.413369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:12.415843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:12.442797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.444124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.445308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.447310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.448887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.449649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.495721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.496247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.496740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.497218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lazy-loading 'fault' on Instance uuid 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:12.643220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.650178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.683710 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f21b0937-f8bb-4309-9a9a-ad37022ebf2c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1303 microversion: 2.1 time: 0.562816 Nov 02 12:35:12.684374 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1542/3071] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:12 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1303 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:12.691728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.697635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.711314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a03aa09b-7152-44fe-bf4f-49681c5f7ec1 req-377190b1-f679-4743-9081-dd5d024d47c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "tag": "b21a0968-4bb4-4e3b-88bf-c5752d860906"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:12.725831 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae4501e4-5e5c-47d6-95ab-93dcca843f13 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.336606 Nov 02 12:35:12.737748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a03aa09b-7152-44fe-bf4f-49681c5f7ec1 req-377190b1-f679-4743-9081-dd5d024d47c8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.738188 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1530/3072] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:12 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:12.739027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a03aa09b-7152-44fe-bf4f-49681c5f7ec1 req-377190b1-f679-4743-9081-dd5d024d47c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.740011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a03aa09b-7152-44fe-bf4f-49681c5f7ec1 req-377190b1-f679-4743-9081-dd5d024d47c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.768469 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a03aa09b-7152-44fe-bf4f-49681c5f7ec1 req-377190b1-f679-4743-9081-dd5d024d47c8 service nova] Creating event network-changed:b21a0968-4bb4-4e3b-88bf-c5752d860906 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:35:12.776550 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a03aa09b-7152-44fe-bf4f-49681c5f7ec1 req-377190b1-f679-4743-9081-dd5d024d47c8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086508 Nov 02 12:35:12.777285 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1543/3073] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:12.780801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:12.781956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:12.795154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.796660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.797763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.799410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.800567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.801613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.819321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:12.820416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:12.838431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.839098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.847189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.848152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.848763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.850592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.611906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.617916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.629217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.631167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.632712 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b79a254-683b-4a5a-b5e2-a54b884ff269 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.819471 Nov 02 12:35:13.646033 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-399e7498-26dd-4463-884e-8667c75be7db tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1393 microversion: 2.1 time: 0.861434 Nov 02 12:35:13.646033 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1531/3074] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:12 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1393 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:13.646033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.646732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:13.647027 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1544/3075] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:12 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:13.673151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.674813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:13.683378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.684143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.684764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.686057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.686760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.687405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.697164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.699677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.701636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.710860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.711479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.713523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.946756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.972706 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7f7e06d-c2ec-408d-ba4a-e2acb405469f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1217 microversion: 2.1 time: 0.335016 Nov 02 12:35:13.976710 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1532/3076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:13 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1217 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:13.985308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.985951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.008813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.011340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.011935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.016844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.017406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.017888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.121089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.121603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.122355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.122825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lazy-loading 'fault' on Instance uuid 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:14.198496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.218719 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d4390939-8b5e-4c7b-be64-4ec28cf5f1f3 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 0.567854 Nov 02 12:35:14.221456 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1545/3077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:13 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:14.240519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.242389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.253900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.284071 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be5df970-1a09-4b47-803e-3916e862b975 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 200 len: 1303 microversion: 2.1 time: 0.304721 Nov 02 12:35:14.286486 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1533/3078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:13 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 1303 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:14.291207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.291879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.292378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.293173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.307026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.307330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.460998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.472243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.474193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.483110 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-271b153e-9d3d-45da-b092-c57347faa9b2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1556 microversion: 2.91 time: 0.252884 Nov 02 12:35:14.485726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1546/3079] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1556 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:14.679998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.681857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.690349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.691807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.701424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.702331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.702961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.704155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.704860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.706358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.711164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.711970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.712615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.713716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.714728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.715751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.726331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.740660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.773709 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0aeca355-5a57-4171-91ec-e251d71b3c64 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1393 microversion: 2.1 time: 1.107558 Nov 02 12:35:15.775427 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1534/3080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1393 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:15.779816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.783660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.785847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-06dda0b2-320f-4162-8c11-8aaf92a7f76a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.105217 Nov 02 12:35:15.786032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7998299e-1733-4c9b-84ae-9a93469165c3 req-8e5d1a52-cd41-45f4-8e30-cf431a18889f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "tag": "111922f9-44fa-4874-bf9a-147981786e2f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:15.786854 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1547/3081] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:15.801551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:15.803361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:15.825263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.825784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.826278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.827037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.827505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.827942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.830447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7998299e-1733-4c9b-84ae-9a93469165c3 req-8e5d1a52-cd41-45f4-8e30-cf431a18889f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.832864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7998299e-1733-4c9b-84ae-9a93469165c3 req-8e5d1a52-cd41-45f4-8e30-cf431a18889f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.834125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7998299e-1733-4c9b-84ae-9a93469165c3 req-8e5d1a52-cd41-45f4-8e30-cf431a18889f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.863849 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7998299e-1733-4c9b-84ae-9a93469165c3 req-8e5d1a52-cd41-45f4-8e30-cf431a18889f service nova] Creating event network-changed:111922f9-44fa-4874-bf9a-147981786e2f for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:35:15.874880 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7998299e-1733-4c9b-84ae-9a93469165c3 req-8e5d1a52-cd41-45f4-8e30-cf431a18889f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096273 Nov 02 12:35:15.878217 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1535/3082] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:15.892659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2fbfec13-d2dd-42fb-b0f1-a510cb84636a req-203c1425-b692-40cd-8824-559e80b25a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef4fe0d-6f31-447d-b886-353ade395208", "tag": "656c809f-ee4f-4ae5-b058-fa0c45b86dd5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:15.915344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2fbfec13-d2dd-42fb-b0f1-a510cb84636a req-203c1425-b692-40cd-8824-559e80b25a60 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.918048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2fbfec13-d2dd-42fb-b0f1-a510cb84636a req-203c1425-b692-40cd-8824-559e80b25a60 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.919675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2fbfec13-d2dd-42fb-b0f1-a510cb84636a req-203c1425-b692-40cd-8824-559e80b25a60 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.962179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2fbfec13-d2dd-42fb-b0f1-a510cb84636a req-203c1425-b692-40cd-8824-559e80b25a60 service nova] Creating event network-changed:656c809f-ee4f-4ae5-b058-fa0c45b86dd5 for instance 9ef4fe0d-6f31-447d-b886-353ade395208 on n-h1-855650-5 Nov 02 12:35:15.972046 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2fbfec13-d2dd-42fb-b0f1-a510cb84636a req-203c1425-b692-40cd-8824-559e80b25a60 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091267 Nov 02 12:35:15.973475 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1536/3083] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:15.984745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:15.998722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.015429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.016253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.016960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.018680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.019302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.020096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:16.020329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.034077 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e3841dae-868e-4261-b255-8ea4168b2ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1279 microversion: 2.1 time: 0.245136 Nov 02 12:35:16.048582 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1548/3084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:15 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:16.048582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.048582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.059305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.062091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.062926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.063865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.065066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.065824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.097394 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] HTTP exception thrown: Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 could not be found. Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Request method failure captured: Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 HTTP/1.1 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmI2bMygi6WhRoQZYUnBURwoz_gMvkDMakwEamdjUnQ7HPS0G80T1wEv-rQgbgT6AobEYgbdOuuxAi5855zt-BoN3ea98w-E-s4n_lUBCtaP2mmSpwC3z0W00pjSG8xPNr02yUgY2jqFZCFXgPWlr1vdrXfoDoJ-zUmYx9UIx4YRVUk Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5f41e93247724e6ab0b764cd9aee9eb0 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5f41e93247724e6ab0b764cd9aee9eb0 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MigrationsAdminTest-703397273-project Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a5a3010848f74c94bb32b506e184d275 Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MigrationsAdminTest-703397273-project Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 could not be found. Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1'} Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 could not be found. Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 could not be found. Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:16.100230 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:16.105891 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:16.105891 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:16.105891 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:16.105891 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:16.105891 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:16.105891 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 could not be found. Nov 02 12:35:16.105891 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:16.107467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Returning 404 to user: Instance 6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:16.108762 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1cf79181-9108-4775-a2a1-a50b24378750 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1" status: 404 len: 111 microversion: 2.1 time: 0.072689 Nov 02 12:35:16.109635 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1549/3085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/servers/6dbf0cb6-a2ed-478c-a2f4-1fc3eb5b74a1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:16.116908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.117553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.124737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.125595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.126375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.127541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.128147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.128847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.404910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:16.427341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:16.430815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:16.441789 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e910bf17-e34e-4bc6-9e4c-7edd0df74ddb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1556 microversion: 2.91 time: 0.330192 Nov 02 12:35:16.442998 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1550/3086] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1556 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:16.452306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.453772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.467971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.469412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.471600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.473385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.474662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.475794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.530022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:35:16.765407 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-28254b8a-2c77-499d-b01e-4502598c87f9 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "DELETE /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 204 len: 0 microversion: 2.1 time: 0.317008 Nov 02 12:35:16.767194 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1551/3087] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:16 2022] DELETE /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:16.798895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.801180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.813780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.815724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.816793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.818284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.819399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.820373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.103545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:17.390794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.402309 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6ed5277a-95fe-4388-a794-25bce700fe5f tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 1.426352 Nov 02 12:35:17.403573 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1537/3088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:15 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:17.412792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:17.414901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:17.428259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.429436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.430494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.432026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.433140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.434411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.603748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.607172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:17.617491 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-26f16d71-84ed-4488-8080-6a914928e937 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1468 microversion: 2.1 time: 0.838213 Nov 02 12:35:17.618343 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1552/3089] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1468 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:17.628160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:17.629366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:17.643997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.643997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.644441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.645575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.646494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.647309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.132657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.145552 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07da7c2c-04c0-4d4c-86a6-fcb225965b14 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1393 microversion: 2.1 time: 0.740386 Nov 02 12:35:18.146804 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1538/3090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:17 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1393 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:18.153273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-553e0d39-3a5d-4938-99db-cd196df69441 req-c1b96d94-54cb-41cf-8137-38169a0b76ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593a5f54-ab59-4a5c-969e-e8c45d008744", "name": "network-vif-plugged", "status": "completed", "tag": "2604b6b7-09e9-464c-a883-2e9cbc79e103"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:18.165918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-553e0d39-3a5d-4938-99db-cd196df69441 req-c1b96d94-54cb-41cf-8137-38169a0b76ff service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.166706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-553e0d39-3a5d-4938-99db-cd196df69441 req-c1b96d94-54cb-41cf-8137-38169a0b76ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.167343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-553e0d39-3a5d-4938-99db-cd196df69441 req-c1b96d94-54cb-41cf-8137-38169a0b76ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.184785 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-553e0d39-3a5d-4938-99db-cd196df69441 req-c1b96d94-54cb-41cf-8137-38169a0b76ff service nova] Creating event network-vif-plugged:2604b6b7-09e9-464c-a883-2e9cbc79e103 for instance 593a5f54-ab59-4a5c-969e-e8c45d008744 on n-h2-855650-5 Nov 02 12:35:18.193108 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-553e0d39-3a5d-4938-99db-cd196df69441 req-c1b96d94-54cb-41cf-8137-38169a0b76ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044423 Nov 02 12:35:18.196585 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1539/3091] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:18.210235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.212523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:18.226719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.227881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.228817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.231106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.232490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.233700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.418003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.448560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.451658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.454273 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-533cd649-4929-4e36-844d-12e8308b184d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.834161 Nov 02 12:35:18.462732 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1553/3092] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:17 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:18.477236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.479058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:18.480295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.496155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.498533 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89b3be5a-bd1d-42a4-8024-7dc96f1c1a08 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1279 microversion: 2.1 time: 0.298389 Nov 02 12:35:18.498798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.499998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.501799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.502926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.504177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.515964 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1540/3093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1279 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:18.544309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-34cbc222-b89e-4587-9327-fc87d7a96ccc req-cf24f6c3-3374-4a51-ac8b-b49e4e4546c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "tag": "e0d29879-e0b6-463c-842f-6b6ea81d4651"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:18.569354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34cbc222-b89e-4587-9327-fc87d7a96ccc req-cf24f6c3-3374-4a51-ac8b-b49e4e4546c3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.569864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34cbc222-b89e-4587-9327-fc87d7a96ccc req-cf24f6c3-3374-4a51-ac8b-b49e4e4546c3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.571090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34cbc222-b89e-4587-9327-fc87d7a96ccc req-cf24f6c3-3374-4a51-ac8b-b49e4e4546c3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.598832 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-34cbc222-b89e-4587-9327-fc87d7a96ccc req-cf24f6c3-3374-4a51-ac8b-b49e4e4546c3 service nova] Creating event network-changed:e0d29879-e0b6-463c-842f-6b6ea81d4651 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:35:18.609069 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-34cbc222-b89e-4587-9327-fc87d7a96ccc req-cf24f6c3-3374-4a51-ac8b-b49e4e4546c3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089754 Nov 02 12:35:18.612022 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1541/3094] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:18.626232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.632253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:18.678238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.682441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.683586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.685089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.686192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.687125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.784967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.806961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.811581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.822852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-433590a2-5db4-46f5-8682-8e5f5f2971d1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1556 microversion: 2.91 time: 0.356935 Nov 02 12:35:18.834512 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1554/3095] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1556 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:18.847335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.850368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:18.863333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.865249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.866639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.868286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.869445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.870552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.073585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a3010848f74c94bb32b506e184d275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f41e93247724e6ab0b764cd9aee9eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.088471 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b0bce7e-cb59-4fb5-8b0b-790ec96b494c tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 200 len: 1426 microversion: 2.1 time: 0.251030 Nov 02 12:35:19.090705 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1555/3096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 1426 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:19.100739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-8678553e-1c06-4a7b-9cde-f5c2fd3050d2 req-adc58dfe-5618-4a08-b89f-9d0dedf04907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a522fa-dddf-4755-899a-445356170ce1", "name": "network-vif-deleted", "tag": "1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:19.124499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8678553e-1c06-4a7b-9cde-f5c2fd3050d2 req-adc58dfe-5618-4a08-b89f-9d0dedf04907 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.126122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8678553e-1c06-4a7b-9cde-f5c2fd3050d2 req-adc58dfe-5618-4a08-b89f-9d0dedf04907 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.128041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8678553e-1c06-4a7b-9cde-f5c2fd3050d2 req-adc58dfe-5618-4a08-b89f-9d0dedf04907 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.158917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-8678553e-1c06-4a7b-9cde-f5c2fd3050d2 req-adc58dfe-5618-4a08-b89f-9d0dedf04907 service nova] Creating event network-vif-deleted:1bbe3d50-32a3-4353-8eb3-65e2b2b4f6aa for instance 08a522fa-dddf-4755-899a-445356170ce1 on n-h2-855650-5 Nov 02 12:35:19.170209 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-8678553e-1c06-4a7b-9cde-f5c2fd3050d2 req-adc58dfe-5618-4a08-b89f-9d0dedf04907 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076711 Nov 02 12:35:19.171549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1556/3097] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:19.191108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:19.192812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:19.202237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.203131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.204400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.205488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.206177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.206879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.370132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.386655 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ebb76da-4ed1-4e81-8630-9f04815c4dc5 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 0.770559 Nov 02 12:35:19.388234 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1542/3098] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:19.511636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:19.512808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:19.538572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.541286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.541286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.542230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.543599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.544904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.646513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.696804 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ee9ec81e-d431-487a-aedb-5cd9a1fa2ec4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1393 microversion: 2.1 time: 0.483594 Nov 02 12:35:19.731349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1557/3099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:19 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1393 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:19.739604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:19.740246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:19.748551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.749346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.750087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.752866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.753596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.754593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.216288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:20.272857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:21.185482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:21.198990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:21.199745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:21.202949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:21.206333 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec48abd3-fe0c-4a0a-9140-da263e65a9f9 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.708260 Nov 02 12:35:21.226690 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1543/3100] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:19 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:21.235314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.236982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.244129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.245188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.245899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.247100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.247823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.248480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.251538 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-242a2aee-b065-4085-a2db-ccfadfd3eb05 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1321 microversion: 2.1 time: 1.513228 Nov 02 12:35:21.253009 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1558/3101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:19 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1321 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:21.280772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.281672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] [instance: 08a522fa-dddf-4755-899a-445356170ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.293421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.294465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.295394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.296584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.297227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.297856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.317729 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] HTTP exception thrown: Instance 08a522fa-dddf-4755-899a-445356170ce1 could not be found. Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Request method failure captured: Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 HTTP/1.1 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmI2bMygi6WhRoQZYUnBURwoz_gMvkDMakwEamdjUnQ7HPS0G80T1wEv-rQgbgT6AobEYgbdOuuxAi5855zt-BoN3ea98w-E-s4n_lUBCtaP2mmSpwC3z0W00pjSG8xPNr02yUgY2jqFZCFXgPWlr1vdrXfoDoJ-zUmYx9UIx4YRVUk Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5f41e93247724e6ab0b764cd9aee9eb0 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f41e93247724e6ab0b764cd9aee9eb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5f41e93247724e6ab0b764cd9aee9eb0 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MigrationsAdminTest-703397273 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MigrationsAdminTest-703397273-project Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a5a3010848f74c94bb32b506e184d275 Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MigrationsAdminTest-703397273-project Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 08a522fa-dddf-4755-899a-445356170ce1 could not be found. Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '08a522fa-dddf-4755-899a-445356170ce1'} Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a522fa-dddf-4755-899a-445356170ce1 could not be found. Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a522fa-dddf-4755-899a-445356170ce1 could not be found. Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:21.320228 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.325461 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:21.325461 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:21.325461 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:21.325461 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:21.325461 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:21.325461 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a522fa-dddf-4755-899a-445356170ce1 could not be found. Nov 02 12:35:21.325461 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.328823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] Returning 404 to user: Instance 08a522fa-dddf-4755-899a-445356170ce1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:21.330316 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d3e04fe-5239-4f0e-91a0-5436eee4eef2 tempest-MigrationsAdminTest-703397273 tempest-MigrationsAdminTest-703397273-project] 10.222.0.45 "GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1" status: 404 len: 111 microversion: 2.1 time: 0.072917 Nov 02 12:35:21.331361 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1559/3102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/08a522fa-dddf-4755-899a-445356170ce1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:21.338185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.339188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.348400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.349407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.350602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.351924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.352934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.353465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.524568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:21.545541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:21.551450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:21.568439 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6ef277e3-ae2b-4d37-a81e-002757fccad0 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.339854 Nov 02 12:35:21.569454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1544/3103] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:21.589591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.590905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.613015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.614539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.622117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.624143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.625290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.628210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:22.493809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:22.513436 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c3364370-5787-488c-9381-038af2ceb4f6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 1.180589 Nov 02 12:35:22.514522 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1560/3104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:22.531360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-af542150-a5a4-43c8-9f7c-f70c6b9ccffd req-69db2882-0296-43eb-9a95-62c68c58a804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "tag": "a5e3df2e-ea9d-46cc-8b90-9a43e80064a6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:22.550896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-af542150-a5a4-43c8-9f7c-f70c6b9ccffd req-69db2882-0296-43eb-9a95-62c68c58a804 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:22.554299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-af542150-a5a4-43c8-9f7c-f70c6b9ccffd req-69db2882-0296-43eb-9a95-62c68c58a804 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:22.554948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-af542150-a5a4-43c8-9f7c-f70c6b9ccffd req-69db2882-0296-43eb-9a95-62c68c58a804 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:22.584741 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-af542150-a5a4-43c8-9f7c-f70c6b9ccffd req-69db2882-0296-43eb-9a95-62c68c58a804 service nova] Creating event network-changed:a5e3df2e-ea9d-46cc-8b90-9a43e80064a6 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:35:22.601555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-af542150-a5a4-43c8-9f7c-f70c6b9ccffd req-69db2882-0296-43eb-9a95-62c68c58a804 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085597 Nov 02 12:35:22.602249 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1561/3105] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:22.610465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:22.611232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:22.630145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:22.630525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:22.630988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:22.635112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:22.635730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:22.636187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.060732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.073802 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d21eb77-0338-4944-b2ac-6fb574805826 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1574 microversion: 2.1 time: 1.502892 Nov 02 12:35:23.098994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1545/3106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1574 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:23.110550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:23.114317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:23.131496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.136792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.137512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.138589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.139302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.140020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.197140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:23.706595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.730646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.739656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.741309 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-13d3d445-6b8d-4c85-b069-2666cd644504 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.137799 Nov 02 12:35:23.742190 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1562/3107] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:22 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:23.753766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:23.759405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:23.774713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.779915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.780754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.781873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.782606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.783794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.258675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:24.271481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:24.276754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:24.307628 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-583009a3-225e-48be-b97b-e3932d2ae9b7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.563670 Nov 02 12:35:24.323041 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1563/3108] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:23 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:24.389859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:24.391253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:24.393295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:24.411617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.412754 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e65036e0-1534-4b88-bc27-e1b48322061d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1321 microversion: 2.1 time: 1.312037 Nov 02 12:35:24.413565 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1546/3109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:23 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1321 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:24.414828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.416041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.418003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.419296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.420960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.459232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:24.460103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:24.488631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.489151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.489795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.496866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.497846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.498349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.950940 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8c86f766-efa0-496b-aafa-baf8ee7351e8 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.625524 Nov 02 12:35:24.954156 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1564/3110] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:35:24 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744/os-interface => generated 285 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:24.979478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-059b94c5-fffc-40ee-ba30-113a5f836bcd req-d299c50f-7eab-4c3c-b9ec-bd88c7eced98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef4fe0d-6f31-447d-b886-353ade395208", "name": "network-vif-plugged", "status": "completed", "tag": "656c809f-ee4f-4ae5-b058-fa0c45b86dd5"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:25.040518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-059b94c5-fffc-40ee-ba30-113a5f836bcd req-d299c50f-7eab-4c3c-b9ec-bd88c7eced98 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.042637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-059b94c5-fffc-40ee-ba30-113a5f836bcd req-d299c50f-7eab-4c3c-b9ec-bd88c7eced98 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.046817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-059b94c5-fffc-40ee-ba30-113a5f836bcd req-d299c50f-7eab-4c3c-b9ec-bd88c7eced98 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.127757 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-059b94c5-fffc-40ee-ba30-113a5f836bcd req-d299c50f-7eab-4c3c-b9ec-bd88c7eced98 service nova] Creating event network-vif-plugged:656c809f-ee4f-4ae5-b058-fa0c45b86dd5 for instance 9ef4fe0d-6f31-447d-b886-353ade395208 on n-h1-855650-5 Nov 02 12:35:25.160858 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-059b94c5-fffc-40ee-ba30-113a5f836bcd req-d299c50f-7eab-4c3c-b9ec-bd88c7eced98 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200382 Nov 02 12:35:25.166077 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1565/3111] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:25.193435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:25.208453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:25.237170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.240889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.248192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.258603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.261265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.262633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.450366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:25.487428 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d01d441f-d683-44b1-923b-c46638f8a0d1 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 1.055336 Nov 02 12:35:25.501598 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1547/3112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:24 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:25.551354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:25.559901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:25.604979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.606597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.607837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.610686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.612467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.614800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.075080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.167473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.172127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.192956 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3e89888-57b0-4923-8a73-30ddffdbd703 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.688221 Nov 02 12:35:26.193570 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1548/3113] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:25 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:26.199063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:26.199691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:26.211465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.212901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.215097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.216884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.218442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.219725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.274388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.344208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.346544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.348047 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f026636e-2f34-43bb-bbd0-72b1d7f0b8c5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.176167 Nov 02 12:35:26.356040 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1566/3114] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:25 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:26.368654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-caf1a91c-8ba4-4abf-be7b-47c88e047a8d req-27f38eb2-2b66-480d-bc7e-3fe9eae3fe2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1236ab7-d8c5-4f61-be01-9534bc36a786", "tag": "31888f16-6862-4ba6-bf43-2c94c53f126f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:26.402034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-caf1a91c-8ba4-4abf-be7b-47c88e047a8d req-27f38eb2-2b66-480d-bc7e-3fe9eae3fe2b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.403604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-caf1a91c-8ba4-4abf-be7b-47c88e047a8d req-27f38eb2-2b66-480d-bc7e-3fe9eae3fe2b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.404373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-caf1a91c-8ba4-4abf-be7b-47c88e047a8d req-27f38eb2-2b66-480d-bc7e-3fe9eae3fe2b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.438265 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-caf1a91c-8ba4-4abf-be7b-47c88e047a8d req-27f38eb2-2b66-480d-bc7e-3fe9eae3fe2b service nova] Creating event network-changed:31888f16-6862-4ba6-bf43-2c94c53f126f for instance d1236ab7-d8c5-4f61-be01-9534bc36a786 on n-h2-855650-5 Nov 02 12:35:26.462316 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-caf1a91c-8ba4-4abf-be7b-47c88e047a8d req-27f38eb2-2b66-480d-bc7e-3fe9eae3fe2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104420 Nov 02 12:35:26.472090 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1567/3115] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:26.558428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:26.559613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:26.580222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.581306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.582058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.583105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.583878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.584568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.898596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.917213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d8a7c3b-ec26-4c19-9315-26356267ce82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1321 microversion: 2.1 time: 0.722353 Nov 02 12:35:26.917860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1549/3116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:26 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1321 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:27.260184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:27.260913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:27.275410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.276237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.276972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.279441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.279969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.280421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.781217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:27.798167 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0d64165-7aaf-49af-bca1-309a46802f7a tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 1.242240 Nov 02 12:35:27.803138 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1568/3117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:26 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:27.815748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:27.819528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:27.842943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.844155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.848027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.849281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.853796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.854782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.023811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.089924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.106524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.129671 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec2c863a-fd69-441f-ba93-b71cb0101d8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.873212 Nov 02 12:35:28.144618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1550/3118] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:27 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:28.184546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:28.187121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:28.199965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.201482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.203070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.205434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.207875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.209233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.526386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.550039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.551876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.553292 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-34e2f2ce-c80e-49c9-879d-cf1b39c9415c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.748783 Nov 02 12:35:28.553957 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1569/3119] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:27 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:28.630329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.645118 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c574c48a-d963-4b92-884b-15b7ab9acbf6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1321 microversion: 2.1 time: 0.488511 Nov 02 12:35:28.646110 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1551/3120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:28 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:28.669415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4c6abde0-a489-44af-8663-0f7cd4a3a6df req-f9aa691e-095c-4aca-bb78-fcc96ff0c03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "tag": "6ea29634-7e85-4371-9350-7f00f347f137"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:28.683455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4c6abde0-a489-44af-8663-0f7cd4a3a6df req-f9aa691e-095c-4aca-bb78-fcc96ff0c03d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.684252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4c6abde0-a489-44af-8663-0f7cd4a3a6df req-f9aa691e-095c-4aca-bb78-fcc96ff0c03d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.684838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4c6abde0-a489-44af-8663-0f7cd4a3a6df req-f9aa691e-095c-4aca-bb78-fcc96ff0c03d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.708873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4c6abde0-a489-44af-8663-0f7cd4a3a6df req-f9aa691e-095c-4aca-bb78-fcc96ff0c03d service nova] Creating event network-changed:6ea29634-7e85-4371-9350-7f00f347f137 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:35:28.731195 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4c6abde0-a489-44af-8663-0f7cd4a3a6df req-f9aa691e-095c-4aca-bb78-fcc96ff0c03d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083708 Nov 02 12:35:28.734889 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1552/3121] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:28.851848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:28.855692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:28.860914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b38c8b42-1347-496f-959b-ff6a52578aa8 tempest-QuotaClassesAdmin257Test-948425018 tempest-QuotaClassesAdmin257Test-948425018-project-admin] Calling method '.version_select at 0x7f228e904700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:28.870492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.872034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.873781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.875796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.877309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.878218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.900494 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b38c8b42-1347-496f-959b-ff6a52578aa8 tempest-QuotaClassesAdmin257Test-948425018 tempest-QuotaClassesAdmin257Test-948425018-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.334896 Nov 02 12:35:28.912016 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1570/3122] 10.222.0.45 () {60 vars in 1226 bytes} [Wed Nov 2 12:35:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:28.924847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9fd16b2-951c-4057-96df-805cfdd7f260 tempest-QuotaClassesAdmin257Test-948425018 tempest-QuotaClassesAdmin257Test-948425018-project-admin] Action: 'update', calling method: .version_select at 0x7f228e904ca0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:29.197781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=89,nova_api:UPDATE=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:29.228098 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b9fd16b2-951c-4057-96df-805cfdd7f260 tempest-QuotaClassesAdmin257Test-948425018 tempest-QuotaClassesAdmin257Test-948425018-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.313047 Nov 02 12:35:29.230577 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1571/3123] 10.222.0.45 () {62 vars in 1247 bytes} [Wed Nov 2 12:35:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:29.240900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.244386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.262255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.263581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.264541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.266390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.268458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.272806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.571896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:29.608265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:29.613051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:29.633555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2b18d5a1-3a6d-4349-b82b-21378f9fb02f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.400911 Nov 02 12:35:29.634512 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1572/3124] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:29.640043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64a97d29-125b-472e-b9fa-bda9c912ea47 tempest-QuotaClassesAdmin257Test-948425018 tempest-QuotaClassesAdmin257Test-948425018-project-admin] Calling method '.version_select at 0x7f228e8741f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.673700 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64a97d29-125b-472e-b9fa-bda9c912ea47 tempest-QuotaClassesAdmin257Test-948425018 tempest-QuotaClassesAdmin257Test-948425018-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.037647 Nov 02 12:35:29.676591 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1573/3125] 10.222.0.45 () {60 vars in 1226 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:29.689677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.691068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.704700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.712850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.717628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.718717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.719389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.720060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.754276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:29.778701 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6a8962a1-42a9-4f7c-b3b0-5a0fc89da6b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 0.933898 Nov 02 12:35:29.779513 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1553/3126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:28 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:29.800004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c6b97989-d83f-451b-a2ad-82e7d46f99d6 req-2cb0178f-51d5-498a-840e-6fa72dec56ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593a5f54-ab59-4a5c-969e-e8c45d008744", "tag": "2604b6b7-09e9-464c-a883-2e9cbc79e103"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:29.817046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:29.825405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6b97989-d83f-451b-a2ad-82e7d46f99d6 req-2cb0178f-51d5-498a-840e-6fa72dec56ae service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.826548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6b97989-d83f-451b-a2ad-82e7d46f99d6 req-2cb0178f-51d5-498a-840e-6fa72dec56ae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.827305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6b97989-d83f-451b-a2ad-82e7d46f99d6 req-2cb0178f-51d5-498a-840e-6fa72dec56ae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.861889 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c6b97989-d83f-451b-a2ad-82e7d46f99d6 req-2cb0178f-51d5-498a-840e-6fa72dec56ae service nova] Creating event network-changed:2604b6b7-09e9-464c-a883-2e9cbc79e103 for instance 593a5f54-ab59-4a5c-969e-e8c45d008744 on n-h2-855650-5 Nov 02 12:35:29.882830 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c6b97989-d83f-451b-a2ad-82e7d46f99d6 req-2cb0178f-51d5-498a-840e-6fa72dec56ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101182 Nov 02 12:35:29.884336 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1554/3127] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:29.905021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.907577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.926243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.927464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.928609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.931617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.932577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.934724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.264212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.296151 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-76984b51-211a-4293-a608-9cad7021dd80 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1574 microversion: 2.1 time: 0.617669 Nov 02 12:35:30.302542 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1574/3128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1574 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:30.314846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f6ed1e86-62c8-44f2-8869-ee7409eae293 tempest-QuotaClassesAdmin257Test-948425018 tempest-QuotaClassesAdmin257Test-948425018-project-admin] Action: 'update', calling method: .version_select at 0x7f228f081550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:30.460713 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f6ed1e86-62c8-44f2-8869-ee7409eae293 tempest-QuotaClassesAdmin257Test-948425018 tempest-QuotaClassesAdmin257Test-948425018-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.156425 Nov 02 12:35:30.465003 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1575/3129] 10.222.0.45 () {62 vars in 1247 bytes} [Wed Nov 2 12:35:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:30.480032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:30.481064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:30.496168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.503977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.505676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.511574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.516047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.516593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.517097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.545056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.552999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.563239 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f057112-4bcc-497a-82d8-1481a2f40f52 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.675384 Nov 02 12:35:30.566559 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1555/3130] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:30.711975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:30.717372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:30.728928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.731113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.731956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.733504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.734334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.736334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.181574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.236015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.245730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.277812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a0f98654-7bfc-4a80-8986-4444beebcf08 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.573687 Nov 02 12:35:31.315781 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1556/3131] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:30 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:31.356462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:31.364990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:31.408710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.415175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.421237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.433090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.436479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.438335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.687629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.703717 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-221899f4-88bf-44e9-be1e-e156c707480b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1321 microversion: 2.1 time: 1.234438 Nov 02 12:35:31.705445 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1576/3132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:30 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1321 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:31.730329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:31.731249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:31.748226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.753197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.754097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.756445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.765239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.775833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.795012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:32.706826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.722519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.730898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.736782 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9fd580e9-6c3c-4a19-8236-ee35e82845eb tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.015599 Nov 02 12:35:32.740119 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1577/3133] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:31 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:32.752062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:32.760344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:32.785542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.786446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.787119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.788140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.788832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.789490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.266073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.271073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.290632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.300330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.315071 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7903d06e-a450-43d3-803b-e5271856476e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 1.994467 Nov 02 12:35:33.316496 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5c86e494-eda8-4a20-862e-2ecdff36d9ce tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.574689 Nov 02 12:35:33.322380 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1578/3134] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:32 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:33.326775 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1557/3135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:31 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:33.351957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:33.362488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:33.393147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.394490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.395770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.396548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.397020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.397457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.827743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:33.829515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:33.852285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.853986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.854957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.856949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.858086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.862654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.219511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:34.241284 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a57fb872-bde5-4b21-8f4a-411683d8b73a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1321 microversion: 2.1 time: 0.917062 Nov 02 12:35:34.242724 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1579/3136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:33 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1321 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:34.414626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.419621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:34.460624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:34.479587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.480619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.483668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.487666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.490552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.491305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.531264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:34.552782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:34.563198 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9374e0da-a081-44b6-81a6-675f2e831b89 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.763770 Nov 02 12:35:34.565575 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1558/3137] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:33 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:34.577494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.579176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:34.603409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.605181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.606508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.608205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.610975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.612321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.005848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.031241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.050749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.100328 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2469ee5-e926-4b78-8663-cd5afbb92d14 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.531987 Nov 02 12:35:35.109478 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1559/3138] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:35.280129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.284577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:35.319770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.320905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.321538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.322949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.323806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.324613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.455628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.476488 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-accf09a5-0751-4071-858a-f2fce0ae28cc tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 1.080821 Nov 02 12:35:35.490648 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1580/3139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:35.595421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.596164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:35.630688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.631310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.631776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.639889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.644178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.650792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.929674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.965636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ffed076-b269-4f7b-9c41-f099ac6dbf45 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1321 microversion: 2.1 time: 0.697650 Nov 02 12:35:35.969484 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1560/3140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:35.996060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7d3d5a80-b73e-43f4-9b45-0569aca0f8f9 req-1a4abcdd-9420-4b7d-8165-04f552601bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1236ab7-d8c5-4f61-be01-9534bc36a786", "name": "network-vif-plugged", "status": "completed", "tag": "31888f16-6862-4ba6-bf43-2c94c53f126f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:36.044982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7d3d5a80-b73e-43f4-9b45-0569aca0f8f9 req-1a4abcdd-9420-4b7d-8165-04f552601bce service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.049446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7d3d5a80-b73e-43f4-9b45-0569aca0f8f9 req-1a4abcdd-9420-4b7d-8165-04f552601bce service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.050015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7d3d5a80-b73e-43f4-9b45-0569aca0f8f9 req-1a4abcdd-9420-4b7d-8165-04f552601bce service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.108588 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7d3d5a80-b73e-43f4-9b45-0569aca0f8f9 req-1a4abcdd-9420-4b7d-8165-04f552601bce service nova] Creating event network-vif-plugged:31888f16-6862-4ba6-bf43-2c94c53f126f for instance d1236ab7-d8c5-4f61-be01-9534bc36a786 on n-h2-855650-5 Nov 02 12:35:36.132517 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7d3d5a80-b73e-43f4-9b45-0569aca0f8f9 req-1a4abcdd-9420-4b7d-8165-04f552601bce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154783 Nov 02 12:35:36.138317 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1561/3141] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:36.173858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:36.190480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:36.241641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.256216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.258606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.260049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.260895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.266133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.019470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.046762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.063205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.082817 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb1bf65b-db5e-47cc-83b6-b76740288050 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.923673 Nov 02 12:35:37.098364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.100046 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1562/3142] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:36 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:37.111099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.115483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.117258 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-395e44e1-e659-45bd-8e29-92c69824bd0d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.528175 Nov 02 12:35:37.119782 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1581/3143] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:37.136210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:37.136545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:37.137386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:37.138299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:37.153446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.154714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.155992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.158499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.159646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.159951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.160607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.161204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.162030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.164065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.165674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.166284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.620149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.641098 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-956b6659-11ce-402a-a427-9af1c2207994 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 0.538002 Nov 02 12:35:37.645186 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1563/3144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:37 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:37.682046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.699362 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c12dac77-21b8-452d-ace6-4dda6d2615fe tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1321 microversion: 2.1 time: 0.578095 Nov 02 12:35:37.718510 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1582/3145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:37 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:38.145433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.146857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:38.147686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.148977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:38.163632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.166689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.167250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.168813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.169442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.171044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.171751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.174675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.175497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.175935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.176496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.176643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.471061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.493521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.495907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.504264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f315603f-13a3-4e40-843c-09d9fe0b4fec tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.366424 Nov 02 12:35:38.505501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1564/3146] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:38.674485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.676195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:38.685152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.686157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.686852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.688140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.688983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.689638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.695766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:39.069813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.089093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.092102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.093949 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ef97ae40-292f-458f-89a2-47c8831518f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.951590 Nov 02 12:35:39.110983 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1583/3147] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:39.121179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:39.122299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:39.129917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.130934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.131815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.132925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.133788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.134580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.744479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.779585 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d783ee6e-667d-4f58-8fe4-a98d1178808e tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1524 microversion: 2.1 time: 1.108019 Nov 02 12:35:39.782791 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1565/3148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1524 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:39.809621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:39.811276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:39.840391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.847359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.848996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.852762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.854276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.858505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.899137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.939335 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-82991398-d938-43dd-ae74-cc4a640667f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1515 microversion: 2.1 time: 0.825689 Nov 02 12:35:39.947347 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1584/3149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:39 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1515 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:39.984322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:40.000609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:40.026292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.028779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.034243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.038185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.039435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.040623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.131465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lazy-loading 'flavor' on Instance uuid d1236ab7-d8c5-4f61-be01-9534bc36a786 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:40.208872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:40.248023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:40.252538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:40.290851 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80519d50-b27c-47d9-95b1-1422e79864c8 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.503003 Nov 02 12:35:40.298077 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1566/3150] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:39 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:40.320458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:40.320854 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c3094bfd-c6ee-4c6e-9194-87ee737190d6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786/action" status: 200 len: 32 microversion: 2.1 time: 0.330509 Nov 02 12:35:40.323062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:40.332494 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1585/3151] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:35:39 2022] POST /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:35:40.366431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:40.370175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.371901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:40.372754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.377552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.380616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.397756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.399100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.415733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.416451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.416917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.419271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.420043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.420515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.460555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:41.257154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.263503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.295003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.301498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.302826 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-decc1ce3-5e04-4e97-841d-677e845bafc3 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 0.962342 Nov 02 12:35:41.304699 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dcba06a1-22f7-4ba8-a91f-8d9bf4f05b4c tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.002116 Nov 02 12:35:41.306974 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1567/3152] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:40 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:41.313252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:41.314538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:41.314682 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1586/3153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:40 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:41.323168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.324105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.324900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.326158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.326923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.327821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.368313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:41.368804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:41.389237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.389851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.390357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.391437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.392758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.397129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.580894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.596799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.606372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.620499 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cff6b456-e521-44e9-b51a-ba133c1c0dd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.271626 Nov 02 12:35:41.621354 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1587/3154] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:41 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:41.810897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.827647 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd61eeaf-fc51-4ce6-9bbf-6f13baf00c61 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1504 microversion: 2.1 time: 0.518798 Nov 02 12:35:41.828422 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1568/3155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:41 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:41.858869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-663dc3b8-e107-47bb-96e6-389d987065b2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Action: 'create', calling method: .version_select at 0x7f228e874c10>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-217454789", "description": "tempest-description-659483069"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:42.363059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.366004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:42.376005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-663dc3b8-e107-47bb-96e6-389d987065b2 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.522918 Nov 02 12:35:42.378447 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1588/3156] 10.222.0.45 () {60 vars in 1180 bytes} [Wed Nov 2 12:35:41 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:42.391568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.393086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:42.411862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.414545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.415404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.417515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.420439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.420908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.421353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.422006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.422225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.422715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.423683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.429388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.019359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.063052 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa1f5224-2653-47d1-8391-667504f7bc79 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 0.682488 Nov 02 12:35:43.066699 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1589/3157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:42 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:43.072890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-217454789"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.074041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.082209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.083171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.084138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.085416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.086188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.090631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.097527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.124160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.135703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.139007 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59e20110-f192-4327-bec4-f10b8b5b509e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.782994 Nov 02 12:35:43.140532 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1569/3158] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:42 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:43.160429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.162145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.178811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.180853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.182098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.184790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.186366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.187337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.393003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.419830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.429174 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.network.security_group_api [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Adding security group 6a85ae20-d15f-41c8-8586-47c72abb1611 to port 13927f43-c5a3-490b-b220-7b73cbc8aa68 Nov 02 12:35:43.431698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.453497 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4acbb8c7-83b8-4317-839a-247a9c528db4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1551 microversion: 2.91 time: 0.300495 Nov 02 12:35:43.456115 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1570/3159] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:43 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1551 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:43.863148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e36d2726-6f29-438b-b397-7891288da2c2"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.867969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.880964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.882127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.883318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.885058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.886356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.887813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.528543 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-73050321-deb5-4c33-8bf4-6df86f63703b tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action" status: 202 len: 0 microversion: 2.1 time: 1.459471 Nov 02 12:35:44.530134 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1590/3160] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action => generated 0 bytes in 1462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:44.543158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.547245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:44.587338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.588966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.590243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.595942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.598838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.601484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.887852 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7f4d019-6915-486f-9597-2528e07f2ea8 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "POST /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.032352 Nov 02 12:35:44.890744 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1571/3161] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:44.904585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.906605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:44.927507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.929064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.930239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.932378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.934100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.935217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.714962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.747023 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ac3e193-0378-44ea-8a2f-21cbc1e8f258 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 1.213126 Nov 02 12:35:45.754664 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1591/3162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:44 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:45.775325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:45.781644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:45.785896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.802614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.804625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.809188 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92379d16-45f8-4532-90bd-9a728f2ca234 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.913035 Nov 02 12:35:45.822292 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1572/3163] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:44 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:45.823260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-217454789"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:45.827164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:45.848097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.848616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.849074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.849827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.850410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.850817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.852962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.855496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.862866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.863664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.864413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.864908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.002908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:46.016060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:46.018073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:46.036590 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-01ca8ff2-2b0f-4ea9-b27e-138d5e4bf0a2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1533 microversion: 2.91 time: 0.278638 Nov 02 12:35:46.050949 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1592/3164] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:45 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1533 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:46.410342 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.network.security_group_api [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Removing security group 6a85ae20-d15f-41c8-8586-47c72abb1611 from port 13927f43-c5a3-490b-b220-7b73cbc8aa68 Nov 02 12:35:46.586038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1019f4b4-8b98-429d-9168-029e34fddd0e req-9cfabffd-df7d-409e-9aee-c1d96d436677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3803cb1-6c47-450a-b0c5-275f54247723", "tag": "13927f43-c5a3-490b-b220-7b73cbc8aa68"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:46.619461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1019f4b4-8b98-429d-9168-029e34fddd0e req-9cfabffd-df7d-409e-9aee-c1d96d436677 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.620002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1019f4b4-8b98-429d-9168-029e34fddd0e req-9cfabffd-df7d-409e-9aee-c1d96d436677 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.623281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1019f4b4-8b98-429d-9168-029e34fddd0e req-9cfabffd-df7d-409e-9aee-c1d96d436677 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.638649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:46.652251 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1019f4b4-8b98-429d-9168-029e34fddd0e req-9cfabffd-df7d-409e-9aee-c1d96d436677 service nova] Creating event network-changed:13927f43-c5a3-490b-b220-7b73cbc8aa68 for instance f3803cb1-6c47-450a-b0c5-275f54247723 on n-h1-855650-5 Nov 02 12:35:46.670348 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1019f4b4-8b98-429d-9168-029e34fddd0e req-9cfabffd-df7d-409e-9aee-c1d96d436677 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.617178 Nov 02 12:35:46.671690 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1593/3165] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:46.793997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:46.794745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:46.809383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.809900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.810430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.811200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.816076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.816751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.537381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:47.553400 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb6a0cbf-8037-4a42-9051-bdbfff4bbc88 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 0.764746 Nov 02 12:35:47.555727 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1594/3166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:46 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:47.571721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.572961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:47.581622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.582865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.583911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.584908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.585639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.586347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.683852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:48.705287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:48.709570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:48.712328 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c29c772f-6fdc-4d7d-ab0f-571606920554 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.151349 Nov 02 12:35:48.713375 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1595/3167] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:48.729713 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71ff2934-3ced-495e-8f49-3081279f7eb7 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action" status: 202 len: 0 microversion: 2.1 time: 2.913508 Nov 02 12:35:48.730869 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1573/3168] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:35:45 2022] POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action => generated 0 bytes in 2916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:48.745366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:48.752093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:48.763921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:48.765520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:48.777393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.778700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.779751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.781351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.781754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.782810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.783006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.783684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.784461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.785078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.785949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.794293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:49.212952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:49.237546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:49.245645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:49.264721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b307510e-c3aa-4b02-897c-ee7bbe0e7955 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1476 microversion: 2.91 time: 0.536467 Nov 02 12:35:49.268193 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1596/3169] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:48 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1476 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:49.287704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-243edbf9-dcf7-428b-bb82-80cf857988ee tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Action: 'create', calling method: .version_select at 0x7f228dcef8b0>, body: {"pool": null} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:50.009843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:50.040283 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f4cb57a-e396-41ef-8cf9-44637cbd2f2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 1.307629 Nov 02 12:35:50.049359 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1574/3170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:48 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:50.066779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e1b0b44f-f793-4676-af7e-353b3bc14452 req-b50b8704-d25d-4380-a71b-a55245a87ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3803cb1-6c47-450a-b0c5-275f54247723", "tag": "13927f43-c5a3-490b-b220-7b73cbc8aa68"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:50.116981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1b0b44f-f793-4676-af7e-353b3bc14452 req-b50b8704-d25d-4380-a71b-a55245a87ced service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.117953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1b0b44f-f793-4676-af7e-353b3bc14452 req-b50b8704-d25d-4380-a71b-a55245a87ced service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.120344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1b0b44f-f793-4676-af7e-353b3bc14452 req-b50b8704-d25d-4380-a71b-a55245a87ced service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.168396 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e1b0b44f-f793-4676-af7e-353b3bc14452 req-b50b8704-d25d-4380-a71b-a55245a87ced service nova] Creating event network-changed:13927f43-c5a3-490b-b220-7b73cbc8aa68 for instance f3803cb1-6c47-450a-b0c5-275f54247723 on n-h1-855650-5 Nov 02 12:35:50.186919 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e1b0b44f-f793-4676-af7e-353b3bc14452 req-b50b8704-d25d-4380-a71b-a55245a87ced service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134920 Nov 02 12:35:50.193768 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1575/3171] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:50.211530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:50.224683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:50.241132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.242174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.242757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.245014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.247527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.249517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.384662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-855650-5". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:35:50.593223 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67b4a68f-1d69-445e-a0cf-bd41dae48f39 tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9/action" status: 202 len: 0 microversion: 2.91 time: 0.396443 Nov 02 12:35:50.594480 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1576/3172] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:35:50 2022] POST /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:50.618614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:50.619383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:50.647087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.654975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.658915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.665685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.671195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.674544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:51.975975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:52.013082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:52.034866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:52.037061 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7096e58d-eed3-4d65-ae1b-a6e8d1c3994b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.436143 Nov 02 12:35:52.039203 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1577/3173] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:50 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:52.061270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:52.064212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:52.082395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.086731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.088417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:52.091590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.093395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.095011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:52.376174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:52.428209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:52.432110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:52.483228 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-81ed9e44-3375-4175-8831-b8c26dc18feb tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1484 microversion: 2.91 time: 0.441236 Nov 02 12:35:52.485712 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1578/3174] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:52 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1484 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:52.518834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:52.520662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:52.538938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.554719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.555310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:52.556644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.557446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.557944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.143128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:53.157166 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-354d4928-e3fa-41ff-ab40-7e52767a18f5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 0.665136 Nov 02 12:35:53.158084 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1579/3175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:52 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:53.165692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:53.171453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:53.196297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.197289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.197948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.198884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.201086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.201795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.216128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:54.706957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:54.739674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:54.745397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:54.751654 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71896a86-9d06-4511-ab62-2ba6ef399860 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.587621 Nov 02 12:35:54.766016 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1580/3176] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:53 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:54.889252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-226914573", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "6073314f-95a7-4839-bb88-cbb45aac3413"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:55.058734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] validate_networks() for [('6073314f-95a7-4839-bb88-cbb45aac3413', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:56.674393 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-243edbf9-dcf7-428b-bb82-80cf857988ee tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.403993 Nov 02 12:35:56.676074 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1597/3177] 10.222.0.45 () {60 vars in 1170 bytes} [Wed Nov 2 12:35:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:56.690572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:56.692918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:56.714356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.718788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.720150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.723084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.729211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.730413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.084988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:57.085807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:57.086054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:57.086509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:57.091787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:57.092906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:57.114814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.118629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.120165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.124418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.125141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:57.129117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.130074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.143971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:57.167367 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9948b8d9-4de0-420f-b072-e6c3936c2202 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.489190 Nov 02 12:35:57.173709 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1598/3178] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:56 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:57.184509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.186893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:57.204908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.205826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.208058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.209464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.211445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.212816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:57.213900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.239629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for user beeb8b4fa7354185ba8aff3194bf9e06 and project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:57.306643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:57.321424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:57.446958 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e8e7ecd-79ce-470a-a73c-a63ce29354e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.688399 Nov 02 12:35:57.449587 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1581/3179] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:57.457912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.459211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:57.468604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.470911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.471816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.472858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.473910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.475581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:58.097263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:58.115708 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41858b17-01d0-4727-887b-7cafe91afb82 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 0.940320 Nov 02 12:35:58.142732 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1599/3180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:57 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:58.153488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.226"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:58.165676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:58.182544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:58.183536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:58.184234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:58.185488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:58.186575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:58.187754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:58.267372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "refresh_cache-f3803cb1-6c47-450a-b0c5-275f54247723" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:35:58.268168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquired lock "refresh_cache-f3803cb1-6c47-450a-b0c5-275f54247723" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:35:58.977306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:59.016631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:59.026262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:59.027664 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe6da8a6-430d-4efd-81c5-100205ce8d8e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.576530 Nov 02 12:35:59.036633 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1582/3181] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:57 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:59.078187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a84d775-c020-4759-bd14-844e326b769d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:59.079145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1a84d775-c020-4759-bd14-844e326b769d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:59.721341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a84d775-c020-4759-bd14-844e326b769d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:59.819292 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a84d775-c020-4759-bd14-844e326b769d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1207 microversion: 2.1 time: 0.764761 Nov 02 12:35:59.830110 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1583/3182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:59 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1207 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:59.876168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:59.877405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:59.900071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:59.966400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:59.983146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:59.984058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:59.986293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:00.001453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:00.004359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:00.985674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:00.997321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:01.004405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:01.019486 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ce75de24-0dfb-4522-bbbb-fe7f6e9de2ff tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 1.184569 Nov 02 12:36:01.026462 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1584/3183] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:59 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:01.051947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:01.053011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:01.075734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:01.076644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:01.077479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:01.078593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:01.079386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:01.080087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:01.483637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:01.530332 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3850ce2d-52e8-41b0-b530-74099fb3f602 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 0.495498 Nov 02 12:36:01.533155 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1585/3184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:01 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:01.543229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:01.544286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:01.557033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:01.558423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:01.559126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:01.560093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:01.560783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:01.561535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:01.902021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:01.924705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:01.927838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:01.930270 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f892856-57b7-4bc5-97aa-f6e212d18a58 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.395138 Nov 02 12:36:01.931377 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1586/3185] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:01 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:01.985024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:01.994007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.005047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.005643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.006470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.007206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.007910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.008574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.182311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:02.200483 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bce0301b-2edb-43bc-968e-d59bfb05d54a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1265 microversion: 2.1 time: 0.232563 Nov 02 12:36:02.202937 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1587/3186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:01 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:02.221428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.223490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.231880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.232844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.233779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.235369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.236059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.236713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.387010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:02.407660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:02.417772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:02.444474 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99605bcf-f5af-4d38-a281-35f86a7bcd48 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.238369 Nov 02 12:36:02.475201 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1588/3187] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:02 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:02.532813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Building network info cache for instance {{(pid=120723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:36:02.565898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-154a79dd-fc4b-4deb-b4f1-a0150be00766 req-703046e8-d549-4eff-b118-c6816614b421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3803cb1-6c47-450a-b0c5-275f54247723", "tag": "13927f43-c5a3-490b-b220-7b73cbc8aa68"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:02.592716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-154a79dd-fc4b-4deb-b4f1-a0150be00766 req-703046e8-d549-4eff-b118-c6816614b421 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.597828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-154a79dd-fc4b-4deb-b4f1-a0150be00766 req-703046e8-d549-4eff-b118-c6816614b421 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.598844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-154a79dd-fc4b-4deb-b4f1-a0150be00766 req-703046e8-d549-4eff-b118-c6816614b421 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.636448 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-154a79dd-fc4b-4deb-b4f1-a0150be00766 req-703046e8-d549-4eff-b118-c6816614b421 service nova] Creating event network-changed:13927f43-c5a3-490b-b220-7b73cbc8aa68 for instance f3803cb1-6c47-450a-b0c5-275f54247723 on n-h1-855650-5 Nov 02 12:36:02.651322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-154a79dd-fc4b-4deb-b4f1-a0150be00766 req-703046e8-d549-4eff-b118-c6816614b421 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090251 Nov 02 12:36:02.653730 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1589/3188] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:02.697793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.698747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.726415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.726922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.727370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.728111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.728576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.730028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:04.085301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:04.138186 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bea45f1f-7960-4279-9a56-d1f4c4fd4319 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 1.464207 Nov 02 12:36:04.141741 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1590/3189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:02 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:04.186529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:04.188667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:04.209590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:04.212611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:04.214419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:04.216732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:04.238571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:04.240881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:05.317646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:05.343746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:05.345857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:05.357000 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-79f5aee0-ce41-41a6-acc8-069e85eb28f7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.213583 Nov 02 12:36:05.358953 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1591/3190] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:04 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:05.374561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:05.374963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:05.404036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:05.404929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:05.405841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:05.406912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:05.407637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:05.408280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:06.372293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:06.401398 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-566cd1ec-3006-478d-aada-bbf5e9fb2650 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1307 microversion: 2.1 time: 1.040686 Nov 02 12:36:06.402589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1592/3191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:05 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1307 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:06.515872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Updating instance_info_cache with network_info: [{"id": "13927f43-c5a3-490b-b220-7b73cbc8aa68", "address": "fa:16:3e:d3:3c:aa", "network": {"id": "de8a7cdb-8f38-41d3-8d17-70b1d4cfb99a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-862976760-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9aa7b3d114c047f69065d9c988516e24", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap13927f43-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:36:06.563124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Releasing lock "refresh_cache-f3803cb1-6c47-450a-b0c5-275f54247723" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:36:06.567512 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cc605210-a96a-417d-a6dc-f48351be5bf6 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action" status: 202 len: 0 microversion: 2.1 time: 8.420804 Nov 02 12:36:06.583782 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1600/3192] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:35:58 2022] POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action => generated 0 bytes in 8439 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:36:06.604538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:06.606202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:06.622409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=7 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:06.625050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:06.626006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:06.626679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:06.627887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:06.628548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:06.629172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:06.780680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e0857681-b5d7-4b42-9ef6-2314f5c4235e"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:06.785832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:06.804952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:06.809579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:06.812138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:06.814859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:06.819404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:06.821136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:06.858972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:06.900198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:06.907939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:06.927198 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-96c207fc-c856-4695-945e-60b4caffe66b tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.339904 Nov 02 12:36:06.928557 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1601/3193] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:06 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:07.004054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:07.007325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:07.021388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.022825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.023768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.025388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.026337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.027117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.118808 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] HTTP exception thrown: Volume e0857681-b5d7-4b42-9ef6-2314f5c4235e could not be found. Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Request method failure captured: Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments/e36d2726-6f29-438b-b397-7891288da2c2 HTTP/1.1 Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 74 Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmObMkyl5lWpLpvJ1R_rf7jIWQ0lNuGQutctyZtzLyrsrDcg5LADjMH3HUVKSIiLfa9cHA5E3wzJm1QA5vTGsTQE5mwUSc6smtk3ZnWGAEeHcPRJwt5cBkNGRG6AH_vak3QPi_EsIJRqhSgea6n41Y8s1S8DDFSlAWaQQ-BF9LXXUIQ Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: b496bda9f6d44265b9cb000f7751140d Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesAdminNegativeTest-1442629937 Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b496bda9f6d44265b9cb000f7751140d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b496bda9f6d44265b9cb000f7751140d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b496bda9f6d44265b9cb000f7751140d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b496bda9f6d44265b9cb000f7751140d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesAdminNegativeTest-1442629937 Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: b496bda9f6d44265b9cb000f7751140d Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1442629937 Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesAdminNegativeTest-1442629937-project-admin Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 2dee647a8bec445baaed6b3897840196 Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesAdminNegativeTest-1442629937-project-admin Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: {"volumeAttachment": {"volumeId": "e0857681-b5d7-4b42-9ef6-2314f5c4235e"}} Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: exception: Volume e0857681-b5d7-4b42-9ef6-2314f5c4235e could not be found. Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': '4d093add-0a0f-44b6-b83f-f461c5488003', 'id': 'e36d2726-6f29-438b-b397-7891288da2c2', 'body': {'volumeAttachment': {'volumeId': 'e0857681-b5d7-4b42-9ef6-2314f5c4235e'}}} Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e0857681-b5d7-4b42-9ef6-2314f5c4235e could not be found. (HTTP 404) (Request-ID: req-8040ae77-bd88-442a-a1f8-3971a594f0b0) Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:36:07.162725 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e0857681-b5d7-4b42-9ef6-2314f5c4235e could not be found. Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e0857681-b5d7-4b42-9ef6-2314f5c4235e could not be found. Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e0857681-b5d7-4b42-9ef6-2314f5c4235e could not be found. Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Returning 400 to user: Volume e0857681-b5d7-4b42-9ef6-2314f5c4235e could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25fc5610-1f82-436d-a826-149741b61315 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] 10.222.0.45 "PUT /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments/e36d2726-6f29-438b-b397-7891288da2c2" status: 400 len: 107 microversion: 2.1 time: 0.743590 Nov 02 12:36:07.182980 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1593/3194] 10.222.0.45 () {60 vars in 1433 bytes} [Wed Nov 2 12:36:06 2022] PUT /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments/e36d2726-6f29-438b-b397-7891288da2c2 => generated 107 bytes in 745 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:07.208574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-00700b5f-3a72-421d-b4d1-0f94bf09a638 req-b8071a82-9745-40b8-ac7f-ef60d7f2376a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542f92f5-8985-475e-b090-6e8e2e413847", "tag": "6c285e87-4de7-477c-a3c9-6018bbb34f2d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:07.216732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:07.244980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00700b5f-3a72-421d-b4d1-0f94bf09a638 req-b8071a82-9745-40b8-ac7f-ef60d7f2376a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.245475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00700b5f-3a72-421d-b4d1-0f94bf09a638 req-b8071a82-9745-40b8-ac7f-ef60d7f2376a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.245916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00700b5f-3a72-421d-b4d1-0f94bf09a638 req-b8071a82-9745-40b8-ac7f-ef60d7f2376a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.307967 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-00700b5f-3a72-421d-b4d1-0f94bf09a638 req-b8071a82-9745-40b8-ac7f-ef60d7f2376a service nova] Creating event network-changed:6c285e87-4de7-477c-a3c9-6018bbb34f2d for instance 542f92f5-8985-475e-b090-6e8e2e413847 on n-h2-855650-5 Nov 02 12:36:07.331395 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-00700b5f-3a72-421d-b4d1-0f94bf09a638 req-b8071a82-9745-40b8-ac7f-ef60d7f2376a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164568 Nov 02 12:36:07.335903 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1594/3195] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:07.353426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:07.354288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:07.388796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.389595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.389948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.393347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.393900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.394398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.498794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:07.518097 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1fc9fad5-578e-4ec6-978c-a9aadd38cac0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 0.550168 Nov 02 12:36:07.532195 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1602/3196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:06 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:07.542252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.226"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:08.979459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:08.993247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:08.998209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:09.004527 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfff415c-b277-4a0a-a339-28709e12cabf tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.656436 Nov 02 12:36:09.014010 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1595/3197] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:07 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:09.020848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:09.024731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:09.034331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:09.035454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:09.038785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:09.040931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:09.044673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:09.045583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:09.049450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:09.056986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:09.058000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:09.058743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:09.059892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:09.070946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:09.078194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:09.292770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lazy-loading 'services' on Instance uuid 4d093add-0a0f-44b6-b83f-f461c5488003 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:09.518134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "refresh_cache-f3803cb1-6c47-450a-b0c5-275f54247723" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:36:09.518903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquired lock "refresh_cache-f3803cb1-6c47-450a-b0c5-275f54247723" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:36:09.624859 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e90748d9-07f0-4804-b27c-2202a2ffdaa3 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments/e36d2726-6f29-438b-b397-7891288da2c2" status: 202 len: 0 microversion: 2.1 time: 0.609140 Nov 02 12:36:09.631787 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1596/3198] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:36:09 2022] DELETE /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments/e36d2726-6f29-438b-b397-7891288da2c2 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:09.638780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:09.650680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:09.667307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:09.667818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:09.668397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:09.669229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:09.669693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:09.671113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:09.753138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:10.833298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:10.845139 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7755c0f-5920-40af-88e2-e1259a2298ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1307 microversion: 2.1 time: 1.211923 Nov 02 12:36:10.846554 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1597/3199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:09 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1307 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:10.871684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:10.872347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:10.888937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:10.890106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:10.892521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:10.892521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:10.893141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:10.893808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:11.194207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:11.219244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:11.220838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:11.236581 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac9ac948-048d-4acf-aab1-51ac31741093 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.379707 Nov 02 12:36:11.237214 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1598/3200] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:10 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:11.244115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:11.256629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:11.286359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:11.298873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:11.302809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:11.303886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:11.310807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:11.311672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:11.383426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:12.277912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Building network info cache for instance {{(pid=120723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:36:12.456117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:12.508055 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-261f1a34-81fc-4047-a6e5-38ddd45a223f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 1.260220 Nov 02 12:36:12.509686 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1599/3201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:11 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:12.568866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:12.576691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:12.619801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.621496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.623710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.625909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.632211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.633408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.826038 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9e8cf0c-5ede-48c8-80cb-da8e004f8696 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.298106 Nov 02 12:36:12.828086 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1600/3202] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:12 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments => generated 197 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:12.846456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:12.848064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:12.873880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.874466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.875528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.876642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.877304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.877755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.683761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:13.732713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:13.745705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:13.755379 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5de5104f-d050-4f7a-ab09-c72404246a7b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.925420 Nov 02 12:36:13.756100 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1601/3203] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:12 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:13.774152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:13.775113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:13.800249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.801511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.802222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.803177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.811490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.812018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.298471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:14.314480 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a5308e28-4563-4f51-be45-b1c639751a37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1307 microversion: 2.1 time: 0.546804 Nov 02 12:36:14.315214 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1602/3204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:13 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1307 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:14.364879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:14.365618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:14.393454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.393995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.403518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.404311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.404867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.405262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.819015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Updating instance_info_cache with network_info: [{"id": "13927f43-c5a3-490b-b220-7b73cbc8aa68", "address": "fa:16:3e:d3:3c:aa", "network": {"id": "de8a7cdb-8f38-41d3-8d17-70b1d4cfb99a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-862976760-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9aa7b3d114c047f69065d9c988516e24", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap13927f43-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:36:14.838159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:14.848070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Releasing lock "refresh_cache-f3803cb1-6c47-450a-b0c5-275f54247723" {{(pid=120723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:36:14.854727 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-741b2aae-3a03-47c8-ab45-a0835979c969 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action" status: 202 len: 0 microversion: 2.1 time: 7.319045 Nov 02 12:36:14.856523 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1603/3205] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:07 2022] POST /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723/action => generated 0 bytes in 7324 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:36:14.867831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:14.881583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:14.883685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-82d1c508-913d-4e0d-a2ee-e544431af9aa req-f300879c-0308-48b2-ae71-f8d2b00d1bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3803cb1-6c47-450a-b0c5-275f54247723", "tag": "13927f43-c5a3-490b-b220-7b73cbc8aa68"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:14.896065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62a965e1-ad0b-492a-8ccb-10b5c1fe5d5d tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.557093 Nov 02 12:36:14.897935 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1603/3206] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:14 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:14.907892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-82d1c508-913d-4e0d-a2ee-e544431af9aa req-f300879c-0308-48b2-ae71-f8d2b00d1bab service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.908370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-82d1c508-913d-4e0d-a2ee-e544431af9aa req-f300879c-0308-48b2-ae71-f8d2b00d1bab service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.908804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-82d1c508-913d-4e0d-a2ee-e544431af9aa req-f300879c-0308-48b2-ae71-f8d2b00d1bab service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.910658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:14.911550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:14.931178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.934665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.935936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.938119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.939371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.939814 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-82d1c508-913d-4e0d-a2ee-e544431af9aa req-f300879c-0308-48b2-ae71-f8d2b00d1bab service nova] Creating event network-changed:13927f43-c5a3-490b-b220-7b73cbc8aa68 for instance f3803cb1-6c47-450a-b0c5-275f54247723 on n-h1-855650-5 Nov 02 12:36:14.940992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.962540 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-82d1c508-913d-4e0d-a2ee-e544431af9aa req-f300879c-0308-48b2-ae71-f8d2b00d1bab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103306 Nov 02 12:36:14.963853 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1604/3207] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:14.978339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:14.983593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:15.013948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.015239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.025854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.027869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.032532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.033651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.198895 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05e81826-b4b7-431e-880d-3ee8721e15ca tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212386 Nov 02 12:36:15.199525 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1605/3208] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:14 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:15.220744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:15.221385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:15.249619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.250841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.251353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.252126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.252587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.253143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.614591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:15.682558 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99f92a2c-6808-4704-81dd-c3b3e46612f2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1521 microversion: 2.1 time: 0.765658 Nov 02 12:36:15.683751 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1604/3209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:14 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1521 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:15.692294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8bb72639-fa06-4f4b-974e-844439657225 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '.version_select at 0x7f2292a5dee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:15.724782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:15.742046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:15.743543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:15.755462 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55e501a9-e178-4da2-b920-cf1dc4c62d6b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.545741 Nov 02 12:36:15.756658 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1606/3210] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:15 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:15.761601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:15.762579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:15.781087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.799879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.802139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.804368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.805747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.806926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.463882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:16.491471 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-559a34ee-6274-4590-b790-436122d0ce92 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1307 microversion: 2.1 time: 0.733091 Nov 02 12:36:16.492975 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1607/3211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:15 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1307 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:16.548440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.550528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:16.569603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.572181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.573474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.575488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.577225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.578860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.675894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:16.690537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:16.692845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:16.715741 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ef9fa430-8474-4e01-9fa1-d88a2b693a8c tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.175767 Nov 02 12:36:16.717924 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1608/3212] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:16.725448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.729006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:16.753447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.754389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.755019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.756092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.756725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.757442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.820232 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-858f98cc-ab8c-4486-a462-609886a81d91 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099896 Nov 02 12:36:16.825756 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1609/3213] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:16.835995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.837152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:16.854559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.857641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.858426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.860114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.864356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.865254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.921164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:17.876994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:17.901727 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-18cd213b-45e3-4eb3-bc29-bc4af68867e1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1501 microversion: 2.1 time: 1.073751 Nov 02 12:36:17.903602 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1610/3214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1501 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:17.919280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:17.923117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:17.943741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:17.945057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:17.947921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:17.949864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:17.952306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:17.954337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.440877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.457556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.460899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.479582 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b9c61243-e427-4af8-b247-15bc60f09b7d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.558110 Nov 02 12:36:18.480031 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1611/3215] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:17 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:18.498606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.499472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.513501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.514360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.514971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.516603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.517283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.517722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.773201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8bb72639-fa06-4f4b-974e-844439657225 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/b31f08cb-bde1-469d-ae99-c967cbab247c" status: 202 len: 0 microversion: 2.1 time: 3.088198 Nov 02 12:36:18.774052 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1605/3216] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:36:15 2022] DELETE /compute/v2.1/os-floating-ips/b31f08cb-bde1-469d-ae99-c967cbab247c => generated 0 bytes in 3090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:18.779887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.780787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.789818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.790623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.791272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.792315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.792978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.793609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.796504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.807465 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff9c30cd-14b7-4884-827f-96ec56aa8414 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1307 microversion: 2.1 time: 0.323713 Nov 02 12:36:18.808616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1612/3217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:18 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:18.814933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.818274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.838303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.839749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.840664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.842224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.843128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.844552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.895269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.922724 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff5fa0ee-720e-4a7d-af27-5c1d72cc2e84 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110947 Nov 02 12:36:18.925289 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1613/3218] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:18 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:18.935947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.937933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.943021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.947931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.971689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.973162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.974314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.986161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.986963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.987482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.992228 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7abe1b4d-d065-4f28-8264-99f7b0dc2175 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.216874 Nov 02 12:36:18.998014 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1606/3219] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:18 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:19.018480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3afc768a-fd31-48d1-b63e-d4a5afd930f0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '.version_select at 0x7f228e54e790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:19.388768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:19.402876 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36876d13-c7a3-4559-b9f4-83393dfe33bd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1516 microversion: 2.1 time: 0.475525 Nov 02 12:36:19.403546 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1614/3220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:18 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1516 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:19.462328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d2244ce-fac8-4a68-b2b5-b0a27cb7db24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:19.466890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d2244ce-fac8-4a68-b2b5-b0a27cb7db24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 65c5ac55-e464-42e3-92a1-e6d06f7c34c1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:19.491937 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-4d2244ce-fac8-4a68-b2b5-b0a27cb7db24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Instance 65c5ac55-e464-42e3-92a1-e6d06f7c34c1 could not be found. Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d2244ce-fac8-4a68-b2b5-b0a27cb7db24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/65c5ac55-e464-42e3-92a1-e6d06f7c34c1/action HTTP/1.1 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 14 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: {"rescue": {}} Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 65c5ac55-e464-42e3-92a1-e6d06f7c34c1 could not be found. Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '65c5ac55-e464-42e3-92a1-e6d06f7c34c1', 'body': {'rescue': {}}} Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c5ac55-e464-42e3-92a1-e6d06f7c34c1 could not be found. Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c5ac55-e464-42e3-92a1-e6d06f7c34c1 could not be found. Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.502428 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:19.508756 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:19.508756 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:19.508756 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:19.508756 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:19.508756 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c5ac55-e464-42e3-92a1-e6d06f7c34c1 could not be found. Nov 02 12:36:19.508756 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.515065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d2244ce-fac8-4a68-b2b5-b0a27cb7db24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 404 to user: Instance 65c5ac55-e464-42e3-92a1-e6d06f7c34c1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:19.517541 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d2244ce-fac8-4a68-b2b5-b0a27cb7db24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/65c5ac55-e464-42e3-92a1-e6d06f7c34c1/action" status: 404 len: 111 microversion: 2.1 time: 0.059554 Nov 02 12:36:19.518798 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1615/3221] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:19 2022] POST /compute/v2.1/servers/65c5ac55-e464-42e3-92a1-e6d06f7c34c1/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:19.532707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:19.533672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:19.548313 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3afc768a-fd31-48d1-b63e-d4a5afd930f0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/6a85ae20-d15f-41c8-8586-47c72abb1611" status: 202 len: 0 microversion: 2.1 time: 0.545491 Nov 02 12:36:19.549724 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1607/3222] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:36:18 2022] DELETE /compute/v2.1/os-security-groups/6a85ae20-d15f-41c8-8586-47c72abb1611 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:19.552417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.554128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.554827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.555758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.556623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.557319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.560082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:19.561568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:19.583204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.583784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.584366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.585327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.591535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.592654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.766835 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1ad8a08b-2c89-44ff-be5a-d6c761eaa3ff tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action" status: 202 len: 0 microversion: 2.1 time: 0.213473 Nov 02 12:36:19.772055 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1608/3223] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:19 2022] POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:19.780557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:19.786786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:19.804941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.807950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.810172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.812755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.814775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.815815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.933768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:36:20.098396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.142987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.143238 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a32fc19c-273f-4a96-ac1b-4b99fca9ee18 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 204 len: 0 microversion: 2.1 time: 0.373912 Nov 02 12:36:20.144210 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1609/3224] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:19 2022] DELETE /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:36:20.146156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.149522 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-72233778-d0a3-4123-8997-a87364ebf7d0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.628462 Nov 02 12:36:20.151085 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1616/3225] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:19 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:20.180923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a08b0dfb-423d-470c-ab9b-ab48898a1cfd req-ed940c09-5130-45bc-9d8d-2e7fa89959ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542f92f5-8985-475e-b090-6e8e2e413847", "name": "network-vif-plugged", "status": "completed", "tag": "6c285e87-4de7-477c-a3c9-6018bbb34f2d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:20.186112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.189423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:20.196337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a08b0dfb-423d-470c-ab9b-ab48898a1cfd req-ed940c09-5130-45bc-9d8d-2e7fa89959ff service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.197651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a08b0dfb-423d-470c-ab9b-ab48898a1cfd req-ed940c09-5130-45bc-9d8d-2e7fa89959ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.198387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a08b0dfb-423d-470c-ab9b-ab48898a1cfd req-ed940c09-5130-45bc-9d8d-2e7fa89959ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.200888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.201846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.202601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.204236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.204950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.206710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.214672 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a08b0dfb-423d-470c-ab9b-ab48898a1cfd req-ed940c09-5130-45bc-9d8d-2e7fa89959ff service nova] Creating event network-vif-plugged:6c285e87-4de7-477c-a3c9-6018bbb34f2d for instance 542f92f5-8985-475e-b090-6e8e2e413847 on n-h2-855650-5 Nov 02 12:36:20.222287 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a08b0dfb-423d-470c-ab9b-ab48898a1cfd req-ed940c09-5130-45bc-9d8d-2e7fa89959ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075955 Nov 02 12:36:20.226576 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1610/3226] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:20.234360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.235186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:20.251216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.252324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.254444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.256373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.258048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.260048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.914919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.932618 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e9e3c6b9-97fe-4ac9-b20c-0322d362d5b7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1521 microversion: 2.1 time: 0.779397 Nov 02 12:36:20.933947 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1617/3227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:20 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1521 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:20.943517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.949261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:20.962658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.964027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.965059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.966565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.967379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.968096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.978825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.998974 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d67f2661-4cb1-4164-b9f9-3038dde429c6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1307 microversion: 2.1 time: 0.770260 Nov 02 12:36:21.000922 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1611/3228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:20 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1307 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:21.021940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.023106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:21.035458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.036062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.036809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.038022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.038953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.039504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.055819 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-23de70c9-9fad-4056-97d3-11680ba0d0eb tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120159 Nov 02 12:36:21.056897 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1618/3229] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:20 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:21.076049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.077089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:21.090783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.095691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.099796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.102104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.102703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.104297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.241296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.275577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.283855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.297479 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2347306-6c60-41fb-8fee-f1b9a8d92fa1 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.292672 Nov 02 12:36:21.298958 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1612/3230] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:21 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:21.309307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.310929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:21.322904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.323708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.324813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.326549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.328312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.329864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.382204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.394378 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6efd264-57f7-41a2-9959-f210d8964c00 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1510 microversion: 2.1 time: 0.335852 Nov 02 12:36:21.394977 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1619/3231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:21 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:21.403399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-41238446", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "5b2cf652-d65e-4f87-b37e-f8a905f9e329"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:21.494774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] validate_networks() for [('5b2cf652-d65e-4f87-b37e-f8a905f9e329', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:36:21.720295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.733010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.734838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.736106 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24cd3694-f17f-4745-ac54-6a8d8dffeb38 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.435752 Nov 02 12:36:21.737464 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1613/3232] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:21 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:21.961653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.962763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:21.973047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.973891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.974784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.975749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.976499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.977232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.320599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:36:22.326812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:36:22.331268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:36:22.331996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:36:22.332605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:36:22.360641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.361238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.361789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.362614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.363173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.363714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.380002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:22.391309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Getting quotas for project 60b7340637d745b5875c43f1589869ea. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:22.404416 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59233831-30d0-432c-a659-6fb7e50c986d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1521 microversion: 2.1 time: 0.447351 Nov 02 12:36:22.405655 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1614/3233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:21 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:22.417927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.419769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:22.423605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Getting quotas for user 5446fad0c7a74bfd936b34867a943bfa and project 60b7340637d745b5875c43f1589869ea. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:22.442241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.447343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.448889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.451632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.455177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.456770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.473210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:36:22.483707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:36:22.650527 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1455b11d-0197-482a-bc28-4658263e3637 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253373 Nov 02 12:36:22.653435 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1620/3234] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:36:22.665292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.667272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:22.702285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.705305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.705835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.706689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.707679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.708131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.817918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:22.830200 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b2c05fd-28f2-46af-b92c-da6f47cd4113 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1307 microversion: 2.1 time: 0.422834 Nov 02 12:36:22.833695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1615/3235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1307 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:22.844774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.849480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:22.867089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.867952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.871726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:22.872148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.873018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.873515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.873988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.883166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:22.897615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:22.901174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:22.913656 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-db1969cf-daca-4a12-afc8-96caa6e38b0a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.256606 Nov 02 12:36:22.915146 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1621/3236] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:22.932319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6c960ec-9f48-4d44-9d7c-c9c2ad53011f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.934157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6c960ec-9f48-4d44-9d7c-c9c2ad53011f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:23.076631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6c960ec-9f48-4d44-9d7c-c9c2ad53011f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:23.114191 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6c960ec-9f48-4d44-9d7c-c9c2ad53011f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1216 microversion: 2.1 time: 0.196586 Nov 02 12:36:23.115260 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1622/3237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1216 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:23.144299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6c613b1d-dd95-4d04-bbb8-fefedf5360a8 req-efa50120-db6d-434a-9479-8f2d0ed36d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "b21a0968-4bb4-4e3b-88bf-c5752d860906"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:23.176644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6c613b1d-dd95-4d04-bbb8-fefedf5360a8 req-efa50120-db6d-434a-9479-8f2d0ed36d31 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.177515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6c613b1d-dd95-4d04-bbb8-fefedf5360a8 req-efa50120-db6d-434a-9479-8f2d0ed36d31 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.178875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6c613b1d-dd95-4d04-bbb8-fefedf5360a8 req-efa50120-db6d-434a-9479-8f2d0ed36d31 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.246628 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6c613b1d-dd95-4d04-bbb8-fefedf5360a8 req-efa50120-db6d-434a-9479-8f2d0ed36d31 service nova] Creating event network-vif-plugged:b21a0968-4bb4-4e3b-88bf-c5752d860906 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:36:23.277007 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6c613b1d-dd95-4d04-bbb8-fefedf5360a8 req-efa50120-db6d-434a-9479-8f2d0ed36d31 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159541 Nov 02 12:36:23.283252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1623/3238] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:23.308476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.314815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:23.329647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.331668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.332905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.342901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.346185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.347772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.946741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:23.979107 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89328192-0b36-4221-bdc0-8de68a5d6177 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1510 microversion: 2.1 time: 1.142725 Nov 02 12:36:23.981255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1616/3239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1510 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:23.992775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.001275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.013729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.021889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.024084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.028194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.028837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.030708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.201626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:24.223422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:24.225414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:24.226942 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-56806ade-d2c7-4a58-9a0b-1fad11237372 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.941874 Nov 02 12:36:24.238078 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1624/3240] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:23 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:24.238078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.238078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.250436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.250436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.250436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.250436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.250436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.250436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.566915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:24.607841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20e9d9e0-0b08-4f93-b460-e77c35940a2e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1501 microversion: 2.1 time: 0.619709 Nov 02 12:36:24.609156 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1617/3241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:23 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1501 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:24.636994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.639287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.676817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.682447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.685272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.693021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.694571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.695808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.754300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:24.783461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-88c99b39-a2ab-4c5a-b6a2-2768ab7edb89 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1487 microversion: 2.1 time: 0.554399 Nov 02 12:36:24.786803 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1625/3242] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1487 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:24.808061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.814938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.844274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.855069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.856122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.861369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.862702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.866005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.132940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:25.168670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:25.186722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:25.212042 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9804a13b-4708-4461-a29a-10fa3198d89f tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1542 microversion: 2.91 time: 0.600026 Nov 02 12:36:25.241127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:25.242512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1618/3243] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1542 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:25.270526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:25.275593 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-215f19b1-3582-4af6-8fd4-9a2b523b3078 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1268 microversion: 2.1 time: 0.483065 Nov 02 12:36:25.277026 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1626/3244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1268 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:25.297630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:25.298763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.300626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.326599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.327587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.334485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.338007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.339470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.344271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.357227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.359988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.360538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.367904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.370384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.370948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.474525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lazy-loading 'flavor' on Instance uuid 9ef4fe0d-6f31-447d-b886-353ade395208 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:25.509294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Cannot 'rescue' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state paused Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action HTTP/1.1 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 14 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: {"rescue": {}} Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'rescue' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state paused Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9ef4fe0d-6f31-447d-b886-353ade395208', 'body': {'rescue': {}}} Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ef4fe0d-6f31-447d-b886-353ade395208 in vm_state paused. Cannot rescue while the instance is in this state. Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state paused Nov 02 12:36:25.512938 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state paused Nov 02 12:36:25.519928 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.523829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 409 to user: Cannot 'rescue' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state paused {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:25.525338 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f827343-956b-4e3e-89b9-18d75539ab83 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action" status: 409 len: 144 microversion: 2.1 time: 0.280940 Nov 02 12:36:25.547981 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1619/3245] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:25 2022] POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action => generated 144 bytes in 305 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:36:25.557520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.558753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.573318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.574265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.575000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.576145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.576844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.579486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.646297 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9c6d6c39-9539-427f-af86-a7d9364338f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847/action" status: 202 len: 0 microversion: 2.1 time: 0.352753 Nov 02 12:36:25.662187 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1627/3246] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:25 2022] POST /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:25.694814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.696847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.729801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.730784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.731825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.733783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.735455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.736538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.749609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:25.775478 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-709f6d7f-6497-4091-8e10-f95f99e0167d tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1468 microversion: 2.1 time: 0.225854 Nov 02 12:36:25.777099 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1620/3247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1468 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:25.787711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-296fc6af-ecba-4968-bf1a-d2159ec76e41 req-1d5f5649-2179-41c5-8b7f-8b01c4b18259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "6ea29634-7e85-4371-9350-7f00f347f137"}, {"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "22fd6bd7-c6b4-4d2a-8460-2167ba242deb"}, {"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "a5e3df2e-ea9d-46cc-8b90-9a43e80064a6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:25.821947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-296fc6af-ecba-4968-bf1a-d2159ec76e41 req-1d5f5649-2179-41c5-8b7f-8b01c4b18259 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.822355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-296fc6af-ecba-4968-bf1a-d2159ec76e41 req-1d5f5649-2179-41c5-8b7f-8b01c4b18259 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.823646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-296fc6af-ecba-4968-bf1a-d2159ec76e41 req-1d5f5649-2179-41c5-8b7f-8b01c4b18259 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.846290 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-296fc6af-ecba-4968-bf1a-d2159ec76e41 req-1d5f5649-2179-41c5-8b7f-8b01c4b18259 service nova] Creating event network-vif-plugged:6ea29634-7e85-4371-9350-7f00f347f137 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:36:25.847659 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-296fc6af-ecba-4968-bf1a-d2159ec76e41 req-1d5f5649-2179-41c5-8b7f-8b01c4b18259 service nova] Creating event network-vif-plugged:22fd6bd7-c6b4-4d2a-8460-2167ba242deb for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:36:25.848636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-296fc6af-ecba-4968-bf1a-d2159ec76e41 req-1d5f5649-2179-41c5-8b7f-8b01c4b18259 service nova] Creating event network-vif-plugged:a5e3df2e-ea9d-46cc-8b90-9a43e80064a6 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:36:25.875546 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-296fc6af-ecba-4968-bf1a-d2159ec76e41 req-1d5f5649-2179-41c5-8b7f-8b01c4b18259 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.080255 Nov 02 12:36:25.879926 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1621/3248] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:25.897573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:25.898342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.928283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.929483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.930770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.931708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.934651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.936061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.128338 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea0d012f-84e8-428c-aeb1-f4dd060da031 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action" status: 202 len: 0 microversion: 2.1 time: 0.242608 Nov 02 12:36:26.129586 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1622/3249] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:25 2022] POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:26.145860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:26.148993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:26.181877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.183455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.184841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.186942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.189429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.191139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.210012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.249575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.254390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.257491 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df1bcddd-8ba3-4da0-9daf-0c1c67294976 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.590381 Nov 02 12:36:26.260132 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1628/3250] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:26.272868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3e4cdaf9-321b-4c00-82d0-426c1c105069 req-99231ad5-a29f-4f52-821f-457eeb2e524c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3803cb1-6c47-450a-b0c5-275f54247723", "name": "network-vif-deleted", "tag": "13927f43-c5a3-490b-b220-7b73cbc8aa68"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:26.302011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3e4cdaf9-321b-4c00-82d0-426c1c105069 req-99231ad5-a29f-4f52-821f-457eeb2e524c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.303439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3e4cdaf9-321b-4c00-82d0-426c1c105069 req-99231ad5-a29f-4f52-821f-457eeb2e524c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.304786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3e4cdaf9-321b-4c00-82d0-426c1c105069 req-99231ad5-a29f-4f52-821f-457eeb2e524c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.314500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:26.341991 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3e4cdaf9-321b-4c00-82d0-426c1c105069 req-99231ad5-a29f-4f52-821f-457eeb2e524c service nova] Creating event network-vif-deleted:13927f43-c5a3-490b-b220-7b73cbc8aa68 for instance f3803cb1-6c47-450a-b0c5-275f54247723 on n-h1-855650-5 Nov 02 12:36:26.359369 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3e4cdaf9-321b-4c00-82d0-426c1c105069 req-99231ad5-a29f-4f52-821f-457eeb2e524c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096107 Nov 02 12:36:26.362234 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1629/3251] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:26.394153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:26.395238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:26.412237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.413275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.414142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.415538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.416426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.427755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.522579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.535367 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8488025-7e14-41a3-8ea9-b24d1225aeb6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 200 len: 1472 microversion: 2.1 time: 0.403599 Nov 02 12:36:26.536580 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1623/3252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:26 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:26.542316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:26.543070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:26.550937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.551483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.551950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.552790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.553622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.554145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.806209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.835383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.844058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.861689 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-826da124-57b8-41ff-ac26-cbb083368aa2 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1529 microversion: 2.91 time: 0.322828 Nov 02 12:36:26.863526 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1624/3253] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:26 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1529 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:26.879488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.879819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:26.880319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:26.882584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:26.901857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.902751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.903570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.905105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.905462 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-330b9c19-ddf5-45d9-9162-47f08fa5254e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1508 microversion: 2.1 time: 0.536568 Nov 02 12:36:26.906365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.907115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.913114 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1630/3254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:26 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1508 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:26.919477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-96340191"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:26.934170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:26.950613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.951150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.951691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.953075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.953721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.954230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.039210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:27.049882 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bc4e63a4-42bf-4290-8096-16bdca340b6a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1274 microversion: 2.1 time: 0.184371 Nov 02 12:36:27.063818 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1625/3255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:26 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:27.075671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.076730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.085757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.087587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.088075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.089106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.089580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.090482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.141288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.141695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.142421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.143068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lazy-loading 'fault' on Instance uuid f3803cb1-6c47-450a-b0c5-275f54247723 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:27.204283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72fcc9334808464092f16556a8e50fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa7b3d114c047f69065d9c988516e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:27.237655 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b751bcbd-b411-427b-a6b2-1405f39702ec tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 200 len: 1313 microversion: 2.1 time: 0.169723 Nov 02 12:36:27.239503 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1626/3256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:27.248974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.251990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.265474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.266492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.267184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.268223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.269464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.270681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.404361 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-73b29113-0130-423c-90ed-4d3688873149 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847/action" status: 202 len: 0 microversion: 2.1 time: 0.489338 Nov 02 12:36:27.412513 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1631/3257] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:26 2022] POST /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:36:27.423140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.424587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.434140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.434679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.435468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.436165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.436649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.438160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.479234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] Lazy-loading 'services' on Instance uuid f169f400-ea59-48ec-a765-2c8cab7131b9 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:27.508354 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c2a1e5f-956c-49cf-9f90-653394f4916a tempest-UnshelveToHostMultiNodesTest-804876704 tempest-UnshelveToHostMultiNodesTest-804876704-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1934 microversion: 2.91 time: 0.265728 Nov 02 12:36:27.509703 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1627/3258] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1934 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:27.516480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70c7a075-aebd-45d1-ae1f-73f59260c6d0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228ee5e280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.605256 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70c7a075-aebd-45d1-ae1f-73f59260c6d0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.093917 Nov 02 12:36:27.607143 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1628/3259] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:27.613791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.614903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.627252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.628287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.629444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.631123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.632044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.634299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.686662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:36:27.764779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:27.775764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:27.777570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:27.778721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cefa94c5-5dd9-4c01-b8dd-7ff2b19e03f0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.364005 Nov 02 12:36:27.779629 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1632/3260] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:27.855205 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5905d332-230e-4a88-8eb8-f0c942e0cbd7 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 204 len: 0 microversion: 2.91 time: 0.245509 Nov 02 12:36:27.861265 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1629/3261] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:27 2022] DELETE /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:36:27.871106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.872208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.888067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.889125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.890579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.892258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.893624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.894077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.915288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f5cdad7f-8014-4d93-a316-6bd45c98bee4 req-caaf3266-475c-42eb-98d4-a8435878210d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "712161f6-8da6-4c4e-85f6-1af79acf041a"}, {"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "111922f9-44fa-4874-bf9a-147981786e2f"}, {"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "e0d29879-e0b6-463c-842f-6b6ea81d4651"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:27.932776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5cdad7f-8014-4d93-a316-6bd45c98bee4 req-caaf3266-475c-42eb-98d4-a8435878210d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.934387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5cdad7f-8014-4d93-a316-6bd45c98bee4 req-caaf3266-475c-42eb-98d4-a8435878210d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.935004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5cdad7f-8014-4d93-a316-6bd45c98bee4 req-caaf3266-475c-42eb-98d4-a8435878210d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.953867 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f5cdad7f-8014-4d93-a316-6bd45c98bee4 req-caaf3266-475c-42eb-98d4-a8435878210d service nova] Creating event network-vif-plugged:712161f6-8da6-4c4e-85f6-1af79acf041a for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:36:27.954951 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f5cdad7f-8014-4d93-a316-6bd45c98bee4 req-caaf3266-475c-42eb-98d4-a8435878210d service nova] Creating event network-vif-plugged:111922f9-44fa-4874-bf9a-147981786e2f for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:36:27.955311 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f5cdad7f-8014-4d93-a316-6bd45c98bee4 req-caaf3266-475c-42eb-98d4-a8435878210d service nova] Creating event network-vif-plugged:e0d29879-e0b6-463c-842f-6b6ea81d4651 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:36:27.967821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f5cdad7f-8014-4d93-a316-6bd45c98bee4 req-caaf3266-475c-42eb-98d4-a8435878210d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056825 Nov 02 12:36:27.980088 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1630/3262] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:27.994781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.997892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:28.011017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.012507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.013312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:28.014757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.016040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.016794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:28.018174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:28.033616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:28.035673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:28.043678 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cca56634-bf84-4c54-bb9d-75e0dd8ba9d5 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.180116 Nov 02 12:36:28.044886 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1633/3263] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:28.093622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.095943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:28.104977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.105930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.106994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:28.108380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.109401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.110220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:28.348568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:28.359887 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b0b8cb3c-728a-4e7d-8c1f-46f79eddfa58 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1274 microversion: 2.1 time: 0.276120 Nov 02 12:36:28.382189 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1634/3264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:28 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1274 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:28.391129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.392064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] [instance: f3803cb1-6c47-450a-b0c5-275f54247723] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:28.400432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.401382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.402328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:28.403626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.405048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.406960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:28.427500 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] HTTP exception thrown: Instance f3803cb1-6c47-450a-b0c5-275f54247723 could not be found. Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Request method failure captured: Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 HTTP/1.1 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmPUJYpA50Rdxh50NaiD8AyVGHBgWjODLstdQF7xyopMxFbmrnhOdAeA-gNBAkqS7GcNao5EW7jpdqkCdjPKV9jEASnsIMEWGHG8Kv1kLFDOVzwMdnq9qLfdWitMJBZp-_Lr3GvJGOQ21pk7c45esV2b7VM0Rje-jm8oirQyzbrdw2E Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 9aa7b3d114c047f69065d9c988516e24 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-953603939 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9aa7b3d114c047f69065d9c988516e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9aa7b3d114c047f69065d9c988516e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9aa7b3d114c047f69065d9c988516e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9aa7b3d114c047f69065d9c988516e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-953603939 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 9aa7b3d114c047f69065d9c988516e24 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-953603939 Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueTestJSONUnderV235-953603939-project Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 72fcc9334808464092f16556a8e50fef Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-953603939-project Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f3803cb1-6c47-450a-b0c5-275f54247723 could not be found. Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f3803cb1-6c47-450a-b0c5-275f54247723'} Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3803cb1-6c47-450a-b0c5-275f54247723 could not be found. Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3803cb1-6c47-450a-b0c5-275f54247723 could not be found. Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.434676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3803cb1-6c47-450a-b0c5-275f54247723 could not be found. Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] Returning 404 to user: Instance f3803cb1-6c47-450a-b0c5-275f54247723 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-54805827-baf7-41ff-8b18-635e3a9ee5b0 tempest-ServerRescueTestJSONUnderV235-953603939 tempest-ServerRescueTestJSONUnderV235-953603939-project] 10.222.0.45 "GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723" status: 404 len: 111 microversion: 2.1 time: 0.053641 Nov 02 12:36:28.447318 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1635/3265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:28 2022] GET /compute/v2.1/servers/f3803cb1-6c47-450a-b0c5-275f54247723 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:28.566159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:28.572844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:28.585415 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a911460a-c1e4-4727-9364-de77d149109d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1516 microversion: 2.1 time: 0.601816 Nov 02 12:36:28.608352 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1631/3266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1516 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:28.639864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0cd8e5fc-70cf-4b0f-b0a3-e5ab1916f670 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e88c700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.745470 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0cd8e5fc-70cf-4b0f-b0a3-e5ab1916f670 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.121121 Nov 02 12:36:28.757394 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1636/3267] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:28 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:28.813332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.819088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:28.854373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.855719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.857358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:28.858665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.860107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.860772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:29.107280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:29.107931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:29.123029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:29.130591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:29.131529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:29.132663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:29.133938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:29.134807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:29.363450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.383111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.389177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.401417 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1bb68af7-1e48-4905-a214-827efb8aef4a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.299264 Nov 02 12:36:29.403384 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1637/3268] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:29 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:36:29.414810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:29.418463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:29.435363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:29.436058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.437060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:29.438293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:29.439988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:29.441188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:29.442359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:29.460622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.463745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.465392 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d430c5a3-31fb-44ce-8074-4f356872210d tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 0.660568 Nov 02 12:36:29.466961 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1632/3269] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:28 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:29.770004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-010c3f78-f0ae-4e7f-9045-7090bfd8cb23 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e5481f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:29.777094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.809250 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c54577ae-29d4-45ae-b4ba-4808f1042227 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 0.398675 Nov 02 12:36:29.828067 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1638/3270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:29 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:29.912456 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-010c3f78-f0ae-4e7f-9045-7090bfd8cb23 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.150894 Nov 02 12:36:29.914064 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1633/3271] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:29 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:30.454825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:30.454825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:30.462126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:30.464264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.465154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.465939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.468694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.469473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.470362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.522180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:30.527048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:30.541380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.542527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.543334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.544596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.545129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.546957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.682320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:30.707321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:30.709228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:30.727993 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-603c6256-43d5-42aa-867f-fb02e071f00a tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1535 microversion: 2.91 time: 0.277442 Nov 02 12:36:30.730010 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1639/3272] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:30 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1535 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:30.855448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:30.856797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:30.867082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.867882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.868739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.870031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.871436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.872363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:31.744201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:31.777763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:31.780893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:31.784210 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe8be6d8-3f0e-4945-a9d0-035f8ba72091 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1875 microversion: 2.32 time: 1.275377 Nov 02 12:36:31.785884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:31.788825 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1634/3273] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:30 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1875 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:31.802892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1b3f2bc-fb21-43b1-bd1c-d9fc6605f12e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292a5ddc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:31.822029 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d15abff1-087c-4bf1-97ff-89985d9ffb6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 0.972747 Nov 02 12:36:31.823152 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1640/3274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:30 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:31.828941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:31.831398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:31.870648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:31.872805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:31.873496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:31.874950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:31.876022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:31.877020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:31.936982 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1b3f2bc-fb21-43b1-bd1c-d9fc6605f12e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.141004 Nov 02 12:36:31.939466 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1635/3275] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:31 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:31.956817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:31.962551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:31.988788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lazy-loading 'flavor' on Instance uuid 9ef4fe0d-6f31-447d-b886-353ade395208 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:31.994293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:31.997216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.000950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.003608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.004919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.006677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.118021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.119973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.123613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.125614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lazy-loading 'fault' on Instance uuid f169f400-ea59-48ec-a765-2c8cab7131b9 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:32.164348 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4524b553-1ba3-4ee6-a88b-27a2140ce41b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action" status: 200 len: 32 microversion: 2.1 time: 0.339738 Nov 02 12:36:32.173057 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1641/3276] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:31 2022] POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action => generated 32 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:32.181771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-426e20d8-ed5f-425f-a1c8-2d7eef56a960 req-afa5ca54-7949-49fe-8b50-417220a708dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d56854-74e0-4b40-b805-542c7ec932c8", "tag": "fda7f593-24ee-4aae-84c5-2c59f1919dce"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:32.215139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-426e20d8-ed5f-425f-a1c8-2d7eef56a960 req-afa5ca54-7949-49fe-8b50-417220a708dd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.217272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-426e20d8-ed5f-425f-a1c8-2d7eef56a960 req-afa5ca54-7949-49fe-8b50-417220a708dd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.220637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-426e20d8-ed5f-425f-a1c8-2d7eef56a960 req-afa5ca54-7949-49fe-8b50-417220a708dd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.262093 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-426e20d8-ed5f-425f-a1c8-2d7eef56a960 req-afa5ca54-7949-49fe-8b50-417220a708dd service nova] Creating event network-changed:fda7f593-24ee-4aae-84c5-2c59f1919dce for instance 49d56854-74e0-4b40-b805-542c7ec932c8 on n-h1-855650-5 Nov 02 12:36:32.274437 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-426e20d8-ed5f-425f-a1c8-2d7eef56a960 req-afa5ca54-7949-49fe-8b50-417220a708dd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098914 Nov 02 12:36:32.275438 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1642/3277] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:32.286097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:32.286941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:32.287791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:32.295373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.296493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.297249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.299392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.300094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.300984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.322781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:32.324368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b835b6c5d364c299cf3e0dfb5c0899a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f141e7a921849d9b7d1f367681f2d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:32.339364 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2faa8819-de11-4e9b-b409-4c9e8eb068c9 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 200 len: 1540 microversion: 2.91 time: 0.397420 Nov 02 12:36:32.345643 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1636/3278] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:31 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 1540 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:32.378784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:32.715939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:32.732520 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5afed334-8a65-4e3c-a779-fd6f60388ec5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 0.449598 Nov 02 12:36:32.746381 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1643/3279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:32 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:32.841636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:32.843983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:32.856450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.857619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.858360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.860221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.861007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.861916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.862608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:32.864653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:32.876321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.877673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.878706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.880392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.881626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.882846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.113255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:33.441463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:33.465004 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6540c2e0-d11d-4185-8409-37c1eff293b0 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 0.608881 Nov 02 12:36:33.466443 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1644/3280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:32 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:33.472232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-327ba67d-ee80-4d7c-9b77-521f4a621a5f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228f099550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:33.493031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:33.530695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:33.536346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:33.544560 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a10f0e0b-b4c7-448e-a800-6dc48ff4ba85 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2827 microversion: 2.32 time: 0.708302 Nov 02 12:36:33.547134 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1637/3281] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:32 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2827 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:36:33.588953 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-327ba67d-ee80-4d7c-9b77-521f4a621a5f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.120933 Nov 02 12:36:33.598492 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1645/3282] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:33 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:33.600649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:33.601773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] [instance: f169f400-ea59-48ec-a765-2c8cab7131b9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:33.611420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:33.612457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:33.630044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.631353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.632487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.634513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.636519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.637754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.639659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.643627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.644438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.650156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.653363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.655145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.684035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:33.715832 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] HTTP exception thrown: Instance f169f400-ea59-48ec-a765-2c8cab7131b9 could not be found. Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Request method failure captured: Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 HTTP/1.1 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmNkDvTbyJoOOzM3gi_euhvakw8tg4f3Hm1hioLJnUV1MHThkFuXwHUjfE4bE0hbQKuUsN-xsj5BXSSoWsz8N79_loZoTh3Kjm9Utfx7JNmPMwGLzy3qqtULKjWNqQrGBN9SC2YbJLO-PCmrVPGBR2PhMHAAtrSggQDQJSqrp15oTPk Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.91 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 4f141e7a921849d9b7d1f367681f2d54 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-322562754 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f141e7a921849d9b7d1f367681f2d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f141e7a921849d9b7d1f367681f2d54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f141e7a921849d9b7d1f367681f2d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f141e7a921849d9b7d1f367681f2d54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-322562754 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 4f141e7a921849d9b7d1f367681f2d54 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-322562754 Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-UnshelveToHostMultiNodesTest-322562754-project Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5b835b6c5d364c299cf3e0dfb5c0899a Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-322562754-project Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance f169f400-ea59-48ec-a765-2c8cab7131b9 could not be found. Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'f169f400-ea59-48ec-a765-2c8cab7131b9'} Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f169f400-ea59-48ec-a765-2c8cab7131b9 could not be found. Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f169f400-ea59-48ec-a765-2c8cab7131b9 could not be found. Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:33.722483 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f169f400-ea59-48ec-a765-2c8cab7131b9 could not be found. Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] Returning 404 to user: Instance f169f400-ea59-48ec-a765-2c8cab7131b9 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9d8db30-2358-4c99-ab66-0e4e381e5ac4 tempest-UnshelveToHostMultiNodesTest-322562754 tempest-UnshelveToHostMultiNodesTest-322562754-project] 10.222.0.45 "GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9" status: 404 len: 111 microversion: 2.91 time: 0.154212 Nov 02 12:36:33.734449 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1638/3283] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:33 2022] GET /compute/v2.1/servers/f169f400-ea59-48ec-a765-2c8cab7131b9 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:33.769499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:33.770168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:33.783678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.784334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.785063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.786412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.787137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.787780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:34.500673 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb72f401-f9c7-4961-adda-9156382d50f5 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.905266 Nov 02 12:36:34.525774 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1646/3284] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Nov 2 12:36:33 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd/os-interface => generated 1832 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:34.525774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:34.525774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:34.532195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:34.533576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:34.534575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:34.538202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:34.539706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:34.541500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:34.607380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:34.623398 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-487ea044-5cbe-4e4a-9765-5e160c6be112 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 0.858217 Nov 02 12:36:34.626872 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1639/3285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:33 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:34.644010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bfc0a9dc-e573-4f19-af1e-d175baeb501d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292a96160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:34.837470 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bfc0a9dc-e573-4f19-af1e-d175baeb501d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.206280 Nov 02 12:36:34.840402 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1640/3286] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:34 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:35.054404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:35.073283 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b7b5f866-7982-4362-8f42-69e6b3cc6455 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 0.562824 Nov 02 12:36:35.075364 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1647/3287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:34 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:35.673062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:35.673944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:35.691477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:35.691984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:35.692438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:35.693165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:35.693635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:35.694114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:35.855558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bad17d3b-a607-412e-915c-8451335990a4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228ee9a310>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:35.960830 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bad17d3b-a607-412e-915c-8451335990a4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.108858 Nov 02 12:36:35.961188 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1648/3288] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:35 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:36.100384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:36.101396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:36.113741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:36.115467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:36.116127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.119102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:36.119842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:36.122431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.954962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:36.978605 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56e104f2-c421-4550-a479-09c8a475e203 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 1.310347 Nov 02 12:36:36.994678 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1641/3289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:35 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:37.002963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4a7d72a-35d2-42dd-970f-5ec3df0aa840 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f22929f09d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:37.128542 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d4a7d72a-35d2-42dd-970f-5ec3df0aa840 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.132524 Nov 02 12:36:37.129555 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1642/3290] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:36 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:37.359899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:37.370027 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-979711a6-ddeb-4db2-9739-e1cb0389dbf5 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 1.273045 Nov 02 12:36:37.386529 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1649/3291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:36 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:37.512839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4ec32963-35df-4fce-b685-4021e8fab6a7 req-531ec5a3-6975-4a26-987e-36837b0b0be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542f92f5-8985-475e-b090-6e8e2e413847", "name": "network-vif-plugged", "status": "completed", "tag": "6c285e87-4de7-477c-a3c9-6018bbb34f2d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:37.553254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4ec32963-35df-4fce-b685-4021e8fab6a7 req-531ec5a3-6975-4a26-987e-36837b0b0be7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:37.557439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4ec32963-35df-4fce-b685-4021e8fab6a7 req-531ec5a3-6975-4a26-987e-36837b0b0be7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:37.561784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4ec32963-35df-4fce-b685-4021e8fab6a7 req-531ec5a3-6975-4a26-987e-36837b0b0be7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:37.657475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4ec32963-35df-4fce-b685-4021e8fab6a7 req-531ec5a3-6975-4a26-987e-36837b0b0be7 service nova] Creating event network-vif-plugged:6c285e87-4de7-477c-a3c9-6018bbb34f2d for instance 542f92f5-8985-475e-b090-6e8e2e413847 on n-h2-855650-5 Nov 02 12:36:37.686165 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4ec32963-35df-4fce-b685-4021e8fab6a7 req-531ec5a3-6975-4a26-987e-36837b0b0be7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177363 Nov 02 12:36:37.688186 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1643/3292] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:38.009465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:38.010129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:38.030051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.045354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.047056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.050084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.052545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.065514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.160952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03a3a1fd-0a02-4f41-85c7-c17683df89cb tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6c05e0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:38.285393 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03a3a1fd-0a02-4f41-85c7-c17683df89cb tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.131378 Nov 02 12:36:38.314274 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1644/3293] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:38 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:38.402536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:38.404425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:38.437337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.439942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.441444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.443746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.445068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.446772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:39.196404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:39.220146 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-133cbb2f-7b41-4180-9ea2-c0feb1d1b36f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 1.213129 Nov 02 12:36:39.246888 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1650/3294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:38 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:39.258176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-4381beaa-b177-4821-b51b-f31bf9945907 req-95d59108-7aca-4c7d-a66d-0cfc1baf6789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "tag": "22fd6bd7-c6b4-4d2a-8460-2167ba242deb"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:39.284952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4381beaa-b177-4821-b51b-f31bf9945907 req-95d59108-7aca-4c7d-a66d-0cfc1baf6789 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:39.286427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4381beaa-b177-4821-b51b-f31bf9945907 req-95d59108-7aca-4c7d-a66d-0cfc1baf6789 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:39.287158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4381beaa-b177-4821-b51b-f31bf9945907 req-95d59108-7aca-4c7d-a66d-0cfc1baf6789 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:39.317242 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4381beaa-b177-4821-b51b-f31bf9945907 req-95d59108-7aca-4c7d-a66d-0cfc1baf6789 service nova] Creating event network-changed:22fd6bd7-c6b4-4d2a-8460-2167ba242deb for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:36:39.345006 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-4381beaa-b177-4821-b51b-f31bf9945907 req-95d59108-7aca-4c7d-a66d-0cfc1baf6789 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091842 Nov 02 12:36:39.346353 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1651/3295] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:39.369895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-72ba247c-6a02-4af3-bc46-4b9a5c575ca6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e986ca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:39.454537 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-72ba247c-6a02-4af3-bc46-4b9a5c575ca6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.106366 Nov 02 12:36:39.455491 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1652/3296] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:39 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:39.513811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:39.533120 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0530a998-190d-4e7b-b369-1844ffcb35cf tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 1.135367 Nov 02 12:36:39.563278 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1645/3297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:38 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:40.253127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:40.254897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:40.279781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:40.284241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:40.285232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:40.288955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:40.289811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:40.290481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:40.479082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-737b786f-73fc-4a57-a5d7-ddc3c588b1b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228eb4ee50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:40.629428 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-737b786f-73fc-4a57-a5d7-ddc3c588b1b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.155991 Nov 02 12:36:40.632098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1646/3298] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:40 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:40.638589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:40.639519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:40.649705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:40.650825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:40.651543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:40.652789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:40.653502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:40.654148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:41.699889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:41.744685 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a36424c4-ac35-414b-93ab-f8b9e1d31c64 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 1.496006 Nov 02 12:36:41.764176 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1653/3299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:40 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:41.816535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2fbde880-7c70-48ab-80f1-abb419c79cc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228eec4dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:42.026522 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2fbde880-7c70-48ab-80f1-abb419c79cc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.235637 Nov 02 12:36:42.034000 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1654/3300] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:41 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:42.389400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:42.417897 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03b27eaf-e39a-44ce-8f56-9cc8df250389 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 1.783209 Nov 02 12:36:42.442717 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1647/3301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:40 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:42.828836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:42.834822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:42.874467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:42.878377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:42.880254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:42.888186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:42.891662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:42.898384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:43.066625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb096304-614a-4115-abc7-9663f8381ff3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f22929c7ee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:43.245691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb096304-614a-4115-abc7-9663f8381ff3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.192321 Nov 02 12:36:43.256149 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1648/3302] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:43 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:43.487259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:43.488298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:43.531694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:43.532549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:43.533880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:43.546563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:43.547304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:43.548101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.020304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:44.063110 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-81a42c4f-13c7-4880-bc37-10aaa69c7ed0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 1.263566 Nov 02 12:36:44.096940 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1655/3303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:42 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:44.277278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea6b4659-803d-47d1-8e5d-12e30662b192 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228eaa8280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.420433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:44.444896 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f1e4bef-7d92-4d46-b95e-8d86ad8c2c6e tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 0.962566 Nov 02 12:36:44.446421 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1649/3304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:43 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:44.516312 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea6b4659-803d-47d1-8e5d-12e30662b192 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.244628 Nov 02 12:36:44.520158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.525615 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1656/3305] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:44 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:44.553423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:44.556625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Searching by: {'deleted': False, 'project_id': '97e284749b1d45a4b0748e50601b4efd'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:44.616163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.622816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.625722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.631694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.640595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.643498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.716869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:36:44.842301 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1072eee-75c6-4a93-a6e1-97c27d3b37ff tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.329886 Nov 02 12:36:44.855964 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1650/3306] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:36:44 2022] GET /compute/v2.1/servers => generated 333 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Searching by: {'deleted': False, 'project_id': '97e284749b1d45a4b0748e50601b4efd'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.968719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:36:45.119303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:45.120233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:45.165746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:45.179334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:45.182251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:45.183053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:45.184213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:45.187195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:45.187761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:45.194855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:45.195355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:45.195806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:45.643664 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8eee2d2-9268-4736-83c9-fac972b079bb tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.785873 Nov 02 12:36:45.645331 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1657/3307] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:44 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:45.662279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:45.663648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:45.675928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:45.677822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:45.679264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:45.681718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:45.684818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:45.685857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:45.768256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:45.778196 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf87e154-4954-4722-8795-570476d00fd4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 0.665894 Nov 02 12:36:45.786843 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1651/3308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:45 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:45.792268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0403e94c-6042-46ef-80d4-f070703ef89c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292ab8ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:45.951727 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0403e94c-6042-46ef-80d4-f070703ef89c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.163286 Nov 02 12:36:45.952535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1652/3309] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:45 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:45.969373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3cec1a39-055c-44d4-8051-ede057e8ab0a req-b729052c-4f26-4cc7-9358-d4ed40030426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d56854-74e0-4b40-b805-542c7ec932c8", "name": "network-vif-plugged", "status": "completed", "tag": "fda7f593-24ee-4aae-84c5-2c59f1919dce"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:46.016503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3cec1a39-055c-44d4-8051-ede057e8ab0a req-b729052c-4f26-4cc7-9358-d4ed40030426 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.017018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3cec1a39-055c-44d4-8051-ede057e8ab0a req-b729052c-4f26-4cc7-9358-d4ed40030426 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.017440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3cec1a39-055c-44d4-8051-ede057e8ab0a req-b729052c-4f26-4cc7-9358-d4ed40030426 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.049855 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3cec1a39-055c-44d4-8051-ede057e8ab0a req-b729052c-4f26-4cc7-9358-d4ed40030426 service nova] Creating event network-vif-plugged:fda7f593-24ee-4aae-84c5-2c59f1919dce for instance 49d56854-74e0-4b40-b805-542c7ec932c8 on n-h1-855650-5 Nov 02 12:36:46.066221 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3cec1a39-055c-44d4-8051-ede057e8ab0a req-b729052c-4f26-4cc7-9358-d4ed40030426 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100637 Nov 02 12:36:46.076246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1653/3310] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:46.489044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Action: 'update', calling method: .version_select at 0x7f2292a963a0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:46.497374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.499159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.500427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.523394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.525100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.526532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.542467 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] HTTP exception thrown: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Request method failure captured: Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203 HTTP/1.1 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 56 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmRdby0IYRY3RJf45B55M-nErc35eVpgR2YZfPGjn7D3M_SgzvAxfCTrooWkhkYeP5BuFlYEg0Ju5_RQ4xannXR3TFl0nYfQM_bvZ4DJ1hK4cJ-4bpcK-gMmRRC9iaddCf0WAG_l__4xewuJW-yFNswfg2Eqt7wFYRBk-caWMe2CuBE Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1e344f4ae19a4392b51a5bd7e6ffacce Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1e344f4ae19a4392b51a5bd7e6ffacce Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5b8aea6311574e23a07d08960eca91b8 Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: exception: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2d250a19-10fa-4632-8c0e-34558a40c203', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:46.548102 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Returning 404 to user: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:46.560456 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38a72ccc-d3eb-4485-9a11-cf5920a6cae0 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203" status: 404 len: 110 microversion: 2.53 time: 0.472943 Nov 02 12:36:46.563695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1654/3311] 10.222.0.45 () {62 vars in 1309 bytes} [Wed Nov 2 12:36:46 2022] PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203 => generated 110 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:46.573324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8fcfaac1-5650-4814-9f45-7543c1d3ac75 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:46.594404 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8fcfaac1-5650-4814-9f45-7543c1d3ac75 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028816 Nov 02 12:36:46.595938 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1655/3312] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:36:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:46.606468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Action: 'update', calling method: .version_select at 0x7f228ed9d430>, body: {"status": "disabled"} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:46.614623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.616277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.617575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.635466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.636612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.637290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.646710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] HTTP exception thrown: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Request method failure captured: Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203 HTTP/1.1 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 22 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmRdby0IYRY3RJf45B55M-nErc35eVpgR2YZfPGjn7D3M_SgzvAxfCTrooWkhkYeP5BuFlYEg0Ju5_RQ4xannXR3TFl0nYfQM_bvZ4DJ1hK4cJ-4bpcK-gMmRRC9iaddCf0WAG_l__4xewuJW-yFNswfg2Eqt7wFYRBk-caWMe2CuBE Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1e344f4ae19a4392b51a5bd7e6ffacce Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1e344f4ae19a4392b51a5bd7e6ffacce Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5b8aea6311574e23a07d08960eca91b8 Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: {"status": "disabled"} Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: exception: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2d250a19-10fa-4632-8c0e-34558a40c203', 'body': {'status': 'disabled'}} Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:46.649518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Returning 404 to user: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:46.662837 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f60e1a52-33e0-447f-978b-49ddac348964 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203" status: 404 len: 110 microversion: 2.53 time: 0.055877 Nov 02 12:36:46.666770 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1656/3313] 10.222.0.45 () {62 vars in 1309 bytes} [Wed Nov 2 12:36:46 2022] PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203 => generated 110 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:46.680473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Action: 'update', calling method: .version_select at 0x7f228e57cc10>, body: {"status": "enabled"} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:46.684887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.685645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.687584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.695813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.696532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.697321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.710101 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] HTTP exception thrown: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Request method failure captured: Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203 HTTP/1.1 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 21 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmRdby0IYRY3RJf45B55M-nErc35eVpgR2YZfPGjn7D3M_SgzvAxfCTrooWkhkYeP5BuFlYEg0Ju5_RQ4xannXR3TFl0nYfQM_bvZ4DJ1hK4cJ-4bpcK-gMmRRC9iaddCf0WAG_l__4xewuJW-yFNswfg2Eqt7wFYRBk-caWMe2CuBE Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1e344f4ae19a4392b51a5bd7e6ffacce Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1e344f4ae19a4392b51a5bd7e6ffacce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1e344f4ae19a4392b51a5bd7e6ffacce Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5b8aea6311574e23a07d08960eca91b8 Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: {"status": "enabled"} Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: exception: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2d250a19-10fa-4632-8c0e-34558a40c203', 'body': {'status': 'enabled'}} Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:46.714826 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. Nov 02 12:36:46.724342 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:36:46.730851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Returning 404 to user: Service 2d250a19-10fa-4632-8c0e-34558a40c203 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:46.732831 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f1139597-2013-470a-ba44-ba68bee05d0a tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203" status: 404 len: 110 microversion: 2.53 time: 0.059075 Nov 02 12:36:46.735140 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1657/3314] 10.222.0.45 () {62 vars in 1309 bytes} [Wed Nov 2 12:36:46 2022] PUT /compute/v2.1/os-services/2d250a19-10fa-4632-8c0e-34558a40c203 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:46.752994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-79bf8707-8e69-4ac9-a4af-14973c04ccbd tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:46.761791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79bf8707-8e69-4ac9-a4af-14973c04ccbd tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.763136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79bf8707-8e69-4ac9-a4af-14973c04ccbd tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.764324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79bf8707-8e69-4ac9-a4af-14973c04ccbd tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.772269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79bf8707-8e69-4ac9-a4af-14973c04ccbd tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.775558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79bf8707-8e69-4ac9-a4af-14973c04ccbd tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.793078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:46.797472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-79bf8707-8e69-4ac9-a4af-14973c04ccbd tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.838341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-50718700-63fc-456e-a423-2abc74592666 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 1.191042 Nov 02 12:36:46.856116 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1658/3315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:45 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:46.882486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:46.883966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:46.906124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.913703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.914922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.916436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.920470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.930717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.935065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-79bf8707-8e69-4ac9-a4af-14973c04ccbd tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.191031 Nov 02 12:36:46.954660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1658/3316] 10.222.0.45 () {60 vars in 1178 bytes} [Wed Nov 2 12:36:46 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:46.969307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:46.985667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:47.018645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.019917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.021279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.022929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.024055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.025016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.102669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:36:47.261180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:47.334701 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e279ad96-1504-4250-9787-51ec0821ddfc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "DELETE /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 204 len: 0 microversion: 2.1 time: 0.377899 Nov 02 12:36:47.336269 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1659/3317] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:46 2022] DELETE /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:36:47.363887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7972fde-0e44-425a-a5b9-a15abd6213e2 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:47.382901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7972fde-0e44-425a-a5b9-a15abd6213e2 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.391260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7972fde-0e44-425a-a5b9-a15abd6213e2 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.392255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7972fde-0e44-425a-a5b9-a15abd6213e2 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.393438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7972fde-0e44-425a-a5b9-a15abd6213e2 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.394343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7972fde-0e44-425a-a5b9-a15abd6213e2 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.395356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7972fde-0e44-425a-a5b9-a15abd6213e2 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.481234 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f7972fde-0e44-425a-a5b9-a15abd6213e2 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.142284 Nov 02 12:36:47.483790 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1660/3318] 10.222.0.45 () {60 vars in 1211 bytes} [Wed Nov 2 12:36:47 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:47.494964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96521abb-5f4b-4fab-9371-f6df88cc4d64 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e57c820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:47.636075 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96521abb-5f4b-4fab-9371-f6df88cc4d64 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.148846 Nov 02 12:36:47.639578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1661/3319] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:47 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:47.665138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:47.672400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:47.704523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.706254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.707908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.710130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.712640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.714202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.870271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:47.895890 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d237ce61-d9da-4495-b5ab-9ae866b0ed06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 1.037352 Nov 02 12:36:47.899061 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1659/3320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:46 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:47.917105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-159ed71b-79ec-4df1-ab8c-58950cdeb61d tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:47.928400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159ed71b-79ec-4df1-ab8c-58950cdeb61d tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.930215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159ed71b-79ec-4df1-ab8c-58950cdeb61d tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.931545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159ed71b-79ec-4df1-ab8c-58950cdeb61d tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.933823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159ed71b-79ec-4df1-ab8c-58950cdeb61d tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.935229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159ed71b-79ec-4df1-ab8c-58950cdeb61d tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.936923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159ed71b-79ec-4df1-ab8c-58950cdeb61d tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.011791 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-159ed71b-79ec-4df1-ab8c-58950cdeb61d tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.108655 Nov 02 12:36:48.013895 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1660/3321] 10.222.0.45 () {60 vars in 1178 bytes} [Wed Nov 2 12:36:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:48.027399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.028995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:48.042275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.043613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.044862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.047811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.049434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.051023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.438598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:48.449481 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ccad8f90-def9-4036-861f-c156c1af4763 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1699 microversion: 2.1 time: 0.806992 Nov 02 12:36:48.474045 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1662/3322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:47 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1699 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:48.474045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d8eb253c-34ef-4444-8ddd-2e9e1c4931af tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.488501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eb253c-34ef-4444-8ddd-2e9e1c4931af tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.493186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eb253c-34ef-4444-8ddd-2e9e1c4931af tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.493999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eb253c-34ef-4444-8ddd-2e9e1c4931af tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.496767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eb253c-34ef-4444-8ddd-2e9e1c4931af tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.499059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eb253c-34ef-4444-8ddd-2e9e1c4931af tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.499807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8eb253c-34ef-4444-8ddd-2e9e1c4931af tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.582496 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d8eb253c-34ef-4444-8ddd-2e9e1c4931af tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=n-d-855650-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.119796 Nov 02 12:36:48.584937 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1663/3323] 10.222.0.45 () {60 vars in 1235 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/os-services?host=n-d-855650-5&binary=xxx => generated 16 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:48.612143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e76fb02-d289-4ef3-9e05-c618ec2c6a08 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.621628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e76fb02-d289-4ef3-9e05-c618ec2c6a08 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.624042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e76fb02-d289-4ef3-9e05-c618ec2c6a08 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.624526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e76fb02-d289-4ef3-9e05-c618ec2c6a08 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.632922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e76fb02-d289-4ef3-9e05-c618ec2c6a08 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.634072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e76fb02-d289-4ef3-9e05-c618ec2c6a08 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.635707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e76fb02-d289-4ef3-9e05-c618ec2c6a08 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.727157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:48.762303 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e76fb02-d289-4ef3-9e05-c618ec2c6a08 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.133254 Nov 02 12:36:48.763256 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1664/3324] 10.222.0.45 () {60 vars in 1178 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:36:48.772727 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c2eadd7f-bdc1-4e77-8715-8fbda9b17b9b tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1316 microversion: 2.1 time: 0.755446 Nov 02 12:36:48.774364 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1661/3325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1316 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:48.786358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7688233-3ede-4a00-975b-6a2061334d5a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228eb793a0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.832961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2a7afba-5746-447e-960a-c5135a3227d9 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.841941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2a7afba-5746-447e-960a-c5135a3227d9 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.844059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2a7afba-5746-447e-960a-c5135a3227d9 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.845313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2a7afba-5746-447e-960a-c5135a3227d9 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.860242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2a7afba-5746-447e-960a-c5135a3227d9 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.860242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2a7afba-5746-447e-960a-c5135a3227d9 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.861904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2a7afba-5746-447e-960a-c5135a3227d9 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.929254 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7688233-3ede-4a00-975b-6a2061334d5a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.161641 Nov 02 12:36:48.933291 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1665/3326] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:48.948031 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2a7afba-5746-447e-960a-c5135a3227d9 tempest-ServicesAdminNegativeV253TestJSON-665256791 tempest-ServicesAdminNegativeV253TestJSON-665256791-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.145543 Nov 02 12:36:48.963130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.967407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:48.968379 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1662/3327] 10.222.0.45 () {60 vars in 1239 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:48.981541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.984032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.009957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.016795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.018378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.019534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.303275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9ea967ea-814e-4f06-bf3d-c5f49ae32aea tempest-ServicesAdminNegativeV253TestJSON-1663147942 tempest-ServicesAdminNegativeV253TestJSON-1663147942-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:49.310708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9ea967ea-814e-4f06-bf3d-c5f49ae32aea tempest-ServicesAdminNegativeV253TestJSON-1663147942 tempest-ServicesAdminNegativeV253TestJSON-1663147942-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3709ea3de8d34f49a515197f0458295c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945da53323546b7a1e25f64f789b3d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9ea967ea-814e-4f06-bf3d-c5f49ae32aea tempest-ServicesAdminNegativeV253TestJSON-1663147942 tempest-ServicesAdminNegativeV253TestJSON-1663147942-project] Request method failure captured: Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRbYyNAMcLtJkwVun55cBkACHg5e_Z_iHixe_FBRDgvTCw2tpjQzQOHt3aoC3BrpXa_dIqeTMg_sBb3WsAbBPs2GJ-NvJ4tVtBCwgEtLQcgnqSqCkyhNLDVRKUGawfcrTtZY8s_d-3EqgYHF0rylPYLJF6TdO8u95-bsts7y_vXkDI Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 6945da53323546b7a1e25f64f789b3d2 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1663147942 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6945da53323546b7a1e25f64f789b3d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6945da53323546b7a1e25f64f789b3d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6945da53323546b7a1e25f64f789b3d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6945da53323546b7a1e25f64f789b3d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1663147942 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 6945da53323546b7a1e25f64f789b3d2 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1663147942 Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1663147942-project Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 3709ea3de8d34f49a515197f0458295c Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1663147942-project Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: action_args: {} Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:36:49.328535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:36:49.336705 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:49.355283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9ea967ea-814e-4f06-bf3d-c5f49ae32aea tempest-ServicesAdminNegativeV253TestJSON-1663147942 tempest-ServicesAdminNegativeV253TestJSON-1663147942-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:49.368545 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9ea967ea-814e-4f06-bf3d-c5f49ae32aea tempest-ServicesAdminNegativeV253TestJSON-1663147942 tempest-ServicesAdminNegativeV253TestJSON-1663147942-project] 10.222.0.45 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.380547 Nov 02 12:36:49.370874 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1663/3328] 10.222.0.45 () {60 vars in 1178 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/os-services => generated 112 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:49.497598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:49.499291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:49.506965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:49.556140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3e47ff5-e875-48c0-b126-3ad593630e68 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 0.600448 Nov 02 12:36:49.561149 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1666/3329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:49.594582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.597062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.600308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.609788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.610456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.617540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.830106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:49.830765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:49.845842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.853892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.854512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.858538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.864448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.865464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:51.345236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:51.390712 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64f75596-f6dd-44d3-aae4-eb3b34477e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1507 microversion: 2.1 time: 1.564773 Nov 02 12:36:51.394457 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1667/3330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:49 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1507 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:51.434437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9af7122-e791-4e14-af96-3fe24b631037 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e57cd30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:51.619257 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9af7122-e791-4e14-af96-3fe24b631037 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.210954 Nov 02 12:36:51.629466 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1668/3331] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:51 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:51.651721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:51.656780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:51.698975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:51.705924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:51.707322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:51.712922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:51.714428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:51.723165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:52.778864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:52.833531 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f102665a-72fa-4484-882f-30e831e842ea tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1699 microversion: 2.1 time: 3.332027 Nov 02 12:36:52.838490 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1664/3332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:49 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1699 bytes in 3349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:52.854491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d7d8e3fe-f8c5-44e4-913a-2779a0488d8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228ea68e50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:52.989339 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d7d8e3fe-f8c5-44e4-913a-2779a0488d8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.148934 Nov 02 12:36:52.995513 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1665/3333] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:52 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:53.699329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:53.719311 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8bb711b4-efbe-428f-a6c2-d375af614679 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 2.087735 Nov 02 12:36:53.720422 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1669/3334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:51 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:53.871787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:53.873705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:53.896941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:53.897949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:53.899042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:53.901700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:53.906966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:53.908962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:54.026375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be1b6797-e384-4b71-b477-369ad8123615 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228eb79dc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:54.173296 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be1b6797-e384-4b71-b477-369ad8123615 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.155175 Nov 02 12:36:54.187400 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1670/3335] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:54 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:54.778972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:54.781910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:54.809523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:54.810781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:54.813489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:54.815335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:54.821999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:54.823659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:55.132547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:56.612512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:56.653168 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55294ca6-e6d6-4f80-bbcc-6021e8155293 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1699 microversion: 2.1 time: 2.784418 Nov 02 12:36:56.654105 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1666/3336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:53 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1699 bytes in 2790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:56.663808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b66810f6-e05c-4457-841c-8a4ebd6e39a8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228eb8ad30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:56.789084 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b66810f6-e05c-4457-841c-8a4ebd6e39a8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.126542 Nov 02 12:36:56.790131 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1667/3337] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:56 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:56.803270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b0944bbe-2a8f-43b9-98b0-ce0cddb3264f"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:56.806776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:56.832007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:56.832817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:56.833447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:56.834799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:56.836924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:56.839961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:56.992348 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] HTTP exception thrown: Volume 2c1c14f0-6675-4606-ae87-be3c6a42ef60 could not be found. Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Request method failure captured: Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8/os-volume_attachments/2c1c14f0-6675-4606-ae87-be3c6a42ef60 HTTP/1.1 Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 74 Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmObMkyl5lWpLpvJ1R_rf7jIWQ0lNuGQutctyZtzLyrsrDcg5LADjMH3HUVKSIiLfa9cHA5E3wzJm1QA5vTGsTQE5mwUSc6smtk3ZnWGAEeHcPRJwt5cBkNGRG6AH_vak3QPi_EsIJRqhSgea6n41Y8s1S8DDFSlAWaQQ-BF9LXXUIQ Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: b496bda9f6d44265b9cb000f7751140d Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-VolumesAdminNegativeTest-1442629937 Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b496bda9f6d44265b9cb000f7751140d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b496bda9f6d44265b9cb000f7751140d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b496bda9f6d44265b9cb000f7751140d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b496bda9f6d44265b9cb000f7751140d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-VolumesAdminNegativeTest-1442629937 Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: b496bda9f6d44265b9cb000f7751140d Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1442629937 Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-VolumesAdminNegativeTest-1442629937-project-admin Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 2dee647a8bec445baaed6b3897840196 Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-VolumesAdminNegativeTest-1442629937-project-admin Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: {"volumeAttachment": {"volumeId": "b0944bbe-2a8f-43b9-98b0-ce0cddb3264f"}} Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: exception: Volume 2c1c14f0-6675-4606-ae87-be3c6a42ef60 could not be found. Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': '49d56854-74e0-4b40-b805-542c7ec932c8', 'id': '2c1c14f0-6675-4606-ae87-be3c6a42ef60', 'body': {'volumeAttachment': {'volumeId': 'b0944bbe-2a8f-43b9-98b0-ce0cddb3264f'}}} Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c1c14f0-6675-4606-ae87-be3c6a42ef60 could not be found. (HTTP 404) (Request-ID: req-8d676551-d137-495d-85df-beb08ff88df7) Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:36:56.997101 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c1c14f0-6675-4606-ae87-be3c6a42ef60 could not be found. Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c1c14f0-6675-4606-ae87-be3c6a42ef60 could not be found. Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c1c14f0-6675-4606-ae87-be3c6a42ef60 could not be found. Nov 02 12:36:57.003268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.010085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] Returning 404 to user: Volume 2c1c14f0-6675-4606-ae87-be3c6a42ef60 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:57.010085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-06a85ae0-2b94-40fb-9b17-01d4132d4464 tempest-VolumesAdminNegativeTest-1442629937 tempest-VolumesAdminNegativeTest-1442629937-project-admin] 10.222.0.45 "PUT /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8/os-volume_attachments/2c1c14f0-6675-4606-ae87-be3c6a42ef60" status: 404 len: 109 microversion: 2.1 time: 0.218364 Nov 02 12:36:57.010865 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1668/3338] 10.222.0.45 () {60 vars in 1433 bytes} [Wed Nov 2 12:36:56 2022] PUT /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8/os-volume_attachments/2c1c14f0-6675-4606-ae87-be3c6a42ef60 => generated 109 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:57.413983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:57.455565 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2713fbc5-b686-4eae-bbf1-28a7678f4fdb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1502 microversion: 2.1 time: 2.696523 Nov 02 12:36:57.459893 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1671/3339] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:54 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1502 bytes in 2704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:57.505584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ed00f16-70c7-4de9-89db-742d09e39f2d"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:57.509800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:57.526283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.527101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.528235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:57.529346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.530145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.530860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:57.641253 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Cannot 'attach_volume' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state rescued Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/os-volume_attachments HTTP/1.1 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 74 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: {"volumeAttachment": {"volumeId": "9ed00f16-70c7-4de9-89db-742d09e39f2d"}} Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: exception: Cannot 'attach_volume' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state rescued Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': '9ef4fe0d-6f31-447d-b886-353ade395208', 'body': {'volumeAttachment': {'volumeId': '9ed00f16-70c7-4de9-89db-742d09e39f2d'}}} Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ef4fe0d-6f31-447d-b886-353ade395208 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 12:36:57.650292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state rescued Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state rescued Nov 02 12:36:57.657212 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:36:57.662330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 409 to user: Cannot 'attach_volume' instance 9ef4fe0d-6f31-447d-b886-353ade395208 while it is in vm_state rescued {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:57.664040 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7fcdfd34-2c58-4e34-970e-90fd331d5749 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.167697 Nov 02 12:36:57.665511 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1669/3340] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:36:57 2022] POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/os-volume_attachments => generated 152 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:36:57.688000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:57.688952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:57.709062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:57.713994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:57.731772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:57.738885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.739779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.740600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:57.741950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.742834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.743560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:57.755127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.756011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.757417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:57.764726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.766299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.775340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:58.181630 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be25cf1f-ed26-4a3f-9a7c-c25ff447cb25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action" status: 202 len: 0 microversion: 2.1 time: 0.506780 Nov 02 12:36:58.206326 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1672/3341] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:57 2022] POST /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:58.238446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f189c14a-8d5d-438d-acb6-d0c79a6450ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc1b040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:58.250619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:58.283291 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b9886556-08b1-4d08-b314-0d904e150f7d tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1632 microversion: 2.1 time: 0.581881 Nov 02 12:36:58.289568 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1670/3342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:57 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1632 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:58.318051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:58.319918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:58.357319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:58.366621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:58.367450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:58.368667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:58.369414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:58.370166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:58.386752 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f189c14a-8d5d-438d-acb6-d0c79a6450ff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.177832 Nov 02 12:36:58.387764 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1673/3343] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:58 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:58.885677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:59.337440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.340225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:59.352178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=16 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:59.421285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.426717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.430580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.432420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.433270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.441205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.808288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:59.854628 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-811d265f-6ec7-4b7a-b4c5-86b61ed0d8fc tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1632 microversion: 2.1 time: 0.527971 Nov 02 12:36:59.855713 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1674/3344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1632 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:59.887807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:59.925316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30e20f52-7078-4edc-bd27-7e460d146b15 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6c00d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.976451 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-17770e09-0f59-4b2c-9d60-f49a422164dd tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1510 microversion: 2.1 time: 1.663779 Nov 02 12:36:59.981194 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1671/3345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:58 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1510 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:00.015726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e5943ed8-f117-473c-9623-cd6bd8736422 req-d140a1d1-b72b-4079-a2c2-a9037b2cae75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593a5f54-ab59-4a5c-969e-e8c45d008744", "name": "network-vif-deleted", "tag": "2604b6b7-09e9-464c-a883-2e9cbc79e103"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:00.065037 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30e20f52-7078-4edc-bd27-7e460d146b15 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.200308 Nov 02 12:37:00.070179 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1675/3346] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:00.122009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e5943ed8-f117-473c-9623-cd6bd8736422 req-d140a1d1-b72b-4079-a2c2-a9037b2cae75 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:00.122009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e5943ed8-f117-473c-9623-cd6bd8736422 req-d140a1d1-b72b-4079-a2c2-a9037b2cae75 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:00.122009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e5943ed8-f117-473c-9623-cd6bd8736422 req-d140a1d1-b72b-4079-a2c2-a9037b2cae75 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:00.314925 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e5943ed8-f117-473c-9623-cd6bd8736422 req-d140a1d1-b72b-4079-a2c2-a9037b2cae75 service nova] Creating event network-vif-deleted:2604b6b7-09e9-464c-a883-2e9cbc79e103 for instance 593a5f54-ab59-4a5c-969e-e8c45d008744 on n-h2-855650-5 Nov 02 12:37:00.370983 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e5943ed8-f117-473c-9623-cd6bd8736422 req-d140a1d1-b72b-4079-a2c2-a9037b2cae75 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365858 Nov 02 12:37:00.377487 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1672/3347] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:00.887417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:00.892174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:00.943282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:00.946707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:00.949674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:00.957850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:00.960103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:00.963419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.047407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.056548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:01.101091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=60 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:01.141417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.146816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.159329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.173213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.176491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.181338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.209384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:01.222863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.227724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.237281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.241904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lazy-loading 'fault' on Instance uuid 593a5f54-ab59-4a5c-969e-e8c45d008744 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:01.769336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71e15a35de14ba691ec72cddac6a1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e284749b1d45a4b0748e50601b4efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:01.786638 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-47dc68ed-d024-4b0e-a188-92a44a8359d4 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 200 len: 1358 microversion: 2.1 time: 0.904933 Nov 02 12:37:01.799374 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1676/3348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:00 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 1358 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:01.825989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e038b24-9466-4891-9eea-722fa5b770d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc20820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.975179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e038b24-9466-4891-9eea-722fa5b770d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.158582 Nov 02 12:37:01.979589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1677/3349] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:02.309626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:02.367559 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f255a7e-7309-4b0a-a5a7-2ccdb82dbd4c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1510 microversion: 2.1 time: 1.334927 Nov 02 12:37:02.375042 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1673/3350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1510 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:02.821470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:02.822826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] [instance: 593a5f54-ab59-4a5c-969e-e8c45d008744] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:02.847841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:02.853938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:02.854882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:02.862425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:02.863351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:02.866150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:02.909856 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] HTTP exception thrown: Instance 593a5f54-ab59-4a5c-969e-e8c45d008744 could not be found. Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Request method failure captured: Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 HTTP/1.1 Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmPcIAHkwhOiyoLY-_pdaqHC66xWGosPgI2Ti3MqejBRxf_2XQs6uXTIb2m3iyPJ5zTEv1zGqoHliZyqD3UnrGStaGmaOeHFQXegvk2fzGg-I62eaPFqljPT44YkyItd8HpP55xQ7hOtLymNwbtZlUhjTY7ldUlR-fIjwXw2Rx44_UI Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 97e284749b1d45a4b0748e50601b4efd Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersTestJSON-607620440 Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/97e284749b1d45a4b0748e50601b4efd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/97e284749b1d45a4b0748e50601b4efd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/97e284749b1d45a4b0748e50601b4efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_97e284749b1d45a4b0748e50601b4efd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersTestJSON-607620440 Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 97e284749b1d45a4b0748e50601b4efd Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersTestJSON-607620440 Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersTestJSON-607620440-project Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c71e15a35de14ba691ec72cddac6a1a8 Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersTestJSON-607620440-project Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 593a5f54-ab59-4a5c-969e-e8c45d008744 could not be found. Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '593a5f54-ab59-4a5c-969e-e8c45d008744'} Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 593a5f54-ab59-4a5c-969e-e8c45d008744 could not be found. Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 593a5f54-ab59-4a5c-969e-e8c45d008744 could not be found. Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:02.916009 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:02.922402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:02.922402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:02.922402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:02.922402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:02.922402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 593a5f54-ab59-4a5c-969e-e8c45d008744 could not be found. Nov 02 12:37:02.922402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:02.930414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Returning 404 to user: Instance 593a5f54-ab59-4a5c-969e-e8c45d008744 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:02.931698 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6ce2b0ff-f35d-4f31-b89d-f0dce549aa68 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744" status: 404 len: 111 microversion: 2.1 time: 0.116657 Nov 02 12:37:02.936241 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1678/3351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:02 2022] GET /compute/v2.1/servers/593a5f54-ab59-4a5c-969e-e8c45d008744 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:02.950444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b3246135-ff88-4cb6-8a44-7dacae7f9915 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] Calling method '.version_select at 0x7f228e992280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:02.998450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67ad867d-645c-4955-8ee6-b88311593a43 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc201f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:03.038199 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b3246135-ff88-4cb6-8a44-7dacae7f9915 tempest-ServersTestJSON-607620440 tempest-ServersTestJSON-607620440-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-935910656" status: 202 len: 0 microversion: 2.1 time: 0.098711 Nov 02 12:37:03.044883 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1674/3352] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:37:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-935910656 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:37:03.090322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67ad867d-645c-4955-8ee6-b88311593a43 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.097124 Nov 02 12:37:03.094392 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1679/3353] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:02 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:03.426137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:03.426993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:03.444120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:03.449725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:03.453739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:03.455129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:03.457718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:03.460369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:04.117641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d3565a4-5b18-40fb-a93b-af6b6c0c3244 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc1e0d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:04.278878 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d3565a4-5b18-40fb-a93b-af6b6c0c3244 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.166847 Nov 02 12:37:04.287280 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1680/3354] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:04 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:04.681107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:04.763034 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-622dca4b-5787-4766-b64b-88b3249afdef tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1510 microversion: 2.1 time: 1.342972 Nov 02 12:37:04.765586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1675/3355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:03 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1510 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:05.310253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bfbe6618-f82c-472b-8725-6b3a66bd91ad tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228edfaaf0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:05.591928 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bfbe6618-f82c-472b-8725-6b3a66bd91ad tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.291396 Nov 02 12:37:05.627416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-513567362", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "3df2b834-542d-4af7-a2f7-6a848f5dc1f3"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:05.631232 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1676/3356] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:05 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:05.917752 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5a79e1f-b7b1-4f7f-862c-ddfe2beafc32 tempest-TenantUsagesNegativeTestJSON-1611289131 tempest-TenantUsagesNegativeTestJSON-1611289131-project-admin] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T12%3A37%3A05.475272&end=2022-11-03T12%3A37%3A05.475272" status: 404 len: 112 microversion: - time: 0.284478 Nov 02 12:37:05.918619 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1677/3357] 10.222.0.45 () {58 vars in 1316 bytes} [Wed Nov 2 12:37:05 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T12%3A37%3A05.475272&end=2022-11-03T12%3A37%3A05.475272 => generated 112 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:37:05.931411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:05.931928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:05.939884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] validate_networks() for [('3df2b834-542d-4af7-a2f7-6a848f5dc1f3', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:05.949929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:05.952167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:05.953295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:05.955943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:05.957104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:05.958197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.110542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:06.495721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ca960c6f-d454-4ba8-8893-31c25bc2fe04 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "DELETE /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 204 len: 0 microversion: 2.1 time: 0.573266 Nov 02 12:37:06.496898 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1678/3358] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:05 2022] DELETE /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:06.536801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:06.540248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:06.570179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.572374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.574852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.583167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.585934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.587027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.162585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:07.177943 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20edb920-c867-4acf-861f-fb50e2128572 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1516 microversion: 2.1 time: 0.675363 Nov 02 12:37:07.207158 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1679/3359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:06 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1516 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:07.215085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ffcd7f0-2237-4f88-8a57-54151a897bb1 tempest-TenantUsagesNegativeTestJSON-1611289131 tempest-TenantUsagesNegativeTestJSON-1611289131-project-admin] Calling method '.version_select at 0x7f228e27b790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:07.231244 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-0ffcd7f0-2237-4f88-8a57-54151a897bb1 tempest-TenantUsagesNegativeTestJSON-1611289131 tempest-TenantUsagesNegativeTestJSON-1611289131-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ffcd7f0-2237-4f88-8a57-54151a897bb1 tempest-TenantUsagesNegativeTestJSON-1611289131 tempest-TenantUsagesNegativeTestJSON-1611289131-project-admin] Request method failure captured: Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-simple-tenant-usage/3e71ea7e5d6e4cbfa3bd17942bfb0307?start=2022-11-03T12%3A37%3A05.475272&end=2022-11-01T12%3A37%3A05.475272 HTTP/1.1 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwgsrCI9R2rJytlpVAgP2Vr1PO9o5bLltQp0ZSYbuHg3RyZfobpwUsafeqnXk0fThhLRNziQMj-qXIwODxyC_cH1a_Vp5q0b0TiFqH6S9BufIc_gqh7JIsJIV-J_Q7I51iwNd_bSqv84wP9r-MckK2yYbLNH7jodL-1oy7jcLHKGY Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: fa6a0da2f2594e1c8ba68a08e89c74f8 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1611289131 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fa6a0da2f2594e1c8ba68a08e89c74f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fa6a0da2f2594e1c8ba68a08e89c74f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fa6a0da2f2594e1c8ba68a08e89c74f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fa6a0da2f2594e1c8ba68a08e89c74f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1611289131 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: fa6a0da2f2594e1c8ba68a08e89c74f8 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1611289131 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TenantUsagesNegativeTestJSON-1611289131-project-admin Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: fc3f9809ffe94b69b33e2da5ce4e3357 Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1611289131-project-admin Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid start time. The start time cannot occur after the end time. Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3e71ea7e5d6e4cbfa3bd17942bfb0307'} Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 02 12:37:07.238395 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.251907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ffcd7f0-2237-4f88-8a57-54151a897bb1 tempest-TenantUsagesNegativeTestJSON-1611289131 tempest-TenantUsagesNegativeTestJSON-1611289131-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:07.251907 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ffcd7f0-2237-4f88-8a57-54151a897bb1 tempest-TenantUsagesNegativeTestJSON-1611289131 tempest-TenantUsagesNegativeTestJSON-1611289131-project-admin] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage/3e71ea7e5d6e4cbfa3bd17942bfb0307?start=2022-11-03T12%3A37%3A05.475272&end=2022-11-01T12%3A37%3A05.475272" status: 400 len: 111 microversion: 2.1 time: 0.036103 Nov 02 12:37:07.251907 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1680/3360] 10.222.0.45 () {58 vars in 1412 bytes} [Wed Nov 2 12:37:07 2022] GET /compute/v2.1/os-simple-tenant-usage/3e71ea7e5d6e4cbfa3bd17942bfb0307?start=2022-11-03T12%3A37%3A05.475272&end=2022-11-01T12%3A37%3A05.475272 => generated 111 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:37:07.257379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:07.268769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:07.285995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:07.285995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:07.289540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.290365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:07.290858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:07.291420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.506565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:07.509104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:07.510544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:07.511737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:07.513422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:07.574696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:07.575646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:07.580494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.584821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:07.587670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:07.593391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.689838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:07.708114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:07.739816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:07.743072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:07.919581 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-179a99be-5c73-4fae-877d-3ab9282eb454 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.765310 Nov 02 12:37:07.931204 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1681/3361] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:07.939002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d29e405c-a3ae-414c-ad34-41be03a37964 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6c0940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:07.977185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:08.018357 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bcf8d2a8-604f-40a2-ab6e-2dfe92ceb7be tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1513 microversion: 2.1 time: 0.768492 Nov 02 12:37:08.031011 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1681/3362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:07 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1513 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:08.105477 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d29e405c-a3ae-414c-ad34-41be03a37964 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.171452 Nov 02 12:37:08.126086 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1682/3363] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:07 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:08.149909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef12573f-4441-493e-aac2-07f8cce7046b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:08.151441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef12573f-4441-493e-aac2-07f8cce7046b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:08.384153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef12573f-4441-493e-aac2-07f8cce7046b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:08.417947 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef12573f-4441-493e-aac2-07f8cce7046b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1192 microversion: 2.1 time: 0.284274 Nov 02 12:37:08.420866 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1683/3364] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:08 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1192 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c624cd16-b8e6-4b7d-983c-bddd88d11dca tempest-TenantUsagesNegativeTestJSON-185022256 tempest-TenantUsagesNegativeTestJSON-185022256-project] Calling method '.version_select at 0x7f228e154040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c624cd16-b8e6-4b7d-983c-bddd88d11dca tempest-TenantUsagesNegativeTestJSON-185022256 tempest-TenantUsagesNegativeTestJSON-185022256-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7aa4ca861bac410ca1c75818f66a7f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ea7e5d6e4cbfa3bd17942bfb0307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c624cd16-b8e6-4b7d-983c-bddd88d11dca tempest-TenantUsagesNegativeTestJSON-185022256 tempest-TenantUsagesNegativeTestJSON-185022256-project] Request method failure captured: Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A37%3A05.475272&end=2022-11-03T12%3A37%3A05.475272&detailed=1 HTTP/1.1 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRt6M9YrxBz9bAwlR2gZqNk5EUMLQZCqJBLHFK5Y3x3WQQ9X8nVEEk_MTBs-h7Vuqdllu-o1kBspZCGdkc4-IwIYSQiIh4id_eHjqQrVvWjSXop6IKuSW_5yZuj9R-OeZUomE74PlqyQdZA8aDCDegT0EmKxtFrxQ7slUafATi30Pg Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 3e71ea7e5d6e4cbfa3bd17942bfb0307 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-185022256 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e71ea7e5d6e4cbfa3bd17942bfb0307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3e71ea7e5d6e4cbfa3bd17942bfb0307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e71ea7e5d6e4cbfa3bd17942bfb0307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3e71ea7e5d6e4cbfa3bd17942bfb0307"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-185022256 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 3e71ea7e5d6e4cbfa3bd17942bfb0307 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-185022256 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TenantUsagesNegativeTestJSON-185022256-project Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 7aa4ca861bac410ca1c75818f66a7f14 Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-185022256-project Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: action_args: {} Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:08.433210 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c624cd16-b8e6-4b7d-983c-bddd88d11dca tempest-TenantUsagesNegativeTestJSON-185022256 tempest-TenantUsagesNegativeTestJSON-185022256-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:08.443107 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c624cd16-b8e6-4b7d-983c-bddd88d11dca tempest-TenantUsagesNegativeTestJSON-185022256 tempest-TenantUsagesNegativeTestJSON-185022256-project] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A37%3A05.475272&end=2022-11-03T12%3A37%3A05.475272&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.409637 Nov 02 12:37:08.447634 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1682/3365] 10.222.0.45 () {58 vars in 1335 bytes} [Wed Nov 2 12:37:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A37%3A05.475272&end=2022-11-03T12%3A37%3A05.475272&detailed=1 => generated 123 bytes in 414 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:09.066726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:09.072450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:09.096147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:09.097011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:09.097707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:09.098805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:09.099743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:09.100484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:09.141869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05615dee-7497-413c-bfcd-1e6b80e7ed66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e776ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:09.328034 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05615dee-7497-413c-bfcd-1e6b80e7ed66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.191082 Nov 02 12:37:09.329984 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1684/3366] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:09 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:09.453957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a8c2cfc-e642-43f9-871f-ac6f58f6d0f8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:09.455013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1a8c2cfc-e642-43f9-871f-ac6f58f6d0f8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:10.369689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a8c2cfc-e642-43f9-871f-ac6f58f6d0f8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:10.388559 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a8c2cfc-e642-43f9-871f-ac6f58f6d0f8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1192 microversion: 2.1 time: 0.942456 Nov 02 12:37:10.389650 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1685/3367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:09 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1192 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:10.440277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b30ab29-5ece-4a17-bfa2-a0f5656d5d5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228ea7a670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:10.653455 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b30ab29-5ece-4a17-bfa2-a0f5656d5d5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1412 microversion: 2.1 time: 0.240220 Nov 02 12:37:10.658503 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1686/3368] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:10 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1412 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:10.740846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:10.776050 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b4ae51e4-f4ee-4dbf-8f3b-e96598f38853 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1513 microversion: 2.1 time: 1.716693 Nov 02 12:37:10.777502 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1683/3369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:09 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1513 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:11.167300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-494620b6-8b99-4b10-bd6f-0c11874e93f1 req-612debdf-8bca-46b4-8d7e-ef56e2f8c08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d56854-74e0-4b40-b805-542c7ec932c8", "name": "network-vif-deleted", "tag": "fda7f593-24ee-4aae-84c5-2c59f1919dce"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:11.247851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-494620b6-8b99-4b10-bd6f-0c11874e93f1 req-612debdf-8bca-46b4-8d7e-ef56e2f8c08a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.248500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-494620b6-8b99-4b10-bd6f-0c11874e93f1 req-612debdf-8bca-46b4-8d7e-ef56e2f8c08a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.249083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-494620b6-8b99-4b10-bd6f-0c11874e93f1 req-612debdf-8bca-46b4-8d7e-ef56e2f8c08a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.300269 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-494620b6-8b99-4b10-bd6f-0c11874e93f1 req-612debdf-8bca-46b4-8d7e-ef56e2f8c08a service nova] Creating event network-vif-deleted:fda7f593-24ee-4aae-84c5-2c59f1919dce for instance 49d56854-74e0-4b40-b805-542c7ec932c8 on n-h1-855650-5 Nov 02 12:37:11.319896 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-494620b6-8b99-4b10-bd6f-0c11874e93f1 req-612debdf-8bca-46b4-8d7e-ef56e2f8c08a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165726 Nov 02 12:37:11.322840 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1687/3370] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:11.434449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.435413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:11.465693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.479122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.479589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.480450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.480994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.481525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.684979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-28d81534-23eb-4905-bf29-14ec4575e948 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e548ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.786861 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-28d81534-23eb-4905-bf29-14ec4575e948 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1421 microversion: 2.1 time: 0.105565 Nov 02 12:37:11.788257 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1688/3371] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:11.819215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48b53e42-db3b-478d-ab3d-80a1717559fc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e776940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.901005 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48b53e42-db3b-478d-ab3d-80a1717559fc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 200 len: 1421 microversion: 2.1 time: 0.086995 Nov 02 12:37:11.901803 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1689/3372] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 1421 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:11.915444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.916692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:11.943518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.944596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.945544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:11.946170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.947654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.948546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.949337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.963031 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c608921b-d6fe-43e5-a4bb-8cd46f4804bd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1252 microversion: 2.1 time: 0.543281 Nov 02 12:37:11.970014 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1684/3373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1252 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:11.978011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36fb8a0e-e679-4a92-91b6-8c66b7de3b13 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'create', calling method: .version_select at 0x7f2292a380d0>, body: {"keypair": {"name": "tempest-keypair-1934330112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjg0eDYButpMjb9irGQtVSJ7LxiOBk8Qx9X7P4RCWaLOGFS+B10KFwgnGFKvwhxOKiGcirM++129PNFgCgjoH3TnvmNSdppLuEli5L+GyUFOAwHNd5JtoO/X8fqgbcebg=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:12.027018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-36fb8a0e-e679-4a92-91b6-8c66b7de3b13 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Getting quotas for project 29944ce70b2d4abea5c2f205a3814881. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:12.043858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-36fb8a0e-e679-4a92-91b6-8c66b7de3b13 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Getting quotas for user 11f2191cdfa640ed9a7f71d4744c9999 and project 29944ce70b2d4abea5c2f205a3814881. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:12.093948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:12.095502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:12.097330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:12.098465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lazy-loading 'fault' on Instance uuid 49d56854-74e0-4b40-b805-542c7ec932c8 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:12.145132 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36fb8a0e-e679-4a92-91b6-8c66b7de3b13 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178897 Nov 02 12:37:12.146234 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1685/3374] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:37:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:12.176838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b7dc9e10-d46f-455c-b8a9-068d476dd250 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e9864c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.468626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:12.493106 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6f89696-aa0c-465f-8eb6-f3d20fc6cc8d tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 200 len: 1306 microversion: 2.1 time: 0.589534 Nov 02 12:37:12.518395 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1690/3375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 1306 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:13.020727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:13.021786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:13.047468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.053393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.054366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:13.062395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.064400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.066749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.047551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:14.130779 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6b659ab-33c4-48fc-85b8-b3b103dc3cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1250 microversion: 2.1 time: 1.115668 Nov 02 12:37:14.140348 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1691/3376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:13 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1250 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:14.166560 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b7dc9e10-d46f-455c-b8a9-068d476dd250 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 204 len: 0 microversion: 2.1 time: 2.012784 Nov 02 12:37:14.168435 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1686/3377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:12 2022] DELETE /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 0 bytes in 2021 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:14.184217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:14.185218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:14.193911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.194999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.201829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:14.207080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.208453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.209295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.209702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 49d56854-74e0-4b40-b805-542c7ec932c8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:14.210275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.254146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:14.278421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.280350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.283291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.288337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.289805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.291672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.328484 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] HTTP exception thrown: Instance 49d56854-74e0-4b40-b805-542c7ec932c8 could not be found. Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Request method failure captured: Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 HTTP/1.1 Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmOGX97LoMdGlDjOTO-vQDmFXKB35aKQQc4mg-8cDqbFMny03mdiERgyoBh4SG0TJCEsIwCtqravfzH8lH87BYfU4-dSvXnqBGuLpar-nfiR5ypmWD3uf9jlSfucxC3anF3hVZsS3Eqsw2DpuAKma4K1fQNu2ToS7nhQGyLW4F21lcw Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60b7340637d745b5875c43f1589869ea Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesAdminNegativeTest-1906843019 Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60b7340637d745b5875c43f1589869ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60b7340637d745b5875c43f1589869ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60b7340637d745b5875c43f1589869ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60b7340637d745b5875c43f1589869ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesAdminNegativeTest-1906843019 Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60b7340637d745b5875c43f1589869ea Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1906843019 Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesAdminNegativeTest-1906843019-project Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5446fad0c7a74bfd936b34867a943bfa Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesAdminNegativeTest-1906843019-project Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 49d56854-74e0-4b40-b805-542c7ec932c8 could not be found. Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '49d56854-74e0-4b40-b805-542c7ec932c8'} Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d56854-74e0-4b40-b805-542c7ec932c8 could not be found. Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d56854-74e0-4b40-b805-542c7ec932c8 could not be found. Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:14.330493 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d56854-74e0-4b40-b805-542c7ec932c8 could not be found. Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Returning 404 to user: Instance 49d56854-74e0-4b40-b805-542c7ec932c8 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:14.339028 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ee5e39c8-dae1-493d-9178-e7444d2b80e7 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8" status: 404 len: 111 microversion: 2.1 time: 0.188762 Nov 02 12:37:14.347703 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1692/3378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:14 2022] GET /compute/v2.1/servers/49d56854-74e0-4b40-b805-542c7ec932c8 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:14.520689 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f170f668-bc80-4c63-9aeb-46dcc3e73be4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 204 len: 0 microversion: 2.1 time: 0.341988 Nov 02 12:37:14.547725 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1687/3379] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:14 2022] DELETE /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:37:14.879665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1993749568", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "6073314f-95a7-4839-bb88-cbb45aac3413"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:15.010738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] validate_networks() for [('6073314f-95a7-4839-bb88-cbb45aac3413', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:15.194445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:15.199781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:15.235519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.238787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.247359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.253299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.256993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.259947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.597571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:15.619459 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7b236fa3-b2ac-47a6-96dc-0478d9aba41f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1250 microversion: 2.1 time: 0.438766 Nov 02 12:37:15.621329 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1688/3380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:15 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1250 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:15.919319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-86beb58c-626b-4f91-87b3-299008817802 req-37051e34-22ff-4a86-8638-87097cd0a878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542f92f5-8985-475e-b090-6e8e2e413847", "name": "network-vif-unplugged", "status": "completed", "tag": "6c285e87-4de7-477c-a3c9-6018bbb34f2d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:15.941425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-86beb58c-626b-4f91-87b3-299008817802 req-37051e34-22ff-4a86-8638-87097cd0a878 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.944460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-86beb58c-626b-4f91-87b3-299008817802 req-37051e34-22ff-4a86-8638-87097cd0a878 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.944918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-86beb58c-626b-4f91-87b3-299008817802 req-37051e34-22ff-4a86-8638-87097cd0a878 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.976828 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-86beb58c-626b-4f91-87b3-299008817802 req-37051e34-22ff-4a86-8638-87097cd0a878 service nova] Creating event network-vif-unplugged:6c285e87-4de7-477c-a3c9-6018bbb34f2d for instance 542f92f5-8985-475e-b090-6e8e2e413847 on n-h2-855650-5 Nov 02 12:37:15.998636 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-86beb58c-626b-4f91-87b3-299008817802 req-37051e34-22ff-4a86-8638-87097cd0a878 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076225 Nov 02 12:37:16.000270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1689/3381] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:16.657150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:16.657895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:16.677995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.678537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.679293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.690660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.691597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.692274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:17.155405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:17.210734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8bb707a5-7667-473c-bccf-d944676d1df5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1250 microversion: 2.1 time: 0.562628 Nov 02 12:37:17.218688 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1690/3382] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:16 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1250 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:17.650102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:18.248292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:18.250878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:18.277084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:18.283382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:18.285035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.289498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:18.290734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:18.296270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.771701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:18.773751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:18.775520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:18.778103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:18.790674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:18.898868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:18.905031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:18.905655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.907192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:18.910358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:18.912675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.941266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=83,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:18.991897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:19.007979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for user beeb8b4fa7354185ba8aff3194bf9e06 and project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:19.048236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:19.052193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:19.183542 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-287d7905-465f-4e86-8f61-d1552c312a32 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.309741 Nov 02 12:37:19.185287 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1693/3383] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:19.277498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:19.372109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e00b992a-0956-40bd-a6e9-57a014bd1aa0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1292 microversion: 2.1 time: 1.123668 Nov 02 12:37:19.377282 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1691/3384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:18 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1292 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:19.417888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-45384df5-bc82-4b1b-ae5b-6a2845571ad3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:19.428363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-45384df5-bc82-4b1b-ae5b-6a2845571ad3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:19.909310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-45384df5-bc82-4b1b-ae5b-6a2845571ad3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:19.941705 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-45384df5-bc82-4b1b-ae5b-6a2845571ad3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1208 microversion: 2.1 time: 0.558231 Nov 02 12:37:19.982123 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1692/3385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:19 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1208 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:20.005633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-380b21bf-6c15-41d0-9a53-83d572941249 tempest-FlavorsV2NegativeTest-1558301478 tempest-FlavorsV2NegativeTest-1558301478-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:20.016875 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-380b21bf-6c15-41d0-9a53-83d572941249 tempest-FlavorsV2NegativeTest-1558301478 tempest-FlavorsV2NegativeTest-1558301478-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.829807 Nov 02 12:37:20.034668 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1694/3386] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:37:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:20.054781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-331a505e-8d0d-477e-8f37-71bd6ad9dd37 req-d4816915-8110-4a46-ac73-5360eed895ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542f92f5-8985-475e-b090-6e8e2e413847", "name": "network-vif-deleted", "tag": "6c285e87-4de7-477c-a3c9-6018bbb34f2d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:20.087542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-331a505e-8d0d-477e-8f37-71bd6ad9dd37 req-d4816915-8110-4a46-ac73-5360eed895ef service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.089182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-331a505e-8d0d-477e-8f37-71bd6ad9dd37 req-d4816915-8110-4a46-ac73-5360eed895ef service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.090155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-331a505e-8d0d-477e-8f37-71bd6ad9dd37 req-d4816915-8110-4a46-ac73-5360eed895ef service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.123372 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-331a505e-8d0d-477e-8f37-71bd6ad9dd37 req-d4816915-8110-4a46-ac73-5360eed895ef service nova] Creating event network-vif-deleted:6c285e87-4de7-477c-a3c9-6018bbb34f2d for instance 542f92f5-8985-475e-b090-6e8e2e413847 on n-h2-855650-5 Nov 02 12:37:20.163328 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-331a505e-8d0d-477e-8f37-71bd6ad9dd37 req-d4816915-8110-4a46-ac73-5360eed895ef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118808 Nov 02 12:37:20.168800 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1693/3387] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:20.407977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:20.408838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:20.425608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.428098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.433341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.434464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.435591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.436307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.015403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.016875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:21.068526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.078292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.078877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.079662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.080197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.080674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.215041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:21.222536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:21.242966 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-872e1237-2b27-4ac8-a95b-2322867cb440 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1292 microversion: 2.1 time: 0.839499 Nov 02 12:37:21.244780 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-daf4cb4d-3f68-4beb-a499-650fec3985d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1260 microversion: 2.1 time: 0.237455 Nov 02 12:37:21.246652 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1694/3388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:21 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:21.251036 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1695/3389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:20 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1292 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:21.518391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.519019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:21.523293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e607197f-fc7a-4b4b-828d-5ea937fbf0c0 tempest-FlavorsV2NegativeTest-1558301478 tempest-FlavorsV2NegativeTest-1558301478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-728745897", "imageRef": "bf6395ee-41c2-4950-94cd-5bbc5ad8a7b7", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:21.536459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.537547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.540981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.542438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.558475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.559388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.607758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-e607197f-fc7a-4b4b-828d-5ea937fbf0c0 tempest-FlavorsV2NegativeTest-1558301478 tempest-FlavorsV2NegativeTest-1558301478-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:21.614461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:21.619482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:21.812794 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f501db4c-06db-4e3b-839c-4c01746de23f tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 204 len: 0 microversion: 2.1 time: 0.301152 Nov 02 12:37:21.813452 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1695/3390] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:21 2022] DELETE /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:37:21.825357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.831202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:21.844035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.847609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.848435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.849522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.854430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.855300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.651889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:22.669740 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b6e23e0b-f930-42e6-8972-3a25cb5de685 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1683 microversion: 2.1 time: 0.847883 Nov 02 12:37:22.672060 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1696/3391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:21 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1683 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:22.686598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:22.687899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:22.703599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.705331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.706846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.708602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.710855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.711935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.249669 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e607197f-fc7a-4b4b-828d-5ea937fbf0c0 tempest-FlavorsV2NegativeTest-1558301478 tempest-FlavorsV2NegativeTest-1558301478-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e607197f-fc7a-4b4b-828d-5ea937fbf0c0 tempest-FlavorsV2NegativeTest-1558301478 tempest-FlavorsV2NegativeTest-1558301478-project] Request method failure captured: Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 142 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmR-YkE7Pow1902lGSQEcqFAShBt2zLXwJD6zJErHZQ864Utu9uLEkAD4QN_P572jZ5j16FiAju6MoixIA2R2GJbgo2jUtbvvyL3PcgTYmmX866rJM5bYDwZzlP-pp1SDV6BesSOeXeXgzxmMMGQCV0WSqKJEH12hSkm2q2YOmFRHn8 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 6d3b126f88214643ba6b0da20e761728 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-FlavorsV2NegativeTest-1558301478 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3b126f88214643ba6b0da20e761728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6d3b126f88214643ba6b0da20e761728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d3b126f88214643ba6b0da20e761728"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6d3b126f88214643ba6b0da20e761728"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-FlavorsV2NegativeTest-1558301478 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 6d3b126f88214643ba6b0da20e761728 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1558301478 Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-FlavorsV2NegativeTest-1558301478-project Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: dad7c995e4264778824eca714fdb2f7b Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-FlavorsV2NegativeTest-1558301478-project Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-728745897", "imageRef": "bf6395ee-41c2-4950-94cd-5bbc5ad8a7b7", "flavorRef": "452"}} Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: exception: Flavor's memory is too small for requested image. Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-728745897', 'imageRef': 'bf6395ee-41c2-4950-94cd-5bbc5ad8a7b7', 'flavorRef': '452'}}} Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:23.251699 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.257174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e607197f-fc7a-4b4b-828d-5ea937fbf0c0 tempest-FlavorsV2NegativeTest-1558301478 tempest-FlavorsV2NegativeTest-1558301478-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:23.259493 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e607197f-fc7a-4b4b-828d-5ea937fbf0c0 tempest-FlavorsV2NegativeTest-1558301478 tempest-FlavorsV2NegativeTest-1558301478-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.742270 Nov 02 12:37:23.264169 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1696/3392] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:21 2022] POST /compute/v2.1/servers => generated 93 bytes in 1746 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:23.274133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.274991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:23.297097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.301814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.302463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.306892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.307649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.308417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.493878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:23.516175 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e93015d-4c0c-401e-ab2d-bddfc603358a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1266 microversion: 2.1 time: 0.254719 Nov 02 12:37:23.526095 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1697/3393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:23.547741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1107823772", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c068488f-a377-46be-b121-31cbe9651f21"}], "security_groups": [{"name": "tempest-securitygroup--1045372830"}], "key_name": "tempest-keypair-1934330112", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:23.589733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:23.606200 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d4f4ce6-01f0-42b1-afda-fcae09b5c8ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1292 microversion: 2.1 time: 0.922934 Nov 02 12:37:23.611850 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1697/3394] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:22 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1292 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:23.713176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.715777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:23.758655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.773239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.780065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.782900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.784046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.786600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:24.584786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] validate_networks() for [('c068488f-a377-46be-b121-31cbe9651f21', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:24.886989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:24.905626 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-378d5086-3a5b-41f2-8c00-ab32c1f3d13c tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1683 microversion: 2.1 time: 1.209607 Nov 02 12:37:24.908496 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1698/3395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1683 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:24.918026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-855795ff-6016-4907-8cee-feef5ca99c5f req-ceac716e-19d4-47f5-9808-f731a7742858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3385330-4644-4f56-a4ab-2e2c3b617ce1", "tag": "533513ee-b7a3-4462-89a7-a06deab93dc9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:24.943477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-855795ff-6016-4907-8cee-feef5ca99c5f req-ceac716e-19d4-47f5-9808-f731a7742858 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:24.945928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-855795ff-6016-4907-8cee-feef5ca99c5f req-ceac716e-19d4-47f5-9808-f731a7742858 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:24.946811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-855795ff-6016-4907-8cee-feef5ca99c5f req-ceac716e-19d4-47f5-9808-f731a7742858 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:24.964913 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-855795ff-6016-4907-8cee-feef5ca99c5f req-ceac716e-19d4-47f5-9808-f731a7742858 service nova] Creating event network-changed:533513ee-b7a3-4462-89a7-a06deab93dc9 for instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 on n-h2-855650-5 Nov 02 12:37:24.972634 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-855795ff-6016-4907-8cee-feef5ca99c5f req-ceac716e-19d4-47f5-9808-f731a7742858 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061677 Nov 02 12:37:24.974071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1699/3396] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:24.983989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:24.985203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:24.997919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:24.998891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:25.000437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:25.001595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:25.002603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:25.003397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:25.218422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:25.254073 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8fa9f156-6486-4d36-b7b5-7252f8505f59 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1266 microversion: 2.1 time: 0.275666 Nov 02 12:37:25.257500 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1700/3397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:24 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:25.316205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:25.322399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:25.374170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:25.375273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:25.377190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:25.378675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:25.379872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:25.380891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:26.415685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:26.440562 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9bcdeb4a-4e78-472e-989c-bb40d239b809 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1292 microversion: 2.1 time: 1.159662 Nov 02 12:37:26.442429 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1701/3398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:25 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1292 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:26.462661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:26.464390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:26.480477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:26.481046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:26.481828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:26.482687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:26.483170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:26.483671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.116527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:27.117731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:27.118946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:27.120927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:27.122166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:27.156582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.157758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.159826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.164078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.166403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.167678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.195440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:27.211806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Getting quotas for project 29944ce70b2d4abea5c2f205a3814881. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:27.234250 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-96d5cca2-57cc-4395-a560-eb0cb202bdb2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1683 microversion: 2.1 time: 0.789763 Nov 02 12:37:27.256438 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1702/3399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:26 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1683 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:27.260867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Getting quotas for user 11f2191cdfa640ed9a7f71d4744c9999 and project 29944ce70b2d4abea5c2f205a3814881. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:27.262355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:27.263304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:27.271121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.276437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.277149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.278243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.278901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.279724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.337616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:27.365617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:27.579836 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78fd2354-9a7e-4851-9f28-9d415d152d70 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.050310 Nov 02 12:37:27.587543 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1698/3400] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 4060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:27.608578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:27.612069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:27.636044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.636597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.638870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.641921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.642831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.644008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:28.884834 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:37:28.885750 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 12:37:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 (ip 10.222.0.45) !!! Nov 02 12:37:29.103525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:29.133623 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e715cf38-780a-40d5-a83f-e919c8a67c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 1.859206 Nov 02 12:37:29.137195 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1703/3401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:27 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:29.147461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:29.170375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:29.199005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.199706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.201086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:29.204909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.205827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.207042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:29.406515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:29.423056 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8fc9cf7-a0e6-47c2-916a-aaf071ee2d62 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1250 microversion: 2.1 time: 0.275863 Nov 02 12:37:29.428303 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1704/3402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:29 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1250 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:29.444519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:29.446214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:29.464518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.465694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.466527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:29.470457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.474967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.476119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:29.647607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:29.667975 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-28ab2351-cae9-4165-8711-5ec6e4128609 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1615 microversion: 2.1 time: 0.238207 Nov 02 12:37:29.675111 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1705/3403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:29 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1615 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:29.746327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:29.763002 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f4865fe5-9f6e-415e-84f3-f78272e4fefb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1292 microversion: 2.1 time: 2.171619 Nov 02 12:37:29.766039 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1699/3404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:27 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1292 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:29.921945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:30.168653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:30.170102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:30.185677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:30.188412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:30.194827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:30.195696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:30.196729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:30.197445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:30.198519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:30.503280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:30.507487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:30.545274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:30.546603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:30.547347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:30.548714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:30.560446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:30.561363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.240069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:31.264602 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-530f6f27-3689-44e3-883c-0b22682e3ae8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 1.096148 Nov 02 12:37:31.281884 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1700/3405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:30 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:31.292395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:31.293040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:31.316355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.317254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.328316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.330073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.334987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.335771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.796913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:31.827654 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e9987d9-7e98-4981-bdd7-cb6dde26db30 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1298 microversion: 2.1 time: 0.556781 Nov 02 12:37:31.828272 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1701/3406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:31 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1298 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:31.838514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:31.839160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:31.866336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.868545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.869031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.869803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.870306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.870731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.875645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:31.937708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:31.950552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:31.959973 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dc62ba7b-6d69-4128-8aae-e2ae67cf9d76 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2946 microversion: 2.32 time: 2.243884 Nov 02 12:37:31.966391 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1706/3407] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:37:29 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2946 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:37:31.991715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:31.998942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:32.026166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:32.031567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.032074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.032534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.033009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lazy-loading 'fault' on Instance uuid 4d093add-0a0f-44b6-b83f-f461c5488003 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:32.035912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.044330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.047503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.052438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.054359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.055287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.220692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5446fad0c7a74bfd936b34867a943bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7340637d745b5875c43f1589869ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:32.236453 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f7faa26-8733-4552-bcb1-46f2a5e19e34 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 200 len: 1332 microversion: 2.1 time: 0.407069 Nov 02 12:37:32.239704 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1702/3408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:31 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 1332 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:32.258851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-942f6f8d-66e2-4081-bace-25483bc60678 req-13008db6-01f1-44f7-8f68-720ed26709a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d093add-0a0f-44b6-b83f-f461c5488003", "name": "network-vif-deleted", "tag": "f6222d7a-ac1c-41cc-8cfc-e37b6012d5ee"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:32.305268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-942f6f8d-66e2-4081-bace-25483bc60678 req-13008db6-01f1-44f7-8f68-720ed26709a0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.306096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-942f6f8d-66e2-4081-bace-25483bc60678 req-13008db6-01f1-44f7-8f68-720ed26709a0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.310746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-942f6f8d-66e2-4081-bace-25483bc60678 req-13008db6-01f1-44f7-8f68-720ed26709a0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.345365 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-942f6f8d-66e2-4081-bace-25483bc60678 req-13008db6-01f1-44f7-8f68-720ed26709a0 service nova] Creating event network-vif-deleted:f6222d7a-ac1c-41cc-8cfc-e37b6012d5ee for instance 4d093add-0a0f-44b6-b83f-f461c5488003 on n-h2-855650-5 Nov 02 12:37:32.395355 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-942f6f8d-66e2-4081-bace-25483bc60678 req-13008db6-01f1-44f7-8f68-720ed26709a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144154 Nov 02 12:37:32.396452 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1703/3409] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:32.428112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:32.432659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:32.460433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.471164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.473595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.474811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.479994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.482744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.723674 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11dd0241-c362-44b3-99c7-af2a80492f8a tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.321671 Nov 02 12:37:32.724552 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1704/3410] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Nov 2 12:37:32 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd/os-interface => generated 1832 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:37:32.747590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:32.750178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:32.752821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:32.762997 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b6e3644-ab71-4d08-82db-d6cd71d835fe tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1292 microversion: 2.1 time: 0.793290 Nov 02 12:37:32.763674 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1707/3411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:31 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1292 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:32.783788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.784656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.788096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.789087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.789731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.790366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.891296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:32.895945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:32.909255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.915414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.916163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.917144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.917817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.918478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.181034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:33.244006 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e3b879b-ba0f-4ee1-bda4-6449d030d590 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1304 microversion: 2.1 time: 0.361652 Nov 02 12:37:33.250562 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1708/3412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:32 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1304 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:33.281564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:33.283174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] [instance: 4d093add-0a0f-44b6-b83f-f461c5488003] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:33.294389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.295511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.300203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.301641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.303447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.304899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.354311 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] HTTP exception thrown: Instance 4d093add-0a0f-44b6-b83f-f461c5488003 could not be found. Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Request method failure captured: Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 HTTP/1.1 Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmOGX97LoMdGlDjOTO-vQDmFXKB35aKQQc4mg-8cDqbFMny03mdiERgyoBh4SG0TJCEsIwCtqravfzH8lH87BYfU4-dSvXnqBGuLpar-nfiR5ypmWD3uf9jlSfucxC3anF3hVZsS3Eqsw2DpuAKma4K1fQNu2ToS7nhQGyLW4F21lcw Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 60b7340637d745b5875c43f1589869ea Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-VolumesAdminNegativeTest-1906843019 Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60b7340637d745b5875c43f1589869ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60b7340637d745b5875c43f1589869ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60b7340637d745b5875c43f1589869ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60b7340637d745b5875c43f1589869ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-VolumesAdminNegativeTest-1906843019 Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 60b7340637d745b5875c43f1589869ea Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1906843019 Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-VolumesAdminNegativeTest-1906843019-project Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5446fad0c7a74bfd936b34867a943bfa Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-VolumesAdminNegativeTest-1906843019-project Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 4d093add-0a0f-44b6-b83f-f461c5488003 could not be found. Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '4d093add-0a0f-44b6-b83f-f461c5488003'} Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d093add-0a0f-44b6-b83f-f461c5488003 could not be found. Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d093add-0a0f-44b6-b83f-f461c5488003 could not be found. Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:33.359682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:33.366879 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:33.366879 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:33.366879 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:33.366879 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:33.366879 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:33.366879 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d093add-0a0f-44b6-b83f-f461c5488003 could not be found. Nov 02 12:37:33.366879 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:33.370324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Returning 404 to user: Instance 4d093add-0a0f-44b6-b83f-f461c5488003 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:33.371552 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e322d84-258f-471d-a6f2-9499b60c3e2a tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003" status: 404 len: 111 microversion: 2.1 time: 0.109688 Nov 02 12:37:33.376419 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1709/3413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:33 2022] GET /compute/v2.1/servers/4d093add-0a0f-44b6-b83f-f461c5488003 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:33.384966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b203985f-6581-4c0a-bd09-8a2db7a836c2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] Calling method '.version_select at 0x7f228e992670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:33.416866 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b203985f-6581-4c0a-bd09-8a2db7a836c2 tempest-VolumesAdminNegativeTest-1906843019 tempest-VolumesAdminNegativeTest-1906843019-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971258558" status: 202 len: 0 microversion: 2.1 time: 0.038303 Nov 02 12:37:33.421566 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1710/3414] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971258558 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:37:33.524547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:33.544691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c201fc98-543a-433c-832e-108e69c35b78 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 0.799231 Nov 02 12:37:33.567731 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1705/3415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:32 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:33.810790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:33.817829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:33.834723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.855349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.857391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.860009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.862688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.864382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.875041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3cc7d11c-a2a1-4d55-82dd-b807d64cfa50 req-9ad7fdb9-eae4-4b4d-9bbe-1e26dcd1b632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3385330-4644-4f56-a4ab-2e2c3b617ce1", "name": "network-vif-plugged", "status": "completed", "tag": "533513ee-b7a3-4462-89a7-a06deab93dc9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:33.916261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3cc7d11c-a2a1-4d55-82dd-b807d64cfa50 req-9ad7fdb9-eae4-4b4d-9bbe-1e26dcd1b632 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.924716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3cc7d11c-a2a1-4d55-82dd-b807d64cfa50 req-9ad7fdb9-eae4-4b4d-9bbe-1e26dcd1b632 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.926090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3cc7d11c-a2a1-4d55-82dd-b807d64cfa50 req-9ad7fdb9-eae4-4b4d-9bbe-1e26dcd1b632 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.987472 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3cc7d11c-a2a1-4d55-82dd-b807d64cfa50 req-9ad7fdb9-eae4-4b4d-9bbe-1e26dcd1b632 service nova] Creating event network-vif-plugged:533513ee-b7a3-4462-89a7-a06deab93dc9 for instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 on n-h2-855650-5 Nov 02 12:37:34.010531 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3cc7d11c-a2a1-4d55-82dd-b807d64cfa50 req-9ad7fdb9-eae4-4b4d-9bbe-1e26dcd1b632 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143994 Nov 02 12:37:34.016439 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1706/3416] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:34.328778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:34.347172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:34.369633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.370923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.372585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.375236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.376608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.378367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.652336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:34.675710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1a4a0b5-8fa4-442d-a8cc-8e1066f0a2b1 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1304 microversion: 2.1 time: 0.383811 Nov 02 12:37:34.677578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1707/3417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:34 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1304 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:34.689949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-265ef50d-6f49-4261-8034-18fd6d8edfb8 req-07d8bbda-4789-4293-a32b-fbbb4b18cc21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "613fc845-dfd6-49ca-b8ff-9c4cebce08d3", "tag": "3b2f7ed6-5126-4ecd-b492-e1ce16b886eb"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:34.729132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-265ef50d-6f49-4261-8034-18fd6d8edfb8 req-07d8bbda-4789-4293-a32b-fbbb4b18cc21 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.730969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-265ef50d-6f49-4261-8034-18fd6d8edfb8 req-07d8bbda-4789-4293-a32b-fbbb4b18cc21 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.733015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-265ef50d-6f49-4261-8034-18fd6d8edfb8 req-07d8bbda-4789-4293-a32b-fbbb4b18cc21 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.760496 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-265ef50d-6f49-4261-8034-18fd6d8edfb8 req-07d8bbda-4789-4293-a32b-fbbb4b18cc21 service nova] Creating event network-changed:3b2f7ed6-5126-4ecd-b492-e1ce16b886eb for instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 on n-h1-855650-5 Nov 02 12:37:34.770705 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-265ef50d-6f49-4261-8034-18fd6d8edfb8 req-07d8bbda-4789-4293-a32b-fbbb4b18cc21 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089824 Nov 02 12:37:34.772938 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1708/3418] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:34.784435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:34.786655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:34.801084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.803282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.804808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.806679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.808405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.810109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.810639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:34.827014 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e67a489-8a43-4d1b-997c-7b013d282362 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1292 microversion: 2.1 time: 1.024384 Nov 02 12:37:34.827631 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1711/3419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:33 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1292 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:35.741037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:35.741735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:35.759954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:35.763749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:35.765193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:35.770885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:35.771811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:35.772753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:36.046189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:36.062953 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-237bf9dc-0c78-421f-a131-430657f71f81 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1304 microversion: 2.1 time: 0.325891 Nov 02 12:37:36.063978 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1712/3420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:35 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1304 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:36.103846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:36.107783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:36.114608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:36.126336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:36.128003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:36.129193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:36.132436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:36.133784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:36.134853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:36.147602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:36.151300 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b89ccf51-e2d6-49f4-8299-fe23dad87a8f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 1.375880 Nov 02 12:37:36.154274 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1709/3421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:34 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:36.741893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:36.755903 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6cd409c5-4624-450d-9775-b9be3518b8d9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1292 microversion: 2.1 time: 0.671456 Nov 02 12:37:36.763849 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1713/3422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:36 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1292 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:37.113987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:37.115513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:37.156941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.159173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.160449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.163212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.165199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.167014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.181192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:37.182021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:37.203788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.204680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.205303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.206246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.206912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.207535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.242595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:37.309940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=22 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:37.874371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:37.897255 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eff7f0a1-34dd-48ed-8d8e-0ddc3c8f7ece tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 0.796977 Nov 02 12:37:37.897899 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1710/3423] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:37 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:37.903935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:37.904914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:37.906162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:37.912865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.913635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.914340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.915433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.916091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.916705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.920064 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98e561a0-4819-4437-a8dd-30c6401924f8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 0.742603 Nov 02 12:37:37.921278 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1714/3424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:37 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:38.157704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:38.177352 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aae71650-5170-4671-85ac-1a2c86acbda8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1472 microversion: 2.1 time: 0.277297 Nov 02 12:37:38.178496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1711/3425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:37 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:38.541103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-645304497", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:38.640368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] validate_networks() for [('3df2b834-542d-4af7-a2f7-6a848f5dc1f3', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:38.929741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:38.931440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:38.960491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:38.961006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:38.961942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:38.963519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:38.964217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:38.964839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:39.922670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:39.956321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d300a038-d282-4034-af8f-db6a0151c67b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 1.033586 Nov 02 12:37:39.972994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1712/3426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:38 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:39.998449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:40.006044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:40.039999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.041673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.042896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.052668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.060546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.062337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.005913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:41.021260 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d67196e3-90fd-4b8b-83a8-be850972f163 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 1.043223 Nov 02 12:37:41.023745 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1713/3427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:39 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:41.038326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:41.040561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:41.059917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.062689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.065319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.070266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.071850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.077206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.463988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:41.465159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:41.466546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:41.467204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:41.468638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:41.484503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.485007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.496135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.497367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.498095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.500035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.558569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:41.572342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:41.616185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:41.619563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 15965c79-c4ac-4da3-9eba-a0ba3775fe1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:41.740062 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cca2ddf9-b0b8-4d0d-9d85-a8a26f0e6a96 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.205347 Nov 02 12:37:41.749690 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1715/3428] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:41.757325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9fe10dc8-efea-4dac-9dca-3ccc6c8c20e7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:41.758272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9fe10dc8-efea-4dac-9dca-3ccc6c8c20e7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 15965c79-c4ac-4da3-9eba-a0ba3775fe1c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:41.767775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:41.806793 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b001098-436b-4196-9943-ee8cbfb96fc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 0.779119 Nov 02 12:37:41.807860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1714/3429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:41 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:41.838853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9fe10dc8-efea-4dac-9dca-3ccc6c8c20e7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 15965c79-c4ac-4da3-9eba-a0ba3775fe1c] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:42.056232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:42.057392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:42.091918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.095013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.098271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.102424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.105374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.109415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.125626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:42.701806 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9fe10dc8-efea-4dac-9dca-3ccc6c8c20e7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c" status: 204 len: 0 microversion: 2.1 time: 0.949786 Nov 02 12:37:42.705410 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1716/3430] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:41 2022] DELETE /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c => generated 0 bytes in 955 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:42.728612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e320030-2358-4b2a-8fb2-d357b0082695 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:42.738916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4e320030-2358-4b2a-8fb2-d357b0082695 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 15965c79-c4ac-4da3-9eba-a0ba3775fe1c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:42.842035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-4e320030-2358-4b2a-8fb2-d357b0082695 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e320030-2358-4b2a-8fb2-d357b0082695 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c HTTP/1.1 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '15965c79-c4ac-4da3-9eba-a0ba3775fe1c'} Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:42.865338 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:37:42.876488 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:37:42.884841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e320030-2358-4b2a-8fb2-d357b0082695 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:42.884841 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4e320030-2358-4b2a-8fb2-d357b0082695 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c" status: 404 len: 111 microversion: 2.1 time: 0.171834 Nov 02 12:37:42.885854 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1717/3431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:42 2022] GET /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:42.900602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:42.906694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:42.941818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.943554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.945234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.947610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.948837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.951977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.137116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:43.155977 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7eea9161-70e8-4303-9e78-79195c2646b0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 1.108020 Nov 02 12:37:43.170862 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1715/3432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:42 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:43.181053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-559407367", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "3df2b834-542d-4af7-a2f7-6a848f5dc1f3"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:43.378481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] validate_networks() for [('3df2b834-542d-4af7-a2f7-6a848f5dc1f3', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:43.481044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:43.501365 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-40a97b71-eeff-46fe-b603-e53f985bcc43 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 0.613210 Nov 02 12:37:43.502430 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1718/3433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:42 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:44.201175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:44.202897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:44.213664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:44.214640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:44.215674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:44.216790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:44.217573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:44.218315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.078200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:45.108532 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-22bad120-478a-4c8e-a03a-ee45eeaa8a11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 0.922508 Nov 02 12:37:45.110135 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1719/3434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:44 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:45.121339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:45.122595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:45.132026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.133021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.133874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.134952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.135965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.136720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.195732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:45.198380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:45.202250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:45.203465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:45.204970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:45.226402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.227846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.229003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.230904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.233005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.234192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.285731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:45.300746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:45.373493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:45.377946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:45.476797 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f5cf560-3bee-4590-937e-e191528fb1a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.301902 Nov 02 12:37:45.479473 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1716/3435] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:45.500797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be65e5e6-458a-4e77-9d92-5929a0f3da45 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:45.502270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be65e5e6-458a-4e77-9d92-5929a0f3da45 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:45.523344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:45.540767 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba3dee03-a765-4c1b-9a2b-049da7fcf460 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 0.428665 Nov 02 12:37:45.545459 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1720/3436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:45 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:45.566214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-74986ac1-1f8a-46a3-b1c6-7fa0b38bff53 req-04b146e6-febb-4d53-a968-4fa89fb31d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613fc845-dfd6-49ca-b8ff-9c4cebce08d3", "name": "network-vif-plugged", "status": "completed", "tag": "3b2f7ed6-5126-4ecd-b492-e1ce16b886eb"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:45.594914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-74986ac1-1f8a-46a3-b1c6-7fa0b38bff53 req-04b146e6-febb-4d53-a968-4fa89fb31d01 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.595525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-74986ac1-1f8a-46a3-b1c6-7fa0b38bff53 req-04b146e6-febb-4d53-a968-4fa89fb31d01 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.596561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-74986ac1-1f8a-46a3-b1c6-7fa0b38bff53 req-04b146e6-febb-4d53-a968-4fa89fb31d01 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.615819 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-74986ac1-1f8a-46a3-b1c6-7fa0b38bff53 req-04b146e6-febb-4d53-a968-4fa89fb31d01 service nova] Creating event network-vif-plugged:3b2f7ed6-5126-4ecd-b492-e1ce16b886eb for instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 on n-h1-855650-5 Nov 02 12:37:45.625526 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-74986ac1-1f8a-46a3-b1c6-7fa0b38bff53 req-04b146e6-febb-4d53-a968-4fa89fb31d01 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078327 Nov 02 12:37:45.627492 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1721/3437] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:45.635631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-42a4ddc2-b228-4bdb-99d4-845637623484 req-2a832871-f830-44c3-87c8-0cdc20a6e86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170451bf-340f-489f-87d4-4fda741d2b9f", "tag": "ada2ad3a-0f3a-4cfe-a928-0307223c9de6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:45.649466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-42a4ddc2-b228-4bdb-99d4-845637623484 req-2a832871-f830-44c3-87c8-0cdc20a6e86e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.650077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-42a4ddc2-b228-4bdb-99d4-845637623484 req-2a832871-f830-44c3-87c8-0cdc20a6e86e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.650603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-42a4ddc2-b228-4bdb-99d4-845637623484 req-2a832871-f830-44c3-87c8-0cdc20a6e86e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.671631 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-42a4ddc2-b228-4bdb-99d4-845637623484 req-2a832871-f830-44c3-87c8-0cdc20a6e86e service nova] Creating event network-changed:ada2ad3a-0f3a-4cfe-a928-0307223c9de6 for instance 170451bf-340f-489f-87d4-4fda741d2b9f on n-h1-855650-5 Nov 02 12:37:45.680053 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-42a4ddc2-b228-4bdb-99d4-845637623484 req-2a832871-f830-44c3-87c8-0cdc20a6e86e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050034 Nov 02 12:37:45.681504 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1722/3438] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:45.784381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-be65e5e6-458a-4e77-9d92-5929a0f3da45 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:45.798037 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be65e5e6-458a-4e77-9d92-5929a0f3da45 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1220 microversion: 2.1 time: 0.304381 Nov 02 12:37:45.798971 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1717/3439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:45 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1220 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:46.165286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:46.166013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:46.202243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.202754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.203208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.203951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.205523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.205523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.591870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:46.592876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:46.621434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.622053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.622522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.623311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.623835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.624272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.981670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:47.009500 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e0930b9-dc6f-4fbc-b431-6c3710aff131 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1308 microversion: 2.1 time: 0.858701 Nov 02 12:37:47.009500 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1723/3440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:46 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1308 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:47.046720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:47.047445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:47.092822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.094009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.094677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.095468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.100396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.101176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.356444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:47.372145 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-86167dfb-b4de-406c-b5a1-110f01bf09be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1224 microversion: 2.1 time: 0.331619 Nov 02 12:37:47.381396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:47.390023 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1724/3441] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:47 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1224 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:47.431198 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-21a430ae-4b60-47a6-9bce-dbe28a2e97fc tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 0.841899 Nov 02 12:37:47.438632 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1718/3442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:46 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:48.043545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:48.049484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:48.091334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.099354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.101790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.103856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.107555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.109114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.407409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:48.414362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:48.467096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.478166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.479911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.484629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.486064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.487172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.967747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:48.989653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d484021-87a7-4d85-bf93-295bb9c64139 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1280 microversion: 2.1 time: 0.595985 Nov 02 12:37:48.990458 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1719/3443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:48 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1280 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:48.995983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:48.997433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:49.012748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.017380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.018087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.019060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.020369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.023988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.157452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:50.183436 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-80065dda-e088-4f33-b0fd-0197f6531635 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1489 microversion: 2.1 time: 2.150112 Nov 02 12:37:50.186889 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1725/3444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:48 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1489 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:50.205892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:50.205892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:50.221431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.221954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.222449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.223355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.223916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.224628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.430991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:50.450594 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67ef118e-fa16-474c-8fa1-4e29d5d76cd7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 1.457805 Nov 02 12:37:50.452874 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1720/3445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:48 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:50.459332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-faa664e6-39f2-42ba-ba29-9ce44bec0c94 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:50.482508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faa664e6-39f2-42ba-ba29-9ce44bec0c94 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.490653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faa664e6-39f2-42ba-ba29-9ce44bec0c94 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.491635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-faa664e6-39f2-42ba-ba29-9ce44bec0c94 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.571719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:50.589395 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-27fb74b0-0f91-4c7b-9ac2-c555546a9545 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1278 microversion: 2.1 time: 0.400244 Nov 02 12:37:50.602416 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1726/3446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:50 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1278 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:50.703528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-faa664e6-39f2-42ba-ba29-9ce44bec0c94 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Going to try to stop instance {{(pid=120722) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:37:50.833719 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-faa664e6-39f2-42ba-ba29-9ce44bec0c94 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3/action" status: 202 len: 0 microversion: 2.1 time: 0.378146 Nov 02 12:37:50.835105 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1721/3447] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:37:50 2022] POST /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:37:50.845348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:50.846005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:50.871873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.872394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.872941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.873831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.874347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.874792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.511196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:51.516230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:51.521226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:51.550361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:51.553578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:51.555129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.556967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:51.564078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:51.565535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.945109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:53.047006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:53.059221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d50d9f73-74f5-4275-9577-590d547aa5b5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 2.216223 Nov 02 12:37:53.060682 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1727/3448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:50 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:53.068502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:53.069379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:53.079705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:53.080486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:53.081127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:53.082295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:53.082978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:53.085399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:53.367639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:53.383578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:53.394825 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c62dc579-5041-4004-863f-0c29711c855b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1278 microversion: 2.1 time: 0.332105 Nov 02 12:37:53.412018 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1728/3449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:53 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1278 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:53.418696 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f96f026-3057-429b-99c4-62cdce0bc7c2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 1.902356 Nov 02 12:37:53.419769 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1722/3450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:51 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:54.133233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:54.142255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:54.177129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.180452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.186690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.189004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.193724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.194586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.426693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:54.431609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:54.479642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.487055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.495516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.498632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.503794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.505224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.262538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:55.423171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:55.457341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-da7500db-6a8c-4e25-9c04-6b196b57db9e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 1.356643 Nov 02 12:37:55.460382 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1729/3451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:54 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:55.472558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:55.474300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:55.511923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:55.512954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:55.515049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.526188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:55.535405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:55.536759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.771276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:55.794137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:55.812248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-501371d4-3c5a-4f87-8e60-9083eeb8de21 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 1.391320 Nov 02 12:37:55.817934 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1723/3452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:54 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:56.509195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:56.510401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:56.537153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.538145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.540192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.542403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.543767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.548297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.638497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:56.661499 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-264dceb4-6168-417b-afe7-6707237d6e34 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 1.198402 Nov 02 12:37:56.663508 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1730/3453] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:55 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:56.851871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:56.854531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:56.878772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.880035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.880817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.888622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.889606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.890460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:57.598416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:57.619777 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8dfea924-7776-42de-b02b-3fa783b34420 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 0.776247 Nov 02 12:37:57.621797 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1731/3454] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:56 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:57.645873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:57.660814 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-975196eb-e4fb-46a7-b5f4-f39fbd2d27a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 1.162348 Nov 02 12:37:57.674773 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1724/3455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:56 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:57.716166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:57.753438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-dec2c22d-57aa-437a-8a6c-88ae4a9e668f req-c0f18770-0261-4a5c-aa6c-fa36f8768ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170451bf-340f-489f-87d4-4fda741d2b9f", "name": "network-vif-plugged", "status": "completed", "tag": "ada2ad3a-0f3a-4cfe-a928-0307223c9de6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:57.755514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:57.769864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:57.776502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:57.778094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:57.779636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:57.780340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:57.783804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:57.791604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dec2c22d-57aa-437a-8a6c-88ae4a9e668f req-c0f18770-0261-4a5c-aa6c-fa36f8768ae7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:57.793853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dec2c22d-57aa-437a-8a6c-88ae4a9e668f req-c0f18770-0261-4a5c-aa6c-fa36f8768ae7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:57.795027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dec2c22d-57aa-437a-8a6c-88ae4a9e668f req-c0f18770-0261-4a5c-aa6c-fa36f8768ae7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:57.824766 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-dec2c22d-57aa-437a-8a6c-88ae4a9e668f req-c0f18770-0261-4a5c-aa6c-fa36f8768ae7 service nova] Creating event network-vif-plugged:ada2ad3a-0f3a-4cfe-a928-0307223c9de6 for instance 170451bf-340f-489f-87d4-4fda741d2b9f on n-h1-855650-5 Nov 02 12:37:57.842418 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-dec2c22d-57aa-437a-8a6c-88ae4a9e668f req-c0f18770-0261-4a5c-aa6c-fa36f8768ae7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117379 Nov 02 12:37:57.844778 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1725/3456] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:58.651572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:58.653808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:58.671187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:58.671861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:58.672785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:58.673811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:58.674419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:58.675494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:59.629588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:59.649220 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e64be522-d765-49b6-8640-95bba779cf7a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1372 microversion: 2.1 time: 1.949073 Nov 02 12:37:59.661394 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1732/3457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:57 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1372 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:59.683315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:59.691228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:59.701581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:59.702100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:59.702561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:59.703305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:59.703771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:59.705127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:00.030999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:00.047046 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d8d82160-c296-4dda-9dd4-d4270af833c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 1.403604 Nov 02 12:38:00.049186 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1726/3458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:58 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:00.595381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:00.602531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:00.617123 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-77a9827b-aa43-4006-aab8-5f9101541096 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.952615 Nov 02 12:38:00.618386 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1733/3459] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:59 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:00.677106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:00.678012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:00.681355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:00.698443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:00.699848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:00.700304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:00.701278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:00.701834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:00.702377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.096380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:01.097507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:01.117847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.119956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.121677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.123359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.124989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.125820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.451958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:01.467698 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d30a5c80-cde0-4f05-ac29-094aeb57eea9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1567 microversion: 2.1 time: 0.794693 Nov 02 12:38:01.486551 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1727/3460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:00 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1567 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:01.506130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:01.506854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:01.519752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.527690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.528842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.529942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.530915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.532313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.964356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:01.979700 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1b01605-24a0-4f97-82c6-2079a6445800 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 0.889265 Nov 02 12:38:01.990069 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1734/3461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:01 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:01.998975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:02.000266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:02.009289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:02.010856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:02.012267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:02.013434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:02.014277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:02.015048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:02.064302 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18d4b1be-0f5c-43d2-9ae4-7254dd769a22 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.566908 Nov 02 12:38:02.084537 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1728/3462] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:38:01 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-interface => generated 285 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:02.297902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1245178632", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a20add55-dae0-40be-a4a7-4b9397826fb8"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:02.460580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] validate_networks() for [('a20add55-dae0-40be-a4a7-4b9397826fb8', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:02.925407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:02.939433 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4089ff1e-6caf-4a28-9e85-a96e5f3f5cd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.946515 Nov 02 12:38:02.955953 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1735/3463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:01 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:02.968734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-bc56061c-f12c-4541-b740-74aa82483215 req-0fc0d8a7-8511-48ec-8b82-d4c78d3ecabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38de7e0e-7703-4ae0-81ac-5b1b8a2319e1", "tag": "f8ed8440-f72d-40a3-b856-d3bae4a63f0a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:02.978696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:02.982861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bc56061c-f12c-4541-b740-74aa82483215 req-0fc0d8a7-8511-48ec-8b82-d4c78d3ecabe service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:02.983659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bc56061c-f12c-4541-b740-74aa82483215 req-0fc0d8a7-8511-48ec-8b82-d4c78d3ecabe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:02.984309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bc56061c-f12c-4541-b740-74aa82483215 req-0fc0d8a7-8511-48ec-8b82-d4c78d3ecabe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:03.004517 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-bc56061c-f12c-4541-b740-74aa82483215 req-0fc0d8a7-8511-48ec-8b82-d4c78d3ecabe service nova] Creating event network-changed:f8ed8440-f72d-40a3-b856-d3bae4a63f0a for instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 on n-h2-855650-5 Nov 02 12:38:03.012598 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-bc56061c-f12c-4541-b740-74aa82483215 req-0fc0d8a7-8511-48ec-8b82-d4c78d3ecabe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054832 Nov 02 12:38:03.014009 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1736/3464] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:03.022793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:03.024795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:03.033936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:03.035849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:03.036582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:03.037531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:03.038217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:03.038820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:04.302445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:04.317766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-339c8016-b1a5-4f33-980c-d8dea0056b31 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 1.300804 Nov 02 12:38:04.319802 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1737/3465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:03 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:04.358022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1dceee11-2347-45c4-9719-85390803ebc0 req-3fb3b955-577a-45cf-a5a0-b90b39de3f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170451bf-340f-489f-87d4-4fda741d2b9f", "tag": "ada2ad3a-0f3a-4cfe-a928-0307223c9de6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:04.373432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1dceee11-2347-45c4-9719-85390803ebc0 req-3fb3b955-577a-45cf-a5a0-b90b39de3f41 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:04.374443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1dceee11-2347-45c4-9719-85390803ebc0 req-3fb3b955-577a-45cf-a5a0-b90b39de3f41 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:04.375438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1dceee11-2347-45c4-9719-85390803ebc0 req-3fb3b955-577a-45cf-a5a0-b90b39de3f41 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:04.390301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1dceee11-2347-45c4-9719-85390803ebc0 req-3fb3b955-577a-45cf-a5a0-b90b39de3f41 service nova] Creating event network-changed:ada2ad3a-0f3a-4cfe-a928-0307223c9de6 for instance 170451bf-340f-489f-87d4-4fda741d2b9f on n-h1-855650-5 Nov 02 12:38:04.410723 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1dceee11-2347-45c4-9719-85390803ebc0 req-3fb3b955-577a-45cf-a5a0-b90b39de3f41 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079061 Nov 02 12:38:04.412234 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1738/3466] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:04.421682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:04.422902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:04.436414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:04.437352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:04.439724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:04.442331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:04.443360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:04.443821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:04.954761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:04.985151 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-057a76de-8bb6-41e5-a8c2-f2fb69faccc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.570930 Nov 02 12:38:04.995953 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1739/3467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:04 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:05.152786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-10c2b062-6a14-4f64-8bc0-6ce22af97c61 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Action: 'create', calling method: .version_select at 0x7f228e293f70>, body: {"keypair": {"name": "tempest-keypair-171444088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjNsEIOjc0iC9wopCnp8RU8P9h1PwyinIGPN6eDyFASvnTTiou3Qo6vrN8VGhjnN1kBRJK6P3/DJEouUaCG5PyRnF8nBjdePTmLCXmwgaNmlOag3ZzCAGku4eUaViFdUg=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:05.272147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-10c2b062-6a14-4f64-8bc0-6ce22af97c61 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Getting quotas for project 4ecbaf8bc88240719b2c57ea95fa869c. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:05.314665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-10c2b062-6a14-4f64-8bc0-6ce22af97c61 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Getting quotas for user 5427bc37ece54ae99b22d68a328b800a and project 4ecbaf8bc88240719b2c57ea95fa869c. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:05.414624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-10c2b062-6a14-4f64-8bc0-6ce22af97c61 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.416204 Nov 02 12:38:05.415789 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1740/3468] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:38:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:05.437286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:05.441219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:05.471981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:05.474453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:05.476948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:05.482342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:05.484647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:05.486122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.315169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:06.329660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:06.331139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:06.331897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:06.332628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:06.333559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:06.354845 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2bd3888d-0a9d-4fcc-b81d-88a9e95130ba tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 0.933647 Nov 02 12:38:06.359728 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1741/3469] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:05 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:06.375127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:06.378244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:06.381089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.382466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:06.385747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:06.386924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:06.394869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:06.397679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.426800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:06.431764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:06.433093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.437235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:06.437935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:06.442868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:06.445954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.458996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for user 6488e600776547958e00ab146f079c46 and project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:06.495902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:06.506864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:06.649659 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d04714e3-fe62-4740-be52-f7e599dcefa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.563701 Nov 02 12:38:06.650836 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1729/3470] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:06.670019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef90c007-f184-44b8-9a23-7ec7df55a569 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:06.671142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef90c007-f184-44b8-9a23-7ec7df55a569 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:07.103091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef90c007-f184-44b8-9a23-7ec7df55a569 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:07.117032 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef90c007-f184-44b8-9a23-7ec7df55a569 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1215 microversion: 2.1 time: 0.454098 Nov 02 12:38:07.118492 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1730/3471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:06 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1215 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:07.342706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:07.358131 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57f77d42-06d9-4cf5-ba3f-742c18c3ecea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.995060 Nov 02 12:38:07.360060 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1742/3472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:06 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:07.402655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:07.403374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:07.422901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:07.423406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:07.424475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:07.425361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:07.425790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:07.426325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:07.907197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:07.936811 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-827ed8bf-6fd4-470b-9a47-65fa5d4ee13a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 0.537513 Nov 02 12:38:07.939546 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1731/3473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:07 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:08.162352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:08.163438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:08.176640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:08.177944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:08.179939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:08.181709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:08.184857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:08.186887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:08.377563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:08.402611 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c4b13fce-ba8a-49bd-a06b-27e58aee2bfa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1219 microversion: 2.1 time: 0.242880 Nov 02 12:38:08.421314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:08.421314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:08.422667 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1743/3474] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:08 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1219 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:08.438427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:08.445260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:08.451308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:08.457772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:08.461890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:08.464751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:08.985707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:08.987690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:09.028035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:09.035839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:09.037500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:09.039671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:09.041317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:09.042349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:09.102231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:09.123867 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95967bb8-6526-4495-9e96-52f6307bb437 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.717552 Nov 02 12:38:09.138179 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1732/3475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:08 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:09.455819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:09.456839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:09.477000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:09.477898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:09.478600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:09.479577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:09.486954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:09.487934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:10.365304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:10.386587 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ba35146-e9dd-41c0-ba7f-9eac7a5965c2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1267 microversion: 2.1 time: 0.934894 Nov 02 12:38:10.388195 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1733/3476] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:09 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1267 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:10.442599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:10.459815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:10.472970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:10.473995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:10.474699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:10.475711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:10.476456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:10.477151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:11.090599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:11.118321 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7541a66a-71a4-46a3-8fc5-18f9a0c77c30 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 2.139240 Nov 02 12:38:11.119200 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1744/3477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:08 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:11.426252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:11.427287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:11.467061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:11.468381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:11.471977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:11.481057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:11.482620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:11.483786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:11.740807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:11.769066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:11.785890 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32d8b239-5a6c-4512-ab64-3912c2fd65fa tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1273 microversion: 2.1 time: 0.370480 Nov 02 12:38:11.806217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cff5cdc-09fd-4cd8-b5c8-286a9b990e99 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 1.409003 Nov 02 12:38:11.806217 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1734/3478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:10 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:11.808830 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1745/3479] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:11 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:12.170435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:12.172714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:12.203242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.205524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.207640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.210194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.216365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.217845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.279977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:12.855715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:12.862585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:12.884312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.887031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.888303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.891764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.893010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.893771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:13.759075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:13.781246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11cad456-bfa1-422a-8623-4cb451a9de52 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 1.620907 Nov 02 12:38:13.798318 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1735/3480] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:12 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:13.798318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:13.801679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:13.822531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:13.825604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:13.826521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:13.829249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:13.835764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:13.836679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:13.939738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:13.977597 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-45ccb9d8-84f1-4e8a-a763-632699f4fe60 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 1.142691 Nov 02 12:38:14.025085 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1746/3481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:12 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:14.248624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:14.268687 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a901c4c-c26f-425f-9042-fe90b9bf66e5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.482492 Nov 02 12:38:14.269198 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1736/3482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:13 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:14.826753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-eabcf3e3-b242-421b-a4b2-d187eb30591d req-43ba90f9-2d1a-4932-a6cb-6aff2d7b3ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38de7e0e-7703-4ae0-81ac-5b1b8a2319e1", "name": "network-vif-plugged", "status": "completed", "tag": "f8ed8440-f72d-40a3-b856-d3bae4a63f0a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:14.828553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:14.829406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:14.848700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.849646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.851948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.864806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.865866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.868568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.877596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-eabcf3e3-b242-421b-a4b2-d187eb30591d req-43ba90f9-2d1a-4932-a6cb-6aff2d7b3ab0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.878889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-eabcf3e3-b242-421b-a4b2-d187eb30591d req-43ba90f9-2d1a-4932-a6cb-6aff2d7b3ab0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.880023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-eabcf3e3-b242-421b-a4b2-d187eb30591d req-43ba90f9-2d1a-4932-a6cb-6aff2d7b3ab0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.913077 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-eabcf3e3-b242-421b-a4b2-d187eb30591d req-43ba90f9-2d1a-4932-a6cb-6aff2d7b3ab0 service nova] Creating event network-vif-plugged:f8ed8440-f72d-40a3-b856-d3bae4a63f0a for instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 on n-h2-855650-5 Nov 02 12:38:14.929059 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-eabcf3e3-b242-421b-a4b2-d187eb30591d req-43ba90f9-2d1a-4932-a6cb-6aff2d7b3ab0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110677 Nov 02 12:38:14.931409 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1747/3483] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:15.032580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:15.041273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:15.065804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:15.066870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:15.067646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:15.068519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:15.069241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:15.069688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:15.359965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:15.431817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:15.521165 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-76a23fc6-18b7-48ed-b304-8bd5efbfcbe8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 0.692370 Nov 02 12:38:15.523766 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1737/3484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:14 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:15.574719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:15.578197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:15.621046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:15.623205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:15.623741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:15.628711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:15.628711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:15.629476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:15.670897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:15.686351 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c0f6334-4e40-4bc3-a11b-d3910509e50b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 0.658120 Nov 02 12:38:15.695196 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1748/3485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:15 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:16.032302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:16.052512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7be37324-fc52-47d6-932b-b7480cd997f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.522606 Nov 02 12:38:16.053659 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1738/3486] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:15 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:16.555792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:16.558646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:16.577373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:16.578437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:16.580041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:16.581562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:16.582331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:16.583148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:16.737150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:16.748542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:16.815668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:16.829798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:16.834698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:16.838408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:16.840197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:16.842914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:16.844264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.108750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:17.495762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:17.507889 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69e06c25-93b4-4eb0-be83-4faac852ea0c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1320 microversion: 2.1 time: 0.958791 Nov 02 12:38:17.509257 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1749/3487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:16 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1320 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:17.516903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:17.518019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:17.529715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:17.530756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:17.531551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.532549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:17.533677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:17.535767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.602382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:17.634694 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-28c8d73a-1f2d-436c-8aaa-5c61ad9f0c95 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 0.904979 Nov 02 12:38:17.637760 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1739/3488] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:16 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:17.648266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-17f9de18-7a88-4684-b444-a8e235c93f44 req-8f216f70-74cd-48ca-93ed-f81e2e8a9351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1477d20-d864-4f64-bbf6-9b90259d4305", "tag": "c23b663a-c9af-4544-b58d-43a8ac863765"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:17.674751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-17f9de18-7a88-4684-b444-a8e235c93f44 req-8f216f70-74cd-48ca-93ed-f81e2e8a9351 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:17.676194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-17f9de18-7a88-4684-b444-a8e235c93f44 req-8f216f70-74cd-48ca-93ed-f81e2e8a9351 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:17.677433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-17f9de18-7a88-4684-b444-a8e235c93f44 req-8f216f70-74cd-48ca-93ed-f81e2e8a9351 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.716367 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-17f9de18-7a88-4684-b444-a8e235c93f44 req-8f216f70-74cd-48ca-93ed-f81e2e8a9351 service nova] Creating event network-changed:c23b663a-c9af-4544-b58d-43a8ac863765 for instance a1477d20-d864-4f64-bbf6-9b90259d4305 on n-h2-855650-5 Nov 02 12:38:17.734200 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-17f9de18-7a88-4684-b444-a8e235c93f44 req-8f216f70-74cd-48ca-93ed-f81e2e8a9351 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093283 Nov 02 12:38:17.736962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1740/3489] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:18.046460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:18.072197 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-903ddab0-1730-4693-96fd-bb59fd943abd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.561535 Nov 02 12:38:18.087742 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1750/3490] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:17 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:18.544968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:18.546720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:18.568652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.570275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.571487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:18.574511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.593332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.595195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:18.667312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:18.668386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:18.698874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.700100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.702346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:18.703168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.703658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.709036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.192509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:19.193795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:19.204029 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7642feaf-a786-413c-b0f2-c408fec988b8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 0.541844 Nov 02 12:38:19.212853 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d17efc77-24ea-4bd9-8ef4-eeca12b623d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1501 microversion: 2.1 time: 0.677974 Nov 02 12:38:19.217473 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1751/3491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:18 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:19.230119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:19.231133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:19.232066 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1741/3492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:18 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1501 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:19.240689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.241500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.242197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.243487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.244260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.244914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.271558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:19.274548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:19.293576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.296696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.298062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.299945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.301290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.306023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.683117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:19.707071 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9c19fa66-6eb7-487e-bd6e-cc7d3438b9a1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.487765 Nov 02 12:38:19.708664 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1752/3493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:19 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:19.762457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:19.803584 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e2ae1ab-3e2e-456b-ae03-2912726da667 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1501 microversion: 2.1 time: 0.534323 Nov 02 12:38:19.818005 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1742/3494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:19 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1501 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:19.846791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:19.847246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:19.865440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.867375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.868556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.880046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.891576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.896566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.966701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:20.019494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:20.235482 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a355852-90f7-462e-aecd-8d9b1c5b8590 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 204 len: 0 microversion: 2.1 time: 0.392254 Nov 02 12:38:20.243025 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1753/3495] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:19 2022] DELETE /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:20.243258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:20.243258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:20.256958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:20.258051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:20.274467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.277992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.278831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.280192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.281054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.281453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.281826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.286224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.287653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.301373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.306802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.312547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:21.347123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:21.367278 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7012846a-2ba6-4847-9126-b24ad621dcb3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1507 microversion: 2.1 time: 1.123858 Nov 02 12:38:21.370586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1754/3496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:20 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1507 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:21.372977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:21.391582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:21.394930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:21.409700 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7606610b-1c81-4210-b6d7-fdf309efd967 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 1.168877 Nov 02 12:38:21.411658 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1743/3497] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:20 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:21.446572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:21.452530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:21.452530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:21.453352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:21.454373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:21.455199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.075577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:22.112948 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-11814171-e49f-435f-8df9-f3b693685a56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1499 microversion: 2.1 time: 0.737176 Nov 02 12:38:22.118769 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1755/3498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:21 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1499 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:22.419164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.420737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:22.443822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.444751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.445562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.458369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.459966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.461124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.469082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.470438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:22.491120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.491658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.492574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.494721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.496985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.503100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.260817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:23.279182 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b9f4cea-683a-41fd-b54e-b8a076be3bed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 0.824762 Nov 02 12:38:23.279799 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1756/3499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:23.285394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:23.286380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:23.309714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.310944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.313255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.322483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.323166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.323714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.410480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:23.431331 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e976abd1-024c-464b-8b15-f83199715518 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1507 microversion: 2.1 time: 1.030181 Nov 02 12:38:23.434669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1744/3500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1507 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:24.280257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:24.297707 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9911bfe9-4ae8-4ae5-bd05-4d23474334be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 200 len: 1476 microversion: 2.1 time: 1.016237 Nov 02 12:38:24.318520 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1757/3501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:23 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 1476 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:24.325378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:24.327517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:24.343356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.344913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.345920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-636789475"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:24.346504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.350619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.352197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.352409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:24.353616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.379906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.390188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.392688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.394358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.395491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.397269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.920141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:24.976026 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-666454ef-0915-4853-a5ee-7a97b089a460 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 0.658029 Nov 02 12:38:24.979033 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1745/3502] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:24 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:25.028342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:25.030767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:25.079824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.081171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.082367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.084615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.086046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.087096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.175029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.179136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.180773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.184879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lazy-loading 'fault' on Instance uuid 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:25.251864 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91a6adf5-32dd-4b13-b830-9541fe601390 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3/action" status: 202 len: 0 microversion: 2.1 time: 0.910060 Nov 02 12:38:25.258231 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1758/3503] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:38:24 2022] POST /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3/action => generated 0 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 02 12:38:25.284842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-958ab472-979a-47a5-83cc-97cf5f743a72 req-d2d574c8-b5df-468a-91b0-bb993c3eff82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38de7e0e-7703-4ae0-81ac-5b1b8a2319e1", "name": "network-vif-deleted", "tag": "f8ed8440-f72d-40a3-b856-d3bae4a63f0a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:25.321329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-958ab472-979a-47a5-83cc-97cf5f743a72 req-d2d574c8-b5df-468a-91b0-bb993c3eff82 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.322584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-958ab472-979a-47a5-83cc-97cf5f743a72 req-d2d574c8-b5df-468a-91b0-bb993c3eff82 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.323698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-958ab472-979a-47a5-83cc-97cf5f743a72 req-d2d574c8-b5df-468a-91b0-bb993c3eff82 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.381102 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-958ab472-979a-47a5-83cc-97cf5f743a72 req-d2d574c8-b5df-468a-91b0-bb993c3eff82 service nova] Creating event network-vif-deleted:f8ed8440-f72d-40a3-b856-d3bae4a63f0a for instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 on n-h2-855650-5 Nov 02 12:38:25.403818 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-958ab472-979a-47a5-83cc-97cf5f743a72 req-d2d574c8-b5df-468a-91b0-bb993c3eff82 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142920 Nov 02 12:38:25.408643 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1759/3504] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:25.473755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39dae69c-6dcc-4b13-acce-6bb593ca398a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f22929d8790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:25.525157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:25.550874 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-28459f1f-844b-4b7e-b379-8bf8dce9bb24 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 200 len: 1310 microversion: 2.1 time: 0.550939 Nov 02 12:38:25.551827 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1746/3505] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:24 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 1310 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:25.643992 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39dae69c-6dcc-4b13-acce-6bb593ca398a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.200876 Nov 02 12:38:25.652300 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1760/3506] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:25 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:26.020357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:26.021165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:26.031962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.039280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.044514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.045845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.046812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.050951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.073704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0bf922ec-2142-4ff6-a444-2f67a9f6c07f req-46929ea4-e76e-46b0-a0cc-adfb0e6b6f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1477d20-d864-4f64-bbf6-9b90259d4305", "name": "network-vif-plugged", "status": "completed", "tag": "c23b663a-c9af-4544-b58d-43a8ac863765"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:26.154359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0bf922ec-2142-4ff6-a444-2f67a9f6c07f req-46929ea4-e76e-46b0-a0cc-adfb0e6b6f18 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.155237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0bf922ec-2142-4ff6-a444-2f67a9f6c07f req-46929ea4-e76e-46b0-a0cc-adfb0e6b6f18 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.156012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0bf922ec-2142-4ff6-a444-2f67a9f6c07f req-46929ea4-e76e-46b0-a0cc-adfb0e6b6f18 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.213764 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0bf922ec-2142-4ff6-a444-2f67a9f6c07f req-46929ea4-e76e-46b0-a0cc-adfb0e6b6f18 service nova] Creating event network-vif-plugged:c23b663a-c9af-4544-b58d-43a8ac863765 for instance a1477d20-d864-4f64-bbf6-9b90259d4305 on n-h2-855650-5 Nov 02 12:38:26.232733 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0bf922ec-2142-4ff6-a444-2f67a9f6c07f req-46929ea4-e76e-46b0-a0cc-adfb0e6b6f18 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167869 Nov 02 12:38:26.233758 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1761/3507] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:26.605365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:26.659226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:26.690512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.691396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.692211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.709174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.711929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.712963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.759384 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 HTTP/1.1 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '38de7e0e-7703-4ae0-81ac-5b1b8a2319e1'} Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:26.765229 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6390284f-4416-4e82-9743-88c62fc29a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 404 len: 111 microversion: 2.1 time: 0.178526 Nov 02 12:38:26.774875 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1762/3508] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:26 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:38:26.794184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ee051736-83ba-48c2-aa40-be5af46714cc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f22929d80d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:26.959369 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ee051736-83ba-48c2-aa40-be5af46714cc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.182971 Nov 02 12:38:26.970221 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1763/3509] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:26 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:26.983732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-687ee373-4e30-4a7c-b870-acf6662c8ed9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: .version_select at 0x7f228edfa280>, body: {"keypair": {"name": "tempest-key-1777614474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzeFc6lk40/5VrkIGCDraiESyeDIqVz8q80e31lI9+S9Zd59vnGaPDSSd3aequLtMEgsi9KPdr7DP78K45+AerV7KlufgRDvxPFv87cvsgVUZj/eVdNhWqXSG8W6R9EuA=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:27.015265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:27.025475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-687ee373-4e30-4a7c-b870-acf6662c8ed9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:27.033190 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de4be631-23ca-4b44-82de-d847132288f7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 1.018153 Nov 02 12:38:27.034079 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1747/3510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:26 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:27.038664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-687ee373-4e30-4a7c-b870-acf6662c8ed9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:27.078237 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-687ee373-4e30-4a7c-b870-acf6662c8ed9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.114767 Nov 02 12:38:27.079320 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1764/3511] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:38:26 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:27.093129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1589443f-17ea-40dc-89dd-38517d9e491e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '.version_select at 0x7f228db3eca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:27.097488 n-d-855650-5 devstack@n-api.service[120722]: WARNING oslo_db.sqlalchemy.utils [None req-1589443f-17ea-40dc-89dd-38517d9e491e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:38:27.115753 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1589443f-17ea-40dc-89dd-38517d9e491e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.029667 Nov 02 12:38:27.126180 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1748/3512] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:38:27 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:27.495745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-147806520", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-key-1777614474", "networks": [{"uuid": "3df2b834-542d-4af7-a2f7-6a848f5dc1f3"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:27.637949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] validate_networks() for [('3df2b834-542d-4af7-a2f7-6a848f5dc1f3', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:27.990076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-97cb6813-9881-443c-ac21-8620222340a2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db66430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:28.160606 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-97cb6813-9881-443c-ac21-8620222340a2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.177827 Nov 02 12:38:28.193330 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1749/3513] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:27 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.210454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:28.212164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:28.227988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.230790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.232225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.234149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.236222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.240227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.227196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:29.288231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:29.289036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:29.289192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:29.289512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:29.290707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:29.292157 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3d5a6e9-89ac-4e90-9c6b-230aea8ea978 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1315 microversion: 2.1 time: 1.093133 Nov 02 12:38:29.295154 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1750/3514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:28 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1315 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:29.307733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa44c140-f4e7-4187-bb9c-e260d5e16fac tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db58790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:29.311492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.313476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.314724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.317541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.319531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.321755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.390522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:29.411566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:29.441488 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa44c140-f4e7-4187-bb9c-e260d5e16fac tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.136876 Nov 02 12:38:29.443510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:29.448544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:29.464417 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1751/3515] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:29.537310 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa783294-d3f4-4d2c-82f6-94ceae8f8eff tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.056639 Nov 02 12:38:29.539824 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1765/3516] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:29.560006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6daa6421-ee6b-45d6-8a62-17ee305c8f9c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:29.566249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6daa6421-ee6b-45d6-8a62-17ee305c8f9c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:29.708109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6daa6421-ee6b-45d6-8a62-17ee305c8f9c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:29.722592 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6daa6421-ee6b-45d6-8a62-17ee305c8f9c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1228 microversion: 2.1 time: 0.170960 Nov 02 12:38:29.724860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1752/3517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1228 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:30.337281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.339123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.359804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.361601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.363270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.366429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.371049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.372708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.466565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04f57994-360b-44c5-9b55-64ac4612401f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbb13a0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.594162 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04f57994-360b-44c5-9b55-64ac4612401f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.132184 Nov 02 12:38:30.597357 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1753/3518] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:30.768669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.773129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.789581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:30.840492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.843223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.846402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.848947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.853676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.855419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.219454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:31.243524 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de62f244-75e3-4f91-a9a0-e3d283b30d71 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1232 microversion: 2.1 time: 0.492676 Nov 02 12:38:31.250383 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1754/3519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1232 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:31.619307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-52195283-e363-4be5-85e7-df3f9e6c4b01 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f22929c7a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.637956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:31.705799 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58ec3181-264c-4e9e-bc62-77f9a9ab7dee tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1503 microversion: 2.1 time: 1.387715 Nov 02 12:38:31.723298 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1766/3520] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1503 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:31.743878 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-52195283-e363-4be5-85e7-df3f9e6c4b01 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.130977 Nov 02 12:38:31.783416 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1755/3521] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:31 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:31.789863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.791336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:31.797471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:31.828036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.833480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.834785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.838146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.841395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.843176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.907256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:32.183491 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-497b63d4-9fbf-4cd8-b7ba-3a9f9b23d7db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 204 len: 0 microversion: 2.1 time: 0.400190 Nov 02 12:38:32.189278 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1767/3522] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:31 2022] DELETE /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:32.195457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:32.196607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:32.206386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.207324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.208030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.209450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.211018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.211863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.283284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:32.284694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:32.316098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.318976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.327534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.329382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.330291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.331105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.701587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.728026 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8c05f25-cbca-4418-8d8a-d611122fd886 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1280 microversion: 2.1 time: 0.454043 Nov 02 12:38:32.738180 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1768/3523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:32 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1280 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:32.799819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ad523585-e0ef-47e6-994f-17ee3b7b60d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292a08280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:32.938760 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ad523585-e0ef-47e6-994f-17ee3b7b60d4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.143024 Nov 02 12:38:32.944172 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1769/3524] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:32 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:33.106762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:33.139016 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0178ee49-0ba6-4459-9e90-01d431b80b1e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1509 microversion: 2.1 time: 0.948105 Nov 02 12:38:33.140248 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1756/3525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:32 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1509 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:33.769955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:33.770958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:33.788619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.789809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.790795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.791856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.792973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.793803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.974376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be729445-534f-4ab5-be1d-7d337ce1a80d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbaee50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:33.981166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:33.994966 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a73388d5-6438-4696-be4d-0675d25495d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1286 microversion: 2.1 time: 0.232450 Nov 02 12:38:34.006043 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1770/3526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:33 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1286 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:34.150539 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be729445-534f-4ab5-be1d-7d337ce1a80d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.179794 Nov 02 12:38:34.165817 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1757/3527] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:33 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:34.169890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:34.172317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:34.228191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.231471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.235806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.240593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.243808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.249832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.911407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:34.942942 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a09f5b6a-0674-46b1-86d0-0c61fd97a439 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1509 microversion: 2.1 time: 0.780706 Nov 02 12:38:34.962889 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1771/3528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:34 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1509 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:35.035910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:35.036966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:35.048906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.049880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.050677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.051827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.053098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.054093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.179523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dfacedf6-6e93-41f9-b19a-8d80357ea141 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228eed7ca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:35.955088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:35.968846 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2fa894f8-31c1-4ddc-aa64-7683c1cd96bb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.939459 Nov 02 12:38:36.000756 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1758/3529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:35 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:36.021954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:36.023789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:36.053463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.055499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.056596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.058727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.061451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.066206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.074334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:36.273837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:36.290573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4897c5e1-aba5-47d8-a537-fe7dda8f92a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 200 len: 1467 microversion: 2.1 time: 0.287978 Nov 02 12:38:36.299536 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1759/3530] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:36 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 1467 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:36.309850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-cea2d1b5-3aa7-4b97-8a06-728ce6b48ab8 req-b589673d-f60b-42c0-bc24-b8bf17e8fcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613fc845-dfd6-49ca-b8ff-9c4cebce08d3", "name": "network-vif-plugged", "status": "completed", "tag": "3b2f7ed6-5126-4ecd-b492-e1ce16b886eb"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:36.354271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cea2d1b5-3aa7-4b97-8a06-728ce6b48ab8 req-b589673d-f60b-42c0-bc24-b8bf17e8fcbb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.362834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cea2d1b5-3aa7-4b97-8a06-728ce6b48ab8 req-b589673d-f60b-42c0-bc24-b8bf17e8fcbb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.364984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cea2d1b5-3aa7-4b97-8a06-728ce6b48ab8 req-b589673d-f60b-42c0-bc24-b8bf17e8fcbb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.397593 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-cea2d1b5-3aa7-4b97-8a06-728ce6b48ab8 req-b589673d-f60b-42c0-bc24-b8bf17e8fcbb service nova] Creating event network-vif-plugged:3b2f7ed6-5126-4ecd-b492-e1ce16b886eb for instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 on n-h1-855650-5 Nov 02 12:38:36.419224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-cea2d1b5-3aa7-4b97-8a06-728ce6b48ab8 req-b589673d-f60b-42c0-bc24-b8bf17e8fcbb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114505 Nov 02 12:38:36.424466 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1760/3531] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:37.015964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:37.022840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:37.061387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:37.062586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:37.063950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:37.065594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:37.067060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:37.068110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:37.947644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:37.967495 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95f197d2-25e6-4064-a27e-aa08cb9b0cd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.965492 Nov 02 12:38:37.979589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1761/3532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:36 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:38.011270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c2fd74d3-9fb9-4443-80e1-fc37ce3ebe2d req-fda2d675-bdad-4a1b-a27f-795c2c548bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1477d20-d864-4f64-bbf6-9b90259d4305", "name": "network-vif-deleted", "tag": "c23b663a-c9af-4544-b58d-43a8ac863765"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:38.059468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c2fd74d3-9fb9-4443-80e1-fc37ce3ebe2d req-fda2d675-bdad-4a1b-a27f-795c2c548bcb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.060171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c2fd74d3-9fb9-4443-80e1-fc37ce3ebe2d req-fda2d675-bdad-4a1b-a27f-795c2c548bcb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.060419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c2fd74d3-9fb9-4443-80e1-fc37ce3ebe2d req-fda2d675-bdad-4a1b-a27f-795c2c548bcb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.113262 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c2fd74d3-9fb9-4443-80e1-fc37ce3ebe2d req-fda2d675-bdad-4a1b-a27f-795c2c548bcb service nova] Creating event network-vif-deleted:c23b663a-c9af-4544-b58d-43a8ac863765 for instance a1477d20-d864-4f64-bbf6-9b90259d4305 on n-h2-855650-5 Nov 02 12:38:38.129507 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c2fd74d3-9fb9-4443-80e1-fc37ce3ebe2d req-fda2d675-bdad-4a1b-a27f-795c2c548bcb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146444 Nov 02 12:38:38.133876 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1762/3533] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:38.146996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.152466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.180262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.183058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.187743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.192472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.195245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.196558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.243095 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 HTTP/1.1 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a1477d20-d864-4f64-bbf6-9b90259d4305'} Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:38.247687 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3eb7518e-ba94-4763-8fc5-d49c41009cb1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 404 len: 111 microversion: 2.1 time: 0.113607 Nov 02 12:38:38.257848 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1763/3534] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:38 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:38.523313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1252820802", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a20add55-dae0-40be-a4a7-4b9397826fb8"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:39.367035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:39.435238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:39.722188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:41.153713 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dfacedf6-6e93-41f9-b19a-8d80357ea141 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 5.977176 Nov 02 12:38:41.156692 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1772/3535] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:35 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 5985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:41.188481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:41.189293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:41.212119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:41.212636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:41.213652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:41.227560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:41.228656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:41.232318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:41.252806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:41.282429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] validate_networks() for [('a20add55-dae0-40be-a4a7-4b9397826fb8', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:42.365525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:42.386145 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-692a68d9-96fa-4268-b9e3-9f9e96940ed8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 1.228021 Nov 02 12:38:42.392516 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1773/3536] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:41 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:42.398655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c71af44e-900b-44f6-9900-3386e8a56a34 req-1fbbf650-2406-420a-a64e-f787f709f2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b", "tag": "872a4240-2c2d-4b21-87c3-169cfe50deac"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:42.452902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c71af44e-900b-44f6-9900-3386e8a56a34 req-1fbbf650-2406-420a-a64e-f787f709f2af service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.454891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c71af44e-900b-44f6-9900-3386e8a56a34 req-1fbbf650-2406-420a-a64e-f787f709f2af service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.458423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c71af44e-900b-44f6-9900-3386e8a56a34 req-1fbbf650-2406-420a-a64e-f787f709f2af service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.511996 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c71af44e-900b-44f6-9900-3386e8a56a34 req-1fbbf650-2406-420a-a64e-f787f709f2af service nova] Creating event network-changed:872a4240-2c2d-4b21-87c3-169cfe50deac for instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b on n-h1-855650-5 Nov 02 12:38:42.535782 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c71af44e-900b-44f6-9900-3386e8a56a34 req-1fbbf650-2406-420a-a64e-f787f709f2af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140742 Nov 02 12:38:42.540114 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1774/3537] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:42.563330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e90b646e-0d0d-4864-aec5-bdd7e8e9df37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228ecf6f70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:42.700872 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e90b646e-0d0d-4864-aec5-bdd7e8e9df37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.157884 Nov 02 12:38:42.701467 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1775/3538] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:42 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:43.343473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63f4b6b1-ba29-47c8-8875-7b32afe73d5f tempest-FloatingIPDetailsNegativeTestJSON-2035487299 tempest-FloatingIPDetailsNegativeTestJSON-2035487299-project] Calling method '.version_select at 0x7f228e1abca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:43.878930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-63f4b6b1-ba29-47c8-8875-7b32afe73d5f tempest-FloatingIPDetailsNegativeTestJSON-2035487299 tempest-FloatingIPDetailsNegativeTestJSON-2035487299-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d9543ba9-af91-4022-8935-d835d000cbbc could not be found", "detail": ""}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:38:43.881653 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-63f4b6b1-ba29-47c8-8875-7b32afe73d5f tempest-FloatingIPDetailsNegativeTestJSON-2035487299 tempest-FloatingIPDetailsNegativeTestJSON-2035487299-project] HTTP exception thrown: Floating IP not found for ID d9543ba9-af91-4022-8935-d835d000cbbc Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63f4b6b1-ba29-47c8-8875-7b32afe73d5f tempest-FloatingIPDetailsNegativeTestJSON-2035487299 tempest-FloatingIPDetailsNegativeTestJSON-2035487299-project] Request method failure captured: Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-floating-ips/d9543ba9-af91-4022-8935-d835d000cbbc HTTP/1.1 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmTSNjQSJT_LpGY5tmbjqWAjD8GDhwhLjYh7Wq0wyN8JUQbCwpJuIYjSm8Yq-RLgq0-ovFZWP0q_A1hZbplbgbMU5OpUYBMtz9uePE4xY87gOByo75dKIwllTiA0W3N5ygFFpipu1qCSANz8fYJveXLqlLTB2dGKS07vDZ28lzOKg64 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: a395c96412514f378574308bcadd39b9 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2035487299 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a395c96412514f378574308bcadd39b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a395c96412514f378574308bcadd39b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a395c96412514f378574308bcadd39b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a395c96412514f378574308bcadd39b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2035487299 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: a395c96412514f378574308bcadd39b9 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2035487299 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2035487299-project Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 901a8defa0ae4028a9546cb770514085 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2035487299-project Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: exception: Floating IP not found for ID d9543ba9-af91-4022-8935-d835d000cbbc Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'd9543ba9-af91-4022-8935-d835d000cbbc'} Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:38:43.886288 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d9543ba9-af91-4022-8935-d835d000cbbc could not be found Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ef0c3c-fcb6-4de5-ba71-69665402de0b'] Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d9543ba9-af91-4022-8935-d835d000cbbc. Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d9543ba9-af91-4022-8935-d835d000cbbc Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d9543ba9-af91-4022-8935-d835d000cbbc Nov 02 12:38:43.896498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:38:43.908341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63f4b6b1-ba29-47c8-8875-7b32afe73d5f tempest-FloatingIPDetailsNegativeTestJSON-2035487299 tempest-FloatingIPDetailsNegativeTestJSON-2035487299-project] Returning 404 to user: Floating IP not found for ID d9543ba9-af91-4022-8935-d835d000cbbc {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:43.909485 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63f4b6b1-ba29-47c8-8875-7b32afe73d5f tempest-FloatingIPDetailsNegativeTestJSON-2035487299 tempest-FloatingIPDetailsNegativeTestJSON-2035487299-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/d9543ba9-af91-4022-8935-d835d000cbbc" status: 404 len: 111 microversion: 2.1 time: 0.932903 Nov 02 12:38:43.912971 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1776/3539] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:38:42 2022] GET /compute/v2.1/os-floating-ips/d9543ba9-af91-4022-8935-d835d000cbbc => generated 111 bytes in 941 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:38:43.942599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:43.947538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:43.976867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.978166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.980473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.982329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.983511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.984772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:44.390985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:44.392258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:44.393006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:44.393763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:44.394396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:44.415542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:44.423058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:44.424149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:44.427221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:44.431463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:44.439171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:44.507198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:44.520859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for user 6488e600776547958e00ab146f079c46 and project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:44.568743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:44.576152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:44.618422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:44.644756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dd015c04-f3a9-4601-a3db-b68f70219e34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.728831 Nov 02 12:38:44.645799 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1777/3540] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:43 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:44.652131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c616a214-1d7c-4c6a-a2ab-edb921188a61 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292a1eaf0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:44.761412 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff1810c7-5589-42e4-be7c-7b4ffd670af0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.242389 Nov 02 12:38:44.763144 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c616a214-1d7c-4c6a-a2ab-edb921188a61 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.112620 Nov 02 12:38:44.767848 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1764/3541] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 6250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:44.778502 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1778/3542] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:44 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:44.785167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d466eafb-f214-45fb-a852-6654e84f1ad3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:44.785784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d466eafb-f214-45fb-a852-6654e84f1ad3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:44.928906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d466eafb-f214-45fb-a852-6654e84f1ad3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:44.956014 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d466eafb-f214-45fb-a852-6654e84f1ad3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1215 microversion: 2.1 time: 0.175632 Nov 02 12:38:44.957367 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1765/3543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:44 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:45.704287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:45.706517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:45.740504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.755298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.757543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.758660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.760213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.761327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.783151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ad12cc6-92bd-4f09-b5f8-fd96edbc010d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e57caf0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:45.905888 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ad12cc6-92bd-4f09-b5f8-fd96edbc010d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.128211 Nov 02 12:38:45.919009 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1766/3544] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:45 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:45.992710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-213ef485-a04f-4664-9734-ce347f5401e7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:45.993653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-213ef485-a04f-4664-9734-ce347f5401e7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:46.229072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:46.249688 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cfbafde4-9e90-4c11-94d4-036977eeb58a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.562792 Nov 02 12:38:46.252022 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1779/3545] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:45 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:46.253752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-213ef485-a04f-4664-9734-ce347f5401e7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:46.279360 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-213ef485-a04f-4664-9734-ce347f5401e7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1215 microversion: 2.1 time: 0.291473 Nov 02 12:38:46.280457 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1767/3546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:45 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:46.930584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98115be2-52a7-46c2-bff0-f2a532195c6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e96a820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:47.066346 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98115be2-52a7-46c2-bff0-f2a532195c6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.139943 Nov 02 12:38:47.079318 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1780/3547] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:46 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:47.287840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:47.289991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:47.303356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.317056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:47.318604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:47.320514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.321558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.337170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.338672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.339404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.361884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.362437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.363168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.367931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.368320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.368821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.682967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:47.719489 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3595cafc-6e42-4cbd-a4c9-cfeef7cf373a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1267 microversion: 2.1 time: 0.407144 Nov 02 12:38:47.721005 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1781/3548] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:47 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:47.741447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:47.766246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40bf2a28-7a8f-473f-a04f-b43014e3a078 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.486024 Nov 02 12:38:47.773037 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1768/3549] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:47 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:48.087778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd638b0c-9c2f-4a39-9e2a-3b44234d538b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e1cf550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:48.238504 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd638b0c-9c2f-4a39-9e2a-3b44234d538b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.154023 Nov 02 12:38:48.239487 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1782/3550] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:48 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:48.754919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:48.758964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:48.784510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:48.789520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:48.790522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.792081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:48.798913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:48.800060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.820248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:48.821190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:48.834815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:48.839591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:48.840343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.841366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:48.843159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:48.846650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:49.043019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:49.092931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f1e2ecc-0c02-4818-860f-2ca356362d7c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1273 microversion: 2.1 time: 0.346833 Nov 02 12:38:49.093799 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1769/3551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:48 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:49.260426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43f69053-cd87-4052-a8f6-d61f8ccadc0e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e5134c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:49.403237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:49.412464 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dfa23356-66d9-4d36-8333-e63015c8e3d5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.596605 Nov 02 12:38:49.414395 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1783/3552] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:48 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:49.425601 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43f69053-cd87-4052-a8f6-d61f8ccadc0e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.173019 Nov 02 12:38:49.427557 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1770/3553] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:49 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:50.126006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.129013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:50.161110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:50.161630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:50.162114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.167363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:50.168274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:50.173404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.451960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.453690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:50.482952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:50.484125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:50.484816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.485879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:50.486585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:50.487239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.697035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:50.710562 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bef2ac2b-e8b3-412c-801a-ad7dec0d8f43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1273 microversion: 2.1 time: 0.596490 Nov 02 12:38:50.739128 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1784/3554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:50 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1273 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:50.753058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-637c8592-317d-4b14-8902-78ceb2219694 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228f5b5940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.885076 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-637c8592-317d-4b14-8902-78ceb2219694 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.144308 Nov 02 12:38:50.909931 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1785/3555] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:50 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:51.175428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:51.192836 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2c2032af-0f06-4977-9768-8ed5f0754902 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.753689 Nov 02 12:38:51.195979 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1771/3556] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:50 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:51.483092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-54f1fe88-21d6-4149-861b-0d35d6013252 req-36660660-d628-46aa-929f-f01f958aa494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b", "name": "network-vif-plugged", "status": "completed", "tag": "872a4240-2c2d-4b21-87c3-169cfe50deac"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:51.512027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-54f1fe88-21d6-4149-861b-0d35d6013252 req-36660660-d628-46aa-929f-f01f958aa494 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.514741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-54f1fe88-21d6-4149-861b-0d35d6013252 req-36660660-d628-46aa-929f-f01f958aa494 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.517958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-54f1fe88-21d6-4149-861b-0d35d6013252 req-36660660-d628-46aa-929f-f01f958aa494 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.547451 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-54f1fe88-21d6-4149-861b-0d35d6013252 req-36660660-d628-46aa-929f-f01f958aa494 service nova] Creating event network-vif-plugged:872a4240-2c2d-4b21-87c3-169cfe50deac for instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b on n-h1-855650-5 Nov 02 12:38:51.555899 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-54f1fe88-21d6-4149-861b-0d35d6013252 req-36660660-d628-46aa-929f-f01f958aa494 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078143 Nov 02 12:38:51.557470 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1786/3557] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:51.756377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:51.757381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:51.788873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.789381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.789823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.796170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.802514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.803219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.919227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63e96638-1155-4658-b981-432ef2d4551b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228fec4700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:52.039721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63e96638-1155-4658-b981-432ef2d4551b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.126383 Nov 02 12:38:52.040332 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1787/3558] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:51 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:52.107611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:52.121111 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8be31b7a-4e82-4267-afa6-a0c5b8d54ddc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1273 microversion: 2.1 time: 0.370130 Nov 02 12:38:52.125304 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1772/3559] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:51 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:52.220909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:52.221804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:52.240972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:52.244217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:52.244726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:52.256093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:52.256595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:52.257044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:52.750948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:52.767454 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6556b586-ce26-4549-a9f2-83bdc21f1805 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.549504 Nov 02 12:38:52.770951 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1788/3560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:52 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:53.061382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5728694-cb67-46bd-8524-efddfdc353f9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e57c1f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:53.142697 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5728694-cb67-46bd-8524-efddfdc353f9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.085269 Nov 02 12:38:53.145797 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1773/3561] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:53 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:53.153209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:53.153844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:53.166663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.167169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.167614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.168349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.168810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.169255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.569264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:53.624967 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d64d589e-6a37-4332-9e6e-b2e4eb98bf39 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.465926 Nov 02 12:38:53.628380 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1789/3562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:53 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:53.808752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:53.810830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:53.875274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.877738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.878254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.880400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.884255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.887027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.163605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-254bca53-fa97-4dff-9e3c-d9c785de3c88 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f22929da790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:54.287691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:54.288384 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-254bca53-fa97-4dff-9e3c-d9c785de3c88 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.129705 Nov 02 12:38:54.293574 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1790/3563] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:54 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:54.309811 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91925fc0-0128-4271-836f-67e367c2dddc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1328 microversion: 2.1 time: 0.514102 Nov 02 12:38:54.310818 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1774/3564] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:53 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1328 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:54.654277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:54.654824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:54.672137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.672645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.678050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.680232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.684914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.686278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.091072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:55.105803 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a1b1731e-eb3d-4349-96b7-ef3ddcc20f96 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.456836 Nov 02 12:38:55.106756 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1791/3565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:54 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:55.315006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17c0b019-9a97-4f60-a460-0187783c48c1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6e1820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:55.342931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:55.343783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:55.359258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.359762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.361034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.361034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.361387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.361786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.363141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:55.473062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17c0b019-9a97-4f60-a460-0187783c48c1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.164857 Nov 02 12:38:55.479475 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1775/3566] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:55 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:55.692266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:55.705793 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0387ef64-14a6-477d-abcd-17967bce696e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1509 microversion: 2.1 time: 0.366857 Nov 02 12:38:55.727062 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1792/3567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:55 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:55.743153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:55.751492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:55.773845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.782667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.783712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.785001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.789812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.791402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.133112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:56.135012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:56.151764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:56.152483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:56.154498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.155497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:56.158669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:56.159401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.222623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:56.244670 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ae47fb1-8063-4cb4-85ec-28884c37ff2e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1509 microversion: 2.1 time: 0.506096 Nov 02 12:38:56.247690 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1776/3568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:55 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1509 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:56.277354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:56.277890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:56.281589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=10 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:56.304239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:56.304753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:56.305207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.306017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:56.316302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:56.317139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.444220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:56.657743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:56.669173 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cdb56df5-687c-4e1d-9a19-53484d7b699f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.540151 Nov 02 12:38:56.682010 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1793/3569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:56 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:56.691825 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9019b66-6ce0-4ada-8eaf-4fe220b689d0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 204 len: 0 microversion: 2.1 time: 0.418090 Nov 02 12:38:56.695571 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1777/3570] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:56 2022] DELETE /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:56.700128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e535939-3a33-4376-9b74-d0ec52183fa4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e03d9d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:56.713456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:56.718459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:56.747614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:56.749234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:56.758876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.760802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:56.761614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:56.765787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.851351 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e535939-3a33-4376-9b74-d0ec52183fa4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.165784 Nov 02 12:38:56.861206 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1794/3571] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:56 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:57.088665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.105013 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3c7b975-9ee5-4e0e-bd43-14ea3ea5ae2c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1515 microversion: 2.1 time: 0.397296 Nov 02 12:38:57.105013 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1778/3572] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:56 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:57.701368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:57.702086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:57.727353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-499308385", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8549ed1c-db80-4609-886c-3e7ed9e5a0ff"}], "security_groups": [{"name": "tempest-securitygroup--124933339"}], "key_name": "tempest-keypair-171444088", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "fd245630-5402-40f7-a79a-e14ba47c28e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:57.769634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.770287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.771119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.771923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.779540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.780281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.373801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] validate_networks() for [('8549ed1c-db80-4609-886c-3e7ed9e5a0ff', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:58.582960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:58.660350 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-343b6534-f4a0-4cbc-8051-463e78f27010 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.963850 Nov 02 12:38:58.676345 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1795/3573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:57 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:58.681709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5062f777-5f7d-4519-aa58-e74651cd8981 req-1b35f212-06d6-4d06-ac14-8a5c3f51033c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f3e53a7-4714-4d91-83b1-537a2b0f9163", "tag": "25495928-f073-4cb1-948f-66690b3dbc80"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:58.732798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5062f777-5f7d-4519-aa58-e74651cd8981 req-1b35f212-06d6-4d06-ac14-8a5c3f51033c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.736228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5062f777-5f7d-4519-aa58-e74651cd8981 req-1b35f212-06d6-4d06-ac14-8a5c3f51033c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.736944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5062f777-5f7d-4519-aa58-e74651cd8981 req-1b35f212-06d6-4d06-ac14-8a5c3f51033c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.798311 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5062f777-5f7d-4519-aa58-e74651cd8981 req-1b35f212-06d6-4d06-ac14-8a5c3f51033c service nova] Creating event network-changed:25495928-f073-4cb1-948f-66690b3dbc80 for instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 on n-h2-855650-5 Nov 02 12:38:58.820019 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5062f777-5f7d-4519-aa58-e74651cd8981 req-1b35f212-06d6-4d06-ac14-8a5c3f51033c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142055 Nov 02 12:38:58.823315 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1796/3574] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:58.854808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-caa5cfd5-f09e-420a-8487-8222aed2e7e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292a08430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:58.988196 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-caa5cfd5-f09e-420a-8487-8222aed2e7e3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.162426 Nov 02 12:38:58.989432 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1797/3575] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:58 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:59.010016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.014653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:59.023459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.024257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.025055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.026338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.027783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.028461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.390259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.414227 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4510bc4b-e711-42aa-8d39-71a80a33304d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1515 microversion: 2.1 time: 0.423265 Nov 02 12:38:59.416664 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1798/3576] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:58 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1515 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:59.537928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Getting quotas for project 4ecbaf8bc88240719b2c57ea95fa869c. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:59.548892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Getting quotas for user 5427bc37ece54ae99b22d68a328b800a and project 4ecbaf8bc88240719b2c57ea95fa869c. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:59.572594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:59.574108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:59.575022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:59.575731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:59.576533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:59.596129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.597138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.598250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.599651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.600566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.601294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.646140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Getting quotas for project 4ecbaf8bc88240719b2c57ea95fa869c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:59.655486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Getting quotas for user 5427bc37ece54ae99b22d68a328b800a and project 4ecbaf8bc88240719b2c57ea95fa869c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:59.696738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.697949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:59.721951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.722871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.729286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.730451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.730949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.731386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.746322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:59.751472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd245630-5402-40f7-a79a-e14ba47c28e2',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:00.030170 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-61dd374a-4d79-4f48-9a77-320e8f3490d1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.308097 Nov 02 12:39:00.031296 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1779/3577] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:39:00.038773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2ec59cd0-a362-48b6-bebb-26a9859150b7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6c00d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:00.040032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:00.057338 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c4ad7a92-a9bb-46f8-bdc5-51ac51d21ba2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.367821 Nov 02 12:39:00.063073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1799/3578] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:59 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:00.075060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a22dc39-c6c8-488e-b458-14bc7728b7fc tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:00.082542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a22dc39-c6c8-488e-b458-14bc7728b7fc tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:00.112169 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2ec59cd0-a362-48b6-bebb-26a9859150b7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.079377 Nov 02 12:39:00.113484 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1780/3579] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:00 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:00.229113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a22dc39-c6c8-488e-b458-14bc7728b7fc tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:00.241433 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a22dc39-c6c8-488e-b458-14bc7728b7fc tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1120 microversion: 2.1 time: 0.176542 Nov 02 12:39:00.242076 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1800/3580] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:00 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1120 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:00.442905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:00.444100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:00.453195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.454261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.455001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.455997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.457255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.458206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.990010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.005551 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c41cf35-e5f1-42cb-93d8-023437acb5ed tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1515 microversion: 2.1 time: 0.567972 Nov 02 12:39:01.013250 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1781/3581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:00 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1515 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:01.100043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:01.101158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:01.133792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.137560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f434ca3d-967f-4e1b-89ef-f6383c85560f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbb0a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:01.139241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.147907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.149317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.150302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.151957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.267745 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f434ca3d-967f-4e1b-89ef-f6383c85560f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.137284 Nov 02 12:39:01.271015 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1782/3582] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:01 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:01.283107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8817ea16-ad54-4d05-8de2-046594d3feed req-c0f22e8d-e8ec-4071-b923-b5f39bda2100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b", "name": "network-vif-deleted", "tag": "872a4240-2c2d-4b21-87c3-169cfe50deac"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:01.291954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:01.305036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8817ea16-ad54-4d05-8de2-046594d3feed req-c0f22e8d-e8ec-4071-b923-b5f39bda2100 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.306314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8817ea16-ad54-4d05-8de2-046594d3feed req-c0f22e8d-e8ec-4071-b923-b5f39bda2100 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.306925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8817ea16-ad54-4d05-8de2-046594d3feed req-c0f22e8d-e8ec-4071-b923-b5f39bda2100 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.366244 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8817ea16-ad54-4d05-8de2-046594d3feed req-c0f22e8d-e8ec-4071-b923-b5f39bda2100 service nova] Creating event network-vif-deleted:872a4240-2c2d-4b21-87c3-169cfe50deac for instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b on n-h1-855650-5 Nov 02 12:39:01.384719 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8817ea16-ad54-4d05-8de2-046594d3feed req-c0f22e8d-e8ec-4071-b923-b5f39bda2100 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111738 Nov 02 12:39:01.385501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1783/3583] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:01.396217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:01.398888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:01.419859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.421263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.421994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.423398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.424227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.424870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.523294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.538846 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bd11bc07-dfff-4afc-9c33-6a49d1f2a421 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1170 microversion: 2.1 time: 0.149846 Nov 02 12:39:01.538846 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1784/3584] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:01 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1170 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:01.611955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.667705 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-676b84d3-6bcd-476d-bfa6-f6b61b5473c6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.579809 Nov 02 12:39:01.682920 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1801/3585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:01 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:02.034529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.036094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:02.053260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.054164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.055576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.057378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.058067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.058683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.145197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.146896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.147784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.148676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lazy-loading 'fault' on Instance uuid 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:02.225930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:02.243134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:02.252005 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0489c83c-1c63-4d2f-a6ca-f177f5986ea4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 200 len: 1318 microversion: 2.1 time: 0.222269 Nov 02 12:39:02.252681 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1785/3586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:02.290503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a065c1e-92d6-42c0-9a01-0b3c8fa58654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e03db80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.354469 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a065c1e-92d6-42c0-9a01-0b3c8fa58654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.069309 Nov 02 12:39:02.355807 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1802/3587] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:02.567559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.572199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:02.587618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.588784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.589453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.590758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.591998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.593258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.696354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.697541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:02.720501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:02.725474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.732742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.733346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.736821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.739855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.745110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.751660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:02.774856 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55d11957-994a-4226-bf9c-dabbfdd4b601 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1170 microversion: 2.1 time: 0.212491 Nov 02 12:39:02.778862 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1786/3588] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1170 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:03.145363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:03.148799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:03.161590 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-764bf6fb-9220-41e6-bf3d-307bafa9f34a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.470508 Nov 02 12:39:03.185272 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1803/3589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:03.297232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.298034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:03.318305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.318825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.319501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.320333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.320836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.321387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.347173 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b HTTP/1.1 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b'} Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.348995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80a6f361-9404-43c7-9f57-457d800807a9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 404 len: 111 microversion: 2.1 time: 0.063178 Nov 02 12:39:03.360196 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1787/3590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:03.367132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8430de1-2cac-4984-94f0-d91be9944f5d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '.version_select at 0x7f228e872ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.385482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8fac4d29-52d0-4a72-b2e2-d5684260a584 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e548700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.452944 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8430de1-2cac-4984-94f0-d91be9944f5d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-key-1777614474" status: 202 len: 0 microversion: 2.1 time: 0.092179 Nov 02 12:39:03.455436 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1804/3591] 10.222.0.45 () {58 vars in 1209 bytes} [Wed Nov 2 12:39:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1777614474 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:39:03.516359 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8fac4d29-52d0-4a72-b2e2-d5684260a584 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.134808 Nov 02 12:39:03.520504 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1788/3592] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:03.811745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.812383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:03.831523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.836232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.836828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.841167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.841668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.842156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.884328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1673207126", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "3df2b834-542d-4af7-a2f7-6a848f5dc1f3"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:04.206507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:04.216555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2edfc65-525d-4966-8432-12aa5641d02c tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1218 microversion: 2.1 time: 0.409594 Nov 02 12:39:04.217166 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1805/3593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1218 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:04.230177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:04.230177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:04.238474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] validate_networks() for [('3df2b834-542d-4af7-a2f7-6a848f5dc1f3', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:04.256615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.257671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.259578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.260822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.263130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.263802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.971059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.009485 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63cd8096-cd2a-400a-8559-2053ec27702f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.786558 Nov 02 12:39:05.012035 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1806/3594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:04 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:05.031986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7668c664-3d93-44a8-afb0-0ce0a4c97773 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f22929eeb80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:05.139483 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7668c664-3d93-44a8-afb0-0ce0a4c97773 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1413 microversion: 2.1 time: 0.123517 Nov 02 12:39:05.148846 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1807/3595] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:05 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:05.245142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:05.245981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:05.255606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.256914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.257767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.259617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.260593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.261264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.431009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.441348 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-35e31318-1782-42d0-aefd-cccabfcc4815 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1236 microversion: 2.1 time: 0.200893 Nov 02 12:39:05.458525 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1808/3596] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:05 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1236 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:06.051750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:06.054205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:06.077505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.080739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.083044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.088960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.090310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.091347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.241024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:06.241894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:06.242122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:06.242786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:06.244450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:06.259444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.261869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.263019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.265327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.266924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.268118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.312751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:06.328979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:06.400427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:39:06.407959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:06.550604 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56722c30-14ad-4ff0-b5cb-470de9f12111 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.671697 Nov 02 12:39:06.552888 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1789/3597] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:39:06.566883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4c86e105-4f19-4991-a7e5-b154f0af9d9f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db648b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:06.690813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:06.753864 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-292ab01a-9b49-4c1e-9782-82b9e8b4edf9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.709825 Nov 02 12:39:06.757388 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4c86e105-4f19-4991-a7e5-b154f0af9d9f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1422 microversion: 2.1 time: 0.201737 Nov 02 12:39:06.758174 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1809/3598] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:06 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:06.763114 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1790/3599] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:06 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1422 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:06.784551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:06.787430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:06.790709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7adbe09d-bfc5-43a8-bd76-e2a8d128f9f0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:06.795983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7adbe09d-bfc5-43a8-bd76-e2a8d128f9f0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:06.817959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.818498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.818931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.823365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.824107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.828952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:07.015237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7adbe09d-bfc5-43a8-bd76-e2a8d128f9f0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.034066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7adbe09d-bfc5-43a8-bd76-e2a8d128f9f0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1209 microversion: 2.1 time: 0.262854 Nov 02 12:39:07.034788 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1791/3600] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:06 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1209 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:07.046342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae6530b0-e7be-45a0-8b4c-6757e341d942 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Calling method '.version_select at 0x7f228e57c040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:07.110383 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae6530b0-e7be-45a0-8b4c-6757e341d942 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e" status: 200 len: 636 microversion: 2.1 time: 0.074314 Nov 02 12:39:07.118679 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1792/3601] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:07 2022] GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e => generated 636 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:07.130218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2ddbdf79-3f74-4989-9251-b9e00d98cd37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db589d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:07.188131 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2ddbdf79-3f74-4989-9251-b9e00d98cd37 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 200 len: 1422 microversion: 2.1 time: 0.068012 Nov 02 12:39:07.190245 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1793/3602] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:07 2022] GET /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:07.197218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22f9d8d7-e415-49a3-8877-a653f0ca94fe tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'update_all', calling method: .version_select at 0x7f228db64e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:07.258133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-22f9d8d7-e415-49a3-8877-a653f0ca94fe tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:07.267399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-22f9d8d7-e415-49a3-8877-a653f0ca94fe tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:07.480412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.516656 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2092b50e-fa09-4ca5-96ae-1b326df90927 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1303 microversion: 2.1 time: 0.754433 Nov 02 12:39:07.527905 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1810/3603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:06 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1303 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:07.548817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b3ea9a1-4fd0-41fc-9064-7f82c0409031 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e0939d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:08.151081 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22f9d8d7-e415-49a3-8877-a653f0ca94fe tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.957668 Nov 02 12:39:08.152660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1794/3604] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:07 2022] PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 61 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:08.177014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:08.195941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:08.215929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.216440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.216896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.217647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.218287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.218569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.432524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:08.451713 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-047b586a-d8f3-4894-8f7c-015f72bc6e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.296528 Nov 02 12:39:08.453673 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1795/3605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:08 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:08.470697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:08.471599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:08.473704 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b3ea9a1-4fd0-41fc-9064-7f82c0409031 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 204 len: 0 microversion: 2.1 time: 0.943196 Nov 02 12:39:08.475282 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1811/3606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:07 2022] DELETE /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 0 bytes in 946 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:08.483301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8fe46122-4166-4493-9ebe-ff44d477587f tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Calling method '.version_select at 0x7f22929da1f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:08.500432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.504773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.507800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.509581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.511496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.514569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.649375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:08.666847 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aeb975fd-ffca-4f9a-bbc2-61ada1f7e6cc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1261 microversion: 2.1 time: 0.208458 Nov 02 12:39:08.669481 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1796/3607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:08 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:08.687798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:08.691047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:08.709439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.709994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.710465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.711238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.711819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.717645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.785376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:39:08.975140 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8fe46122-4166-4493-9ebe-ff44d477587f tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "DELETE /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.498251 Nov 02 12:39:08.976004 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1812/3608] 10.222.0.45 () {58 vars in 1296 bytes} [Wed Nov 2 12:39:08 2022] DELETE /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata/os_version => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:08.990212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:08.992771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:09.005959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.006807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.007490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.008448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.009116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.009769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.010289 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ed5dd0f-75e7-46e0-9f0a-5162e307f367 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 204 len: 0 microversion: 2.1 time: 0.332604 Nov 02 12:39:09.035854 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1797/3609] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:08 2022] DELETE /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:09.051449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2d70dfef-e8bc-41b9-8a23-44d5baa6b7c2 req-1e104b61-9504-42e1-ab77-0c647f952380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3e53a7-4714-4d91-83b1-537a2b0f9163", "name": "network-vif-plugged", "status": "completed", "tag": "25495928-f073-4cb1-948f-66690b3dbc80"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:09.082436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2d70dfef-e8bc-41b9-8a23-44d5baa6b7c2 req-1e104b61-9504-42e1-ab77-0c647f952380 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.083168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2d70dfef-e8bc-41b9-8a23-44d5baa6b7c2 req-1e104b61-9504-42e1-ab77-0c647f952380 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.087461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2d70dfef-e8bc-41b9-8a23-44d5baa6b7c2 req-1e104b61-9504-42e1-ab77-0c647f952380 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.123070 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2d70dfef-e8bc-41b9-8a23-44d5baa6b7c2 req-1e104b61-9504-42e1-ab77-0c647f952380 service nova] Creating event network-vif-plugged:25495928-f073-4cb1-948f-66690b3dbc80 for instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 on n-h2-855650-5 Nov 02 12:39:09.139248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2d70dfef-e8bc-41b9-8a23-44d5baa6b7c2 req-1e104b61-9504-42e1-ab77-0c647f952380 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099715 Nov 02 12:39:09.143626 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1798/3610] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:09.162209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-233c12d1-5297-4a1f-ad53-80119593ce9e tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Calling method '.version_select at 0x7f228db2bee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:09.225580 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-233c12d1-5297-4a1f-ad53-80119593ce9e tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.077945 Nov 02 12:39:09.226621 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1799/3611] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:39:09 2022] GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 37 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:09.242515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d448f82-d282-43dc-b969-301e645dd196 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'update_all', calling method: .version_select at 0x7f228db0a790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:09.292216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:09.303338 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b201cce3-dfa2-40f7-95ca-99b52244c301 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1303 microversion: 2.1 time: 0.321579 Nov 02 12:39:09.304473 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1813/3612] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:08 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1303 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:09.310819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1996116807", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "6073314f-95a7-4839-bb88-cbb45aac3413"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:09.338697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9d448f82-d282-43dc-b969-301e645dd196 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:09.353937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9d448f82-d282-43dc-b969-301e645dd196 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:09.386208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] validate_networks() for [('6073314f-95a7-4839-bb88-cbb45aac3413', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:09.763532 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d448f82-d282-43dc-b969-301e645dd196 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.527004 Nov 02 12:39:09.766201 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1800/3613] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:09 2022] PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 61 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:09.778327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:09.779968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:09.792188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.792839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.793393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.794309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.795182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.796085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.098193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.116576 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55f50c71-d3ea-4d1d-9a1f-345e2d4c0452 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 0.337144 Nov 02 12:39:10.118867 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1801/3614] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:09 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:10.126060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.127270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:10.141245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.142256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.142972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.143939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.144633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.145764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.160228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:10.161157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:10.161641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:10.161942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:10.162397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:10.177180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.178135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.178793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.180115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.180819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.181474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.210896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:10.219624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for user beeb8b4fa7354185ba8aff3194bf9e06 and project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:10.236286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.247519 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48b4dca2-cef3-440c-9a24-390489ffb888 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1261 microversion: 2.1 time: 0.126944 Nov 02 12:39:10.248641 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1802/3615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1261 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:10.249581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:39:10.253589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:10.270335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3ec2c86-3438-4144-908e-6fe67b65d783 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Calling method '.version_select at 0x7f228dbc8550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.351231 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b32dbbaf-51a8-480f-a7a1-c48757fa82d7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045107 Nov 02 12:39:10.358474 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1814/3616] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:39:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:39:10.364940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3a93dd30-c0ba-478f-8ae4-49e95485d92c req-d41c9aa7-f290-47ef-8b26-6938bb2ec395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7522fbf-cc29-4ae9-a95b-16214f7b1d40", "tag": "4fa46058-46e4-40f8-809e-67f3dc4f0e93"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:10.369640 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3ec2c86-3438-4144-908e-6fe67b65d783 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.119210 Nov 02 12:39:10.378527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3a93dd30-c0ba-478f-8ae4-49e95485d92c req-d41c9aa7-f290-47ef-8b26-6938bb2ec395 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.385044 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1803/3617] 10.222.0.45 () {58 vars in 1290 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata/os_distro => generated 33 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:10.386605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3a93dd30-c0ba-478f-8ae4-49e95485d92c req-d41c9aa7-f290-47ef-8b26-6938bb2ec395 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.387328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3a93dd30-c0ba-478f-8ae4-49e95485d92c req-d41c9aa7-f290-47ef-8b26-6938bb2ec395 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.396910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.398003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:10.415763 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3a93dd30-c0ba-478f-8ae4-49e95485d92c req-d41c9aa7-f290-47ef-8b26-6938bb2ec395 service nova] Creating event network-changed:4fa46058-46e4-40f8-809e-67f3dc4f0e93 for instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 on n-h2-855650-5 Nov 02 12:39:10.424005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3a93dd30-c0ba-478f-8ae4-49e95485d92c req-d41c9aa7-f290-47ef-8b26-6938bb2ec395 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062899 Nov 02 12:39:10.424878 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1815/3618] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:10.433038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e6da5b79-a70e-440a-a782-b889d2d833eb tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.434121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6da5b79-a70e-440a-a782-b889d2d833eb tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:10.442296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.443013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.444351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.447014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.447632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.448471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.645381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e6da5b79-a70e-440a-a782-b889d2d833eb tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.660468 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e6da5b79-a70e-440a-a782-b889d2d833eb tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1208 microversion: 2.1 time: 0.231954 Nov 02 12:39:10.662427 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1816/3619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1208 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:10.669381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8735a5ca-9376-4aee-94b4-a5089950385f tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'update_all', calling method: .version_select at 0x7f22929dae50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:10.809114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8735a5ca-9376-4aee-94b4-a5089950385f tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:10.822389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8735a5ca-9376-4aee-94b4-a5089950385f tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:10.938464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.955918 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a993586e-d8ed-4782-bc0a-a3406ece0727 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1303 microversion: 2.1 time: 0.574115 Nov 02 12:39:10.974586 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1804/3620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1303 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:11.163187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:11.172227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:11.206127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.206987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.217353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.221291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.226219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.229626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.324525 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8735a5ca-9376-4aee-94b4-a5089950385f tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.659114 Nov 02 12:39:11.327137 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1817/3621] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:10 2022] PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 61 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:11.352924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:11.354166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:11.397365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.398309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.399543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.400840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.401697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.411042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.813843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:11.850120 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7cf522a4-0665-4a30-994a-7cca4676d219 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1269 microversion: 2.1 time: 0.514972 Nov 02 12:39:11.851616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1818/3622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:11 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1269 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:11.873009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0155f20d-bdf1-4cdc-bdc8-b245b6dbd937 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Calling method '.version_select at 0x7f22929da310>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:12.005172 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0155f20d-bdf1-4cdc-bdc8-b245b6dbd937 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.151199 Nov 02 12:39:12.007446 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1819/3623] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:39:11 2022] GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 61 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:12.029343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:12.030963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:12.052591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.059847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.060909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.065438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.066313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.067091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.156568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:12.167853 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3fc4e747-68b7-4118-8e34-05a30742991c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1315 microversion: 2.1 time: 1.018737 Nov 02 12:39:12.183246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1805/3624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:11 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:12.183246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-bc317676-d32b-4875-a219-99cf440cee4e req-e2b83d38-0875-450f-9652-05882d20b4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613fc845-dfd6-49ca-b8ff-9c4cebce08d3", "name": "network-vif-unplugged", "status": "completed", "tag": "3b2f7ed6-5126-4ecd-b492-e1ce16b886eb"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:12.203476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bc317676-d32b-4875-a219-99cf440cee4e req-e2b83d38-0875-450f-9652-05882d20b4d5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.204541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bc317676-d32b-4875-a219-99cf440cee4e req-e2b83d38-0875-450f-9652-05882d20b4d5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.205066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bc317676-d32b-4875-a219-99cf440cee4e req-e2b83d38-0875-450f-9652-05882d20b4d5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.224225 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-bc317676-d32b-4875-a219-99cf440cee4e req-e2b83d38-0875-450f-9652-05882d20b4d5 service nova] Creating event network-vif-unplugged:3b2f7ed6-5126-4ecd-b492-e1ce16b886eb for instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 on n-h1-855650-5 Nov 02 12:39:12.230838 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-bc317676-d32b-4875-a219-99cf440cee4e req-e2b83d38-0875-450f-9652-05882d20b4d5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058122 Nov 02 12:39:12.232058 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1806/3625] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:12.239466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:12.240515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:12.251976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.252976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.253763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.254936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.255576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.256206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.458592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:12.491050 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55ee9fc0-bc04-4f1c-91c9-bc7c3c2fb2b1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1204 microversion: 2.1 time: 0.479790 Nov 02 12:39:12.492469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1820/3626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:12 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1204 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:12.500005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b999f473-1ee9-4781-a5ee-41e8d2da6812 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'update_all', calling method: .version_select at 0x7f22929daaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:12.599183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b999f473-1ee9-4781-a5ee-41e8d2da6812 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:12.613319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b999f473-1ee9-4781-a5ee-41e8d2da6812 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:12.825771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:12.836791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4bf1b76-7d44-4c52-b40a-93e399b199bb tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1303 microversion: 2.1 time: 0.602985 Nov 02 12:39:12.846875 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1807/3627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:12 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1303 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:12.885393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:12.886576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:12.907392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.918671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.919679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.921581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.922512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.936151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.089868 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b999f473-1ee9-4781-a5ee-41e8d2da6812 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.594365 Nov 02 12:39:13.090972 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1821/3628] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:12 2022] PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 61 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:13.105805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1bf7614f-e18f-43fa-a7e4-03949ea066f9 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'update_all', calling method: .version_select at 0x7f2292a1e700>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:13.275234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1bf7614f-e18f-43fa-a7e4-03949ea066f9 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:13.293742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1bf7614f-e18f-43fa-a7e4-03949ea066f9 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:13.447980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:13.477293 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cafc63a7-a3cd-4c22-b102-788084b60e25 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1267 microversion: 2.1 time: 0.600852 Nov 02 12:39:13.482234 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1808/3629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:12 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1267 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:13.526550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:13.536438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:13.621227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.622486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.626839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.634857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.636483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.638790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.007529 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1bf7614f-e18f-43fa-a7e4-03949ea066f9 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.906615 Nov 02 12:39:14.008287 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1822/3630] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:13 2022] PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 64 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:39:14.014624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:14.018583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:14.046591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.049875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.050852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.051813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.053907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.054788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.265171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:14.279338 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-07e33e15-4f7c-4810-978f-51223dbdff3e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1266 microversion: 2.1 time: 0.268229 Nov 02 12:39:14.301458 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1823/3631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:14 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:14.307750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:14.309411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1b3bcc07-d44b-4655-b2e1-cfa8c3c9e1de req-cf6da968-d1af-4fde-b72b-85164777ddb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613fc845-dfd6-49ca-b8ff-9c4cebce08d3", "name": "network-vif-deleted", "tag": "3b2f7ed6-5126-4ecd-b492-e1ce16b886eb"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:14.322255 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ba85620-a941-4d1c-b730-ba9ca5d77736 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1502 microversion: 2.1 time: 0.829866 Nov 02 12:39:14.323429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1b3bcc07-d44b-4655-b2e1-cfa8c3c9e1de req-cf6da968-d1af-4fde-b72b-85164777ddb1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.324045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1b3bcc07-d44b-4655-b2e1-cfa8c3c9e1de req-cf6da968-d1af-4fde-b72b-85164777ddb1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.324572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1b3bcc07-d44b-4655-b2e1-cfa8c3c9e1de req-cf6da968-d1af-4fde-b72b-85164777ddb1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.342133 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1809/3632] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:13 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1502 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:14.363733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:14.365551 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1b3bcc07-d44b-4655-b2e1-cfa8c3c9e1de req-cf6da968-d1af-4fde-b72b-85164777ddb1 service nova] Creating event network-vif-deleted:3b2f7ed6-5126-4ecd-b492-e1ce16b886eb for instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 on n-h1-855650-5 Nov 02 12:39:14.366445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:14.374927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.375707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.377384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.378352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.378995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.379601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.387835 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1b3bcc07-d44b-4655-b2e1-cfa8c3c9e1de req-cf6da968-d1af-4fde-b72b-85164777ddb1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084557 Nov 02 12:39:14.388459 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1824/3633] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:14.393765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac198535-8d05-4ec1-9769-6316f7b87591 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Calling method '.version_select at 0x7f2292a1eca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:14.455952 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac198535-8d05-4ec1-9769-6316f7b87591 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.065865 Nov 02 12:39:14.456608 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1825/3634] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:39:14 2022] GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 64 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:14.471699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5dca940e-2d80-4f5f-8802-e3d0125cb5e1 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'update_all', calling method: .version_select at 0x7f228e2a7160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:14.557792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-5dca940e-2d80-4f5f-8802-e3d0125cb5e1 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:14.568560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-5dca940e-2d80-4f5f-8802-e3d0125cb5e1 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:15.216614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:15.235085 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f9d8597-0d61-4884-a766-1bb87d7f01e8 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1303 microversion: 2.1 time: 0.890072 Nov 02 12:39:15.236511 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1810/3635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:14 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1303 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:15.275900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:15.276575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:15.299984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:15.300515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:15.300979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:15.303999 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5dca940e-2d80-4f5f-8802-e3d0125cb5e1 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.839827 Nov 02 12:39:15.304670 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1826/3636] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:14 2022] PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 61 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:39:15.306942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:15.307457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:15.307916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:15.325031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:15.325931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:15.350440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:15.351176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:15.351634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:15.354718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:15.355224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:15.355672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:15.530410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:15.543109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cc481b63-655f-41ae-9a31-c44a1453bf30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1266 microversion: 2.1 time: 0.236668 Nov 02 12:39:15.558006 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1827/3637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:15 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:15.589324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2d9c1f5-727c-48c4-8b40-5f6fd3f63184 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'update', calling method: .version_select at 0x7f22929ee310>, body: {"meta": {"os_version": "alt"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:15.709393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a2d9c1f5-727c-48c4-8b40-5f6fd3f63184 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:15.718278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a2d9c1f5-727c-48c4-8b40-5f6fd3f63184 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:15.966780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:15.993929 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8807f76-49dc-4bc9-b8d3-db79c840ffd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.744380 Nov 02 12:39:15.995045 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1811/3638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:15 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:16.265370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:16.267083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:16.292006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:16.299295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:16.301282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:16.303639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:16.304751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:16.306577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:16.322755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:16.397677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:16.508956 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2d9c1f5-727c-48c4-8b40-5f6fd3f63184 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.956293 Nov 02 12:39:16.514542 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1828/3639] 10.222.0.45 () {60 vars in 1313 bytes} [Wed Nov 2 12:39:15 2022] PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata/os_version => generated 31 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:16.521589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96fd1310-e047-494b-855d-e565fa6b15ca tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Calling method '.version_select at 0x7f228ecf6550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:16.634363 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-96fd1310-e047-494b-855d-e565fa6b15ca tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.116864 Nov 02 12:39:16.635979 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1829/3640] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:39:16 2022] GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 58 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:16.650530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:16.653804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:16.682494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:16.683595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:16.685830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:16.686472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:16.688125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:16.688584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.366223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:17.375048 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b43338f9-a54a-4607-b580-df5af33e96f0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.737403 Nov 02 12:39:17.382697 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1830/3641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:16 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:17.389340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-354aa676-0270-40ba-afc8-53f59c4e6273 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'update_all', calling method: .version_select at 0x7f228e182160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:17.399919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:17.412987 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4769950e-f14e-4af2-92de-435b1c94d2a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1303 microversion: 2.1 time: 1.152589 Nov 02 12:39:17.414550 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1812/3642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:16 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1303 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:17.420110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:17.425276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:17.434882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:17.436134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:17.437551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.438761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:17.439501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:17.440198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.491492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-354aa676-0270-40ba-afc8-53f59c4e6273 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:17.499030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-354aa676-0270-40ba-afc8-53f59c4e6273 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:17.859078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:17.864988 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-354aa676-0270-40ba-afc8-53f59c4e6273 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.480280 Nov 02 12:39:17.866644 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1831/3643] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:17 2022] PUT /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 61 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:17.875423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8f2fbfc-ed85-4cbd-919a-d9226ac4313c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.459550 Nov 02 12:39:17.878562 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1813/3644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:17 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:17.880261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72000c78-492c-4ceb-b175-1d3c41e45527"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:17.884199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:17.892065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:17.894826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:17.895698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:17.896446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.897537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:17.898235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:17.898588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-266e10ea-9a2c-4b0a-b400-01022f2a308d req-57eafb30-091e-42ab-bbe4-7a21fb94881d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ccf37f-d6ce-40ad-a868-e7950e02dd60", "tag": "01568f97-09eb-4fd9-b2f3-4c068f40d4f9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:17.899677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.913462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-266e10ea-9a2c-4b0a-b400-01022f2a308d req-57eafb30-091e-42ab-bbe4-7a21fb94881d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:17.915456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-266e10ea-9a2c-4b0a-b400-01022f2a308d req-57eafb30-091e-42ab-bbe4-7a21fb94881d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:17.916118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-266e10ea-9a2c-4b0a-b400-01022f2a308d req-57eafb30-091e-42ab-bbe4-7a21fb94881d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.944071 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-266e10ea-9a2c-4b0a-b400-01022f2a308d req-57eafb30-091e-42ab-bbe4-7a21fb94881d service nova] Creating event network-changed:01568f97-09eb-4fd9-b2f3-4c068f40d4f9 for instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 on n-h1-855650-5 Nov 02 12:39:17.951191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-266e10ea-9a2c-4b0a-b400-01022f2a308d req-57eafb30-091e-42ab-bbe4-7a21fb94881d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070969 Nov 02 12:39:17.953280 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1814/3645] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:17.963826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0493976a-6ec4-4a2f-97e7-96b6cc9416a6 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Action: 'create', calling method: .version_select at 0x7f228dbc8e50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:18.063889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-0493976a-6ec4-4a2f-97e7-96b6cc9416a6 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:18.074275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-0493976a-6ec4-4a2f-97e7-96b6cc9416a6 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Getting quotas for user 2db5171207084cf3b8db7a0546d944f9 and project ae2853d48b8a46289e3d41624d1239f7. Resources: dict_keys(['metadata_items']) {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:18.386251 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55d9a1ed-ad99-4d60-baee-94ba340b3d98 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515294 Nov 02 12:39:18.387536 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1832/3646] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:39:17 2022] POST /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:18.412406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:18.413506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:18.435067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.437874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.442521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:18.448140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.449726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.450780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:18.651340 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0493976a-6ec4-4a2f-97e7-96b6cc9416a6 tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "POST /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.691882 Nov 02 12:39:18.652117 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1815/3647] 10.222.0.45 () {60 vars in 1281 bytes} [Wed Nov 2 12:39:17 2022] POST /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 85 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:18.664225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:18.666728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:18.677186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.682083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.682083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:18.682083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.682083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.682746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:18.870516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:18.892805 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-215dce88-83b7-4796-b043-04ecd798bfbe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.490494 Nov 02 12:39:18.909647 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1833/3648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:18 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:18.909647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a0f586a9-1658-480f-9830-478fa040cb9b tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] Calling method '.version_select at 0x7f22929dad30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:18.966189 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a0f586a9-1658-480f-9830-478fa040cb9b tempest-ImagesMetadataTestJSON-2046689868 tempest-ImagesMetadataTestJSON-2046689868-project] 10.222.0.45 "GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.071231 Nov 02 12:39:18.967527 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1834/3649] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Nov 2 12:39:18 2022] GET /compute/v2.1/images/f5a331db-2b9f-42fe-ab7d-2d17dfcda51e/metadata => generated 85 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:18.978655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:18.979298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:18.996140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.996670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.997142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:18.998076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.998555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.998993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:19.684636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:19.695116 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5149dc0-20a2-451b-9e9e-0a26d95588e8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.726045 Nov 02 12:39:19.696202 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1835/3650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:18 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:19.700192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:19.713332 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b5a245f3-f9c7-4193-84f8-97e8eac1426e tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1291 microversion: 2.1 time: 1.059481 Nov 02 12:39:19.718707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-34a5fd57-d49a-40b5-89db-cb761b4ebc55 req-337b0294-a960-4e48-a278-19928675560d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb56fdc-ed37-4237-a01a-70221545fb3e", "tag": "f0ac7e5a-dc52-48ce-99d2-767d0eb4b958"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:19.732049 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1816/3651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:18 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1291 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:19.739031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-34a5fd57-d49a-40b5-89db-cb761b4ebc55 req-337b0294-a960-4e48-a278-19928675560d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:19.745564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-34a5fd57-d49a-40b5-89db-cb761b4ebc55 req-337b0294-a960-4e48-a278-19928675560d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:19.749462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-34a5fd57-d49a-40b5-89db-cb761b4ebc55 req-337b0294-a960-4e48-a278-19928675560d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:19.774018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:19.776945 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-34a5fd57-d49a-40b5-89db-cb761b4ebc55 req-337b0294-a960-4e48-a278-19928675560d service nova] Creating event network-changed:f0ac7e5a-dc52-48ce-99d2-767d0eb4b958 for instance 1cb56fdc-ed37-4237-a01a-70221545fb3e on n-h1-855650-5 Nov 02 12:39:19.785917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-34a5fd57-d49a-40b5-89db-cb761b4ebc55 req-337b0294-a960-4e48-a278-19928675560d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070872 Nov 02 12:39:19.786825 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1836/3652] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:19.926397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:19.927931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:19.938540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:19.939579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:19.940255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:19.941616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:19.942342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:19.943033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:20.193199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:20.209360 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9e73695-afff-440e-ae26-82e4d7023eed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.296054 Nov 02 12:39:20.210457 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1817/3653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:19 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:20.724519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:20.726743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:20.737928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:20.739855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:20.763074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:20.764463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:20.773324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:20.774901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:20.775437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:20.775892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:20.776756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:20.777082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:20.777511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:20.780896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:20.783683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:20.784801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:20.785458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:20.786166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:21.107916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:21.123807 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb622828-ac1f-4a14-ac38-6db743cd342f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.403049 Nov 02 12:39:21.124604 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1837/3654] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:20 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:21.151382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:21.166785 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac20b7b6-b582-4761-a092-fa8d57c4c4f1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1291 microversion: 2.1 time: 0.433087 Nov 02 12:39:21.183721 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1818/3655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:20 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1291 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:21.241043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:21.241660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:21.248411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:21.248911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:21.249422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:21.250234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:21.250838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:21.251305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:21.936988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:21.952325 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4fcc17c7-aba9-4f92-b41a-b35ea6d46673 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.714812 Nov 02 12:39:21.956228 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1838/3656] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:21 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:22.153048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:22.153660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:22.173580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:22.174127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:22.174926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:22.176106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:22.176565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:22.176995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:22.200591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:22.201210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:22.213591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:22.215774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:22.216903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:22.222425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:22.223624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:22.224731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:22.981681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:23.004452 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fca03f68-6ea8-49fe-ba42-158a93a8acb8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.855492 Nov 02 12:39:23.006378 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1819/3657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:22 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:23.022495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:23.023552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:23.036784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:23.037611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:23.038252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:23.040006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:23.040702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:23.041331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:23.082155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:23.092325 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1825fa5-f0d0-47a1-8875-bfb7521df0ae tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1291 microversion: 2.1 time: 0.896399 Nov 02 12:39:23.098305 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1839/3658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:22 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1291 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:23.435031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:23.450243 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ab1e357-9aa6-441c-b1ec-44ec5778ae19 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.442399 Nov 02 12:39:23.451060 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1820/3659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:23 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:24.046011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:24.047174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:24.065616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.068080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.068861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:24.072509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.077983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.078887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:24.146595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:24.147579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:24.173356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.174299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.176139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:24.178125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.186581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.188218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:25.172790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:25.179060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:25.190141 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3f6a67eb-43dd-44cb-a8cf-8087e6fdcedd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 1.149035 Nov 02 12:39:25.193173 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a38dac2e-bf85-4b2d-942a-e285807d4bb2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1291 microversion: 2.1 time: 1.050715 Nov 02 12:39:25.198395 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1840/3660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:24 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:25.208550 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1821/3661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:24 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1291 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:25.210908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:25.212513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:25.226052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:25.231343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:25.232000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:25.233094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:25.236033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:25.237426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:25.760785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:25.777268 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac80e805-a07d-419f-b0a4-96f5ce95a095 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.577084 Nov 02 12:39:25.777940 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1841/3662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:25 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:26.220931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:26.221720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:26.243745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:26.244553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:26.253248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.257418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.259324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.267669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.268178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.268706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.278356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.279737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.280674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.286040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.288245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.290576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.750615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:26.750883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:26.763141 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-767e880e-04d2-41db-bb90-c9ac44608d31 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1291 microversion: 2.1 time: 0.526321 Nov 02 12:39:26.766273 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1842/3663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:26 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1291 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:26.771467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c5667dd0-cb51-4cb7-aedb-03bbb06b02b0 req-dcfd65c7-cdfd-4891-8a85-a0eee0f13a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ccf37f-d6ce-40ad-a868-e7950e02dd60", "name": "network-vif-plugged", "status": "completed", "tag": "01568f97-09eb-4fd9-b2f3-4c068f40d4f9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:26.791645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c5667dd0-cb51-4cb7-aedb-03bbb06b02b0 req-dcfd65c7-cdfd-4891-8a85-a0eee0f13a16 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.792129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c5667dd0-cb51-4cb7-aedb-03bbb06b02b0 req-dcfd65c7-cdfd-4891-8a85-a0eee0f13a16 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.792566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c5667dd0-cb51-4cb7-aedb-03bbb06b02b0 req-dcfd65c7-cdfd-4891-8a85-a0eee0f13a16 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.799899 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a095f18-4d53-4b2b-8708-8aea71e9b897 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.581920 Nov 02 12:39:26.801002 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1822/3664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:26 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:26.816396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:26.821800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:26.834688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.836242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.837324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.838864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.843896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.844172 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c5667dd0-cb51-4cb7-aedb-03bbb06b02b0 req-dcfd65c7-cdfd-4891-8a85-a0eee0f13a16 service nova] Creating event network-vif-plugged:01568f97-09eb-4fd9-b2f3-4c068f40d4f9 for instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 on n-h1-855650-5 Nov 02 12:39:26.845207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.866118 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c5667dd0-cb51-4cb7-aedb-03bbb06b02b0 req-dcfd65c7-cdfd-4891-8a85-a0eee0f13a16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098235 Nov 02 12:39:26.866865 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1843/3665] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:27.357855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:27.374634 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af422104-8e15-4f61-ac75-1bfa07e31419 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.569320 Nov 02 12:39:27.375691 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1823/3666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:26 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:27.802108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=34 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:27.812223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:27.814073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:27.827058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:27.828405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:27.829431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:27.831184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:27.832464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:27.832964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:27.833792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:27.834394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:27.844397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:27.844928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:27.847760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:27.852494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:27.854424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:27.855561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:28.084439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=30 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:28.452674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:28.464587 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2edc7d5-c819-4983-86a0-744e409ce3e4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1291 microversion: 2.1 time: 0.666618 Nov 02 12:39:28.465816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:28.471881 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1844/3667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:27 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1291 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:28.482182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:28.484691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84887e72-79f7-401a-87f2-a7cbd02bac06 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.656807 Nov 02 12:39:28.486043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:28.486774 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1824/3668] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:27 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:28.503047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:28.504465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:28.507031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:28.510316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:28.511808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:28.512781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:28.795641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:28.807618 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e83bced-8978-49e0-93ee-e3699a53e34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.333070 Nov 02 12:39:28.808319 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1845/3669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:28 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:29.294608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d85eda61-8885-4fbc-94d1-067f169667af req-094b81de-848a-43a9-8a67-a5ef63918c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7522fbf-cc29-4ae9-a95b-16214f7b1d40", "name": "network-vif-plugged", "status": "completed", "tag": "4fa46058-46e4-40f8-809e-67f3dc4f0e93"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:29.309227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d85eda61-8885-4fbc-94d1-067f169667af req-094b81de-848a-43a9-8a67-a5ef63918c53 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.309718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d85eda61-8885-4fbc-94d1-067f169667af req-094b81de-848a-43a9-8a67-a5ef63918c53 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.310527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d85eda61-8885-4fbc-94d1-067f169667af req-094b81de-848a-43a9-8a67-a5ef63918c53 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.331116 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d85eda61-8885-4fbc-94d1-067f169667af req-094b81de-848a-43a9-8a67-a5ef63918c53 service nova] Creating event network-vif-plugged:4fa46058-46e4-40f8-809e-67f3dc4f0e93 for instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 on n-h2-855650-5 Nov 02 12:39:29.345268 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d85eda61-8885-4fbc-94d1-067f169667af req-094b81de-848a-43a9-8a67-a5ef63918c53 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055470 Nov 02 12:39:29.347210 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1825/3670] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:29.489180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:29.490641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:29.500786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.502307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.503782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.507745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.511174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.511949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.518986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:29.520393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:29.528462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.529479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.530199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.531124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.532141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.532785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.927623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:29.935021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:29.938783 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b311c26d-633c-4132-ae82-aedfa8a13289 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1291 microversion: 2.1 time: 0.454189 Nov 02 12:39:29.943105 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1846/3671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:29 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1291 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:29.949203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03ee3230-20ab-44e5-a945-c29bcf1d2167 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.435903 Nov 02 12:39:29.949764 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1826/3672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:29 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:29.962685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:29.964610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:29.972215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.973147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.974542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.975690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.976342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.977048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:30.308379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:30.322962 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0330407d-0ef7-4af1-8605-4146c4720d85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1308 microversion: 2.1 time: 0.378676 Nov 02 12:39:30.324417 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1847/3673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:29 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:30.980740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:30.981439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:30.985442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:30.986787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:30.995965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:30.996466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:30.996912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:30.997623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:30.998106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:30.998544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.005491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.006031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.006466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.007195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.007654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.008131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.468527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:31.475236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:31.491490 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6627b79f-b4fd-4fb9-aaba-7e68945276a6 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1291 microversion: 2.1 time: 0.527196 Nov 02 12:39:31.496719 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1827/3674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:30 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1291 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:31.500878 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5bfccd8a-88c6-45fd-841b-3b6baf4291e1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.529669 Nov 02 12:39:31.505125 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1848/3675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:30 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:31.506619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:31.507566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:31.515888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.516695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.517434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.518477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.519156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.519926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.763536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:31.775383 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cb8e86d-a34e-423d-adc9-922262e45482 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1488 microversion: 2.1 time: 0.277038 Nov 02 12:39:31.777925 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1828/3676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:31 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1488 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:31.805547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:31.806553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:31.818696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.824112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.824984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.826113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.827819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.829623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.916542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lazy-loading 'flavor' on Instance uuid 47ccf37f-d6ce-40ad-a868-e7950e02dd60 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:32.052812 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6305108-0a41-41c3-a38f-1fee6ec5fc3b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60/action" status: 202 len: 0 microversion: 2.1 time: 0.251003 Nov 02 12:39:32.055463 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1849/3677] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:39:31 2022] POST /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:39:32.063820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:32.065394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:32.076543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:32.081756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:32.082874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:32.083879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:32.084572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:32.087646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:32.217917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec72e2d0-f7ad-4e12-9905-b5c3d9bb7650"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:32.227435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:32.237311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:32.243848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:32.244385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:32.245132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:32.245643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:32.246066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:32.425812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:32.443802 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82fc5d5e-5802-4081-96cd-49168ac0bdc8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1496 microversion: 2.1 time: 0.384176 Nov 02 12:39:32.444833 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1829/3678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:32 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1496 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:32.655790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-393791290", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5cf3c128-0f29-45a5-959b-e98a60998e0d"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:32.718444 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-70902f82-7f18-4a9f-b137-19864a0bacb0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489995 Nov 02 12:39:32.720610 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1850/3679] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:39:32 2022] POST /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:39:32.731140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:32.733991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:32.745009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:32.745698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:32.761416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:32.762434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:32.763118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:32.763733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:32.785603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] validate_networks() for [('5cf3c128-0f29-45a5-959b-e98a60998e0d', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:32.812383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:33.910716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:33.921594 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e303409f-c35f-46e0-af64-007b2fb6bd93 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1482 microversion: 2.1 time: 1.199331 Nov 02 12:39:33.926128 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1851/3680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:32 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1482 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:33.942843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:33.943715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:33.978558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:33.979265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:33.979895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:33.980663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:33.981129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:33.981564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.778232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:34.826186 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce6c69f1-b61b-453a-ad2f-55e284f154d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.898651 Nov 02 12:39:34.826911 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1852/3681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:33 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:34.832462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:34.833258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:34.842101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:34.842972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:34.843640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.844687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:34.846524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:34.847261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.893566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:34.899724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:39:34.907000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:34.908979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:34.909675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:34.910409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:34.931123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:34.932031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:34.933009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.934361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:34.935093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:34.935754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.980117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Getting quotas for project 0fd477702de64a558f540c617feea703. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:35.029894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Getting quotas for user 9c0e502afdee43378bdb22ff55d28263 and project 0fd477702de64a558f540c617feea703. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:35.084725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Going to run 2 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:39:35.088402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: df5d5b47-e25a-460f-a061-6736f4d92346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:35.107567 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff9c8de7-96ac-488b-87d0-d64e2932d56f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 204 len: 0 microversion: 2.1 time: 0.279045 Nov 02 12:39:35.113050 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1853/3682] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:34 2022] DELETE /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:35.135232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:35.135957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:35.148852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.149507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.149944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.150875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.151647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.152244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.184768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=df5d5b47-e25a-460f-a061-6736f4d92346,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:35.328407 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-405cab33-d97c-4a28-8402-4a5f13e94220 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.881456 Nov 02 12:39:35.329876 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1830/3683] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:39:35.366569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:35.368278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:35.380052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.382296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.383851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.385445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.386897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.387944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.653921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8fde6988-59c5-42b6-882e-873794b760e2 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.321946 Nov 02 12:39:35.656130 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1831/3684] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:39:35 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40/os-interface => generated 285 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:35.679824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2b577612-b273-485b-98f9-5715defff925 req-7e08176e-6dd9-4237-b682-46835d564df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb56fdc-ed37-4237-a01a-70221545fb3e", "name": "network-vif-plugged", "status": "completed", "tag": "f0ac7e5a-dc52-48ce-99d2-767d0eb4b958"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:35.703377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:35.719821 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9064d696-9407-4620-9d93-b4ed086e6798 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 200 len: 1479 microversion: 2.1 time: 0.594612 Nov 02 12:39:35.719978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b577612-b273-485b-98f9-5715defff925 req-7e08176e-6dd9-4237-b682-46835d564df2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.720728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b577612-b273-485b-98f9-5715defff925 req-7e08176e-6dd9-4237-b682-46835d564df2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.721670 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1854/3685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:35 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 1479 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:35.722465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b577612-b273-485b-98f9-5715defff925 req-7e08176e-6dd9-4237-b682-46835d564df2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.745183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:35.746401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:35.777665 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2b577612-b273-485b-98f9-5715defff925 req-7e08176e-6dd9-4237-b682-46835d564df2 service nova] Creating event network-vif-plugged:f0ac7e5a-dc52-48ce-99d2-767d0eb4b958 for instance 1cb56fdc-ed37-4237-a01a-70221545fb3e on n-h1-855650-5 Nov 02 12:39:35.791065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2b577612-b273-485b-98f9-5715defff925 req-7e08176e-6dd9-4237-b682-46835d564df2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114832 Nov 02 12:39:35.792453 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1832/3686] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:35.796172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.797012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.801662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:35.803670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.804579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.805065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.805500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.809726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:35.811437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Searching by: {'deleted': False, 'project_id': '0fd477702de64a558f540c617feea703'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:39:35.834813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.836307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.837161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.838350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.839107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.840209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.875135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:35.880833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5bf4537f-df9e-4117-866f-c2fb11781c2b tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.085749 Nov 02 12:39:35.889802 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1833/3687] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:39:35 2022] GET /compute/v2.1/servers => generated 675 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:35.895613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-994344027"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:35.901615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:35.909926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.911327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.912065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.914618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.915771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.916456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.659908 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c5fcfcd-b942-4d22-aafa-57c7c6a150e0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60/action" status: 202 len: 0 microversion: 2.1 time: 0.767570 Nov 02 12:39:36.661382 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1834/3688] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:39:35 2022] POST /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:39:36.677549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:36.677818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:36.687451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:36.688296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:36.688951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.690343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:36.698644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:36.699542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.709509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:36.723476 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e6c3564-3c2e-4c16-b6dd-2a49b569438f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1554 microversion: 2.1 time: 0.999650 Nov 02 12:39:36.732032 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1855/3689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:35 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1554 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:36.748179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0750a4dd-0131-48e8-bf01-ee60c3da2c40 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:36.754031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0750a4dd-0131-48e8-bf01-ee60c3da2c40 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:36.987339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0750a4dd-0131-48e8-bf01-ee60c3da2c40 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:36.996132 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0750a4dd-0131-48e8-bf01-ee60c3da2c40 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1219 microversion: 2.1 time: 0.262691 Nov 02 12:39:36.996739 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1856/3690] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:36 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1219 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:37.032068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-db6993d5-1ebe-4229-89b7-1e9b3828cb06 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc84af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:37.122347 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-db6993d5-1ebe-4229-89b7-1e9b3828cb06 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.095021 Nov 02 12:39:37.123266 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1857/3691] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:37 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:37.760861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:37.762695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:37.786966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:37.787612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:37.788544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:37.790682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:37.793693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:37.794224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:37.797514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:37.802245 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a02e3b46-b18d-4862-a9fe-b53b4c2a0852 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 1.138868 Nov 02 12:39:37.803254 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1835/3692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:36 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:38.036274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:38.037133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:38.067948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.070886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.072033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.074525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.075109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.077834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.207968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:38.219816 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f02a70cf-1ec7-4414-ac39-00f0da38fedb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1554 microversion: 2.1 time: 0.466808 Nov 02 12:39:38.225279 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1858/3693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:37 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1554 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:38.252674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff0d78b5-73f7-45c9-bde7-9f847977d958 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228f5b53a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:38.332127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:38.342284 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b35d0f56-6a2f-41db-bfbe-ae22f4871a26 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1215 microversion: 2.1 time: 0.323983 Nov 02 12:39:38.357860 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff0d78b5-73f7-45c9-bde7-9f847977d958 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.122103 Nov 02 12:39:38.358510 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1859/3694] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:38 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:38.372100 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1836/3695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:38 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1215 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:38.391201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:38.391721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:38.422185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.422485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.423328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.430187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.431833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.432827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.498541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:39:38.723175 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34b57690-9c76-433b-a9b8-c694cd5d05b1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 204 len: 0 microversion: 2.32 time: 0.352614 Nov 02 12:39:38.729648 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1837/3696] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:38 2022] DELETE /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:39:38.738594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:38.739249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:38.752879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.754657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.755521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.756524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.758503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.759196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.835167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:38.837160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:38.856818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.867868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.874968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.876795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.881991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.892398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:39.317854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:39.331494 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b5c365c-8001-4de1-855e-8d184346417a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1309 microversion: 2.1 time: 0.504622 Nov 02 12:39:39.356525 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1838/3697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:38 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:39.365142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:39.365895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:39.366306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:39.377767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:39.378407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:39.378937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:39.379927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:39.380570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:39.380752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:39.381913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:39.382074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:39.383444 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c103c26b-dd8b-4911-87c6-bddf7dc40841 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2952 microversion: 2.32 time: 0.650249 Nov 02 12:39:39.392399 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1860/3698] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:38 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2952 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:39.397486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8860cfc-1ce9-4a6a-bc41-c2017daefdad tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e093700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:39.481393 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b8860cfc-1ce9-4a6a-bc41-c2017daefdad tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.087685 Nov 02 12:39:39.494424 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1861/3699] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:39 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:39.499484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:39.500120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:39.519367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:39.519873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:39.520315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:39.521025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:39.521477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:39.521907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:39.821122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:39.834337 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59004ceb-4e3f-4436-99b0-95ac572229e6 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1271 microversion: 2.1 time: 0.338539 Nov 02 12:39:39.834963 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1862/3700] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:39 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1271 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:40.124271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:40.141702 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86dba053-3019-4b85-afd2-d105fa1e7548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1554 microversion: 2.1 time: 0.784273 Nov 02 12:39:40.161747 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1839/3701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:39 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1554 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:40.370623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:40.388845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:40.401556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:40.415312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:40.418528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:40.420905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:40.421531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:40.433121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:40.434257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:40.435555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:40.436670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:40.441126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:40.444684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:40.452797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:40.453556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:40.454040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.290892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:41.308940 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ff0e2fe-9695-4454-a378-bbfc79fdbe87 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1489 microversion: 2.1 time: 0.948367 Nov 02 12:39:41.318156 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1863/3702] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:40 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1489 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:41.330523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ee58b3a-c20c-480f-a01d-bba97803448c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292a08310>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:41.422109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ee58b3a-c20c-480f-a01d-bba97803448c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.110811 Nov 02 12:39:41.426608 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1864/3703] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:41 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:41.442600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:41.444130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:41.488894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:41.508754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.511000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.512602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.513679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:41.515285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.516496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.518684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.526770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:41.528127 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f344069a-faf4-443d-ab4f-438d1ecf13c7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2952 microversion: 2.32 time: 1.112703 Nov 02 12:39:41.552797 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1840/3704] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:40 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2952 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:41.568068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9f3a7a90-d8a3-42ab-a491-b5c08ad796f2 req-b2991dc4-ca1c-452b-b71b-9b80323e7916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3e53a7-4714-4d91-83b1-537a2b0f9163", "name": "network-vif-deleted", "tag": "25495928-f073-4cb1-948f-66690b3dbc80"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:41.589415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9f3a7a90-d8a3-42ab-a491-b5c08ad796f2 req-b2991dc4-ca1c-452b-b71b-9b80323e7916 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.590282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9f3a7a90-d8a3-42ab-a491-b5c08ad796f2 req-b2991dc4-ca1c-452b-b71b-9b80323e7916 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.590946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9f3a7a90-d8a3-42ab-a491-b5c08ad796f2 req-b2991dc4-ca1c-452b-b71b-9b80323e7916 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.627417 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9f3a7a90-d8a3-42ab-a491-b5c08ad796f2 req-b2991dc4-ca1c-452b-b71b-9b80323e7916 service nova] Creating event network-vif-deleted:25495928-f073-4cb1-948f-66690b3dbc80 for instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 on n-h2-855650-5 Nov 02 12:39:41.638682 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9f3a7a90-d8a3-42ab-a491-b5c08ad796f2 req-b2991dc4-ca1c-452b-b71b-9b80323e7916 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084156 Nov 02 12:39:41.639313 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1841/3705] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:41.657635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:41.659066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:41.674916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.678332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.679080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.680746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.682639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.683352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.745215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:41.757875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84f53427-c3e5-4376-b1f2-10f861981987 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1277 microversion: 2.1 time: 0.328819 Nov 02 12:39:41.758338 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1865/3706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:41 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:41.773562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1673207126", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "3df2b834-542d-4af7-a2f7-6a848f5dc1f3"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:41.869479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] validate_networks() for [('3df2b834-542d-4af7-a2f7-6a848f5dc1f3', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:41.869771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:41.883028 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7402700-e4a2-4df3-b633-7d5fafb117f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1346 microversion: 2.1 time: 0.237225 Nov 02 12:39:41.887326 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1842/3707] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:41 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1346 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:41.898286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:41.899220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:41.916611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.916876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.917337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.918279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.918780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.919227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:42.296562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:42.309222 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be5a48bb-9c23-46ff-9fc0-b3b82120b583 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1482 microversion: 2.1 time: 0.420124 Nov 02 12:39:42.314338 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1843/3708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:41 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1482 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:42.467288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-946211d3-b16e-4498-9535-c0301ef905ac tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db2ba60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:42.549263 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-946211d3-b16e-4498-9535-c0301ef905ac tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.103169 Nov 02 12:39:42.552499 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1844/3709] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:42 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:42.571330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:42.574386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:42.595371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:42.597103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:42.598529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:42.600518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:42.602717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:42.606660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.235832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:43.254270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:43.256338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:43.261465 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f5d80f50-1985-46ab-ab14-b311f3865d70 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2952 microversion: 2.32 time: 0.702214 Nov 02 12:39:43.263425 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1845/3710] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:42 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2952 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:43.271089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-de56de45-f37b-4e02-bf33-ba3d59e6a52d req-f59f7dc6-f092-4dae-86dc-333fd451b10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ccf37f-d6ce-40ad-a868-e7950e02dd60", "name": "network-vif-plugged", "status": "completed", "tag": "01568f97-09eb-4fd9-b2f3-4c068f40d4f9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:43.286369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de56de45-f37b-4e02-bf33-ba3d59e6a52d req-f59f7dc6-f092-4dae-86dc-333fd451b10a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.287409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de56de45-f37b-4e02-bf33-ba3d59e6a52d req-f59f7dc6-f092-4dae-86dc-333fd451b10a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.290525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-de56de45-f37b-4e02-bf33-ba3d59e6a52d req-f59f7dc6-f092-4dae-86dc-333fd451b10a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.308327 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-de56de45-f37b-4e02-bf33-ba3d59e6a52d req-f59f7dc6-f092-4dae-86dc-333fd451b10a service nova] Creating event network-vif-plugged:01568f97-09eb-4fd9-b2f3-4c068f40d4f9 for instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 on n-h1-855650-5 Nov 02 12:39:43.315352 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-de56de45-f37b-4e02-bf33-ba3d59e6a52d req-f59f7dc6-f092-4dae-86dc-333fd451b10a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050212 Nov 02 12:39:43.316505 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1846/3711] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:43.329405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:43.330443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:43.340828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.342189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.342902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.345612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.346534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.347190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.735774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:43.758716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aba52eda-c9e8-44fc-ba62-394fa2cfbba2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1277 microversion: 2.1 time: 0.432636 Nov 02 12:39:43.773539 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1847/3712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:43 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1277 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:43.800694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:43.803837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:43.830777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.831654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.832313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.834151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.834840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.836923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.011358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:44.032279 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ed267460-8a8d-4e28-b8a0-bd3f388280a0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1346 microversion: 2.1 time: 0.259652 Nov 02 12:39:44.033399 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1848/3713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:43 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1346 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:44.039816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14129ba2-2141-4788-85de-79c43c60ad56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228daefa60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:44.190463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14129ba2-2141-4788-85de-79c43c60ad56 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.153944 Nov 02 12:39:44.194470 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1849/3714] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:44 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:44.214825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7f4fe801-384c-4ceb-bae0-c7ba3b80a989 req-490e8d61-3661-47d6-9d3f-754a413a4bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7522fbf-cc29-4ae9-a95b-16214f7b1d40", "tag": "4fa46058-46e4-40f8-809e-67f3dc4f0e93"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:44.240106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f4fe801-384c-4ceb-bae0-c7ba3b80a989 req-490e8d61-3661-47d6-9d3f-754a413a4bb6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.245319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f4fe801-384c-4ceb-bae0-c7ba3b80a989 req-490e8d61-3661-47d6-9d3f-754a413a4bb6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.250015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f4fe801-384c-4ceb-bae0-c7ba3b80a989 req-490e8d61-3661-47d6-9d3f-754a413a4bb6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.270059 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7f4fe801-384c-4ceb-bae0-c7ba3b80a989 req-490e8d61-3661-47d6-9d3f-754a413a4bb6 service nova] Creating event network-changed:4fa46058-46e4-40f8-809e-67f3dc4f0e93 for instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 on n-h2-855650-5 Nov 02 12:39:44.283449 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7f4fe801-384c-4ceb-bae0-c7ba3b80a989 req-490e8d61-3661-47d6-9d3f-754a413a4bb6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080180 Nov 02 12:39:44.285389 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1850/3715] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:44.300480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:44.301920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:44.344997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.345848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.349663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.352271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.353855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.355222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.430471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:45.063792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:45.080020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:45.080880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:45.082184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:45.082947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:45.083705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:45.101492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:45.102235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:45.103089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.105016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:45.105560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:45.106570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.130404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:45.137730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:45.161937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:45.180608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:39:45.182372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:45.187637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:45.188826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:45.192898 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-048ed792-96f7-4c43-a3bb-b797ee70e844 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2952 microversion: 2.32 time: 0.897128 Nov 02 12:39:45.219913 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1851/3716] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:44 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2952 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:45.233502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:45.234459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:45.247143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:45.248386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:45.250215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.252205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:45.254564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:45.256786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.302393 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59c6c695-8f2e-4021-bdb8-a88f91231701 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.530475 Nov 02 12:39:45.303238 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1866/3717] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:39:45.312444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:45.313323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:45.365524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:45.369674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:45.370211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.370964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:45.389890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:45.390639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.643995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:45.655189 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d2480ac6-2cd1-4349-bded-d81779a6febd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1346 microversion: 2.1 time: 0.350636 Nov 02 12:39:45.655664 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1867/3718] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:45 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1346 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:45.689859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b32574e-8913-4995-92c6-1ae7b1e56ec4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f22929d8b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:45.752913 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b32574e-8913-4995-92c6-1ae7b1e56ec4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.081291 Nov 02 12:39:45.761251 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1868/3719] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:45 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:45.771207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8642482-a797-4fc9-81ab-0a913479f13c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:45.772132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8642482-a797-4fc9-81ab-0a913479f13c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:45.862591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:45.937066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8642482-a797-4fc9-81ab-0a913479f13c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:45.948451 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8642482-a797-4fc9-81ab-0a913479f13c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1209 microversion: 2.1 time: 0.185570 Nov 02 12:39:45.951038 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1869/3720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:45 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1209 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:46.051845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:46.069494 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f785cc93-5206-45b2-9f33-936bef5e7686 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1319 microversion: 2.1 time: 0.844870 Nov 02 12:39:46.082854 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1852/3721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:45 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1319 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:46.232888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:46.233807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:46.241325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.242766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.243641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.244551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.245114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.245798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.307676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e74e02b2-c709-48a9-bb02-f2202c8d3eef req-f49e6045-96bb-4831-83d9-f32c8d4f992e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5d5b47-e25a-460f-a061-6736f4d92346", "tag": "d6008b10-5143-49dd-8e63-211e51682553"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:46.321361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e74e02b2-c709-48a9-bb02-f2202c8d3eef req-f49e6045-96bb-4831-83d9-f32c8d4f992e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.322214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e74e02b2-c709-48a9-bb02-f2202c8d3eef req-f49e6045-96bb-4831-83d9-f32c8d4f992e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.322804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e74e02b2-c709-48a9-bb02-f2202c8d3eef req-f49e6045-96bb-4831-83d9-f32c8d4f992e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.344285 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e74e02b2-c709-48a9-bb02-f2202c8d3eef req-f49e6045-96bb-4831-83d9-f32c8d4f992e service nova] Creating event network-changed:d6008b10-5143-49dd-8e63-211e51682553 for instance df5d5b47-e25a-460f-a061-6736f4d92346 on n-h2-855650-5 Nov 02 12:39:46.353822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e74e02b2-c709-48a9-bb02-f2202c8d3eef req-f49e6045-96bb-4831-83d9-f32c8d4f992e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052562 Nov 02 12:39:46.358150 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1853/3722] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:39:46.683693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:46.684743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:46.694499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.696203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.697266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.698334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.698987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.699624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.865830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:46.872535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:46.889661 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3b19e60-948c-4c9a-a15d-fd1125acf6e8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1346 microversion: 2.1 time: 0.209631 Nov 02 12:39:46.890315 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1854/3723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:46 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1346 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:46.901140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b3e2646-910c-408b-8bc2-b91fa9600b70 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228f028e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:46.916991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:46.920046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:46.923809 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d3833c7-cf35-4b6e-8c61-65ccfda61cda tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2952 microversion: 2.32 time: 0.695460 Nov 02 12:39:46.925337 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1870/3724] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:46 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2952 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:46.970066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2b3e2646-910c-408b-8bc2-b91fa9600b70 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.078165 Nov 02 12:39:46.971306 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1855/3725] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:46 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:46.972300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:46.972923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:46.987600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.988104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.988719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.989451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.989904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.990376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.094393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:47.095535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:47.103563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.104220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.104778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.105728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.106465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.107019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.118200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:47.129240 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65e42458-ffc0-42d0-a85d-2e090d2e4b18 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1261 microversion: 2.1 time: 0.160747 Nov 02 12:39:47.132998 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1871/3726] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:46 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:47.672227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:47.680705 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f71c8714-0579-4278-bcc5-a00b46d36b0c tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1319 microversion: 2.1 time: 0.590239 Nov 02 12:39:47.681390 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1856/3727] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:47 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:47.946453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:47.949221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:47.957507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:47.959179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:47.963425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:47.966689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.968116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.971038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.972731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.974457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.975528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.001099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.001932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.009825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.011139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.011978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.012767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.367301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:48.378442 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9fb84809-fca0-4738-b2cb-39d954397530 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1346 microversion: 2.1 time: 0.438060 Nov 02 12:39:48.391943 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1872/3728] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:47 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1346 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:48.404710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-89fa38ac-410f-4faa-bff8-56b4068e3c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc8f550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:48.469123 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-89fa38ac-410f-4faa-bff8-56b4068e3c85 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.072839 Nov 02 12:39:48.481196 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1873/3729] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:48 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:48.486984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:48.488639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:48.498217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.499013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.499733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.502353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.503269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.505810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.934151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:48.938275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:48.977047 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f8176169-a015-43e8-8879-1691a4f2d903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1267 microversion: 2.1 time: 0.493550 Nov 02 12:39:48.986227 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1874/3730] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:48 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1267 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:49.011750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-4f98168f-f7b2-4f07-96d2-023fe64e9089 req-660278bf-bd9a-4f94-a945-9aec3c28cfbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-unplugged", "status": "completed", "tag": "6ea29634-7e85-4371-9350-7f00f347f137"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:49.034433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4f98168f-f7b2-4f07-96d2-023fe64e9089 req-660278bf-bd9a-4f94-a945-9aec3c28cfbe service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:49.036335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4f98168f-f7b2-4f07-96d2-023fe64e9089 req-660278bf-bd9a-4f94-a945-9aec3c28cfbe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:49.037460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4f98168f-f7b2-4f07-96d2-023fe64e9089 req-660278bf-bd9a-4f94-a945-9aec3c28cfbe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:49.063286 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4f98168f-f7b2-4f07-96d2-023fe64e9089 req-660278bf-bd9a-4f94-a945-9aec3c28cfbe service nova] Creating event network-vif-unplugged:6ea29634-7e85-4371-9350-7f00f347f137 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:39:49.078889 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-4f98168f-f7b2-4f07-96d2-023fe64e9089 req-660278bf-bd9a-4f94-a945-9aec3c28cfbe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089145 Nov 02 12:39:49.081010 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1875/3731] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:49.094151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:49.096022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:49.111516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:49.112872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:49.113567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:49.115352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:49.116386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:49.117385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:49.737622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:49.760433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:49.774335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:49.775972 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6b7c442-426d-4f8a-b4fe-be8888a70461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2931 microversion: 2.32 time: 1.825704 Nov 02 12:39:49.803790 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1857/3732] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:47 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2931 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:39:49.814544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:49.816004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:49.833432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:49.836295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:49.836774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:49.837740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:49.838245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:49.838714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.137146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:50.153553 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2c868a34-ade4-403a-8918-f9e57b4070df tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1346 microversion: 2.1 time: 0.347590 Nov 02 12:39:50.167356 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1858/3733] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:49 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1346 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:50.174471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d2b2454c-39c4-4c34-a214-520574c95b88 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db53550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:50.283524 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d2b2454c-39c4-4c34-a214-520574c95b88 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.114222 Nov 02 12:39:50.284739 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1859/3734] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:50 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:50.302496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c64bb339-186f-4d20-bbb7-bbc50c3c94fd req-eb852356-9bf9-4b60-bcf1-eb3796ac9217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1396549-0afd-4bf0-b31b-9bb94b84c8fa", "tag": "b687c428-c264-4f8b-bb52-9f7a2cb8c432"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:50.313357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:50.334022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c64bb339-186f-4d20-bbb7-bbc50c3c94fd req-eb852356-9bf9-4b60-bcf1-eb3796ac9217 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.334890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c64bb339-186f-4d20-bbb7-bbc50c3c94fd req-eb852356-9bf9-4b60-bcf1-eb3796ac9217 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.335450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c64bb339-186f-4d20-bbb7-bbc50c3c94fd req-eb852356-9bf9-4b60-bcf1-eb3796ac9217 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.360377 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c64bb339-186f-4d20-bbb7-bbc50c3c94fd req-eb852356-9bf9-4b60-bcf1-eb3796ac9217 service nova] Creating event network-changed:b687c428-c264-4f8b-bb52-9f7a2cb8c432 for instance d1396549-0afd-4bf0-b31b-9bb94b84c8fa on n-h2-855650-5 Nov 02 12:39:50.370804 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c64bb339-186f-4d20-bbb7-bbc50c3c94fd req-eb852356-9bf9-4b60-bcf1-eb3796ac9217 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084360 Nov 02 12:39:50.373265 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1860/3735] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:50.384312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:50.385907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:50.400189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.401049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.401733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.402947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.403437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.403886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.407378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:50.432233 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-482f5803-ec71-43df-91c5-20835fa9f4df tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1319 microversion: 2.1 time: 1.338745 Nov 02 12:39:50.433832 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1876/3736] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:49 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1319 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:50.640320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:50.657217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-54a9d4a5-953e-4fba-ac9d-7141bcf1c3a2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1267 microversion: 2.1 time: 0.280917 Nov 02 12:39:50.671281 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1861/3737] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:50 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:50.812343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:50.815385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:50.824192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:50.826986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:50.830504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.831656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.832464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.836974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.837755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.838462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.845383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.849324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.850295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.854113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.855647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.858457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.928593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lazy-loading 'flavor' on Instance uuid 170451bf-340f-489f-87d4-4fda741d2b9f {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:51.364557 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-712383aa-2559-4e1a-8249-d99c74477d0a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/action" status: 200 len: 32 microversion: 2.1 time: 0.553459 Nov 02 12:39:51.367077 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1877/3738] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:39:50 2022] POST /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/action => generated 32 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:51.387797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-46637346-95e2-4cd6-a942-efb38174687f req-0d6f7c2d-a05a-44a4-b762-3a7504f43fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-unplugged", "status": "completed", "tag": "e0d29879-e0b6-463c-842f-6b6ea81d4651"}, {"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-unplugged", "status": "completed", "tag": "22fd6bd7-c6b4-4d2a-8460-2167ba242deb"}, {"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-unplugged", "status": "completed", "tag": "a5e3df2e-ea9d-46cc-8b90-9a43e80064a6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:51.433055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-46637346-95e2-4cd6-a942-efb38174687f req-0d6f7c2d-a05a-44a4-b762-3a7504f43fbb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.434139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-46637346-95e2-4cd6-a942-efb38174687f req-0d6f7c2d-a05a-44a4-b762-3a7504f43fbb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.434139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-46637346-95e2-4cd6-a942-efb38174687f req-0d6f7c2d-a05a-44a4-b762-3a7504f43fbb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.482516 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-46637346-95e2-4cd6-a942-efb38174687f req-0d6f7c2d-a05a-44a4-b762-3a7504f43fbb service nova] Creating event network-vif-unplugged:e0d29879-e0b6-463c-842f-6b6ea81d4651 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:39:51.482812 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-46637346-95e2-4cd6-a942-efb38174687f req-0d6f7c2d-a05a-44a4-b762-3a7504f43fbb service nova] Creating event network-vif-unplugged:22fd6bd7-c6b4-4d2a-8460-2167ba242deb for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:39:51.484754 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-46637346-95e2-4cd6-a942-efb38174687f req-0d6f7c2d-a05a-44a4-b762-3a7504f43fbb service nova] Creating event network-vif-unplugged:a5e3df2e-ea9d-46cc-8b90-9a43e80064a6 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:39:51.505573 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-46637346-95e2-4cd6-a942-efb38174687f req-0d6f7c2d-a05a-44a4-b762-3a7504f43fbb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.134111 Nov 02 12:39:51.509024 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1878/3739] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:51.523868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:51.524697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:51.549673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.550379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.550843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.551610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.553770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.554361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.648408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.653126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.653954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.654300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lazy-loading 'fault' on Instance uuid 9f3e53a7-4714-4d91-83b1-537a2b0f9163 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:52.032620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.056382 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b653021-de06-423b-90bd-6823d03d6670 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 200 len: 1351 microversion: 2.1 time: 0.545778 Nov 02 12:39:52.058571 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1879/3740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:51 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 1351 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:52.079740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9f5485aa-afa1-46b0-aa71-a7f55719443f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc950d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:52.167142 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9f5485aa-afa1-46b0-aa71-a7f55719443f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.105181 Nov 02 12:39:52.178270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1880/3741] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:52 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:52.190916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:52.194051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:52.228125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.231112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.237763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.238081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.240023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.242904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.758784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.772330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.778647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.786582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9aac89e-29fd-472e-8cf5-be4147593b9b tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2910 microversion: 2.32 time: 1.968949 Nov 02 12:39:52.803518 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1862/3742] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:50 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2910 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:39:52.826930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:52.827707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:52.844238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.844854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.845317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.848656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.849292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.849756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.528433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:53.543561 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9f0d3408-2ab4-4511-b19c-226a63a3609e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 1.363554 Nov 02 12:39:53.556653 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1881/3743] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:52 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:53.564716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:53.564716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:53.587186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:53.587795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:53.588313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.589108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:53.589715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:53.590569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.761565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:53.783043 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c4506d7d-2e59-4223-8547-fef51ed94111 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1319 microversion: 2.1 time: 0.975652 Nov 02 12:39:53.786101 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1863/3744] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:52 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1319 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:53.804132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:53.805164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:53.816532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:53.817646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:53.822239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.824799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:53.829542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:53.831414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.860134 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 HTTP/1.1 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9f3e53a7-4714-4d91-83b1-537a2b0f9163'} Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:53.862701 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f876bd8e-88b0-4fe2-b5c5-4fc62ff5f7e1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 404 len: 111 microversion: 2.1 time: 0.076571 Nov 02 12:39:53.870903 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1864/3745] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:53 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:53.877687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8dcaef7-3c10-45e0-98c3-a5805550292f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db2be50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:54.001550 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8dcaef7-3c10-45e0-98c3-a5805550292f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.129707 Nov 02 12:39:54.011509 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1865/3746] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:53 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:54.037323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3dc5a5a2-e9b0-46bc-aa4a-e5ed04396a9e req-c68cb407-a174-41b8-955e-06fbfe872f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-unplugged", "status": "completed", "tag": "111922f9-44fa-4874-bf9a-147981786e2f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:54.066949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3dc5a5a2-e9b0-46bc-aa4a-e5ed04396a9e req-c68cb407-a174-41b8-955e-06fbfe872f2b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.067845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3dc5a5a2-e9b0-46bc-aa4a-e5ed04396a9e req-c68cb407-a174-41b8-955e-06fbfe872f2b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.068616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3dc5a5a2-e9b0-46bc-aa4a-e5ed04396a9e req-c68cb407-a174-41b8-955e-06fbfe872f2b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.113651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:54.123191 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3a568b8a-9bb2-40cd-a49e-949252354943 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1309 microversion: 2.1 time: 0.573906 Nov 02 12:39:54.134927 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1882/3747] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:53 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1309 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:54.140887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:54.145040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:54.159568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.160482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.161388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.162415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.165047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.168140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3dc5a5a2-e9b0-46bc-aa4a-e5ed04396a9e req-c68cb407-a174-41b8-955e-06fbfe872f2b service nova] Creating event network-vif-unplugged:111922f9-44fa-4874-bf9a-147981786e2f for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:39:54.169041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.181890 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3dc5a5a2-e9b0-46bc-aa4a-e5ed04396a9e req-c68cb407-a174-41b8-955e-06fbfe872f2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155142 Nov 02 12:39:54.182562 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1866/3748] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:54.202269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:54.209430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:54.217790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.218842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.219518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.220481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.221120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.222738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.250748 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163/os-volume_attachments HTTP/1.1 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': '9f3e53a7-4714-4d91-83b1-537a2b0f9163'} Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:54.253061 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:39:54.259695 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:39:54.263200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:54.264912 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90683b3b-7e52-4b92-a7a3-fb7077193153 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074781 Nov 02 12:39:54.266491 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1867/3749] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:39:54 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163/os-volume_attachments => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:54.567057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:54.583683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:54.584921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:54.585278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:54.588780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:54.599227 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ecc57f7b-d900-4d1e-824a-56f042b8b9e4 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2910 microversion: 2.32 time: 0.462265 Nov 02 12:39:54.602141 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1883/3750] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:54 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2910 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:54.623929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.624644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.627559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.630019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.630806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.633742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.736132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-84851062", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a20add55-dae0-40be-a4a7-4b9397826fb8"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:54.908176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] validate_networks() for [('a20add55-dae0-40be-a4a7-4b9397826fb8', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:55.119342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:55.715500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:55.727556 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2330735c-75e1-4e27-86d5-57e9d9980c25 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 1.151741 Nov 02 12:39:55.732626 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1868/3751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:54 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:55.741562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:55.744196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:55.772691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:55.774073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:55.774730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:55.775868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:55.777027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:55.778417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:55.942936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:56.527596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:56.561592 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14294b4c-6052-4e89-8f5a-692d9f4d4674 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1319 microversion: 2.1 time: 0.827392 Nov 02 12:39:56.568194 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1869/3752] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:55 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1319 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:56.624987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b7f3265f-5eaf-4bb4-aa8b-b8910702334c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dac2d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:56.715120 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b7f3265f-5eaf-4bb4-aa8b-b8910702334c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.116555 Nov 02 12:39:56.717807 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1870/3753] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:56 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:56.724574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:56.726476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:56.734319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:56.736242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:56.736953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:56.737921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:56.739145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:56.739785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:57.088476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:57.089245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:57.089412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:57.090332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:57.090332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:57.132608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:57.134063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:57.136476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:57.138212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:57.139563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:57.143439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:57.178417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:57.189474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for user 6488e600776547958e00ab146f079c46 and project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:57.216178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:39:57.219488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:57.341683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f80642d4-8b29-4e90-b491-54737556ec47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.619981 Nov 02 12:39:57.344230 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1884/3754] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:39:57.358982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-2fb72924-b47c-402f-9901-bec1af35bcd2 req-19a93261-cc69-41b4-bc13-aeb5286e7a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-deleted", "tag": "111922f9-44fa-4874-bf9a-147981786e2f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:57.390916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2fb72924-b47c-402f-9901-bec1af35bcd2 req-19a93261-cc69-41b4-bc13-aeb5286e7a4f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:57.391735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2fb72924-b47c-402f-9901-bec1af35bcd2 req-19a93261-cc69-41b4-bc13-aeb5286e7a4f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:57.392487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2fb72924-b47c-402f-9901-bec1af35bcd2 req-19a93261-cc69-41b4-bc13-aeb5286e7a4f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:57.409276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:57.433268 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb951ad1-f53a-4586-ab15-4e684318dd09 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1309 microversion: 2.1 time: 0.713550 Nov 02 12:39:57.437712 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1871/3755] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:56 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1309 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:57.448182 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-2fb72924-b47c-402f-9901-bec1af35bcd2 req-19a93261-cc69-41b4-bc13-aeb5286e7a4f service nova] Creating event network-vif-deleted:111922f9-44fa-4874-bf9a-147981786e2f for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:39:57.455261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:57.461253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:57.470089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:57.472047 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-2fb72924-b47c-402f-9901-bec1af35bcd2 req-19a93261-cc69-41b4-bc13-aeb5286e7a4f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122296 Nov 02 12:39:57.473704 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1885/3756] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:57.477003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:57.477511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:57.487101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:57.487664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:57.488230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:57.489604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-352fe5c0-03d0-4693-a055-a8e84991ab7c req-f3195abb-0c00-475a-8781-4e07df9db488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5d5b47-e25a-460f-a061-6736f4d92346", "name": "network-vif-plugged", "status": "completed", "tag": "d6008b10-5143-49dd-8e63-211e51682553"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:57.517316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-352fe5c0-03d0-4693-a055-a8e84991ab7c req-f3195abb-0c00-475a-8781-4e07df9db488 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:57.518930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-352fe5c0-03d0-4693-a055-a8e84991ab7c req-f3195abb-0c00-475a-8781-4e07df9db488 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:57.522080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-352fe5c0-03d0-4693-a055-a8e84991ab7c req-f3195abb-0c00-475a-8781-4e07df9db488 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:57.560535 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-352fe5c0-03d0-4693-a055-a8e84991ab7c req-f3195abb-0c00-475a-8781-4e07df9db488 service nova] Creating event network-vif-plugged:d6008b10-5143-49dd-8e63-211e51682553 for instance df5d5b47-e25a-460f-a061-6736f4d92346 on n-h2-855650-5 Nov 02 12:39:57.572646 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-352fe5c0-03d0-4693-a055-a8e84991ab7c req-f3195abb-0c00-475a-8781-4e07df9db488 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095475 Nov 02 12:39:57.573574 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1886/3757] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:57.592276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:57.594788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:57.628707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:57.629527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:57.630699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:57.631647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:57.632896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:57.633604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:59.088256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:59.108681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:59.110954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:59.120440 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e386eace-6ef0-4dda-8f6e-a59fcec7fdd2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2818 microversion: 2.32 time: 1.680812 Nov 02 12:39:59.126751 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1872/3758] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:57 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2818 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:59.141379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:59.146971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:59.164655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:59.165557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:59.176659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:59.178371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:59.179454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:59.180276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:59.309777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:59.338833 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-62a2f160-5529-40a6-b234-4a5aaefef56b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 1.761909 Nov 02 12:39:59.340310 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1887/3759] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:57 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:59.352202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:59.353412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:59.365702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:59.366813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:59.367850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:59.369234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:59.370085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:59.371126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:59.383712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:59.395948 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8894a59f-b75a-44a0-8855-236076708589 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9" status: 200 len: 1209 microversion: 2.1 time: 0.267070 Nov 02 12:39:59.414240 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1873/3760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:59 2022] GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 => generated 1209 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:59.429374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-040df723-8b57-4c86-857c-500a46061e5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dad4c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:59.495980 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-040df723-8b57-4c86-857c-500a46061e5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.079991 Nov 02 12:39:59.506469 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1874/3761] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:59 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:59.512667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:59.513672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:59.522547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:59.523339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:59.523973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:59.525920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:59.526572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:59.527018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:00.361447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:00.375146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89be2531-3e0a-4d53-afef-b361e12e2fd2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1309 microversion: 2.1 time: 0.866816 Nov 02 12:40:00.378960 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1875/3762] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:59 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1309 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:00.398676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:00.410146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:00.411099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:00.413511 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e292a4a9-e1d6-4c54-a170-7355103c5223 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1319 microversion: 2.1 time: 1.071484 Nov 02 12:40:00.415876 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1888/3763] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:59 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1319 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:00.433091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a919324d-93b7-490e-b985-384d94b23501 req-c994cdb9-5e51-4771-8382-8b6376cfd2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-deleted", "tag": "6ea29634-7e85-4371-9350-7f00f347f137"}, {"name": "network-changed", "server_uuid": "10e9bebf-7306-4b45-b442-18b8f8de9a96", "tag": "cdad2bcc-e426-491b-84a3-e10732953241"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:00.438926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:00.440583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:00.441402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:00.442441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:00.443162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:00.443821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:00.458590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a919324d-93b7-490e-b985-384d94b23501 req-c994cdb9-5e51-4771-8382-8b6376cfd2cc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:00.459081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a919324d-93b7-490e-b985-384d94b23501 req-c994cdb9-5e51-4771-8382-8b6376cfd2cc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:00.462809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a919324d-93b7-490e-b985-384d94b23501 req-c994cdb9-5e51-4771-8382-8b6376cfd2cc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:00.470639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:00.476414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:00.494453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a919324d-93b7-490e-b985-384d94b23501 req-c994cdb9-5e51-4771-8382-8b6376cfd2cc service nova] Creating event network-vif-deleted:6ea29634-7e85-4371-9350-7f00f347f137 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:40:00.495012 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a919324d-93b7-490e-b985-384d94b23501 req-c994cdb9-5e51-4771-8382-8b6376cfd2cc service nova] Creating event network-changed:cdad2bcc-e426-491b-84a3-e10732953241 for instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 on n-h1-855650-5 Nov 02 12:40:00.514708 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a919324d-93b7-490e-b985-384d94b23501 req-c994cdb9-5e51-4771-8382-8b6376cfd2cc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.092014 Nov 02 12:40:00.518650 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1889/3764] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:00.526717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:00.527435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:00.551167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:00.552824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:00.553851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:00.557381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:00.558261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:00.560073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:00.701286 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6bfdff5e-c597-4510-ae72-92a7755ab272 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9" status: 204 len: 0 microversion: 2.1 time: 0.299395 Nov 02 12:40:00.702205 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1876/3765] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:00 2022] DELETE /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:00.732271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:00.737439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:00.763780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:00.773595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:00.778073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:00.781304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:00.788244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:00.788880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:01.419711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:01.438869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:01.445684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:01.447531 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2150b75c-dfde-4f95-a268-cd08104ec6b7 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2658 microversion: 2.32 time: 0.927669 Nov 02 12:40:01.452167 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1890/3766] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:00 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2658 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:01.459844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78b3b302-4893-4c01-a7af-f90a2b6c5bfe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc8f160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:01.573946 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78b3b302-4893-4c01-a7af-f90a2b6c5bfe tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.120129 Nov 02 12:40:01.574575 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1891/3767] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:01 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:01.578694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:01.593218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:01.598756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:01.621902 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ed84b4b2-0b88-4997-bc5d-2707d748f02e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 0.905812 Nov 02 12:40:01.626741 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1877/3768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:00 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:01.641796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:01.643931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:01.654369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:01.655422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:01.655578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:01.656272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:01.656776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:01.657232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:01.681814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:01.682452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:01.692585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:01.696288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:01.697628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:01.700033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:01.884167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:01.893990 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dbf68b1a-a537-40b7-801f-1a64f9357bfe tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9" status: 200 len: 1215 microversion: 2.1 time: 0.315296 Nov 02 12:40:01.894908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1892/3769] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:01 2022] GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:01.926869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:01.928122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:01.941458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:01.942386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:01.943046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:01.944182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:01.945437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:01.948726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:02.343269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:02.356851 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-73f542c3-0d0a-4b22-a961-d2b7bbfeea99 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1309 microversion: 2.1 time: 0.728282 Nov 02 12:40:02.357476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1878/3770] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:01 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1309 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:02.375077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ee1c0058-5eb2-4599-955e-e99e6040f31c req-6a2bc738-5152-45b2-8e11-040e00cd9b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1396549-0afd-4bf0-b31b-9bb94b84c8fa", "name": "network-vif-plugged", "status": "completed", "tag": "b687c428-c264-4f8b-bb52-9f7a2cb8c432"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:02.382476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:02.388302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ee1c0058-5eb2-4599-955e-e99e6040f31c req-6a2bc738-5152-45b2-8e11-040e00cd9b35 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:02.389245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ee1c0058-5eb2-4599-955e-e99e6040f31c req-6a2bc738-5152-45b2-8e11-040e00cd9b35 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:02.389919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ee1c0058-5eb2-4599-955e-e99e6040f31c req-6a2bc738-5152-45b2-8e11-040e00cd9b35 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:02.396008 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2197da39-7d4f-4a8d-9df3-a5ffb7412e53 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1319 microversion: 2.1 time: 0.488279 Nov 02 12:40:02.404434 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ee1c0058-5eb2-4599-955e-e99e6040f31c req-6a2bc738-5152-45b2-8e11-040e00cd9b35 service nova] Creating event network-vif-plugged:b687c428-c264-4f8b-bb52-9f7a2cb8c432 for instance d1396549-0afd-4bf0-b31b-9bb94b84c8fa on n-h2-855650-5 Nov 02 12:40:02.410952 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ee1c0058-5eb2-4599-955e-e99e6040f31c req-6a2bc738-5152-45b2-8e11-040e00cd9b35 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042806 Nov 02 12:40:02.412112 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1879/3771] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:02.415786 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1893/3772] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:01 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:02.497720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:02.499823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:02.533176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:02.534491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:02.534958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:02.535700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:02.536170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:02.536697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:02.586399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-990cd91f-46df-403c-9814-86f0e61d4071 req-8d0452c0-78c6-43b1-812d-d48a048688b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-deleted", "tag": "22fd6bd7-c6b4-4d2a-8460-2167ba242deb"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:02.623885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-990cd91f-46df-403c-9814-86f0e61d4071 req-8d0452c0-78c6-43b1-812d-d48a048688b0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:02.627847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-990cd91f-46df-403c-9814-86f0e61d4071 req-8d0452c0-78c6-43b1-812d-d48a048688b0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:02.629660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-990cd91f-46df-403c-9814-86f0e61d4071 req-8d0452c0-78c6-43b1-812d-d48a048688b0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:02.665364 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-990cd91f-46df-403c-9814-86f0e61d4071 req-8d0452c0-78c6-43b1-812d-d48a048688b0 service nova] Creating event network-vif-deleted:22fd6bd7-c6b4-4d2a-8460-2167ba242deb for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:40:02.685168 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-990cd91f-46df-403c-9814-86f0e61d4071 req-8d0452c0-78c6-43b1-812d-d48a048688b0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128442 Nov 02 12:40:02.686548 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1894/3773] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:02.695589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e3075c7e-e327-4d7f-bb86-072b38210c24 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e182280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:02.775494 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e3075c7e-e327-4d7f-bb86-072b38210c24 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.086280 Nov 02 12:40:02.777471 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1895/3774] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:02 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:03.092994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:03.094825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:03.135055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:03.136985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:03.141706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:03.143648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:03.144343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:03.145426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:03.258829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:03.291738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:03.302906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:03.306123 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-209e2126-bf56-4804-8687-58f4880c5ae0 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2658 microversion: 2.32 time: 0.819277 Nov 02 12:40:03.318439 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1880/3775] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:02 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2658 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:03.328285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:03.347331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:03.357746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:03.358642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:03.359437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:03.360457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:03.361275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:03.361921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:03.661912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:03.685094 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9f35eee-4e92-4622-aeec-4a0b5a643122 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9" status: 200 len: 1215 microversion: 2.1 time: 0.363071 Nov 02 12:40:03.690077 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1881/3776] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:03 2022] GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 => generated 1215 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:03.709676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:03.711606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:03.745364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:03.747492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:03.751788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:03.755816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:03.760858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:03.765877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:04.192353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:04.194979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:04.213383 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-71859f43-f530-47c3-86c7-a362a68a35a0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 1.433209 Nov 02 12:40:04.239910 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1896/3777] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:02 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:04.245272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:04.254467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:04.285784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:04.286663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:04.287538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:04.289178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:04.290005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:04.290737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:04.698813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:04.715244 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db6d708b-cee4-414a-b6ef-37106a05d83d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1309 microversion: 2.1 time: 1.023345 Nov 02 12:40:04.715899 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1882/3778] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:03 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1309 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:04.736443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45009015-a915-4041-b019-d9d431bc76e8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dadd790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:04.869809 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-45009015-a915-4041-b019-d9d431bc76e8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.138060 Nov 02 12:40:04.880795 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1883/3779] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:04 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:04.899390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:04.907164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:04.935918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:04.936722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:04.937371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:04.938599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:04.939064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:04.939486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:05.825206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:05.836309 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fecbbe94-6fe2-40bb-89f5-d3f8884430fa tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1319 microversion: 2.1 time: 1.594683 Nov 02 12:40:05.841960 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1897/3780] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:04 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1319 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:05.851632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:05.854750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:05.875951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:05.876955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:05.877827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:05.878938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:05.879672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:05.882336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:06.155059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:06.173064 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b1a04e3-5d9e-4dc2-9027-586f3d0e98a9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9" status: 200 len: 1217 microversion: 2.1 time: 0.328185 Nov 02 12:40:06.174509 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1898/3781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:05 2022] GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 => generated 1217 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:06.190771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:06.206793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:06.212548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:06.219723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:06.226643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:06.231638 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7a327c02-ac67-43cd-acef-9df53f8acf05 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2544 microversion: 2.32 time: 1.347484 Nov 02 12:40:06.232446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:06.234428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:06.235113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:06.235531 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1884/3782] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:04 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2544 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:06.238102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:06.238783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:06.240498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:06.259995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:06.261087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:06.289550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:06.293267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:06.294344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:06.297226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:06.298564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:06.300631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:07.107519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:07.141298 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e856e84-5e18-49ba-b4bf-beec72646c4e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1309 microversion: 2.1 time: 0.902345 Nov 02 12:40:07.145380 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1885/3783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:06 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1309 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:07.164038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:07.171426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3e90bb2-42bf-4adb-af62-90604ee31279 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbb0af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:07.206193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:07.289345 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e3e90bb2-42bf-4adb-af62-90604ee31279 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.140626 Nov 02 12:40:07.294614 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1886/3784] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:07 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:07.312133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-76a8e643-2e0e-4fcf-8216-8433601b8757 req-6a9862c1-e5dd-4ca1-9fcd-10a9e99d29ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-deleted", "tag": "a5e3df2e-ea9d-46cc-8b90-9a43e80064a6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:07.342694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76a8e643-2e0e-4fcf-8216-8433601b8757 req-6a9862c1-e5dd-4ca1-9fcd-10a9e99d29ae service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:07.346855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76a8e643-2e0e-4fcf-8216-8433601b8757 req-6a9862c1-e5dd-4ca1-9fcd-10a9e99d29ae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:07.347951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76a8e643-2e0e-4fcf-8216-8433601b8757 req-6a9862c1-e5dd-4ca1-9fcd-10a9e99d29ae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:07.373503 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-76a8e643-2e0e-4fcf-8216-8433601b8757 req-6a9862c1-e5dd-4ca1-9fcd-10a9e99d29ae service nova] Creating event network-vif-deleted:a5e3df2e-ea9d-46cc-8b90-9a43e80064a6 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:40:07.389868 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-76a8e643-2e0e-4fcf-8216-8433601b8757 req-6a9862c1-e5dd-4ca1-9fcd-10a9e99d29ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091667 Nov 02 12:40:07.393032 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1887/3785] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:07.404642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:07.408840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:07.423347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:07.426694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:07.427061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:07.428000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:07.431538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:07.432204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:07.521378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:07.539628 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8e2480b5-8610-4723-b9ed-19e1c3a6739a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 1.363125 Nov 02 12:40:07.559860 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1899/3786] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:06 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:07.568238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:07.569657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:07.578215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:07.578907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:07.579528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:07.582372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:07.583053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:07.583816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:07.605712 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 HTTP/1.1 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '57c35e27-dccd-4e41-a357-a686522b73d9'} Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:07.609515 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:07.614585 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:07.614585 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:07.614585 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:07.614585 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:07.614585 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:07.614585 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:40:07.614585 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:07.616985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:07.625947 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-181e4fc7-c0e0-41fa-b4fb-edf2147cc1d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9" status: 404 len: 111 microversion: 2.1 time: 0.062900 Nov 02 12:40:07.626772 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1900/3787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:07 2022] GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:07.641078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:07.645407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:07.665918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:07.671161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:07.671981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:07.672968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:07.675697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:07.676435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:07.884252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:07.898229 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89e562da-645b-482e-9be9-fb0f6cff2773 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 200 len: 1506 microversion: 2.1 time: 0.503520 Nov 02 12:40:07.908000 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1888/3788] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:07 2022] GET /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:08.027841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-80d24c09-9552-4d06-88dd-3a4beb7ffb63 req-fb8435ab-1053-45a5-a871-7df44e6b6335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e9bebf-7306-4b45-b442-18b8f8de9a96", "name": "network-vif-plugged", "status": "completed", "tag": "cdad2bcc-e426-491b-84a3-e10732953241"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:08.045553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-80d24c09-9552-4d06-88dd-3a4beb7ffb63 req-fb8435ab-1053-45a5-a871-7df44e6b6335 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:08.048113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-80d24c09-9552-4d06-88dd-3a4beb7ffb63 req-fb8435ab-1053-45a5-a871-7df44e6b6335 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:08.048612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-80d24c09-9552-4d06-88dd-3a4beb7ffb63 req-fb8435ab-1053-45a5-a871-7df44e6b6335 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:08.065108 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-80d24c09-9552-4d06-88dd-3a4beb7ffb63 req-fb8435ab-1053-45a5-a871-7df44e6b6335 service nova] Creating event network-vif-plugged:cdad2bcc-e426-491b-84a3-e10732953241 for instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 on n-h1-855650-5 Nov 02 12:40:08.083228 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-80d24c09-9552-4d06-88dd-3a4beb7ffb63 req-fb8435ab-1053-45a5-a871-7df44e6b6335 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173615 Nov 02 12:40:08.088494 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1889/3789] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:08.096596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:08.100806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1227577744", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a20add55-dae0-40be-a4a7-4b9397826fb8"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:08.107776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:08.109721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:08.120129 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-18e8fbd3-37b6-484c-856a-2ef08b189ab6 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 2342 microversion: 2.32 time: 0.491891 Nov 02 12:40:08.121290 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1901/3790] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:07 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 2342 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:08.129178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:08.130069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: df5d5b47-e25a-460f-a061-6736f4d92346] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:08.150591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:08.151593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:08.152213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:08.157825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:08.158514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:08.159293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:08.247049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] validate_networks() for [('a20add55-dae0-40be-a4a7-4b9397826fb8', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:08.665530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:08.680183 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9c21f72f-7849-4d9a-a7aa-d3d2328287f4 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/df5d5b47-e25a-460f-a061-6736f4d92346" status: 200 len: 1507 microversion: 2.1 time: 0.557280 Nov 02 12:40:08.686184 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1902/3791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:08 2022] GET /compute/v2.1/servers/df5d5b47-e25a-460f-a061-6736f4d92346 => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:08.691398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:08.698963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:08.713588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:08.714388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:08.715078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:08.716556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:08.718745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:08.719536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:09.199631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:09.211200 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6f31e9c-4ed5-4cfb-ad8b-8f33c8a3436b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1309 microversion: 2.1 time: 0.523473 Nov 02 12:40:09.211869 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1903/3792] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:08 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:09.224262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-38d6f677-8540-4704-9951-5716225a9e16 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc2d0d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:09.317270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-38d6f677-8540-4704-9951-5716225a9e16 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.103709 Nov 02 12:40:09.319270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1904/3793] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:09 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:09.347088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:09.347834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:09.366571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:09.370767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:09.371366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:09.376062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:09.376710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:09.377268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:09.752184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:09.752882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:09.753731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:09.755612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:09.756346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:09.779947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:09.780650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:09.782031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:09.784755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:09.786810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:09.788559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:09.830723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:09.839098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for user 6488e600776547958e00ab146f079c46 and project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:09.872122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:09.879461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:09.959263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:09.974056 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a7c2dd3e-d662-40a8-acdf-6fa928530610 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 0.641435 Nov 02 12:40:09.985993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1905/3794] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:09 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:10.008437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:10.008687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: df5d5b47-e25a-460f-a061-6736f4d92346] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:10.010557 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae8d4b0a-5632-4247-be89-f08bfa755b43 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917051 Nov 02 12:40:10.016831 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1890/3795] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:40:10.025219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:10.030369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:10.033224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.033845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.034584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.035589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.036282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.040151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.049369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.050366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.053084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.054703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.056175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.057204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.113783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: df5d5b47-e25a-460f-a061-6736f4d92346] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:10.210025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:10.227973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:10.237637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:10.239949 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33435bae-9bd5-4df1-8236-38eebeadfc0e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.221734 Nov 02 12:40:10.266029 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1891/3796] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:10 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:10.288778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7e6cabed-31b3-4ff2-b1d7-edb7dd4eec43 req-0e1c1ffa-cc62-4fb3-ad8b-6c224263ea67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6c782-4032-46df-8abc-e1eedfe7f0fd", "name": "network-vif-deleted", "tag": "e0d29879-e0b6-463c-842f-6b6ea81d4651"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:10.320490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7e6cabed-31b3-4ff2-b1d7-edb7dd4eec43 req-0e1c1ffa-cc62-4fb3-ad8b-6c224263ea67 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.325044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7e6cabed-31b3-4ff2-b1d7-edb7dd4eec43 req-0e1c1ffa-cc62-4fb3-ad8b-6c224263ea67 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.326915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7e6cabed-31b3-4ff2-b1d7-edb7dd4eec43 req-0e1c1ffa-cc62-4fb3-ad8b-6c224263ea67 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.382029 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7e6cabed-31b3-4ff2-b1d7-edb7dd4eec43 req-0e1c1ffa-cc62-4fb3-ad8b-6c224263ea67 service nova] Creating event network-vif-deleted:e0d29879-e0b6-463c-842f-6b6ea81d4651 for instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd on n-h1-855650-5 Nov 02 12:40:10.404577 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7e6cabed-31b3-4ff2-b1d7-edb7dd4eec43 req-0e1c1ffa-cc62-4fb3-ad8b-6c224263ea67 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133935 Nov 02 12:40:10.412202 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1892/3797] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:10.417780 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-42316d30-8f8d-44dc-92ba-ed06a3004532 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "DELETE /compute/v2.1/servers/df5d5b47-e25a-460f-a061-6736f4d92346" status: 204 len: 0 microversion: 2.1 time: 0.436180 Nov 02 12:40:10.424745 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1906/3798] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:09 2022] DELETE /compute/v2.1/servers/df5d5b47-e25a-460f-a061-6736f4d92346 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:10.434838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-269c3a65-6b29-4128-9df2-c5f4c15984d1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:10.437414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-269c3a65-6b29-4128-9df2-c5f4c15984d1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:10.441267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:10.442316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:10.460392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.461094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.462353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.464629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.466070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.467853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.568924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-269c3a65-6b29-4128-9df2-c5f4c15984d1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:10.579869 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-269c3a65-6b29-4128-9df2-c5f4c15984d1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1215 microversion: 2.1 time: 0.163687 Nov 02 12:40:10.583214 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1893/3799] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:10 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:10.595109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a74dcdeb-db19-4605-9f50-4d8294a30e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db2bb80>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:10.775398 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a74dcdeb-db19-4605-9f50-4d8294a30e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.190804 Nov 02 12:40:10.780320 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1894/3800] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:10 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:10.797791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:10.798709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:10.819210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.819902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.820524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.825803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:10.826576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:10.827186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:10.836806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:10.854913 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-28e675f2-2a7e-42ce-bd89-b00a87d1fbd4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1309 microversion: 2.1 time: 0.419424 Nov 02 12:40:10.873360 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1907/3801] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:10 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:10.920964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: d1396549-0afd-4bf0-b31b-9bb94b84c8fa] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:11.013163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:11.014546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:11.025067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.026360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.027153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.029008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.029809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.031270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.132460 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7fa6b7bc-a944-4551-a915-470b2d80697e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa" status: 204 len: 0 microversion: 2.1 time: 0.349057 Nov 02 12:40:11.134454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1895/3802] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:10 2022] DELETE /compute/v2.1/servers/d1396549-0afd-4bf0-b31b-9bb94b84c8fa => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:11.235082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1532756486", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5cf3c128-0f29-45a5-959b-e98a60998e0d"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:11.407299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] validate_networks() for [('5cf3c128-0f29-45a5-959b-e98a60998e0d', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:11.506733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:11.526777 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c1d5c8db-1f2e-4e3b-8be9-aaa01ab06aeb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 0.525681 Nov 02 12:40:11.533099 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1908/3803] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:10 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:11.559450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:11.566849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:11.629354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.639799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.655861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.657395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.668973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.669949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.834970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:11.857186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:11.869281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:11.871245 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8bfcc05-cf30-4070-b5f4-61432e066cf2 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.336444 Nov 02 12:40:11.881665 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1909/3804] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:11 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:11.903514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:11.904385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:11.942549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.945936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.948241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.953613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.954388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.955994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.259743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:12.278525 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-818ba615-c82f-4aee-8c20-201fee6defe1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1219 microversion: 2.1 time: 0.395400 Nov 02 12:40:12.281689 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1910/3805] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:11 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1219 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:12.302287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-90e4ffcb-9381-46ef-a8fe-e91e2e2b7b84 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e047ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:12.421627 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-90e4ffcb-9381-46ef-a8fe-e91e2e2b7b84 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1439 microversion: 2.1 time: 0.136828 Nov 02 12:40:12.423711 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1911/3806] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:12 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1439 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:12.442929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:12.444175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:12.461819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.462271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.462723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.463447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.463903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.466124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.475159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:12.475705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:12.476051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:12.476468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:12.476883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:12.496444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.496938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.497381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.498147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.498608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.499214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.544375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Getting quotas for project 0fd477702de64a558f540c617feea703. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:12.572822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Getting quotas for user 9c0e502afdee43378bdb22ff55d28263 and project 0fd477702de64a558f540c617feea703. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:12.608120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Going to run 2 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:12.611198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:12.652861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:12.671433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=b78c9169-cb07-47a8-a617-ce5274ca3eb0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:12.853286 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ddf1eb7e-074c-4e1b-af40-e80c66de33b8 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.623522 Nov 02 12:40:12.857488 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1896/3807] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:11 2022] POST /compute/v2.1/servers => generated 32 bytes in 1629 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:40:12.885652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:12.886273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:12.899105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:12.910657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.911441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.912918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.914815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.916501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.917173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.919832 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e35a9700-4337-4697-a4c3-71a6a5ebeebd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1490 microversion: 2.1 time: 0.492549 Nov 02 12:40:12.942339 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1912/3808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:12 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1490 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:12.973208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.002841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:13.006730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Searching by: {'deleted': False, 'project_id': '0fd477702de64a558f540c617feea703'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:40:13.097074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.097578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.098047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.098845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.099305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.099865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.255213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:40:13.351786 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b9bc4b83-cd44-4aca-81fe-b18cd35996e7 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.408182 Nov 02 12:40:13.360421 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1913/3809] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:40:12 2022] GET /compute/v2.1/servers => generated 1335 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:13.369816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.370752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:13.394828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.398822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.399818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.404938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.409136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.409890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.421644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:13.447276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:13.454153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:13.461215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac584a64-df63-4d93-8b0b-36ff9c8fdc24 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 0.601349 Nov 02 12:40:13.461852 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1897/3810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:12 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:13.507811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.508521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:13.556295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.556682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.557133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.557851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.558353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.558790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.624089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:13.646146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:13.654908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:13.661596 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-706dae2d-5269-44a6-af65-2c1677525461 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.306696 Nov 02 12:40:13.667697 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1914/3811] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:13 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:13.693035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.706493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:13.729726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.734751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.735501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.736375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.741245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.758170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:14.243993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:14.264884 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ccf1be3-3a64-48a6-b4b0-8c3b70fe4d70 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1211 microversion: 2.1 time: 0.585979 Nov 02 12:40:14.269735 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1915/3812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:13 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1211 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:14.277392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c3cf9e5b-0051-40c0-8e7e-a83a7b5c2646 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:14.278662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c3cf9e5b-0051-40c0-8e7e-a83a7b5c2646 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:14.294480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:14.448483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c3cf9e5b-0051-40c0-8e7e-a83a7b5c2646 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:14.457757 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c3cf9e5b-0051-40c0-8e7e-a83a7b5c2646 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1218 microversion: 2.1 time: 0.184882 Nov 02 12:40:14.473923 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1916/3813] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:14 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:14.493531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1d6aff6e-cdb5-4fbd-a362-5f35f0aada8b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e182430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:14.566265 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1d6aff6e-cdb5-4fbd-a362-5f35f0aada8b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1448 microversion: 2.1 time: 0.090136 Nov 02 12:40:14.569857 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1917/3814] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:14 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1448 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:14.581859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:14.584350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:14.600258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:14.601044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:14.601746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:14.603463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:14.604335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:14.604761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:14.680363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:14.688985 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34186fb0-6c14-48cf-b471-2b492ba101c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1489 microversion: 2.1 time: 1.206374 Nov 02 12:40:14.696193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1898/3815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:13 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1489 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:14.709606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31b64ac8-54ae-431f-9472-c5ac0bfcd005 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dac2af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:14.807396 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31b64ac8-54ae-431f-9472-c5ac0bfcd005 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 200 len: 1448 microversion: 2.1 time: 0.109441 Nov 02 12:40:14.818816 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1899/3816] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:14 2022] GET /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 1448 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:14.823487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:14.831032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:14.862316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:14.862821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:14.866949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:14.870273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:14.870497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:14.872883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.019643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:15.033549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:15.044865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:15.049855 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b994af38-7e87-4b2c-a56b-57c1d8a30b04 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.236230 Nov 02 12:40:15.054272 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1900/3817] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:14 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:15.064896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:15.067133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:15.087944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.090630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.091463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.093054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.094659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:15.099531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.100735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.110955 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-80be491f-f26d-4f37-aa56-6508c18a76b6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 0.539823 Nov 02 12:40:15.111586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1918/3818] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:14 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:15.133733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a82a3f8-60ba-4d1d-9066-0dc7afa71d0f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc8f310>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:15.454201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:15.464402 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ce27f163-d209-4384-9dac-5b510378d1d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1490 microversion: 2.1 time: 0.408792 Nov 02 12:40:15.467619 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1901/3819] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:15 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1490 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:15.487110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:15.488620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:15.509472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.510222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.511751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.516674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.516674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.519704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.659689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:15.682031 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c86d5fb-5b04-4a2f-a4ac-951d43344f22 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1273 microversion: 2.1 time: 0.211549 Nov 02 12:40:15.684650 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1902/3820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:15 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:15.703898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:15.705052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:15.732664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.734630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.735863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.739795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.741038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.745833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.914550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:15.930222 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7f28276-89b6-46da-b3dc-fda5381b21d5 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1222 microversion: 2.1 time: 0.242930 Nov 02 12:40:15.932697 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1903/3821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:15 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:15.952449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:15.953311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:15.969131 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a82a3f8-60ba-4d1d-9066-0dc7afa71d0f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 204 len: 0 microversion: 2.1 time: 0.839920 Nov 02 12:40:15.970048 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1919/3822] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:15 2022] DELETE /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:15.981812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:15.982113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.982524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:15.983811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.984250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.986777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.988269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.988827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.995036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.995992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.996690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.997827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.998483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.999060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.038439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:16.046542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:16.288676 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a01af0ff-7962-4d83-9683-2459ac151808 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 204 len: 0 microversion: 2.1 time: 0.311058 Nov 02 12:40:16.294420 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1920/3823] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:15 2022] DELETE /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:40:16.327541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:16.333050 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a16b0bde-8798-455b-a314-6e2fe258ac82 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 204 len: 0 microversion: 2.1 time: 0.394363 Nov 02 12:40:16.337363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:16.339992 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1904/3824] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:15 2022] DELETE /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:16.358520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:16.359012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:16.360338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:16.363959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.367606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:16.367853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:16.368431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:16.370138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.388632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:16.390850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:16.394026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.397959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:16.398535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:16.399102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.499393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:16.524801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:16.528631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:16.531056 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-81a0a7b4-2aae-48bf-954f-726aac9dca75 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.231416 Nov 02 12:40:16.533616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1921/3825] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:16 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:16.544897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:16.547037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:16.557466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:16.558572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:16.559231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.560180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:16.560875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:16.561664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.724469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:16.753273 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89b17c7f-53d0-4e15-925a-7ac05d8f4669 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 0.403908 Nov 02 12:40:16.754020 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1905/3826] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:16 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:16.775233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-887354238", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "6073314f-95a7-4839-bb88-cbb45aac3413"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:16.892930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] validate_networks() for [('6073314f-95a7-4839-bb88-cbb45aac3413', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:17.534223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:17.548774 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a50f7a06-92d2-41b4-a8c9-98fa42c021be tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1496 microversion: 2.1 time: 1.010083 Nov 02 12:40:17.550516 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1922/3827] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:16 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1496 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:17.562109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:17.564951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:17.582253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:17.582763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:17.584818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:17.586135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:17.586625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:17.587063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:17.780386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:17.794627 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16151373-2822-4da5-877f-e889f38e1515 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1273 microversion: 2.1 time: 0.242732 Nov 02 12:40:17.797343 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1923/3828] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:17 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:17.804259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:17.830800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:17.831627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Searching by: {'deleted': False, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:40:17.854793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:17.856648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:17.860445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:17.865697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:17.870010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:17.872668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:17.954719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:40:18.017752 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e820adde-7e0a-4ecb-bd78-47311d10b20d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.218629 Nov 02 12:40:18.019163 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1924/3829] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:40:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:18.028611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:18.030135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:18.038533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.039443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.040449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.041864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.043072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.044929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.175051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:18.187098 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c9b0fd5-7fbe-4e01-8f7f-50b5627c7a17 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1214 microversion: 2.1 time: 0.165911 Nov 02 12:40:18.188364 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1925/3830] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:18 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:18.359008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:18.359587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:18.360321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:18.360924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:18.361828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:18.389514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.392347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.393162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.396092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.398556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.400806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.403884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b060e022-8ae4-4bca-8bd8-396bbbf3b200 req-fc8c494f-6d68-49d3-8c41-1ec344b3d3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5d5b47-e25a-460f-a061-6736f4d92346", "name": "network-vif-deleted", "tag": "d6008b10-5143-49dd-8e63-211e51682553"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:18.445873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b060e022-8ae4-4bca-8bd8-396bbbf3b200 req-fc8c494f-6d68-49d3-8c41-1ec344b3d3b1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.446412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b060e022-8ae4-4bca-8bd8-396bbbf3b200 req-fc8c494f-6d68-49d3-8c41-1ec344b3d3b1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.446839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b060e022-8ae4-4bca-8bd8-396bbbf3b200 req-fc8c494f-6d68-49d3-8c41-1ec344b3d3b1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.449291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:18.463064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for user beeb8b4fa7354185ba8aff3194bf9e06 and project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:18.486816 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b060e022-8ae4-4bca-8bd8-396bbbf3b200 req-fc8c494f-6d68-49d3-8c41-1ec344b3d3b1 service nova] Creating event network-vif-deleted:d6008b10-5143-49dd-8e63-211e51682553 for instance df5d5b47-e25a-460f-a061-6736f4d92346 on n-h2-855650-5 Nov 02 12:40:18.504909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:18.508877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:18.511623 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b060e022-8ae4-4bca-8bd8-396bbbf3b200 req-fc8c494f-6d68-49d3-8c41-1ec344b3d3b1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.320501 Nov 02 12:40:18.513681 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1926/3831] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:18.529199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:18.531093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:18.548798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.552084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.554535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.556458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.556981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.560325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.578322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b42d9c2-d4ae-4199-af03-49c70bf96f66 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822432 Nov 02 12:40:18.579948 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1906/3832] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:40:18.585571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:18.586635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:18.594228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.595142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.596751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.598021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.599699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.601730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.797959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:18.818089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:18.826259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:18.828143 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1072b322-e107-4829-ae0e-b4086d5f70cc tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.312092 Nov 02 12:40:18.829093 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1927/3833] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:18 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:18.854004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:18.868875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:18.879605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Searching by: {'deleted': False, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:40:18.892184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.893364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.894213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.895714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.896863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.897891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.964047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:40:19.015307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:19.022732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:19.032360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.033386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.034433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.038410 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0e37fc0b-1eec-44d6-af92-a3b2e8cc24a2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 0.456979 Nov 02 12:40:19.059632 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1907/3834] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:18 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:19.065686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.066821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:19.076329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.077278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.078114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.079391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.081568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.082590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.464811 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de90042b-b761-4f0d-b264-8134b0505ae1 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.622255 Nov 02 12:40:19.482578 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1928/3835] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:40:18 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:19.508570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.510188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:19.520924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.522472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.523273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.524858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.525887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.526719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.572148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:19.581610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7eda535e-6609-4b72-885f-81ec698e4234 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1496 microversion: 2.1 time: 0.520026 Nov 02 12:40:19.582255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1908/3836] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1496 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:19.600234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.601218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:19.613428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.618228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.618924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.620024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.623592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.624789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.719571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:19.750543 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e730f16-1a24-473b-b8bd-8a23e0fe1d1c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1211 microversion: 2.1 time: 0.265633 Nov 02 12:40:19.752351 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1929/3837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1211 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:19.762736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.764148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:19.782090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.784315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.786973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.789730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.791068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.792112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.935091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:19.944749 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bf823133-289e-4ded-b7a9-be1a14cbdae3 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1214 microversion: 2.1 time: 0.189766 Nov 02 12:40:19.962082 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1930/3838] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:19.962082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8aeae336-eef5-457c-aecf-b70bff34b5d3 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.963877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:19.977357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1bd989c1-8a9d-404b-82fc-05d2401e64d7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1315 microversion: 2.1 time: 0.388656 Nov 02 12:40:19.991117 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1909/3839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:20.000859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:20.002004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:20.003328 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8aeae336-eef5-457c-aecf-b70bff34b5d3 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052949 Nov 02 12:40:20.005206 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1931/3840] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:20.018027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.023068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.024133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.025950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.026533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.028775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.066948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:20.067715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:20.078062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.078642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.079311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.080227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.081272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.082370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.497931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:20.516070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:20.517533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:20.518920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0f67fb3-7a5d-439d-81da-a4a46ba8fcc1 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.526356 Nov 02 12:40:20.519596 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1910/3841] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:20.535305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:20.535690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:20.549765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.554512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.555015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.555856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.556337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.556825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.614567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:20.769730 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92c42911-10de-4dea-85e6-387f56fea825 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 204 len: 0 microversion: 2.1 time: 0.237112 Nov 02 12:40:20.785612 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1911/3842] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:20 2022] DELETE /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:20.796276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8bf9515a-f0df-4b22-8bce-116a5acbc615 req-fe4154aa-b180-4b12-ba00-588b70786238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1396549-0afd-4bf0-b31b-9bb94b84c8fa", "name": "network-vif-deleted", "tag": "b687c428-c264-4f8b-bb52-9f7a2cb8c432"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:20.814417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bf9515a-f0df-4b22-8bce-116a5acbc615 req-fe4154aa-b180-4b12-ba00-588b70786238 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.815177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bf9515a-f0df-4b22-8bce-116a5acbc615 req-fe4154aa-b180-4b12-ba00-588b70786238 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.816089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bf9515a-f0df-4b22-8bce-116a5acbc615 req-fe4154aa-b180-4b12-ba00-588b70786238 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.833610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8bf9515a-f0df-4b22-8bce-116a5acbc615 req-fe4154aa-b180-4b12-ba00-588b70786238 service nova] Creating event network-vif-deleted:b687c428-c264-4f8b-bb52-9f7a2cb8c432 for instance d1396549-0afd-4bf0-b31b-9bb94b84c8fa on n-h2-855650-5 Nov 02 12:40:20.845437 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8bf9515a-f0df-4b22-8bce-116a5acbc615 req-fe4154aa-b180-4b12-ba00-588b70786238 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054507 Nov 02 12:40:20.846707 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1912/3843] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:20.858216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:20.859957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:20.862129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:20.865047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:20.888562 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91e6e8e3-3467-43d9-b602-33ce37d67766 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1737 microversion: 2.1 time: 0.823870 Nov 02 12:40:20.892739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.893647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.895670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.897861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.898572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.899569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.928057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:20.966168 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1932/3844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:20 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1737 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:20.988236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:20.993586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:21.004379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.009472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.010112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.014053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.014914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.016245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.267762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:21.285108 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4fb1e746-1cb1-4222-9595-93f527a0b607 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1203 microversion: 2.1 time: 0.311589 Nov 02 12:40:21.287206 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1933/3845] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:20 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1203 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:21.297512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:21.300817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:21.338249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.342677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.346461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.347804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.348657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.349274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.692902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:21.706872 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8bf686aa-d323-4816-b8fa-91aef069c47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1496 microversion: 2.1 time: 0.854755 Nov 02 12:40:21.710515 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1913/3846] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:20 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1496 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:21.723447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:21.724163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:21.760685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.767003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.767514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.768305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.768796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.769210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.123217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:22.141762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-718fcbb3-551e-49d3-9037-7fb324674f35 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1214 microversion: 2.1 time: 0.430006 Nov 02 12:40:22.142462 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1914/3847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:21 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1214 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:22.155879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:22.157249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:22.167797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.168605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.169264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.170491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.171287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.171892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.458255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:22.475205 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-92a3c0eb-a423-4394-9e60-301c8c0c96ca tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1606 microversion: 2.1 time: 1.185720 Nov 02 12:40:22.475822 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1934/3848] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:21 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1606 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:22.490799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0b24156c-b0d1-4dad-9a15-65d54e572f50 req-6e88b1f6-23ff-43e1-be1b-0f8c42752304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ccf37f-d6ce-40ad-a868-e7950e02dd60", "name": "network-vif-unplugged", "status": "completed", "tag": "01568f97-09eb-4fd9-b2f3-4c068f40d4f9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:22.514478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0b24156c-b0d1-4dad-9a15-65d54e572f50 req-6e88b1f6-23ff-43e1-be1b-0f8c42752304 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.515773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0b24156c-b0d1-4dad-9a15-65d54e572f50 req-6e88b1f6-23ff-43e1-be1b-0f8c42752304 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.516471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0b24156c-b0d1-4dad-9a15-65d54e572f50 req-6e88b1f6-23ff-43e1-be1b-0f8c42752304 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.537915 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0b24156c-b0d1-4dad-9a15-65d54e572f50 req-6e88b1f6-23ff-43e1-be1b-0f8c42752304 service nova] Creating event network-vif-unplugged:01568f97-09eb-4fd9-b2f3-4c068f40d4f9 for instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 on n-h1-855650-5 Nov 02 12:40:22.546803 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0b24156c-b0d1-4dad-9a15-65d54e572f50 req-6e88b1f6-23ff-43e1-be1b-0f8c42752304 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069299 Nov 02 12:40:22.548254 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1935/3849] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:22.556179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:22.557303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:22.566654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.567546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.569556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.570663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.571480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.572192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.814533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:22.826287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:22.840086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:22.841894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ddbd6fe5-c5ff-4ed8-8f63-66685d3daa10 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.291342 Nov 02 12:40:22.843122 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1936/3850] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:22 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:22.848399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:22.858981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:22.866602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.867384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.873174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.874479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.875172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.875776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.012161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:23.043648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ee2ce07f-01c7-4821-8dc2-c7e641fdd60e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1315 microversion: 2.1 time: 0.896714 Nov 02 12:40:23.044676 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1915/3851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:22 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:23.058637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:23.063926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:23.087026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.098655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.100700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.101731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.103732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.104611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.523122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:23.535165 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f734a97-199c-4d82-a839-01721e0ff1c9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1259 microversion: 2.1 time: 0.486937 Nov 02 12:40:23.536589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1916/3852] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:23 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1259 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:23.543221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:23.544259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:23.566508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.567417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.569844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.572558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.572558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.572558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.687772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:23.709036 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d92bd37d-7cb1-4fb0-bf68-f147caad55d2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1717 microversion: 2.1 time: 0.864527 Nov 02 12:40:23.709652 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1937/3853] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:22 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1717 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:23.714559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e1299d36-c2ff-4ff5-a6f0-f5f7cc59757c req-e2afd4f8-49f8-4b54-98c7-f0098c3a71db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed14fcc4-b09f-4368-9370-e6c857e3826e", "tag": "94f2801e-30fd-4360-b18b-5c54e258e6f3"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:23.754957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e1299d36-c2ff-4ff5-a6f0-f5f7cc59757c req-e2afd4f8-49f8-4b54-98c7-f0098c3a71db service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.755449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e1299d36-c2ff-4ff5-a6f0-f5f7cc59757c req-e2afd4f8-49f8-4b54-98c7-f0098c3a71db service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.756480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e1299d36-c2ff-4ff5-a6f0-f5f7cc59757c req-e2afd4f8-49f8-4b54-98c7-f0098c3a71db service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.790218 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e1299d36-c2ff-4ff5-a6f0-f5f7cc59757c req-e2afd4f8-49f8-4b54-98c7-f0098c3a71db service nova] Creating event network-changed:94f2801e-30fd-4360-b18b-5c54e258e6f3 for instance ed14fcc4-b09f-4368-9370-e6c857e3826e on n-h2-855650-5 Nov 02 12:40:23.798747 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e1299d36-c2ff-4ff5-a6f0-f5f7cc59757c req-e2afd4f8-49f8-4b54-98c7-f0098c3a71db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087749 Nov 02 12:40:23.803015 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1938/3854] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:23.821803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:23.823083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:23.835529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.836897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.837660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.839131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.839880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.841509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.027133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:24.042247 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6fef06e0-a40b-4a76-803f-340e55161c3e tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1276 microversion: 2.1 time: 0.237541 Nov 02 12:40:24.043534 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1939/3855] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:23 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:24.050328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:24.051239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:24.059558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.060378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.061004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.062151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.062813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.063428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.151219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:25.173301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f6577ef-12ae-45df-83ab-6cc258871012 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1606 microversion: 2.1 time: 1.126065 Nov 02 12:40:25.174637 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1940/3856] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:24 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1606 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:25.206626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.223577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:25.252196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.253253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.254212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.255623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.259611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.260970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.419229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:25.455458 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d8a8429-8fa3-4f01-8133-63615caf2955 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1496 microversion: 2.1 time: 1.903728 Nov 02 12:40:25.455698 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Cannot 'detach_volume' instance 170451bf-340f-489f-87d4-4fda741d2b9f while it is in vm_state rescued Nov 02 12:40:25.458161 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1917/3857] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:23 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1496 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments/ec72e2d0-f7ad-4e12-9905-b5c3d9bb7650 HTTP/1.1 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: exception: Cannot 'detach_volume' instance 170451bf-340f-489f-87d4-4fda741d2b9f while it is in vm_state rescued Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': '170451bf-340f-489f-87d4-4fda741d2b9f', 'id': 'ec72e2d0-f7ad-4e12-9905-b5c3d9bb7650'} Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 170451bf-340f-489f-87d4-4fda741d2b9f in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 170451bf-340f-489f-87d4-4fda741d2b9f while it is in vm_state rescued Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:25.466706 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 170451bf-340f-489f-87d4-4fda741d2b9f while it is in vm_state rescued Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 409 to user: Cannot 'detach_volume' instance 170451bf-340f-489f-87d4-4fda741d2b9f while it is in vm_state rescued {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d523cb59-a4ac-49c9-80e5-d06caeb6753e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments/ec72e2d0-f7ad-4e12-9905-b5c3d9bb7650" status: 409 len: 152 microversion: 2.1 time: 0.292479 Nov 02 12:40:25.476757 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1941/3858] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:40:25 2022] DELETE /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments/ec72e2d0-f7ad-4e12-9905-b5c3d9bb7650 => generated 152 bytes in 294 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:25.477784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-67fa1b60-186b-4ac2-abe4-089efd6ead56 req-fe36e842-8119-4b36-b010-4fca7a40af76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78c9169-cb07-47a8-a617-ce5274ca3eb0", "tag": "574a28f5-8445-4c43-abf4-ee056e64596d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:25.484372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.485261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:25.521217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-67fa1b60-186b-4ac2-abe4-089efd6ead56 req-fe36e842-8119-4b36-b010-4fca7a40af76 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.521706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-67fa1b60-186b-4ac2-abe4-089efd6ead56 req-fe36e842-8119-4b36-b010-4fca7a40af76 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.522178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-67fa1b60-186b-4ac2-abe4-089efd6ead56 req-fe36e842-8119-4b36-b010-4fca7a40af76 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.535807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.538090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.546431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.558957 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-67fa1b60-186b-4ac2-abe4-089efd6ead56 req-fe36e842-8119-4b36-b010-4fca7a40af76 service nova] Creating event network-changed:574a28f5-8445-4c43-abf4-ee056e64596d for instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 on n-h2-855650-5 Nov 02 12:40:25.560525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.561417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.566320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.567644 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-67fa1b60-186b-4ac2-abe4-089efd6ead56 req-fe36e842-8119-4b36-b010-4fca7a40af76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096770 Nov 02 12:40:25.571106 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1942/3859] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:25.593191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.594310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:25.609777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.617838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.625714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.630718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.634406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.635273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.826593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:25.853404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:25.857769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:25.866905 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-58e8b024-8ece-457d-8931-295a5b76af3e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.404875 Nov 02 12:40:25.868006 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1918/3860] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:25.875333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.876563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:25.886855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.892728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.894677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.895931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.897307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.898037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.128967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:26.153435 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fc36941b-88a8-4af7-b4c9-f2ed51718148 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1265 microversion: 2.1 time: 0.282632 Nov 02 12:40:26.154284 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1919/3861] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.160070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.163628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:26.182605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.183650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.184656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.186117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.191888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.192682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.428437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:26.463377 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3de59f6d-8811-43d8-8aec-04a0e3faf789 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1276 microversion: 2.1 time: 0.307480 Nov 02 12:40:26.472830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:26.486690 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1920/3862] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.487895 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-127b4ab3-7110-475d-ad7d-e7bba22307db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1315 microversion: 2.1 time: 0.914217 Nov 02 12:40:26.489269 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1943/3863] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.495484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:26.496454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:26.499703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.500486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:26.509426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.510481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.511120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.512084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.512552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.513023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.531763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.532832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.533631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.540855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.543555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.544104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.680753 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82a90a35-e857-4767-9107-9e995220fbd5 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/action" status: 202 len: 0 microversion: 2.1 time: 0.189697 Nov 02 12:40:26.681883 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1921/3864] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:26 2022] POST /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:26.697405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.698365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:26.709239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.712924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.713403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.716651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.717176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.717628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.797140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.798405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.798908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.799383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lazy-loading 'fault' on Instance uuid 10e9bebf-7306-4b45-b442-18b8f8de9a96 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:26.805890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:26.840155 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b422d51-f630-409e-a3e5-5f54cdf592df tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1539 microversion: 2.1 time: 0.331932 Nov 02 12:40:26.842283 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1944/3865] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1539 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.874981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.876356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:26.928294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.933313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.936046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.938940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.940723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.941917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.975407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:26.988561 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f084077f-420e-4dd9-9ebf-58d2f63380dd tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 200 len: 1299 microversion: 2.1 time: 0.304132 Nov 02 12:40:26.992665 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1922/3866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:27.006284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:27.007223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:27.026658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.027603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.029120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.032477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.035724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.036470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.410158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:27.426370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:27.428634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:27.431123 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-511db4f1-0c59-423b-bf01-efcccb332bd3 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.436953 Nov 02 12:40:27.434736 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1923/3867] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:27.446666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:27.455231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:27.465487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.466710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.467743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.468728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.469383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.470285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.853872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:27.863871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8cbef22e-4d6d-4887-8f26-509ace123bec tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1725 microversion: 2.1 time: 1.003602 Nov 02 12:40:27.866858 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1945/3868] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1725 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:27.872080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:27.872698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:27.880932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.881735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.882440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.883486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.884147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.884759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.426788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:28.488268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=20 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:28.525752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:28.528077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:28.539500 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4eda9760-e170-4139-8e04-0735018bb47a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 0.670964 Nov 02 12:40:28.540397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-737f88ca-15e5-4c1a-97b9-03c7bc627a3d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 1.104164 Nov 02 12:40:28.542852 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1924/3869] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:27 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:28.551937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.556449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:28.561489 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1946/3870] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:27 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:28.568113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-4705b976-fb1e-433d-af67-96b40ba5e2d4 req-cc6d6654-3b0f-4579-8d79-19e3bdb826d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ccf37f-d6ce-40ad-a868-e7950e02dd60", "name": "network-vif-deleted", "tag": "01568f97-09eb-4fd9-b2f3-4c068f40d4f9"}, {"server_uuid": "10e9bebf-7306-4b45-b442-18b8f8de9a96", "name": "network-vif-deleted", "tag": "cdad2bcc-e426-491b-84a3-e10732953241"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:28.577016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.579465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.580726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.581700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.584275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.589285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.601783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4705b976-fb1e-433d-af67-96b40ba5e2d4 req-cc6d6654-3b0f-4579-8d79-19e3bdb826d4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.602451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4705b976-fb1e-433d-af67-96b40ba5e2d4 req-cc6d6654-3b0f-4579-8d79-19e3bdb826d4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.602990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4705b976-fb1e-433d-af67-96b40ba5e2d4 req-cc6d6654-3b0f-4579-8d79-19e3bdb826d4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.643713 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4705b976-fb1e-433d-af67-96b40ba5e2d4 req-cc6d6654-3b0f-4579-8d79-19e3bdb826d4 service nova] Creating event network-vif-deleted:01568f97-09eb-4fd9-b2f3-4c068f40d4f9 for instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 on n-h1-855650-5 Nov 02 12:40:28.644335 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4705b976-fb1e-433d-af67-96b40ba5e2d4 req-cc6d6654-3b0f-4579-8d79-19e3bdb826d4 service nova] Creating event network-vif-deleted:cdad2bcc-e426-491b-84a3-e10732953241 for instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 on n-h1-855650-5 Nov 02 12:40:28.655350 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-4705b976-fb1e-433d-af67-96b40ba5e2d4 req-cc6d6654-3b0f-4579-8d79-19e3bdb826d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090567 Nov 02 12:40:28.657117 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1947/3871] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:28.666811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.676668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:28.691587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.702138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.702817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.703750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.704319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.705071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.935103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:28.956236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:28.969331 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e23b1f89-ccdb-4958-b4ee-a5b70cc1da84 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1539 microversion: 2.1 time: 0.309944 Nov 02 12:40:28.973133 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1948/3872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1539 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:28.988564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.994004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.035439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:29.041627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.043000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.046466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.047358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.048722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.049174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.087267 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 HTTP/1.1 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '10e9bebf-7306-4b45-b442-18b8f8de9a96'} Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:29.092601 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:29.097559 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:29.097559 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:29.097559 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:29.097559 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:29.097559 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:40:29.097559 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:29.097559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:29.097559 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0263efb7-fde3-4085-92d2-4bff25d95d2a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 404 len: 111 microversion: 2.1 time: 0.118040 Nov 02 12:40:29.100692 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1949/3873] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:29.109729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:29.110432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.111282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.118192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.119190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.119704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.120539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.120999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.121215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d22075cf-9672-4ce9-8c66-715cc89a4d38 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1315 microversion: 2.1 time: 0.576807 Nov 02 12:40:29.121422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.128553 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1925/3874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:29.144237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:29.144873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.162514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.162968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.163645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.164556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.174816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.175554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.321936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.343347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.346721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.354553 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-96bd167d-8369-461d-bd53-654bf4a463fd tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.254629 Nov 02 12:40:29.355315 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1950/3875] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:29 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:29.364417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0e99accd-d823-4531-bbd9-b278fa487d2d req-ee2cb465-24d4-4438-8e62-48ad9db34135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7522fbf-cc29-4ae9-a95b-16214f7b1d40", "name": "network-vif-deleted", "tag": "4fa46058-46e4-40f8-809e-67f3dc4f0e93"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:29.391077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0e99accd-d823-4531-bbd9-b278fa487d2d req-ee2cb465-24d4-4438-8e62-48ad9db34135 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.391860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0e99accd-d823-4531-bbd9-b278fa487d2d req-ee2cb465-24d4-4438-8e62-48ad9db34135 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.393417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0e99accd-d823-4531-bbd9-b278fa487d2d req-ee2cb465-24d4-4438-8e62-48ad9db34135 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.419444 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0e99accd-d823-4531-bbd9-b278fa487d2d req-ee2cb465-24d4-4438-8e62-48ad9db34135 service nova] Creating event network-vif-deleted:4fa46058-46e4-40f8-809e-67f3dc4f0e93 for instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 on n-h2-855650-5 Nov 02 12:40:29.448191 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0e99accd-d823-4531-bbd9-b278fa487d2d req-ee2cb465-24d4-4438-8e62-48ad9db34135 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091096 Nov 02 12:40:29.448825 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1951/3876] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:29.454955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:29.455547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.479240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.480656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.481324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.482322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.482965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.483568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.546127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:29.557347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.580179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15e6e88c-e028-40a8-a405-7b018bd6e2e7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1725 microversion: 2.1 time: 0.450320 Nov 02 12:40:29.595996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1926/3877] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:29 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1725 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:29.595996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:29.595996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.598150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.598778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.600475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.601348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.604402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:29.605285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.605844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.742999 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-25a3b218-4d0b-461c-9885-ff32fba0b6a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 204 len: 0 microversion: 2.1 time: 0.292749 Nov 02 12:40:29.744409 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1952/3878] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:29 2022] DELETE /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:29.755090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:29.758310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.773738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.777116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.777822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.778837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.779477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.781267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.855432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.870064 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c2a80c0-1a9c-4d53-a9fe-ddfb27dcc787 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.287504 Nov 02 12:40:29.872118 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1927/3879] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:29 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:29.877683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:29.883663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.897160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.906133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.906957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.907989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.910681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.911419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.262640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:30.277527 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e3411f20-24b5-485f-8619-04c51f1ea96f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 0.531634 Nov 02 12:40:30.300833 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1953/3880] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:29 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:30.310101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:30.311212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:30.329077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.329077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.329077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.329077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.329077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.329077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.357122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:30.359940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:30.370747 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0a4af71-bfa9-4271-92f9-87853b4c43d7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1495 microversion: 2.1 time: 0.496615 Nov 02 12:40:30.384781 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1928/3881] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:29 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1495 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:30.404716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:30.405351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:30.430035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.430681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.431162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.432163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.432838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.433459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.488273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:30.502705 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-139634ce-7ead-4cf5-bc0c-b910cc713bc4 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1251 microversion: 2.1 time: 0.200617 Nov 02 12:40:30.505618 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1954/3882] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:30 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1251 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:30.515293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:30.515943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:30.535089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.538309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.538776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.539570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.540035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.541996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.100986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.116006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.118200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.122523 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2fadf5d9-fc56-4a92-9e59-11cf588c2a15 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.616102 Nov 02 12:40:31.124142 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1955/3883] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:30 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:31.131592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.132687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:31.140292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.141744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.142663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.143807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.144508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.145180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.284526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.296880 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1522204a-7664-4a50-ae6f-5a8b1462fbc3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1315 microversion: 2.1 time: 0.910629 Nov 02 12:40:31.310868 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1929/3884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:30 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:31.321362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.322725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:31.334362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:31.336305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.337181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.337927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.339403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.340087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.340731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.484813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.496809 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f5328764-fd0b-4591-9b4d-6ef8b22fc457 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1725 microversion: 2.1 time: 0.371222 Nov 02 12:40:31.498644 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1956/3885] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1725 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:31.504131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.505115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:31.513578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.514763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.515753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.516886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.518331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.519152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.791831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.808465 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07ecd57a-abd3-466b-971f-b79da2437dea tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.495932 Nov 02 12:40:31.809818 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1930/3886] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:31.821790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.823092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:31.839995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.840499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.840948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.841664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.842152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.842580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.381671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.389855 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7f6b2035-13a8-44e2-9776-36b5d8c94949 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 0.889701 Nov 02 12:40:32.405555 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1957/3887] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:32.418182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:32.418823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:32.429070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.429603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.430327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.431279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.432085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.432730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.560178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.573047 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-24b0d80c-673c-445c-a8e2-c91e4f9c4513 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1251 microversion: 2.1 time: 0.174626 Nov 02 12:40:32.576244 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1958/3888] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:32 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1251 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:32.588962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1e9b0429-d3ff-4a23-8bda-5a8dbd27a65d req-29c3be1d-5fd3-46c8-b6f1-1ee193081f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4edd3698-808d-4ed4-b690-3612d0349614", "tag": "88bb2590-80c7-4d9e-b361-37a59832c397"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:32.616403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.636837 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c98b0a99-9330-4350-b984-ea7e0b6280e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1495 microversion: 2.1 time: 0.825480 Nov 02 12:40:32.647608 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1931/3889] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1495 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:32.652720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1e9b0429-d3ff-4a23-8bda-5a8dbd27a65d req-29c3be1d-5fd3-46c8-b6f1-1ee193081f89 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.653426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1e9b0429-d3ff-4a23-8bda-5a8dbd27a65d req-29c3be1d-5fd3-46c8-b6f1-1ee193081f89 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.658241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:32.658975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1e9b0429-d3ff-4a23-8bda-5a8dbd27a65d req-29c3be1d-5fd3-46c8-b6f1-1ee193081f89 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.665815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:32.679154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.682811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.683934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.684410 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1e9b0429-d3ff-4a23-8bda-5a8dbd27a65d req-29c3be1d-5fd3-46c8-b6f1-1ee193081f89 service nova] Creating event network-changed:88bb2590-80c7-4d9e-b361-37a59832c397 for instance 4edd3698-808d-4ed4-b690-3612d0349614 on n-h1-855650-5 Nov 02 12:40:32.687037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.687539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.690687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.691477 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1e9b0429-d3ff-4a23-8bda-5a8dbd27a65d req-29c3be1d-5fd3-46c8-b6f1-1ee193081f89 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112619 Nov 02 12:40:32.693033 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1959/3890] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:32.700981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:32.702265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:32.712975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.714219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.714901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.715866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.716570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.718061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.859982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.870993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.873864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.875749 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cd5b524-48dd-4b8b-bf85-805e335f3d57 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.223432 Nov 02 12:40:32.893770 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1932/3891] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:32 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:32.902385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ba13a6f4-efc7-46d8-aa7e-ba49222822de req-d535f2f8-f5c4-4d10-860b-5cb05a9dcc41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3470b9e7-d8fc-4cd0-bd43-5217fe7030a4", "tag": "6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:32.914694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ba13a6f4-efc7-46d8-aa7e-ba49222822de req-d535f2f8-f5c4-4d10-860b-5cb05a9dcc41 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.915480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ba13a6f4-efc7-46d8-aa7e-ba49222822de req-d535f2f8-f5c4-4d10-860b-5cb05a9dcc41 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.916101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ba13a6f4-efc7-46d8-aa7e-ba49222822de req-d535f2f8-f5c4-4d10-860b-5cb05a9dcc41 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.930710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ba13a6f4-efc7-46d8-aa7e-ba49222822de req-d535f2f8-f5c4-4d10-860b-5cb05a9dcc41 service nova] Creating event network-changed:6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c for instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 on n-h1-855650-5 Nov 02 12:40:32.936823 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ba13a6f4-efc7-46d8-aa7e-ba49222822de req-d535f2f8-f5c4-4d10-860b-5cb05a9dcc41 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038231 Nov 02 12:40:32.937709 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1933/3892] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:32.944275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d7b3627d-12e6-4e0b-9297-100837e22104 req-315d5686-3ec8-457f-a2e7-236599e75ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed14fcc4-b09f-4368-9370-e6c857e3826e", "name": "network-vif-plugged", "status": "completed", "tag": "94f2801e-30fd-4360-b18b-5c54e258e6f3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:32.955786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d7b3627d-12e6-4e0b-9297-100837e22104 req-315d5686-3ec8-457f-a2e7-236599e75ad5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.956350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d7b3627d-12e6-4e0b-9297-100837e22104 req-315d5686-3ec8-457f-a2e7-236599e75ad5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.956804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d7b3627d-12e6-4e0b-9297-100837e22104 req-315d5686-3ec8-457f-a2e7-236599e75ad5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.993843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d7b3627d-12e6-4e0b-9297-100837e22104 req-315d5686-3ec8-457f-a2e7-236599e75ad5 service nova] Creating event network-vif-plugged:94f2801e-30fd-4360-b18b-5c54e258e6f3 for instance ed14fcc4-b09f-4368-9370-e6c857e3826e on n-h2-855650-5 Nov 02 12:40:33.000761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d7b3627d-12e6-4e0b-9297-100837e22104 req-315d5686-3ec8-457f-a2e7-236599e75ad5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061246 Nov 02 12:40:33.002024 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1934/3893] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:33.007701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:33.008683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.017044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.018127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.019471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.021184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.022074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.022725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.025865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.039023 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f744777a-9c69-4f02-9ab5-779933d3b769 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1315 microversion: 2.1 time: 0.344208 Nov 02 12:40:33.054479 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1960/3894] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:32 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:33.069195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:33.070378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.076777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:33.078970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.079740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.080482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.081587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.082265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.082879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.482472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.507601 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-359b8898-ebc8-4012-ae8b-8a3bb8af4d20 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1725 microversion: 2.1 time: 0.503899 Nov 02 12:40:33.508232 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1935/3895] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1725 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:33.513043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:33.513951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.524456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.525242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.529250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.530427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.531910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.533373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.539963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.552347 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9dd3a849-c42e-495f-8f95-c0269b476c54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.496305 Nov 02 12:40:33.553015 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1961/3896] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:33.604028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:33.605439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.612881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.615432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.616259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.617245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.617917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.618894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.768976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.786813 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-defe8cc9-8a27-42f4-b93e-5e154c32903d tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1251 microversion: 2.1 time: 0.187308 Nov 02 12:40:33.787889 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1962/3897] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1251 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:33.808633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:33.810170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.843482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.844288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.845090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.846413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.847147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.847852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.190138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.203549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.204538 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d633bfe7-b7f9-4fa7-a42b-dc90e4cd478e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1495 microversion: 2.1 time: 0.415158 Nov 02 12:40:34.222465 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1963/3898] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1495 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:34.231170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.231806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.231993 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65760c86-6ce2-4852-be5b-93247cea52d0 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 0.721231 Nov 02 12:40:34.236361 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1936/3899] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:34.239044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.240782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.241515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.242556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.243457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.246634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.258137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.259065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.276867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.278417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.279703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.280781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.281574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.297912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.455370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.467357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.468811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.477529 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1149a44a-099b-453c-8b2e-f219319b158e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.253741 Nov 02 12:40:34.490497 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1964/3900] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:34.537091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.537609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.547752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.548260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.548714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.549445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.549912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.552992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.606516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.619059 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b938ea16-4993-4a3f-bb11-e5a1e6518ccf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1315 microversion: 2.1 time: 0.379405 Nov 02 12:40:34.622696 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1937/3901] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:34.637208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.640408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.659123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.659640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.660098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.661117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.663611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.666839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.874011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.884070 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b748726b-29da-4152-8829-b48d50468e00 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1731 microversion: 2.1 time: 0.351444 Nov 02 12:40:34.888912 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1965/3902] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1731 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:34.916264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.918689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.939404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.941955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.949175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.951105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.951883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.952524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.985159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.997003 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a8564c81-b936-4af9-b6dd-97c06fc5be5b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.368928 Nov 02 12:40:34.997868 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1938/3903] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:35.004679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.007006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:35.018244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.019182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.019904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.020899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.021737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.022453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.212413 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c200845-2aa2-4f71-b21c-d63464ac7e10 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.213159 Nov 02 12:40:35.224684 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1939/3904] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:35.225122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:35.233574 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-449a9486-938e-4a0d-bc4d-614a819bb30f tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1251 microversion: 2.1 time: 0.343198 Nov 02 12:40:35.235592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.236642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:35.239443 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1966/3905] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1251 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:35.263252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.264737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.267033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.271054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.271345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.272000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:35.273042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.273531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.293448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.294612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.299202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.300695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.301597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.303363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.473051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:35.487960 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88d2f009-fd49-425a-a6d7-b72244cc4f54 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1453 microversion: 2.1 time: 0.252596 Nov 02 12:40:35.501486 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1940/3906] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:35 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1453 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:35.508142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-feb4d575-cfbf-4f63-b204-41d682fe8ea0 req-67ec3568-0fbc-48d1-a0a7-20eedb712309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb56fdc-ed37-4237-a01a-70221545fb3e", "name": "network-vif-deleted", "tag": "f0ac7e5a-dc52-48ce-99d2-767d0eb4b958"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:35.526634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-feb4d575-cfbf-4f63-b204-41d682fe8ea0 req-67ec3568-0fbc-48d1-a0a7-20eedb712309 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.527131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-feb4d575-cfbf-4f63-b204-41d682fe8ea0 req-67ec3568-0fbc-48d1-a0a7-20eedb712309 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.527575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-feb4d575-cfbf-4f63-b204-41d682fe8ea0 req-67ec3568-0fbc-48d1-a0a7-20eedb712309 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.561617 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-feb4d575-cfbf-4f63-b204-41d682fe8ea0 req-67ec3568-0fbc-48d1-a0a7-20eedb712309 service nova] Creating event network-vif-deleted:f0ac7e5a-dc52-48ce-99d2-767d0eb4b958 for instance 1cb56fdc-ed37-4237-a01a-70221545fb3e on n-h1-855650-5 Nov 02 12:40:35.572206 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-feb4d575-cfbf-4f63-b204-41d682fe8ea0 req-67ec3568-0fbc-48d1-a0a7-20eedb712309 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080436 Nov 02 12:40:35.572206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1941/3907] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:35.578848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.579569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:35.598630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.599725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.606985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.607861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.608362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.608814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.817554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:35.834329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:35.835822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:35.837085 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a584a0e-a638-4133-828f-2227748ca8ec tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1605 microversion: 2.32 time: 0.262626 Nov 02 12:40:35.845486 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1942/3908] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:35 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1605 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:35.885195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.886267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:35.937466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.939232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.939966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.947251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:35.956030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.959839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.960832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.982873 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf1d1fb2-505b-4c44-84b3-7eb671f86224 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 0.720041 Nov 02 12:40:36.002037 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1967/3909] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:35 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:36.029829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:36.030991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:36.042819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.044004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.044819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.046325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.047390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.048705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.300097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:36.320637 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b2a0d8a7-e551-49b0-a6b1-ea8e71dcbdde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1503 microversion: 2.1 time: 0.473254 Nov 02 12:40:36.324724 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1943/3910] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:35 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1503 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:36.337690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:36.340851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:36.357069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.358062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.360194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.361207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.365823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.366791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.435421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:36.446567 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8dcb38a3-a15f-4519-8b3d-4521ef50230a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.424525 Nov 02 12:40:36.449009 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1968/3911] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:36 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:36.459019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:36.459574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:36.484051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.484559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.485006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.485724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.486210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.486639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.519407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:36.628981 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65a3a933-1678-4f08-a302-6cc9a94ef0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e/action" status: 202 len: 0 microversion: 2.1 time: 0.178449 Nov 02 12:40:36.633428 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1969/3912] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:36 2022] POST /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:36.639822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:36.646227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:36.660122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.660930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.661614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.662623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.665220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.666549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.667171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:36.683874 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c5395a4-7aea-4ec0-9d36-07544f679c83 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1251 microversion: 2.1 time: 0.357748 Nov 02 12:40:36.685884 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1944/3913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:36 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1251 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:36.691997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:36.693649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:36.704432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.705240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.706107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.707274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.707905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.708671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.340426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:37.362971 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05fdbd4f-56c4-4ad4-b99d-1294433e10e5 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 200 len: 1294 microversion: 2.1 time: 0.727816 Nov 02 12:40:37.363791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1970/3914] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:36 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 1294 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:37.368291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:37.368907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:37.384227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.384650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.385104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.385869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.386338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.387354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.496292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.498848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.499306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.501129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lazy-loading 'fault' on Instance uuid b8c6c782-4032-46df-8abc-e1eedfe7f0fd {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:37.656468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:37.671343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:37.676284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '488c08ed761140ffbfd18033118772f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7d4ee77f204c59a152667c634974d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:37.683649 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-38411145-8a6c-400d-8297-eae443decdac tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 200 len: 1610 microversion: 2.32 time: 0.318796 Nov 02 12:40:37.685990 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1971/3915] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:37 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 1610 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:37.695252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:37.696174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:37.704822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.705691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.706380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.715062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.715875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.716553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.908212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:37.920007 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f8a6a657-b71d-4192-8029-4ae7837a8cbf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1508 microversion: 2.1 time: 1.232586 Nov 02 12:40:37.931424 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1945/3916] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:36 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1508 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:37.945902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ec2382f7-4108-429d-adac-80e7fe2fba77 req-4e1f947d-9137-44ca-b7c2-d1f5d0efc8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78c9169-cb07-47a8-a617-ce5274ca3eb0", "name": "network-vif-plugged", "status": "completed", "tag": "574a28f5-8445-4c43-abf4-ee056e64596d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:37.962683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ec2382f7-4108-429d-adac-80e7fe2fba77 req-4e1f947d-9137-44ca-b7c2-d1f5d0efc8d9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.963475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ec2382f7-4108-429d-adac-80e7fe2fba77 req-4e1f947d-9137-44ca-b7c2-d1f5d0efc8d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.964176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ec2382f7-4108-429d-adac-80e7fe2fba77 req-4e1f947d-9137-44ca-b7c2-d1f5d0efc8d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.978801 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ec2382f7-4108-429d-adac-80e7fe2fba77 req-4e1f947d-9137-44ca-b7c2-d1f5d0efc8d9 service nova] Creating event network-vif-plugged:574a28f5-8445-4c43-abf4-ee056e64596d for instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 on n-h2-855650-5 Nov 02 12:40:37.984666 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ec2382f7-4108-429d-adac-80e7fe2fba77 req-4e1f947d-9137-44ca-b7c2-d1f5d0efc8d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043576 Nov 02 12:40:37.986098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1946/3917] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:38.006012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:38.007249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:38.015197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.016096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.016819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.032698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.043725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.045812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.174691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:38.184312 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-90e1572c-5aad-456b-b6e3-cd3de98bf1ce tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 0.497002 Nov 02 12:40:38.185585 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1972/3918] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:37 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:38.190585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:38.191495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:38.199306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.200179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.200849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.201850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.202573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.203249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.349432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:38.364875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-529010fa-f8a4-4b70-92db-6043cd8b5607 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1251 microversion: 2.1 time: 0.177759 Nov 02 12:40:38.367594 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1973/3919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:38 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1251 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:38.386900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:38.393269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:38.410294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.410904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.411721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.412533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.413075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.413590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.434986 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e HTTP/1.1 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1cb56fdc-ed37-4237-a01a-70221545fb3e'} Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.437441 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:38.444484 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:38.444484 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:38.444484 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:38.444484 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:38.444484 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:40:38.444484 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.447138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:38.448232 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60e1b7ad-a1cb-411f-87d0-244e39e066a6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 404 len: 111 microversion: 2.1 time: 0.065345 Nov 02 12:40:38.452708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1974/3920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:38 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:38.512698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-858501549", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "3df2b834-542d-4af7-a2f7-6a848f5dc1f3"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:38.533857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:38.543717 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0be2287-cb2e-4f7c-9d1e-0c44383199fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.556121 Nov 02 12:40:38.558909 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1947/3921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:37 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:38.592007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] validate_networks() for [('3df2b834-542d-4af7-a2f7-6a848f5dc1f3', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:38.713014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:38.715254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:38.727960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.738901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.740293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.741285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.741927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.742705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.775838 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] HTTP exception thrown: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Request method failure captured: Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd HTTP/1.1 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmM0tI9MIj_-nFTy_cV2q1perPy3L6LCP30NcN9PwtI2-CODRZm9sc7Abt-Ks2b3jnq8Uj9eB69KzIb3LtFX2_2uK1ff3c3CX9lFZVpgk7aVPorxfeUCGZ2M9aPpOONjm7IlTcFOkufZ2JvvX28pPOa0BNuij-eTxljHBh7Whu6DnyU Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 4f7d4ee77f204c59a152667c634974d5 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 4f7d4ee77f204c59a152667c634974d5 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TaggedBootDevicesTest-1995598779-project Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 488c08ed761140ffbfd18033118772f6 Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TaggedBootDevicesTest-1995598779-project Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'b8c6c782-4032-46df-8abc-e1eedfe7f0fd'} Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.787856 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Returning 404 to user: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04426e3e-3492-4ccb-9db3-c6f633b7239f tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 404 len: 111 microversion: 2.32 time: 0.080959 Nov 02 12:40:38.793845 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1948/3922] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:38 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:38.798932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-021ef2fc-21b4-4ee4-94c7-07cfbe74ba98 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '.version_select at 0x7f228dbc8a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:38.804445 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [None req-021ef2fc-21b4-4ee4-94c7-07cfbe74ba98 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:40:39.812253 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [None req-021ef2fc-21b4-4ee4-94c7-07cfbe74ba98 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48972. Nov 02 12:40:39.847436 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-021ef2fc-21b4-4ee4-94c7-07cfbe74ba98 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248003859" status: 204 len: 0 microversion: 2.32 time: 1.052587 Nov 02 12:40:39.848477 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1949/3923] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 12:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248003859 => generated 0 bytes in 1054 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:40:39.854773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:39.867000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:39.874661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:39.875557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:39.876511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:39.877558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:39.878363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:39.879085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:39.913117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:39.987996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:39.992699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:39.995617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:39.997185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:39.998940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:40.022369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.023043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.023967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.024846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.025536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.026115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.089143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:40.096744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:40.144550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:40.154868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:40.168712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:40.182273 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6911b89a-3b84-4e70-bb49-feed4b098803 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1488 microversion: 2.1 time: 0.331670 Nov 02 12:40:40.195239 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1950/3924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:39 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1488 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:40.217461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:40.218141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:40.227893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.228456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.228917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.229671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.234166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.235232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.280615 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-883b3972-4ce7-4d8c-817b-c1c223f0c1f3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772332 Nov 02 12:40:40.282004 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1975/3925] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:40:40.302955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:40.303861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:40.316566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.317359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.318628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.319711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.320380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.320997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.582323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:40.596798 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c68f239c-1cc2-4cb3-949e-0be4d7dde8a5 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1251 microversion: 2.1 time: 0.311462 Nov 02 12:40:40.603346 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1976/3926] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:40 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1251 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:40.612316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6d1a37af-b439-4eb5-9f6d-658d9a86b996 req-5e869602-2fb3-4006-8e16-7872cd3506f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170451bf-340f-489f-87d4-4fda741d2b9f", "tag": "ada2ad3a-0f3a-4cfe-a928-0307223c9de6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:40.680382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d1a37af-b439-4eb5-9f6d-658d9a86b996 req-5e869602-2fb3-4006-8e16-7872cd3506f1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.681007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d1a37af-b439-4eb5-9f6d-658d9a86b996 req-5e869602-2fb3-4006-8e16-7872cd3506f1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.681455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d1a37af-b439-4eb5-9f6d-658d9a86b996 req-5e869602-2fb3-4006-8e16-7872cd3506f1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.704804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:40.720672 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26a27800-2f1f-43c9-991f-e1574f4599e9 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 0.524034 Nov 02 12:40:40.730639 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1951/3927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:40 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:40.733878 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6d1a37af-b439-4eb5-9f6d-658d9a86b996 req-5e869602-2fb3-4006-8e16-7872cd3506f1 service nova] Creating event network-changed:ada2ad3a-0f3a-4cfe-a928-0307223c9de6 for instance 170451bf-340f-489f-87d4-4fda741d2b9f on n-h1-855650-5 Nov 02 12:40:40.747681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:40.750460 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6d1a37af-b439-4eb5-9f6d-658d9a86b996 req-5e869602-2fb3-4006-8e16-7872cd3506f1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141939 Nov 02 12:40:40.751587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:40.755440 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1977/3928] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:40.767604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:40.767989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.769353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:40.774197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.774988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.775924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.776684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.777044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.777300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.777911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.778640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.780030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.780792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.781426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.821349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:40.962820 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf9fb149-22b1-4d48-807d-3c093a275583 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 204 len: 0 microversion: 2.1 time: 0.204679 Nov 02 12:40:40.971233 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1978/3929] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:40 2022] DELETE /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:40.999639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a7f440a9-40f3-451e-a380-250e447cd04b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:41.015024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a7f440a9-40f3-451e-a380-250e447cd04b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:41.247554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a7f440a9-40f3-451e-a380-250e447cd04b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:41.261593 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a7f440a9-40f3-451e-a380-250e447cd04b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1208 microversion: 2.1 time: 0.285686 Nov 02 12:40:41.264157 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1979/3930] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:40 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1208 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:41.274749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:41.281192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:41.296218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.300035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.300780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.302498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.304596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.306292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.365558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:41.385312 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d6eacf8-7009-4b48-a48f-9495a6cf8d11 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.651999 Nov 02 12:40:41.388008 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1952/3931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:40 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:41.717486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:41.718144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:41.733897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.734644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.735160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.735968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.736440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.737655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.826324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:41.840966 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-53222436-8c2a-4ea1-a5c8-dcfb2142a8d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1494 microversion: 2.1 time: 0.575303 Nov 02 12:40:41.841623 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1980/3932] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:41 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1494 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:41.855960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:41.857094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:41.875438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.876287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.876931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.877922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.878664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.879274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.943969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:41.957139 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f11bf2c-2c09-4209-89ed-290d6682a175 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1251 microversion: 2.1 time: 0.243580 Nov 02 12:40:41.962244 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1953/3933] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:41 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1251 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:42.289296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:42.290304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:42.315578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.316487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.317170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.318285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.318992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.319853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.384103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:42.403087 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97dbef07-834e-4dfb-81db-9145177f5c81 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 0.548618 Nov 02 12:40:42.403876 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1981/3934] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:41 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:42.416690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:42.417472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:42.435148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.435703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.436144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.436909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.437361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.437814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.649382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:42.663023 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4bc9ed6a-4b95-456d-b548-edf7380dc2ad tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1212 microversion: 2.1 time: 0.378717 Nov 02 12:40:42.664413 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1954/3935] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:42 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1212 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:42.789100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e31cdb49-9fb0-497c-8df8-2f9b6f0e5b0f req-e88b70ed-7092-4eb9-b208-970bf58baa63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170451bf-340f-489f-87d4-4fda741d2b9f", "tag": "ada2ad3a-0f3a-4cfe-a928-0307223c9de6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:42.810232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e31cdb49-9fb0-497c-8df8-2f9b6f0e5b0f req-e88b70ed-7092-4eb9-b208-970bf58baa63 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.810953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e31cdb49-9fb0-497c-8df8-2f9b6f0e5b0f req-e88b70ed-7092-4eb9-b208-970bf58baa63 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.811589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e31cdb49-9fb0-497c-8df8-2f9b6f0e5b0f req-e88b70ed-7092-4eb9-b208-970bf58baa63 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.826322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e31cdb49-9fb0-497c-8df8-2f9b6f0e5b0f req-e88b70ed-7092-4eb9-b208-970bf58baa63 service nova] Creating event network-changed:ada2ad3a-0f3a-4cfe-a928-0307223c9de6 for instance 170451bf-340f-489f-87d4-4fda741d2b9f on n-h1-855650-5 Nov 02 12:40:42.837809 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e31cdb49-9fb0-497c-8df8-2f9b6f0e5b0f req-e88b70ed-7092-4eb9-b208-970bf58baa63 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053085 Nov 02 12:40:42.838915 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1955/3936] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:42.868921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:42.869516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:42.879593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.888067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.900889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.905425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.909055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.909866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.155690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:43.168133 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0475a4eb-eca9-4c22-ade2-5446d5d2e260 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.755156 Nov 02 12:40:43.172922 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1982/3937] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:42 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:43.189574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:43.191280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:43.211145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.213154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.214523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.217875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.219569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.220588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.277691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.281934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.283675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.285226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lazy-loading 'fault' on Instance uuid f7522fbf-cc29-4ae9-a95b-16214f7b1d40 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:43.290616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:43.302046 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c6f6296-3d51-4ba5-ae8a-a6a547e15e4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1494 microversion: 2.1 time: 0.436992 Nov 02 12:40:43.322430 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1956/3938] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:42 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1494 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:43.396223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5427bc37ece54ae99b22d68a328b800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecbaf8bc88240719b2c57ea95fa869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:43.407815 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d832d6b8-ffb8-486e-b1b2-15e044e8b781 tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 200 len: 1256 microversion: 2.1 time: 0.231067 Nov 02 12:40:43.410967 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1983/3939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:43 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 1256 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:43.431008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:43.431635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:43.450247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.452316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.455177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.457216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.458044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.459423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.651429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ead13fc5-15f5-4bf6-843e-02637921a01e req-f2816a8c-503d-4b5a-8826-3141c8b792ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edd3698-808d-4ed4-b690-3612d0349614", "name": "network-vif-plugged", "status": "completed", "tag": "88bb2590-80c7-4d9e-b361-37a59832c397"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:43.680311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ead13fc5-15f5-4bf6-843e-02637921a01e req-f2816a8c-503d-4b5a-8826-3141c8b792ac service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.683894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ead13fc5-15f5-4bf6-843e-02637921a01e req-f2816a8c-503d-4b5a-8826-3141c8b792ac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.685150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ead13fc5-15f5-4bf6-843e-02637921a01e req-f2816a8c-503d-4b5a-8826-3141c8b792ac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.734108 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ead13fc5-15f5-4bf6-843e-02637921a01e req-f2816a8c-503d-4b5a-8826-3141c8b792ac service nova] Creating event network-vif-plugged:88bb2590-80c7-4d9e-b361-37a59832c397 for instance 4edd3698-808d-4ed4-b690-3612d0349614 on n-h1-855650-5 Nov 02 12:40:43.740823 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ead13fc5-15f5-4bf6-843e-02637921a01e req-f2816a8c-503d-4b5a-8826-3141c8b792ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103426 Nov 02 12:40:43.742165 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1984/3940] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:43.747841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:43.749035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:43.758252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.759066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.759787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.761532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.762637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.763417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:44.083838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:44.108106 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2126f6ff-ce53-46b2-b773-4807e7263b4c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1260 microversion: 2.1 time: 0.364065 Nov 02 12:40:44.109767 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1985/3941] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:43 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1260 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:44.200399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:44.201315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:44.211724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:44.212541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:44.213579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:44.214562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:44.215279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:44.215918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:44.306528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:44.869862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:44.886826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7335b4b8-3c35-4fd6-ad55-e69e7c9cec84 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1318 microversion: 2.1 time: 1.461335 Nov 02 12:40:44.894768 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1957/3942] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:43 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1318 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:44.908515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:44.917426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:44.934419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:44.934922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:44.935614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:44.936676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:44.937356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:44.938134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.021929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:45.031505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.032264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.032679 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e1a005e8-833f-4fe6-86ed-26b7a6348659 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.836795 Nov 02 12:40:45.033221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.033863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lazy-loading 'fault' on Instance uuid ed14fcc4-b09f-4368-9370-e6c857e3826e {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:45.034653 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1986/3943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:44 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:45.045654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.046902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] [instance: f7522fbf-cc29-4ae9-a95b-16214f7b1d40] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:45.075231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.076259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.077791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.079120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.081501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.083835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.087116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:45.096567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a84ad7d7-2046-4ff2-a487-2739bbc6ba79 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 200 len: 1305 microversion: 2.1 time: 0.200363 Nov 02 12:40:45.098082 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1958/3944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:44 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 1305 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:45.118590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-cb1646fd-1468-4974-8fa5-1d713ab391c9 req-b2e8009c-317a-4af2-9245-b1fa49391a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed14fcc4-b09f-4368-9370-e6c857e3826e", "name": "network-vif-deleted", "tag": "94f2801e-30fd-4360-b18b-5c54e258e6f3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:45.130838 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] HTTP exception thrown: Instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 could not be found. Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Request method failure captured: Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 HTTP/1.1 Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSrbFa-mCjqnCnqRekgaE6iTk66cZtszvbi24ixezRDzdrfHj_wysGtRydg0LWZ9yfLgKBlP5zFrww6Fr4aIYnKzcRmFx9qtMN1doWo_MwCtJIJ7pvhTM6B0IOdsBHmZ7Cyz93EK70eOfGx_mIJNZsDPyarHVkIWljNuE-AeSbeP74 Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 4ecbaf8bc88240719b2c57ea95fa869c Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestBootFromVolume-458606682 Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4ecbaf8bc88240719b2c57ea95fa869c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4ecbaf8bc88240719b2c57ea95fa869c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4ecbaf8bc88240719b2c57ea95fa869c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4ecbaf8bc88240719b2c57ea95fa869c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestBootFromVolume-458606682 Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 4ecbaf8bc88240719b2c57ea95fa869c Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestBootFromVolume-458606682 Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestBootFromVolume-458606682-project Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5427bc37ece54ae99b22d68a328b800a Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestBootFromVolume-458606682-project Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 could not be found. Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f7522fbf-cc29-4ae9-a95b-16214f7b1d40'} Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 could not be found. Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 could not be found. Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:45.135103 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.144015 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:45.144015 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:45.144015 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:45.144015 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:45.144015 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:45.144015 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 could not be found. Nov 02 12:40:45.144015 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.147058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Returning 404 to user: Instance f7522fbf-cc29-4ae9-a95b-16214f7b1d40 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:45.148642 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c478a5cc-18cc-4b8e-8279-b2db6c02cc1a tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40" status: 404 len: 111 microversion: 2.1 time: 0.110827 Nov 02 12:40:45.150370 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1987/3945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:45 2022] GET /compute/v2.1/servers/f7522fbf-cc29-4ae9-a95b-16214f7b1d40 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:45.153558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cb1646fd-1468-4974-8fa5-1d713ab391c9 req-b2e8009c-317a-4af2-9245-b1fa49391a1f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.154110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cb1646fd-1468-4974-8fa5-1d713ab391c9 req-b2e8009c-317a-4af2-9245-b1fa49391a1f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.154566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cb1646fd-1468-4974-8fa5-1d713ab391c9 req-b2e8009c-317a-4af2-9245-b1fa49391a1f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.159209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.160260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:45.167764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.168560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.169206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.170406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.171066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.171673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.189189 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-cb1646fd-1468-4974-8fa5-1d713ab391c9 req-b2e8009c-317a-4af2-9245-b1fa49391a1f service nova] Creating event network-vif-deleted:94f2801e-30fd-4360-b18b-5c54e258e6f3 for instance ed14fcc4-b09f-4368-9370-e6c857e3826e on n-h2-855650-5 Nov 02 12:40:45.196592 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-cb1646fd-1468-4974-8fa5-1d713ab391c9 req-b2e8009c-317a-4af2-9245-b1fa49391a1f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096371 Nov 02 12:40:45.197306 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1959/3946] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:45.212928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e2a39e0-b1f2-4e3f-ab35-3aff4bcf18db tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] Calling method '.version_select at 0x7f228dadd820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.261271 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e2a39e0-b1f2-4e3f-ab35-3aff4bcf18db tempest-ServersTestBootFromVolume-458606682 tempest-ServersTestBootFromVolume-458606682-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-171444088" status: 202 len: 0 microversion: 2.1 time: 0.062538 Nov 02 12:40:45.261847 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1960/3947] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-171444088 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:45.292534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:45.309184 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e0475d0-ac8f-48ed-9f04-546091468782 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1266 microversion: 2.1 time: 0.156929 Nov 02 12:40:45.309796 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1988/3948] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:45 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:45.914527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.915308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:45.932429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.933163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.937377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.944910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.946395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.948239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.983973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-cba79403-da21-4147-905c-1146ded3718c req-11a171b7-bafe-440d-8889-f07538694b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3470b9e7-d8fc-4cd0-bd43-5217fe7030a4", "name": "network-vif-plugged", "status": "completed", "tag": "6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:46.011643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cba79403-da21-4147-905c-1146ded3718c req-11a171b7-bafe-440d-8889-f07538694b7a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.017578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cba79403-da21-4147-905c-1146ded3718c req-11a171b7-bafe-440d-8889-f07538694b7a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.018359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cba79403-da21-4147-905c-1146ded3718c req-11a171b7-bafe-440d-8889-f07538694b7a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.042642 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-cba79403-da21-4147-905c-1146ded3718c req-11a171b7-bafe-440d-8889-f07538694b7a service nova] Creating event network-vif-plugged:6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c for instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 on n-h1-855650-5 Nov 02 12:40:46.049746 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-cba79403-da21-4147-905c-1146ded3718c req-11a171b7-bafe-440d-8889-f07538694b7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069521 Nov 02 12:40:46.056241 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1989/3949] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:46.062493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:46.068763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:46.099050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.104336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.105228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.106709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.107532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.108267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.860940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:46.878122 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa188091-82f6-49e1-a075-bb0a4965247a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 200 len: 1506 microversion: 2.1 time: 0.969104 Nov 02 12:40:46.880744 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1961/3950] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:45 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 1506 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:46.887858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:46.888838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:46.909252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.909812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.910297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.911356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.912069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.912851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.931649 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e HTTP/1.1 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'ed14fcc4-b09f-4368-9370-e6c857e3826e'} Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:46.933510 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:46.939049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e4d933d-fbdf-4113-b630-6d3be31b5ca3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 404 len: 111 microversion: 2.1 time: 0.052338 Nov 02 12:40:46.946187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1962/3951] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:46 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:46.957752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:46.959956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:46.975969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.990766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.991230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.991982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.994616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.995308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:46.998752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.010158 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1fd9220c-e4d5-4e55-82a5-b1c998a51f6b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.952156 Nov 02 12:40:47.010777 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1990/3952] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:46 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:47.021077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:47.021695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:47.039938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:47.040555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:47.041435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.045897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:47.047641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:47.048620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.197041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:47.212698 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-653da325-d0c3-417c-9300-e1b203a9eae7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1266 microversion: 2.1 time: 0.259035 Nov 02 12:40:47.214218 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1963/3953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:46 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:47.220560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-443592813", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a20add55-dae0-40be-a4a7-4b9397826fb8"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:47.292939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] validate_networks() for [('a20add55-dae0-40be-a4a7-4b9397826fb8', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:47.528774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:47.546265 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-92f80c05-4bc4-40a0-8666-216f88545150 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0" status: 200 len: 1505 microversion: 2.1 time: 0.530529 Nov 02 12:40:47.550417 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1991/3954] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:47 2022] GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:47.583938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:47.585147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:47.602840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:47.603347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:47.603792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.604518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:47.610334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:47.610806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.653645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:47.813787 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1290b5dc-50bd-4775-8b10-3f2e3939056d tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0" status: 204 len: 0 microversion: 2.1 time: 0.235515 Nov 02 12:40:47.815015 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1992/3955] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:47 2022] DELETE /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:47.829361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:47.830958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:47.839972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:47.843206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:47.843729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.845180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:47.845679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:47.846206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.920030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:48.018304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:48.027287 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8d43c813-3954-467f-aec9-77b8b443e23a tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 204 len: 0 microversion: 2.1 time: 0.205769 Nov 02 12:40:48.029912 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1993/3956] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:47 2022] DELETE /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:48.041125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.041605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:48.050487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.052439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.053080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.054222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.054951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.055673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.076146 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] HTTP exception thrown: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Request method failure captured: Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd HTTP/1.1 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmM0tI9MIj_-nFTy_cV2q1perPy3L6LCP30NcN9PwtI2-CODRZm9sc7Abt-Ks2b3jnq8Uj9eB69KzIb3LtFX2_2uK1ff3c3CX9lFZVpgk7aVPorxfeUCGZ2M9aPpOONjm7IlTcFOkufZ2JvvX28pPOa0BNuij-eTxljHBh7Whu6DnyU Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 4f7d4ee77f204c59a152667c634974d5 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 4f7d4ee77f204c59a152667c634974d5 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TaggedBootDevicesTest-1995598779-project Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 488c08ed761140ffbfd18033118772f6 Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TaggedBootDevicesTest-1995598779-project Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b8c6c782-4032-46df-8abc-e1eedfe7f0fd'} Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:48.078260 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.084215 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.086567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Returning 404 to user: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:48.087758 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3f009bf9-2d5a-4579-8233-08835283a422 tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 404 len: 111 microversion: 2.32 time: 0.055830 Nov 02 12:40:48.088898 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1994/3957] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:40:48 2022] DELETE /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:48.094227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.095170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:48.102316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.103204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.103863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.104875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.105547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.106202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.455799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:48.471349 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e616698b-4267-4149-9cd0-1412c2d62e95 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0" status: 200 len: 1511 microversion: 2.1 time: 0.378681 Nov 02 12:40:48.474271 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1995/3958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:48.480581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.481491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:48.489989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.490813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.491460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.492722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.493509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.494147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.535106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:48.537283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:48.538005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:48.538832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:48.539484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:48.552895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.554521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.555341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.556416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.557876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.558602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.583492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:48.590871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for user 6488e600776547958e00ab146f079c46 and project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:48.609063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:48.612779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:48.673323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acc1762e-5d63-4673-a56e-18e8b07bb01b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457675 Nov 02 12:40:48.674243 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1964/3959] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:40:48.679617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.680685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] [instance: b8c6c782-4032-46df-8abc-e1eedfe7f0fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:48.688794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.689636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.690289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.691454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.692913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.693552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.714142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] HTTP exception thrown: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Request method failure captured: Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd HTTP/1.1 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmM0tI9MIj_-nFTy_cV2q1perPy3L6LCP30NcN9PwtI2-CODRZm9sc7Abt-Ks2b3jnq8Uj9eB69KzIb3LtFX2_2uK1ff3c3CX9lFZVpgk7aVPorxfeUCGZ2M9aPpOONjm7IlTcFOkufZ2JvvX28pPOa0BNuij-eTxljHBh7Whu6DnyU Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 4f7d4ee77f204c59a152667c634974d5 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f7d4ee77f204c59a152667c634974d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 4f7d4ee77f204c59a152667c634974d5 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1995598779 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TaggedBootDevicesTest-1995598779-project Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 488c08ed761140ffbfd18033118772f6 Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TaggedBootDevicesTest-1995598779-project Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'b8c6c782-4032-46df-8abc-e1eedfe7f0fd'} Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.716076 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] Returning 404 to user: Instance b8c6c782-4032-46df-8abc-e1eedfe7f0fd could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:48.720760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e727aeb-2111-4a06-a4bf-955afe9fc91e tempest-TaggedBootDevicesTest-1995598779 tempest-TaggedBootDevicesTest-1995598779-project] 10.222.0.45 "GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd" status: 404 len: 111 microversion: 2.32 time: 0.042101 Nov 02 12:40:48.722787 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1965/3960] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/servers/b8c6c782-4032-46df-8abc-e1eedfe7f0fd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:48.727545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.728179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:48.736231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.737630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.738336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.739399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.740050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.740658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.813609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:48.823958 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ede331af-d855-4d66-9cdd-73c5fec0bce4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1307 microversion: 2.1 time: 0.347896 Nov 02 12:40:48.824551 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1996/3961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1307 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:48.842627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3dbbbde7-200f-4dcd-bbb6-260a1dd1a006 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.843252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3dbbbde7-200f-4dcd-bbb6-260a1dd1a006 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:49.055128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3dbbbde7-200f-4dcd-bbb6-260a1dd1a006 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:49.065518 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3dbbbde7-200f-4dcd-bbb6-260a1dd1a006 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1214 microversion: 2.1 time: 0.226682 Nov 02 12:40:49.066229 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1997/3962] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:49.173401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:49.191833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-846b0210-9a11-4f72-a7c8-918774a7c0de tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.468368 Nov 02 12:40:49.193676 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1966/3963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:49.504814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:49.505610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:49.524378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:49.526333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:49.527472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:49.530774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:49.532458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:49.533440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:49.852287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:49.854264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:49.862235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:49.863019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:49.863649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:49.864730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:49.865366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:49.865959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:50.007494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:50.018021 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8e3dd077-220d-426a-a428-1cbbb9fe8232 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0" status: 200 len: 1511 microversion: 2.1 time: 0.518879 Nov 02 12:40:50.038413 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1998/3964] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:49 2022] GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 => generated 1511 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:50.089350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:50.090106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:50.092562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:50.113068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:50.114712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:50.115491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:50.116534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:50.117207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:50.117859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:50.652083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:50.666527 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c29142e8-d094-41a9-a5b8-70558953fd47 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1266 microversion: 2.1 time: 0.581209 Nov 02 12:40:50.667126 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1999/3965] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:50 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1266 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:50.674172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:50.674172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:50.691031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:50.691539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:50.692031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:50.692751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:50.693213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:50.693645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:50.998635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:51.013534 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19369aa5-ce7b-4d4b-af17-f4250778b974 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 200 len: 1488 microversion: 2.1 time: 1.166291 Nov 02 12:40:51.014858 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1967/3966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:49 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 1488 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:51.021562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-86dada64-e946-4671-8d61-73d16ef0b8a7 req-1be7599f-f15a-4de1-b5d8-5214b513e7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78c62e3-b683-4b22-96d5-4a1db73eb2e7", "tag": "276e0763-3a17-4653-ba26-015eac6ea769"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:51.036946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-86dada64-e946-4671-8d61-73d16ef0b8a7 req-1be7599f-f15a-4de1-b5d8-5214b513e7b2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.037853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-86dada64-e946-4671-8d61-73d16ef0b8a7 req-1be7599f-f15a-4de1-b5d8-5214b513e7b2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.039390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-86dada64-e946-4671-8d61-73d16ef0b8a7 req-1be7599f-f15a-4de1-b5d8-5214b513e7b2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.063886 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-86dada64-e946-4671-8d61-73d16ef0b8a7 req-1be7599f-f15a-4de1-b5d8-5214b513e7b2 service nova] Creating event network-changed:276e0763-3a17-4653-ba26-015eac6ea769 for instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 on n-h2-855650-5 Nov 02 12:40:51.085191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-86dada64-e946-4671-8d61-73d16ef0b8a7 req-1be7599f-f15a-4de1-b5d8-5214b513e7b2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068143 Nov 02 12:40:51.087225 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1968/3967] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:51.099771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2084916859"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:51.104609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:51.116743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.117737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.118572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.120181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.122336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.123720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.447275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:51.472756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cbf01ed6-4bef-4749-b62a-d0a914559b34 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.804126 Nov 02 12:40:51.475133 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2000/3968] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:50 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:51.481742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:51.482682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:51.493623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.493623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.494125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.495482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.496354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.496935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.598318 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6655bc97-f2ab-428f-8703-73cd40e22454 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4/action" status: 202 len: 0 microversion: 2.1 time: 0.508208 Nov 02 12:40:51.602391 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1969/3969] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:51 2022] POST /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:40:51.639259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-061decb2-498b-4978-9c59-6ab5af4aa34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228da87040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:51.730489 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-061decb2-498b-4978-9c59-6ab5af4aa34f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.122053 Nov 02 12:40:51.743357 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1970/3970] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:51 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:51.755556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:51.757142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:51.776188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:51.778663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.779509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.780128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.781064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.782300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.782940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.788006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:52.000613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:52.011499 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59e15a49-2515-4d02-b8d6-99ff4fbfc19f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0" status: 200 len: 1511 microversion: 2.1 time: 0.534522 Nov 02 12:40:52.019211 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2001/3971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:51 2022] GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 => generated 1511 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:52.065041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:52.074861 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d22c8d64-7c50-432c-aae3-89d015a44955 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1272 microversion: 2.1 time: 0.337204 Nov 02 12:40:52.095447 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1971/3972] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:51 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:52.250277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-72a37199-6eba-4304-aab4-f97af73bb91b req-0d0e095e-6050-4b99-b940-bf0d336f7eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edd3698-808d-4ed4-b690-3612d0349614", "name": "network-vif-deleted", "tag": "88bb2590-80c7-4d9e-b361-37a59832c397"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:52.294701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-72a37199-6eba-4304-aab4-f97af73bb91b req-0d0e095e-6050-4b99-b940-bf0d336f7eeb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:52.298049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-72a37199-6eba-4304-aab4-f97af73bb91b req-0d0e095e-6050-4b99-b940-bf0d336f7eeb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:52.299530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-72a37199-6eba-4304-aab4-f97af73bb91b req-0d0e095e-6050-4b99-b940-bf0d336f7eeb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:52.356286 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-72a37199-6eba-4304-aab4-f97af73bb91b req-0d0e095e-6050-4b99-b940-bf0d336f7eeb service nova] Creating event network-vif-deleted:88bb2590-80c7-4d9e-b361-37a59832c397 for instance 4edd3698-808d-4ed4-b690-3612d0349614 on n-h1-855650-5 Nov 02 12:40:52.373956 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-72a37199-6eba-4304-aab4-f97af73bb91b req-0d0e095e-6050-4b99-b940-bf0d336f7eeb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281211 Nov 02 12:40:52.375530 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2002/3973] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:52.501293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:52.502488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:52.514574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:52.516975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:52.518216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:52.525406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:52.526123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:52.526743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:52.751640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f325496-aed9-48b6-8926-efaed3640064 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbbb5e0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:52.893094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f325496-aed9-48b6-8926-efaed3640064 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.145025 Nov 02 12:40:52.900890 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2003/3974] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:52 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:52.948717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:52.959007 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95cb05ea-31f2-49d8-b253-d9f56301b308 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.461748 Nov 02 12:40:52.959624 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1972/3975] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:52 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:53.038333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:53.040740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:53.056949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.058125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.058776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.059672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.060299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.060893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.083855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:53.112549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:53.113181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:53.125702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.126025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.126489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.131308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.131429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.131816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.156853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.157770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.158467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.159476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lazy-loading 'fault' on Instance uuid b78c9169-cb07-47a8-a617-ce5274ca3eb0 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:53.376250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:53.411096 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8001a987-21b5-4ded-8c63-020486cb9b0f tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0" status: 200 len: 1308 microversion: 2.1 time: 0.377815 Nov 02 12:40:53.427753 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2004/3976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:53 2022] GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:53.586036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:53.596961 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39d0b7f1-1d4a-4a91-80f1-eaa3d6cf1650 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.488520 Nov 02 12:40:53.601423 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1973/3977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:53 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:53.917134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c601ca66-00d3-47ee-8e3e-6dd2f9ca4923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc28040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:53.990698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:53.993074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:54.001788 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c601ca66-00d3-47ee-8e3e-6dd2f9ca4923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.088542 Nov 02 12:40:54.002673 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2005/3978] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:53 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:54.014367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.015301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.015995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.016977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.017707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.018416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.405708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-565091ec-f5ce-4692-a2bd-1f2a71a08d72 req-3258ff33-f37b-4160-b0ba-b037c78b6917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78c9169-cb07-47a8-a617-ce5274ca3eb0", "name": "network-vif-deleted", "tag": "574a28f5-8445-4c43-abf4-ee056e64596d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:54.453576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-565091ec-f5ce-4692-a2bd-1f2a71a08d72 req-3258ff33-f37b-4160-b0ba-b037c78b6917 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.454698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-565091ec-f5ce-4692-a2bd-1f2a71a08d72 req-3258ff33-f37b-4160-b0ba-b037c78b6917 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.455396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-565091ec-f5ce-4692-a2bd-1f2a71a08d72 req-3258ff33-f37b-4160-b0ba-b037c78b6917 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.480808 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-565091ec-f5ce-4692-a2bd-1f2a71a08d72 req-3258ff33-f37b-4160-b0ba-b037c78b6917 service nova] Creating event network-vif-deleted:574a28f5-8445-4c43-abf4-ee056e64596d for instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 on n-h2-855650-5 Nov 02 12:40:54.498929 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-565091ec-f5ce-4692-a2bd-1f2a71a08d72 req-3258ff33-f37b-4160-b0ba-b037c78b6917 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097473 Nov 02 12:40:54.500214 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2006/3979] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:54.513419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:54.521863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:54.522488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:54.534789 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f5f1d30-934e-45bd-be20-591980d8ce47 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.554781 Nov 02 12:40:54.535407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1974/3980] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:53 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:54.539883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.540387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.540824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.541539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.542063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.542494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.625365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:54.626356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:54.639836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.640354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.640812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.641579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.642104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.642548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.745035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.745547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.746071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.746548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lazy-loading 'fault' on Instance uuid b78c9169-cb07-47a8-a617-ce5274ca3eb0 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:55.119149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0e502afdee43378bdb22ff55d28263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd477702de64a558f540c617feea703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:55.136012 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d96576e8-33b4-49ee-a948-1ed2f7a45675 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0" status: 200 len: 1308 microversion: 2.1 time: 0.630668 Nov 02 12:40:55.136765 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2007/3981] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:54 2022] GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 => generated 1308 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:55.246124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-107383c4-e623-4ed4-84a9-c9f38f1d47e6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc28dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:55.300280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:55.313258 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c7059fa-5b8a-4a59-8860-ba150b2154e2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.692277 Nov 02 12:40:55.324512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1975/3982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:54 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:55.424605 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-107383c4-e623-4ed4-84a9-c9f38f1d47e6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.283413 Nov 02 12:40:55.425946 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2008/3983] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:55 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:55.563759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:55.564832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:55.590181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:55.590894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:55.591532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:55.592610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:55.593299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:55.594013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.127799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:56.149171 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fc7d3d48-2299-4365-a197-571b0161e79a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.592275 Nov 02 12:40:56.178991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:56.179919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: b78c9169-cb07-47a8-a617-ce5274ca3eb0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:56.182195 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1976/3984] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:55 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:56.188013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.188688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.189440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.190201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.190661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.192304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.210248 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] HTTP exception thrown: Instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 could not be found. Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Request method failure captured: Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 HTTP/1.1 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmUEUwjtEdgsARLBa4HKSiTpi2GoKfrA1EBZbQxK7WYgrQcgnH0mrlNXFn9dpGm9YBExqjhlqVLYbdHbisVYbdAb8ID2TXW_XG1MMgNfmye-JScsX8b--51ZGJNS_NHY2JZwjVCGB7HoX52PAMOVd8VqF1qjJt8QSFLp6rLRTwH7PE0 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0fd477702de64a558f540c617feea703 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-MultipleCreateTestJSON-700820253 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fd477702de64a558f540c617feea703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0fd477702de64a558f540c617feea703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fd477702de64a558f540c617feea703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0fd477702de64a558f540c617feea703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-MultipleCreateTestJSON-700820253 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0fd477702de64a558f540c617feea703 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-MultipleCreateTestJSON-700820253 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-MultipleCreateTestJSON-700820253-project Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 9c0e502afdee43378bdb22ff55d28263 Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-MultipleCreateTestJSON-700820253-project Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 could not be found. Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b78c9169-cb07-47a8-a617-ce5274ca3eb0'} Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 could not be found. Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 could not be found. Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:56.213117 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.219964 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:56.219964 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:56.219964 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:56.219964 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:56.219964 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:56.219964 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 could not be found. Nov 02 12:40:56.219964 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.227401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Returning 404 to user: Instance b78c9169-cb07-47a8-a617-ce5274ca3eb0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:56.234487 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-37175dc9-1a94-4755-9ca6-a007f3bdf8f2 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0" status: 404 len: 111 microversion: 2.1 time: 0.059069 Nov 02 12:40:56.236446 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2009/3985] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:56 2022] GET /compute/v2.1/servers/b78c9169-cb07-47a8-a617-ce5274ca3eb0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:56.247010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:56.248708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] [instance: 4edd3698-808d-4ed4-b690-3612d0349614] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:56.257289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.258613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.259341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.268292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.269066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.269811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.305287 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] HTTP exception thrown: Instance 4edd3698-808d-4ed4-b690-3612d0349614 could not be found. Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Request method failure captured: Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 HTTP/1.1 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmUEUwjtEdgsARLBa4HKSiTpi2GoKfrA1EBZbQxK7WYgrQcgnH0mrlNXFn9dpGm9YBExqjhlqVLYbdHbisVYbdAb8ID2TXW_XG1MMgNfmye-JScsX8b--51ZGJNS_NHY2JZwjVCGB7HoX52PAMOVd8VqF1qjJt8QSFLp6rLRTwH7PE0 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0fd477702de64a558f540c617feea703 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-MultipleCreateTestJSON-700820253 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fd477702de64a558f540c617feea703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0fd477702de64a558f540c617feea703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0fd477702de64a558f540c617feea703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0fd477702de64a558f540c617feea703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-MultipleCreateTestJSON-700820253 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0fd477702de64a558f540c617feea703 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-MultipleCreateTestJSON-700820253 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-MultipleCreateTestJSON-700820253-project Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 9c0e502afdee43378bdb22ff55d28263 Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-MultipleCreateTestJSON-700820253-project Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 4edd3698-808d-4ed4-b690-3612d0349614 could not be found. Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4edd3698-808d-4ed4-b690-3612d0349614'} Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edd3698-808d-4ed4-b690-3612d0349614 could not be found. Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edd3698-808d-4ed4-b690-3612d0349614 could not be found. Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:56.307437 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.312554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:56.312554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:56.312554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:56.312554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:56.312554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:56.312554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edd3698-808d-4ed4-b690-3612d0349614 could not be found. Nov 02 12:40:56.312554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:40:56.317109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] Returning 404 to user: Instance 4edd3698-808d-4ed4-b690-3612d0349614 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:56.317109 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da517ba5-58c4-4362-8d12-5a8dd363dd12 tempest-MultipleCreateTestJSON-700820253 tempest-MultipleCreateTestJSON-700820253-project] 10.222.0.45 "GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614" status: 404 len: 111 microversion: 2.1 time: 0.075229 Nov 02 12:40:56.319168 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1977/3986] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:56 2022] GET /compute/v2.1/servers/4edd3698-808d-4ed4-b690-3612d0349614 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:56.346763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:56.348383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:56.358485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.359508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.360647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.361454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.361919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.362435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.441006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4763ece-693f-4caf-94b2-924b9981cecd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dac2f70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:56.492914 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c4763ece-693f-4caf-94b2-924b9981cecd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.056056 Nov 02 12:40:56.506089 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1978/3987] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:56 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:56.804224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:56.824005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-62803578-2ca0-4633-8aa4-b1fa5f27b6be tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.484148 Nov 02 12:40:56.827252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2010/3988] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:56 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:57.184567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:57.185843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:57.194671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.195438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.196109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:57.197045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.197718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.200015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:57.363019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-32c5c78b-2c2c-456a-9874-6f680d45d015 req-c1cc5f5b-c812-4a35-aa2a-1fadb74903b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7621dc5d-4750-4b8a-b0d7-94b4346154f7", "tag": "6bb13b0f-1da4-4f25-a516-241809c392c5"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:57.390847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-32c5c78b-2c2c-456a-9874-6f680d45d015 req-c1cc5f5b-c812-4a35-aa2a-1fadb74903b4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.391562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-32c5c78b-2c2c-456a-9874-6f680d45d015 req-c1cc5f5b-c812-4a35-aa2a-1fadb74903b4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.395082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-32c5c78b-2c2c-456a-9874-6f680d45d015 req-c1cc5f5b-c812-4a35-aa2a-1fadb74903b4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:57.424494 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-32c5c78b-2c2c-456a-9874-6f680d45d015 req-c1cc5f5b-c812-4a35-aa2a-1fadb74903b4 service nova] Creating event network-changed:6bb13b0f-1da4-4f25-a516-241809c392c5 for instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 on n-h2-855650-5 Nov 02 12:40:57.442789 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-32c5c78b-2c2c-456a-9874-6f680d45d015 req-c1cc5f5b-c812-4a35-aa2a-1fadb74903b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081156 Nov 02 12:40:57.445555 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2011/3989] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:57.510966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97de7f82-69b9-4264-8677-ad411de9d024 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbddf70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:57.601548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97de7f82-69b9-4264-8677-ad411de9d024 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.095345 Nov 02 12:40:57.602207 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2012/3990] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:57 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:57.681736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:57.697937 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ba64f65-fac5-4030-98f0-b90403f357d3 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.510623 Nov 02 12:40:57.700453 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1979/3991] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:57 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:57.850289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:57.851802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:57.866603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.867158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.869242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:57.870305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.873019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.874234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:58.260295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:58.283565 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b9b2c8b-3c1e-4e42-a0f9-c13f71cfc46f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.435277 Nov 02 12:40:58.286691 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2013/3992] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:57 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:58.619949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65f3ba0d-91dc-4513-92fd-931675760703 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228da87040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:58.630265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:58.638189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:58.701348 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65f3ba0d-91dc-4513-92fd-931675760703 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.087001 Nov 02 12:40:58.702327 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1980/3993] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:58 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:58.728467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:58.730059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:58.744084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:58.744904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:58.758754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:58.759796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:58.760445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:58.761052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:59.060359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:59.310104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:59.311329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:59.334285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:59.334983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:59.335624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:59.337709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:59.340765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:59.341691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:59.435589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:59.483675 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-43dca2dc-f5d0-446a-a4bd-76407e0011f7 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.753506 Nov 02 12:40:59.484840 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2014/3994] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:58 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:59.717694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58750cca-07fa-4f98-a7ab-d4f90d93f6ca tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbdd790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:59.770567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:59.796091 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b6cee740-0311-4133-bff0-f1adeea86ab2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.490138 Nov 02 12:40:59.799748 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1981/3995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:59 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:59.829317 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58750cca-07fa-4f98-a7ab-d4f90d93f6ca tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.115367 Nov 02 12:40:59.831351 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2015/3996] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:59 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:00.280654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-abb3c2c5-7934-47e9-bba1-da199dd1999b req-7b40ace5-b3a5-451d-aaf8-4b9a1d1863f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3470b9e7-d8fc-4cd0-bd43-5217fe7030a4", "name": "network-vif-plugged", "status": "completed", "tag": "6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:00.312203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-abb3c2c5-7934-47e9-bba1-da199dd1999b req-7b40ace5-b3a5-451d-aaf8-4b9a1d1863f2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.323800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-abb3c2c5-7934-47e9-bba1-da199dd1999b req-7b40ace5-b3a5-451d-aaf8-4b9a1d1863f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.324702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-abb3c2c5-7934-47e9-bba1-da199dd1999b req-7b40ace5-b3a5-451d-aaf8-4b9a1d1863f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.377652 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-abb3c2c5-7934-47e9-bba1-da199dd1999b req-7b40ace5-b3a5-451d-aaf8-4b9a1d1863f2 service nova] Creating event network-vif-plugged:6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c for instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 on n-h1-855650-5 Nov 02 12:41:00.422333 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-abb3c2c5-7934-47e9-bba1-da199dd1999b req-7b40ace5-b3a5-451d-aaf8-4b9a1d1863f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126102 Nov 02 12:41:00.422333 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1982/3997] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:00.513591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:00.514969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:00.528041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.532097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.532788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.533736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.534445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.537222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.828814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:00.831005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:00.865072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.869796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.870665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.891532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.893193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.895666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.932969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:00.946197 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a135b538-dbc8-49cd-a45e-da258ed6dd9a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.434765 Nov 02 12:41:00.947244 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2016/3998] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:00 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:00.958497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4802a7dc-40ef-40cf-a011-37b8b2f22e40 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc169d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:01.076039 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4802a7dc-40ef-40cf-a011-37b8b2f22e40 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.125584 Nov 02 12:41:01.077006 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2017/3999] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:00 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:01.292563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:01.319924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b22f34ca-8093-4363-a548-e33cb0840bdf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.493997 Nov 02 12:41:01.321085 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1983/4000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:00 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:01.975753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:01.980040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:02.005472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.006618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.019341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.021312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.022605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.023934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.114807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59e86cbf-ac42-43f4-8eac-45efa83c7479 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e57cd30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:02.366232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:02.372251 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59e86cbf-ac42-43f4-8eac-45efa83c7479 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.280208 Nov 02 12:41:02.379568 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f97e588d-167e-4d28-91d2-3049e7c84988 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.412151 Nov 02 12:41:02.382035 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1984/4001] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:02 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:02.402398 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2018/4002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:01 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:02.411291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:02.412424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:02.423892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.424400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.425035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.426652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.428512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.429159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.659877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:02.676989 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7ab349a3-b09a-4a6d-a58b-d062179a377f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.271240 Nov 02 12:41:02.680191 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2019/4003] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:02 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:02.685392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c2bee5d3-c229-4e95-9326-5ff08af25431 req-71ad34ce-b6f4-4e8d-ae03-b7c3c8b476d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78c62e3-b683-4b22-96d5-4a1db73eb2e7", "name": "network-vif-plugged", "status": "completed", "tag": "276e0763-3a17-4653-ba26-015eac6ea769"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:02.728112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c2bee5d3-c229-4e95-9326-5ff08af25431 req-71ad34ce-b6f4-4e8d-ae03-b7c3c8b476d5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.729325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c2bee5d3-c229-4e95-9326-5ff08af25431 req-71ad34ce-b6f4-4e8d-ae03-b7c3c8b476d5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.733152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c2bee5d3-c229-4e95-9326-5ff08af25431 req-71ad34ce-b6f4-4e8d-ae03-b7c3c8b476d5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.787831 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c2bee5d3-c229-4e95-9326-5ff08af25431 req-71ad34ce-b6f4-4e8d-ae03-b7c3c8b476d5 service nova] Creating event network-vif-plugged:276e0763-3a17-4653-ba26-015eac6ea769 for instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 on n-h2-855650-5 Nov 02 12:41:02.812755 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c2bee5d3-c229-4e95-9326-5ff08af25431 req-71ad34ce-b6f4-4e8d-ae03-b7c3c8b476d5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130678 Nov 02 12:41:02.813718 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2020/4004] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:02.882443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3945e73a-d45b-4c3f-8abb-0a78cb40c27e tempest-ExtensionsTest-895373258 tempest-ExtensionsTest-895373258-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:02.884440 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3945e73a-d45b-4c3f-8abb-0a78cb40c27e tempest-ExtensionsTest-895373258 tempest-ExtensionsTest-895373258-project] 10.222.0.45 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.501137 Nov 02 12:41:02.886100 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1985/4005] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Nov 2 12:41:02 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:02.898374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3b30d1c6-c78e-49cb-bcaa-3fbb28c666d5 tempest-ExtensionsTest-895373258 tempest-ExtensionsTest-895373258-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:02.900813 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3b30d1c6-c78e-49cb-bcaa-3fbb28c666d5 tempest-ExtensionsTest-895373258 tempest-ExtensionsTest-895373258-project] 10.222.0.45 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008549 Nov 02 12:41:02.918134 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2021/4006] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Nov 2 12:41:02 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:41:03.389675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b36048de-8032-4fc3-a70c-d014ab9fed53 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dadd280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:03.414161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:03.414916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:03.433048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:03.440291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:03.443400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:03.445546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:03.449069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:03.452609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:03.496461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b36048de-8032-4fc3-a70c-d014ab9fed53 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.111881 Nov 02 12:41:03.506677 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1986/4007] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:03 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:03.703538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:03.704435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:03.719466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:03.720012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:03.733362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:03.734338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:03.740401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:03.741183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:03.896094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:03.908017 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52cdb6bc-fe8c-4823-a3cf-ab8525c5ea97 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.498914 Nov 02 12:41:03.939431 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2022/4008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:03 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:04.251268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:04.263373 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4616bc08-eb82-4e0d-ac05-63f586dc2e32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.563765 Nov 02 12:41:04.266953 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1987/4009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:03 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:04.523538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a6243a8-ce7d-4c54-90fc-010872d384cd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc28550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:04.637538 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a6243a8-ce7d-4c54-90fc-010872d384cd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.119352 Nov 02 12:41:04.642315 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2023/4010] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:04 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:04.943667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:04.945550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:04.967685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:04.970329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:04.970985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:04.972650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:04.975734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:04.976366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:05.287861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:05.288982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:05.303481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:05.304489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:05.305127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:05.307978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:05.310701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:05.312368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:05.790500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:05.809993 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f89adf3d-1447-4123-9efe-eae5576bfbdb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1308 microversion: 2.1 time: 0.868772 Nov 02 12:41:05.813278 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1988/4011] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:04 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1308 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:05.823745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a124aa5c-3fcb-49ef-bc43-2eccefb9fd5c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6e14c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:05.907612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:05.948697 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6bae3b97-72aa-4f3a-bc42-ad3578e76ed3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.648617 Nov 02 12:41:05.949412 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2024/4012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:05 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:05.969045 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a124aa5c-3fcb-49ef-bc43-2eccefb9fd5c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.153983 Nov 02 12:41:05.969949 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1989/4013] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:05 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:06.844499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:06.845280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:06.865937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:06.869244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:06.873815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:06.878359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:06.882031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:06.888660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:06.986065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:06.987265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:07.009060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:07.010529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:07.013647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:07.016395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:07.017073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:07.019279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.360721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:08.373301 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-500df92c-88d9-4613-86fb-488d8f2c2f3e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 1.396553 Nov 02 12:41:08.373903 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1990/4014] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:06 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:08.396757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14880bb6-e3b6-4445-b049-c2495ce7122b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc1e280>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:08.504733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:08.511987 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14880bb6-e3b6-4445-b049-c2495ce7122b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.136922 Nov 02 12:41:08.512634 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1991/4015] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:08 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:08.525006 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c7d0cde2-4f11-465d-9cfe-0595149b4507 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1489 microversion: 2.1 time: 1.684889 Nov 02 12:41:08.554657 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2025/4016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:06 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1489 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:08.559941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:08.561238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-95f8035e-ea84-44ba-9d41-46ac631ceb0c req-1743789c-1adf-416e-88e2-7961509b534b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7621dc5d-4750-4b8a-b0d7-94b4346154f7", "name": "network-vif-plugged", "status": "completed", "tag": "6bb13b0f-1da4-4f25-a516-241809c392c5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:08.576184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:08.592464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.592657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-95f8035e-ea84-44ba-9d41-46ac631ceb0c req-1743789c-1adf-416e-88e2-7961509b534b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.593450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.593912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-95f8035e-ea84-44ba-9d41-46ac631ceb0c req-1743789c-1adf-416e-88e2-7961509b534b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.594359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.594486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-95f8035e-ea84-44ba-9d41-46ac631ceb0c req-1743789c-1adf-416e-88e2-7961509b534b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.595557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.596234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.596899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.624797 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-95f8035e-ea84-44ba-9d41-46ac631ceb0c req-1743789c-1adf-416e-88e2-7961509b534b service nova] Creating event network-vif-plugged:6bb13b0f-1da4-4f25-a516-241809c392c5 for instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 on n-h2-855650-5 Nov 02 12:41:08.640130 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-95f8035e-ea84-44ba-9d41-46ac631ceb0c req-1743789c-1adf-416e-88e2-7961509b534b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122193 Nov 02 12:41:08.641137 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1992/4017] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:08.696195 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb163379-52e5-4a45-a21e-5a248b3bd789 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "PUT /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1084 microversion: 2.1 time: 0.140018 Nov 02 12:41:08.706714 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2026/4018] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:41:08 2022] PUT /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1084 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:08.723355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:08.724748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:08.731956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.733253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.734724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.735618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.736302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.736896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:09.208590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:09.227770 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb14f7ae-bc54-45e0-be4e-aa17ebedd9ac tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1510 microversion: 2.1 time: 0.511826 Nov 02 12:41:09.228559 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1993/4019] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:08 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:09.257751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:09.258404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:09.272229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:09.276083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:09.276820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:09.282460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:09.283151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:09.283962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:09.401818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:09.403083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:09.409546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:09.410337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:09.412212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:09.414341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:09.415003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:09.415587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.096325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:10.114790 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d13c970-926e-43e7-a5c4-457ecd423d7e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1510 microversion: 2.1 time: 0.864115 Nov 02 12:41:10.116037 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2027/4020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:09 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1510 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:10.130467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-21277528-90f3-4e4b-a4f0-9c299510ec18 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc26ca0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:10.176202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:10.186475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3c38661-00f6-417b-9b0a-7ecfd89c3085 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1314 microversion: 2.1 time: 0.789321 Nov 02 12:41:10.194782 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1994/4021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:09 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:10.231300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:10.234740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:10.251064 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-21277528-90f3-4e4b-a4f0-9c299510ec18 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.133099 Nov 02 12:41:10.251767 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2028/4022] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:10 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:10.276375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:10.280885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:10.283632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.287941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:10.290551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:10.291155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.389309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:41:10.528359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:10.655224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd575b85-0b61-4e29-b631-9480fe3816df tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 204 len: 0 microversion: 2.1 time: 0.437373 Nov 02 12:41:10.656589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1995/4023] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:41:10 2022] DELETE /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:10.674783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:10.677038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:10.696393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:10.698337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:10.702313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.703294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:10.703938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:10.704533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.914945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1287505037", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": "none"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:11.034231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:41:11.034785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:41:11.035358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:41:11.036415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:41:11.036925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:41:11.065568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.067168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.069679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.070706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.071317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.073106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.149797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Getting quotas for project 55695eee3a064befaec800d79a0b1acf. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:11.167831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Getting quotas for user 8bf2f1998fec4ae2a62c8280048be801 and project 55695eee3a064befaec800d79a0b1acf. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:11.187755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:11.204750 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5965c299-1428-4b6d-b0e3-f5c80b4a890a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1516 microversion: 2.1 time: 0.541738 Nov 02 12:41:11.205955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1996/4024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:10 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1516 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:11.206821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:41:11.211251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:41:11.223439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:11.224061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:11.247921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.248431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.248878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.249603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.250092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.250527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.274554 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-17f786da-b7fe-4790-b746-76e04a4b6692 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.715662 Nov 02 12:41:11.275800 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2029/4025] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:41:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:41:11.282309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d0eb158-caf7-40d5-8080-ef449ff11d73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbc0040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:11.394005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d0eb158-caf7-40d5-8080-ef449ff11d73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.116748 Nov 02 12:41:11.397131 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2030/4026] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:11 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:11.404254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c43f546-6834-48f8-b51d-554ef5609b0b tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:11.405761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1c43f546-6834-48f8-b51d-554ef5609b0b tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:11.669152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c43f546-6834-48f8-b51d-554ef5609b0b tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:11.710955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c43f546-6834-48f8-b51d-554ef5609b0b tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:11.722884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c43f546-6834-48f8-b51d-554ef5609b0b tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:11.726999 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1c43f546-6834-48f8-b51d-554ef5609b0b tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1281 microversion: 2.47 time: 0.328317 Nov 02 12:41:11.731655 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2031/4027] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:11 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1281 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:11.950007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:11.964423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-365d4909-8b4d-460a-ae55-42727e937c32 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1501 microversion: 2.1 time: 0.744591 Nov 02 12:41:11.973787 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1997/4028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:11 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1501 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:11.993105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:11.993891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:12.007038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:12.012929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:12.015820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:12.019073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:12.020355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:12.022917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:12.101370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lazy-loading 'flavor' on Instance uuid 7621dc5d-4750-4b8a-b0d7-94b4346154f7 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:41:12.120596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:12.246916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.249435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:12.271574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:12.273541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:12.276063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:12.282132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:12.292732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:12.298535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:12.318208 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:41:12.319125 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 12:41:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7/action (ip 10.222.0.45) !!! Nov 02 12:41:12.667844 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a689a08a-d273-43b6-a067-6228a85fa90d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7/action" status: 202 len: 0 microversion: 2.1 time: 0.679651 Nov 02 12:41:12.672534 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2032/4029] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:41:11 2022] POST /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:41:12.697677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c2128ffd-ad57-4a1b-9244-463fcc65f694 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dbddee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.793915 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c2128ffd-ad57-4a1b-9244-463fcc65f694 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.119962 Nov 02 12:41:12.794771 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2033/4030] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:12 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:12.806442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.818856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:12.835390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:12.839752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:12.840398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:12.841310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:12.841936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:12.842552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:13.817126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:13.836568 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a8e604d9-c668-4755-9201-7414013320d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1516 microversion: 2.1 time: 1.596581 Nov 02 12:41:13.847376 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1998/4031] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:12 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1516 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:13.863092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:13.863737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:13.870652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:13.871221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:13.871588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:13.872306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:13.872766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:13.873195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:14.062718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:14.065804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:14.074572 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-aa860892-157c-4f75-a522-f2c9c4003b52 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 1.278208 Nov 02 12:41:14.075092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2034/4032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:12 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:14.088227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c869aee-e46a-4394-bcd3-8dc7d433ab02 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc1d820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:14.112696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:14.123180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:14.124575 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6719e368-fb8d-4da5-8292-a86e2cc0449d tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1333 microversion: 2.47 time: 0.276089 Nov 02 12:41:14.126522 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1999/4033] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:13 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1333 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:14.176271 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c869aee-e46a-4394-bcd3-8dc7d433ab02 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.099575 Nov 02 12:41:14.177187 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2035/4034] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:14 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:14.416935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-375060e4-e5e4-4916-9524-9f3adaa1297f req-e6b82426-2294-4f60-bd19-89fe913f1297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78c62e3-b683-4b22-96d5-4a1db73eb2e7", "name": "network-vif-deleted", "tag": "276e0763-3a17-4653-ba26-015eac6ea769"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:14.442289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-375060e4-e5e4-4916-9524-9f3adaa1297f req-e6b82426-2294-4f60-bd19-89fe913f1297 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:14.443893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-375060e4-e5e4-4916-9524-9f3adaa1297f req-e6b82426-2294-4f60-bd19-89fe913f1297 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:14.444562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-375060e4-e5e4-4916-9524-9f3adaa1297f req-e6b82426-2294-4f60-bd19-89fe913f1297 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:14.482856 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-375060e4-e5e4-4916-9524-9f3adaa1297f req-e6b82426-2294-4f60-bd19-89fe913f1297 service nova] Creating event network-vif-deleted:276e0763-3a17-4653-ba26-015eac6ea769 for instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 on n-h2-855650-5 Nov 02 12:41:14.503248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-375060e4-e5e4-4916-9524-9f3adaa1297f req-e6b82426-2294-4f60-bd19-89fe913f1297 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090191 Nov 02 12:41:14.511986 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2000/4035] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:14.873666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:14.874526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:14.888654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:14.889407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:14.890476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:14.896299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:14.896940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:14.897608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:14.993753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:14.994724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:14.995326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:14.996086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lazy-loading 'fault' on Instance uuid c78c62e3-b683-4b22-96d5-4a1db73eb2e7 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:41:15.102122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:15.102843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:15.125325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:15.126525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:15.131940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:15.135227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:15.138857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:15.145109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:15.219802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:15.249416 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e38a0b72-e9c6-41ae-a0e1-4e06c24cef81 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 200 len: 1319 microversion: 2.1 time: 0.380980 Nov 02 12:41:15.283722 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2036/4036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:14 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:15.333845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:15.338103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:15.367132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:15.385488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:15.391373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:15.392967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:15.399620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:15.403282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:15.808523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:15.833446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:15.835197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:15.836414 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-748845a9-6bb1-43b4-ac1b-88ab662d2880 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1339 microversion: 2.47 time: 0.544352 Nov 02 12:41:15.872773 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2037/4037] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:15 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1339 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:15.885014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56aa79cb-0296-4db5-ba80-1e0bf8a8b0ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dba6160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:15.918569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:15.937764 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5a1752e9-4fd9-4b67-a24d-523de8fa95cb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.839914 Nov 02 12:41:15.938950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2001/4038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:15 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:15.980109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-56aa79cb-0296-4db5-ba80-1e0bf8a8b0ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.105701 Nov 02 12:41:15.980775 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2038/4039] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:15 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:16.281471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.282134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:16.297661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.310291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.310591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.311373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.322791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.323267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.376089 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 HTTP/1.1 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c78c62e3-b683-4b22-96d5-4a1db73eb2e7'} Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.377762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.381639 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.381639 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.381639 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:16.381639 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:16.381639 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:41:16.381639 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.381639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:16.381639 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f002ee6-7846-4084-a37e-fece66fe473c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 404 len: 111 microversion: 2.1 time: 0.102406 Nov 02 12:41:16.396508 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2002/4040] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:16 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:16.646439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1378744149", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "3df2b834-542d-4af7-a2f7-6a848f5dc1f3"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:16.789343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] validate_networks() for [('3df2b834-542d-4af7-a2f7-6a848f5dc1f3', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:16.873153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.877043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:16.906296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.906810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.907263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.907990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.908460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.908894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:17.281214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:17.302494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:17.310121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:17.313117 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-76854e61-9f9e-4e09-91d0-ce79f69b53bd tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1339 microversion: 2.47 time: 0.447459 Nov 02 12:41:17.319758 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2003/4041] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:16 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1339 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:17.360247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:17.360947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:17.385143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:17.391821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:17.392569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:17.398266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:17.399558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:17.402692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:17.858930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:17.889009 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-491fd7d0-d2a9-4e08-a97c-487471bf4d5c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.544218 Nov 02 12:41:17.890107 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2004/4042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:17 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:17.903776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-504d9b1b-3767-4489-a36c-6ef523c321a7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6c0550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:17.987761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-504d9b1b-3767-4489-a36c-6ef523c321a7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.092079 Nov 02 12:41:17.989385 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2005/4043] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:17 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:18.127959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:41:18.129394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:41:18.130154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:41:18.130702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:41:18.131275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:41:18.138631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:18.159215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:18.162080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:18.163010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.167434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:18.168912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:18.169797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.203584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:18.230924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Getting quotas for user f94e46a856ed4b418efb28ff0405a48e and project 07b234bec6b94a66b2f4dad457c5bc80. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:18.269511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:41:18.272444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:41:18.355161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:18.355933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:18.361600 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-77521e39-38bd-40d0-a4ed-84d18a7e2c7f tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720515 Nov 02 12:41:18.362909 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2039/4044] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:41:18.373919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:18.374126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63da0c28-472d-4933-9e10-cb435e537dcb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:18.374778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63da0c28-472d-4933-9e10-cb435e537dcb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:18.375491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:18.377420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.385663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:18.386543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:18.387220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.529397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-63da0c28-472d-4933-9e10-cb435e537dcb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:18.537847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63da0c28-472d-4933-9e10-cb435e537dcb tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1209 microversion: 2.1 time: 0.167608 Nov 02 12:41:18.543187 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2040/4045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:18 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1209 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:18.547155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:18.557224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:18.563753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:18.565368 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-180c3c38-ebad-4732-ab12-b43b4d18aa4a tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1339 microversion: 2.47 time: 0.215564 Nov 02 12:41:18.568486 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2006/4046] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:18 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:18.917321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:18.918333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:18.944601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:18.949657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:18.950452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.956826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:18.958367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:18.959061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.006119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f38e6058-c9fb-40f2-a4ee-0a304cec80fb tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6c0310>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:19.084763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f38e6058-c9fb-40f2-a4ee-0a304cec80fb tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.083125 Nov 02 12:41:19.090676 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2007/4047] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:19 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:19.285943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:19.303310 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8f3cf26-7174-44f0-bc47-46faa62ff89a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.392555 Nov 02 12:41:19.307424 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2041/4048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:18 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:19.570079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:19.571418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:19.586839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.594654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.595460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.596410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.596706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:19.597706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.598394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:19.598953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.618510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.622638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.624967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.629556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.630364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.631009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.177436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:20.195907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:20.198827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:20.200230 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b515b4ff-7c07-4c1b-b15f-9cfeccc511a8 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1339 microversion: 2.47 time: 0.607935 Nov 02 12:41:20.201290 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2042/4049] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:19 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1339 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:20.206310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c08826c-3525-40af-af0a-d81d77cc9bd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db88670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:20.221275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:20.234081 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8a0f942-cf97-44c5-93fe-d9c275fe6023 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1205 microversion: 2.1 time: 0.665830 Nov 02 12:41:20.234782 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2008/4050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:19 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1205 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:20.257676 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9c08826c-3525-40af-af0a-d81d77cc9bd8 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.055104 Nov 02 12:41:20.258700 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2043/4051] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:20 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:20.334506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:20.335174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:20.349929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:20.350579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:20.351665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.355831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:20.356646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:20.358564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.746090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:20.758462 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3caa7568-8549-42c0-a9dc-232af3f7fed7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.429793 Nov 02 12:41:20.766007 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2009/4052] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:20 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:21.233947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:21.235220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:21.254549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.260184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:21.261125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:21.267836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.268638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:21.270351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.272716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.273548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.274157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:21.277923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.278949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:21.280083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.283427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.284665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:21.486348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:21.502978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:21.507219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:21.510667 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-756e794c-94a8-486f-ae53-913f7af8bcc3 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1360 microversion: 2.47 time: 0.279119 Nov 02 12:41:21.511472 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2044/4053] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:21 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1360 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:21.515418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:21.529925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc1a3bd2-39b6-467b-baef-2b7bedb5b8f6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db88700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:21.539986 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0e15c53-16c1-4acc-a42c-902986a186dc tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1267 microversion: 2.1 time: 0.283946 Nov 02 12:41:21.540899 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2010/4054] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:21 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:21.546472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-580473308"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:21.559378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:21.577455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.578598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.583391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:21.584387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.585010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.585583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:21.635912 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cc1a3bd2-39b6-467b-baef-2b7bedb5b8f6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.114682 Nov 02 12:41:21.641775 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2045/4055] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:21 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:21.788009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:21.788631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:21.817845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.818373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.818814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:21.819521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.820233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.820658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.091559 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f7bb4ef1-ecef-4b0b-ab7c-cc587945c925 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "POST /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca/action" status: 202 len: 52 microversion: 2.47 time: 0.549176 Nov 02 12:41:22.092551 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2011/4056] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:41:21 2022] POST /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca/action => generated 52 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:41:22.107297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.111059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:22.125429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:22.131024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.132430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.133034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.134214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.139227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.140145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.213532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:41:22.315383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:22.421873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d328032-7f39-4d3d-82d1-19fa89173e0e tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "DELETE /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 204 len: 0 microversion: 2.47 time: 0.321507 Nov 02 12:41:22.422822 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2012/4057] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:41:22 2022] DELETE /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:41:22.434472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.438800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:22.475549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.477299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.478961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.481395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.483265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.483670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.635079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:22.664560 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ae17b5a-31cc-4275-b34d-27ae041d0c33 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.880896 Nov 02 12:41:22.677658 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2046/4058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:21 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:22.683485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.684398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:22.691894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.692619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.693344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.696522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.698166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.698854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.955289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:22.974604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:22.976235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:22.981915 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd82167d-4c14-4a72-ab5e-890cc2440bfe tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1366 microversion: 2.47 time: 0.550327 Nov 02 12:41:22.983822 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2013/4059] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:22 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:41:22.996025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a61cc184-4d0b-42c3-8497-212ea8ba546d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292aca790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.089566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a61cc184-4d0b-42c3-8497-212ea8ba546d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.102433 Nov 02 12:41:23.090776 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2014/4060] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:22 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:23.127233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:23.137225 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e79db49-bff5-4360-a9e4-922a7496226d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1267 microversion: 2.1 time: 0.458166 Nov 02 12:41:23.138092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2047/4061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:22 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1267 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:23.700702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.701361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:23.727756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.728319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.728777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.729547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.730222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.730827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.018454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:24.020462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:24.035543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.040570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.042584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.044466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.051017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.053832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.468495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:24.503119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:24.505524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:24.506847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a9743cf-dbb7-4006-965d-d54ed0d3c181 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1366 microversion: 2.47 time: 0.492479 Nov 02 12:41:24.523013 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2048/4062] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:24 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:24.538777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7ff3fc26-cb5d-4d50-8afc-1132da730914 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db88430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:24.546465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:24.568576 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-272f7ff6-e218-4000-9bee-cb5c3b2abe9a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.871889 Nov 02 12:41:24.572286 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2015/4063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:23 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:24.580346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:24.580966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:24.623774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.624365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.625554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.626900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.627638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.629497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.637368 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7ff3fc26-cb5d-4d50-8afc-1132da730914 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.112755 Nov 02 12:41:24.647476 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2049/4064] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:24 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:24.755975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:24.786451 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-850c2615-0cfd-4f7f-8d1e-dbcb6edfc02e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1267 microversion: 2.1 time: 0.212886 Nov 02 12:41:24.787852 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2016/4065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:24 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:25.553260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:25.555035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:25.573182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:25.580330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:25.581419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:25.582449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:25.583195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:25.586352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:25.597989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:25.599192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:25.624083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:25.624593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:25.633631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:25.635414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:25.638169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:25.639343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:25.904033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:25.921907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:25.923781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:25.925506 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4429cb41-083b-4666-ba05-fd3939155267 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1366 microversion: 2.47 time: 0.382623 Nov 02 12:41:25.926184 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2050/4066] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:25 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:25.977595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a4ce1455-0f98-4680-9a17-27a38bfd935c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db7a940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:26.242676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:26.263764 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fcb86e32-be61-4927-b051-f76b14854eea tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.671296 Nov 02 12:41:26.265017 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2017/4067] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:25 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:26.387093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59c7d003-3968-4f07-973e-f7caf862ad5c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: .version_select at 0x7f228da87d30>, body: {"keypair": {"name": "tempest-keypair-1843935171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgTUnw8rFg4dbC94IOQvhdafTKPmqIGvF49lk6E8jEeVKgHiNRv1LPZgGveE+xQXFJV7V7tm2DfiM0qOcEuQj68aq9Y12GXkvSk4cJ46aXDhnWTKCVSdhLXfAbR+GuTLw=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:26.437068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-59c7d003-3968-4f07-973e-f7caf862ad5c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:26.444985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-59c7d003-3968-4f07-973e-f7caf862ad5c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for user be15916efb09427eb892d0104e3db5ff and project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:26.508004 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a4ce1455-0f98-4680-9a17-27a38bfd935c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.552218 Nov 02 12:41:26.508724 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2051/4068] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:25 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:26.524264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59c7d003-3968-4f07-973e-f7caf862ad5c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.257442 Nov 02 12:41:26.528061 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2018/4069] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:41:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:26.532306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:26.533162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:26.543530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:26.544041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:26.544486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:26.545507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:26.546203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:26.546635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:26.954953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:26.956824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:26.972246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:26.978541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:26.979694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:26.980477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:26.983751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:26.985476 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea7ab050-9ea7-4200-a41a-af428cbd0bc6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 0.468886 Nov 02 12:41:26.985891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:26.987858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:26.988032 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2052/4070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:26 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:27.117880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.119669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.120868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.124165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lazy-loading 'fault' on Instance uuid 296d146b-8a10-46a7-8251-9a6d71e340ca {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:41:27.286517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:27.294428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:27.296314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:27.306562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:27.309375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf2f1998fec4ae2a62c8280048be801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55695eee3a064befaec800d79a0b1acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:27.312047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fc23f39c-838e-42fb-9032-611976880fd7 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 200 len: 1371 microversion: 2.47 time: 0.362005 Nov 02 12:41:27.326261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.326261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.326261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.326261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.326261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.328028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.328508 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2019/4071] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:26 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:27.525093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dda06c7e-f295-44dd-80a5-b57ca6ff6c52 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e513af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:27.628516 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dda06c7e-f295-44dd-80a5-b57ca6ff6c52 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.106903 Nov 02 12:41:27.630649 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2020/4072] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:27 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:27.820476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:27.834013 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57cd1adf-4638-4d79-ace1-ed3e71ecf07d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.546229 Nov 02 12:41:27.839403 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2053/4073] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:27 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:28.017476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:28.018317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:28.047749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:28.051635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:28.055844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:28.057783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:28.058977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:28.062869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:28.344465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:28.345115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] [instance: 296d146b-8a10-46a7-8251-9a6d71e340ca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:28.353191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:28.375643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:28.376156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:28.376609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:28.384806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:28.385383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:28.385845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:28.442275 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] HTTP exception thrown: Instance 296d146b-8a10-46a7-8251-9a6d71e340ca could not be found. Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Request method failure captured: Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca HTTP/1.1 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmVmfFKEsgejF6ClQp8AsV0v95IZNdSLG44-l9FFYANZzLqtOCSLmjv5czC7GsMDIqHYso_BEkDrHjb9g_A_qMcKCupzHsLZyzHsytpJKKBQLBILUQi6hVCNkGImiwoN9SzEEeGcooYgx4f3aglga63RKWjIRzdmBQJOn5CQvOeWLtY Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 55695eee3a064befaec800d79a0b1acf Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersAaction247Test-207274216 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/55695eee3a064befaec800d79a0b1acf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/55695eee3a064befaec800d79a0b1acf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/55695eee3a064befaec800d79a0b1acf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_55695eee3a064befaec800d79a0b1acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersAaction247Test-207274216 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 55695eee3a064befaec800d79a0b1acf Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersAaction247Test-207274216 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersAaction247Test-207274216-project Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 8bf2f1998fec4ae2a62c8280048be801 Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersAaction247Test-207274216-project Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 296d146b-8a10-46a7-8251-9a6d71e340ca could not be found. Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '296d146b-8a10-46a7-8251-9a6d71e340ca'} Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 296d146b-8a10-46a7-8251-9a6d71e340ca could not be found. Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 296d146b-8a10-46a7-8251-9a6d71e340ca could not be found. Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:28.454393 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 296d146b-8a10-46a7-8251-9a6d71e340ca could not be found. Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] Returning 404 to user: Instance 296d146b-8a10-46a7-8251-9a6d71e340ca could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a7d81858-b016-4917-94ed-801844ec9b44 tempest-ServersAaction247Test-207274216 tempest-ServersAaction247Test-207274216-project] 10.222.0.45 "GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca" status: 404 len: 111 microversion: 2.47 time: 0.117198 Nov 02 12:41:28.461034 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2054/4074] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:41:28 2022] GET /compute/v2.1/servers/296d146b-8a10-46a7-8251-9a6d71e340ca => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:41:28.647253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1377b890-4eb2-42ba-857d-46db0d0d40ca tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e1829d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:28.674197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=16 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:28.725455 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1377b890-4eb2-42ba-857d-46db0d0d40ca tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.084011 Nov 02 12:41:28.726544 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2055/4075] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:28 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:28.811947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:28.828725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-878f70f0-6125-47be-96ab-c1c147e1f9a8 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 0.815079 Nov 02 12:41:28.831793 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2021/4076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:28 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:28.867075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:28.868591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:28.877504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:28.879051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:28.879768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:28.880980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:28.883130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:28.884765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:29.744575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be2d8fb1-1e4d-4416-8ee0-019c523dcd54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e513af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:29.864015 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be2d8fb1-1e4d-4416-8ee0-019c523dcd54 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.125402 Nov 02 12:41:29.864679 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2022/4077] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:29 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:29.874857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:29.879949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:29.897945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:29.898529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:29.901402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:29.902834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:29.903488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:29.904701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:30.707030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:30.722219 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8af5e024-51b2-4250-9892-dd4a0ae2e7c7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 1.862958 Nov 02 12:41:30.724151 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2056/4078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:28 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:30.880269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-352d1e2f-9e03-448f-9c66-53ba912449a7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db82a60>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:30.971408 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-352d1e2f-9e03-448f-9c66-53ba912449a7 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1414 microversion: 2.1 time: 0.095174 Nov 02 12:41:30.974238 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2057/4079] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:30 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:31.278391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:31.290718 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de5f9f1f-e5bc-4098-9b04-d22e85147dd9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 1.424813 Nov 02 12:41:31.294820 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2023/4080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:29 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:31.760247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:31.761600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:31.772982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:31.781809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:31.783291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:31.786741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:31.787819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:31.794812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:31.828711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:31.888860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d42b21b3-0a7d-4c83-a816-99c77c64217c req-68a442bb-7415-423a-9111-8e67092aedac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5abd2e9d-c4a7-47f8-8772-fbfcc8da8981", "tag": "b277df25-393c-4bb3-b95b-4fb7ccecb28a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:31.912353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d42b21b3-0a7d-4c83-a816-99c77c64217c req-68a442bb-7415-423a-9111-8e67092aedac service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:31.913691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d42b21b3-0a7d-4c83-a816-99c77c64217c req-68a442bb-7415-423a-9111-8e67092aedac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:31.914258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d42b21b3-0a7d-4c83-a816-99c77c64217c req-68a442bb-7415-423a-9111-8e67092aedac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:31.953465 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d42b21b3-0a7d-4c83-a816-99c77c64217c req-68a442bb-7415-423a-9111-8e67092aedac service nova] Creating event network-changed:b277df25-393c-4bb3-b95b-4fb7ccecb28a for instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 on n-h2-855650-5 Nov 02 12:41:31.975348 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d42b21b3-0a7d-4c83-a816-99c77c64217c req-68a442bb-7415-423a-9111-8e67092aedac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090949 Nov 02 12:41:31.976126 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2024/4081] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:31.995287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cafd03e8-bf1a-4337-b7dd-60af9192f5cd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e6901f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:32.107479 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cafd03e8-bf1a-4337-b7dd-60af9192f5cd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1423 microversion: 2.1 time: 0.121772 Nov 02 12:41:32.108931 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2025/4082] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:31 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:32.148805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f331c34-d94a-47e5-b196-9dbf13141557 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228ec1a430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:32.250197 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f331c34-d94a-47e5-b196-9dbf13141557 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 200 len: 1423 microversion: 2.1 time: 0.129820 Nov 02 12:41:32.251546 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2026/4083] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:32 2022] GET /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 1423 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:32.342561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:32.344063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:32.372529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:32.373159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:32.373629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:32.374694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:32.375164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:32.375607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:32.863854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:32.898810 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b0c73a67-a662-410f-b6e2-e02725ef2c6f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 1.145032 Nov 02 12:41:32.899978 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2058/4084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:31 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:32.920137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1380613891", "imageRef": "9e68830e-fda7-46bb-9c4b-f62580219a29", "flavorRef": "452", "networks": [{"uuid": "6073314f-95a7-4839-bb88-cbb45aac3413"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:33.011758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] validate_networks() for [('6073314f-95a7-4839-bb88-cbb45aac3413', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:33.085510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:33.095298 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78422ba5-87ae-4bd8-87f8-f0b4dc8344d6 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 0.758229 Nov 02 12:41:33.099985 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2027/4085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:32 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:33.923387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:33.924001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:33.938151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:33.942099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:33.942772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:33.943653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:33.947903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:33.948374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:34.499314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:34.527863 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0a812a96-6a9a-4762-8d60-661ca0772e83 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.606753 Nov 02 12:41:34.546509 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2028/4086] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:33 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:34.553226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:34.553861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:34.571944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:34.575343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:34.576168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:34.577047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:34.578424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:34.580052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:34.620168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:41:34.620659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:41:34.621340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:41:34.621843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:41:34.622379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:41:34.647910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:34.649877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:34.651183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:34.656401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:34.660919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:34.661385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:34.722737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:34.740181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for user beeb8b4fa7354185ba8aff3194bf9e06 and project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:34.757581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:41:34.760103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e68830e-fda7-46bb-9c4b-f62580219a29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:41:34.838414 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-037fffce-3434-48b2-91d2-23ef47b72c1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.935122 Nov 02 12:41:34.841179 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2059/4087] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:41:34.853935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-959709667", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92a568cc-930f-412f-9bc6-cc5b26f3a471"}], "security_groups": [{"name": "tempest-securitygroup--1729780060"}], "key_name": "tempest-keypair-1843935171", "user_data": "}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:34.870852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:34.886912 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9abf5c6f-7629-4a04-a802-a05c057bd549 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 0.338942 Nov 02 12:41:34.887560 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2029/4088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:34 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:34.898513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-920c314d-2308-42f8-8bda-8a7e07dff179 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:34.902456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-920c314d-2308-42f8-8bda-8a7e07dff179 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:35.024150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-920c314d-2308-42f8-8bda-8a7e07dff179 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:35.033419 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-920c314d-2308-42f8-8bda-8a7e07dff179 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1208 microversion: 2.1 time: 0.142460 Nov 02 12:41:35.038634 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2030/4089] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:34 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1208 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:35.107151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] validate_networks() for [('92a568cc-930f-412f-9bc6-cc5b26f3a471', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:35.561610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:35.568813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:35.594643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:35.597002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:35.597002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:35.597154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:35.597926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:35.612458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.107880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:36.123221 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bcd96953-7e3e-4119-90b1-cc5648991fd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.569079 Nov 02 12:41:36.124456 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2031/4090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:35 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:36.129466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:36.130199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:36.164175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:41:36.164735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:41:36.165139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:41:36.165564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:41:36.166345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:41:36.174055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.177482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.179594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.180006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.180478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.180925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.181339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.181469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.182404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.182971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.183201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.184386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.220447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:36.228767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for user be15916efb09427eb892d0104e3db5ff and project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:36.249900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:41:36.254262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:41:36.348191 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9579b9b7-f2ee-4a1f-b1d6-5290b488ec30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.503511 Nov 02 12:41:36.351416 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2060/4091] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:41:36.364551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:36.365185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:36.379160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.379914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.380752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.381925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.382916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.384176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.533137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:36.547324 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e06480de-18a1-46ab-a479-c23ad2dde49a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1260 microversion: 2.1 time: 0.193788 Nov 02 12:41:36.547925 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2061/4092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:36 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:36.557466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58fa18a5-4b53-4ad1-ad7e-6f51f7f2f3a4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:36.563507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58fa18a5-4b53-4ad1-ad7e-6f51f7f2f3a4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:36.565597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:36.585945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-710da174-f053-4a9e-93b6-e57b2f032868 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 0.457551 Nov 02 12:41:36.586845 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2032/4093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:36 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:36.591914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-67bb30e3-7b1c-48e4-9915-3c811ef0eb9e req-10707ed0-9e77-40fe-b746-7d5c9f2754f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3470b9e7-d8fc-4cd0-bd43-5217fe7030a4", "name": "network-vif-unplugged", "status": "completed", "tag": "6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:36.610254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-67bb30e3-7b1c-48e4-9915-3c811ef0eb9e req-10707ed0-9e77-40fe-b746-7d5c9f2754f6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.611173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-67bb30e3-7b1c-48e4-9915-3c811ef0eb9e req-10707ed0-9e77-40fe-b746-7d5c9f2754f6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.611840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-67bb30e3-7b1c-48e4-9915-3c811ef0eb9e req-10707ed0-9e77-40fe-b746-7d5c9f2754f6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.654218 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-67bb30e3-7b1c-48e4-9915-3c811ef0eb9e req-10707ed0-9e77-40fe-b746-7d5c9f2754f6 service nova] Creating event network-vif-unplugged:6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c for instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 on n-h1-855650-5 Nov 02 12:41:36.667583 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-67bb30e3-7b1c-48e4-9915-3c811ef0eb9e req-10707ed0-9e77-40fe-b746-7d5c9f2754f6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079210 Nov 02 12:41:36.668592 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2033/4094] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:36.674201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58fa18a5-4b53-4ad1-ad7e-6f51f7f2f3a4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:36.696796 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58fa18a5-4b53-4ad1-ad7e-6f51f7f2f3a4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1241 microversion: 2.1 time: 0.142874 Nov 02 12:41:36.699185 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2062/4095] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:36 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1241 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:37.153386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:37.155631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:37.171359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.173076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.174903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.175994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.176785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.177883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.441468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:37.458900 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca662691-8495-4e12-9200-49ce385d7038 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.311150 Nov 02 12:41:37.460960 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2034/4096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:37 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:37.575229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:37.576163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:37.590096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.590608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.591071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.591778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.592451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.593539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.612114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:37.612736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:37.627365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.628429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.628884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.629615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.630115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.630555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.810862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:37.838009 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d06dcc3-b4a9-439a-93bd-2948b5f5642a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1266 microversion: 2.1 time: 0.265366 Nov 02 12:41:37.838634 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2063/4097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:37 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:37.853764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:37.854548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:37.877799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.879891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.882743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.883816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.895516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.899034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:38.134150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:38.150765 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2b4e33b5-2bfe-4f7a-86db-f0eaa6317c40 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 0.540134 Nov 02 12:41:38.153882 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2035/4098] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:37 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:38.214430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:38.225754 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6acae6b-1ccf-48d0-aa03-a5903e3c8a0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1293 microversion: 2.1 time: 0.383844 Nov 02 12:41:38.241996 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2064/4099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:37 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1293 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:38.485915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:38.486715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:38.501301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:38.502019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:38.503173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:38.504064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:38.504719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:38.505333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:38.805846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:38.808761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:38.828042 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a45c4f2c-f00d-4399-acfc-439a5109bf45 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1507 microversion: 2.1 time: 0.345997 Nov 02 12:41:38.843713 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2036/4100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:38 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:38.861508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:38.862881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:38.919016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:38.920694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:38.921332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:38.929339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:38.932097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:38.935859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.183428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:39.184011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:39.191058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:39.199029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.199534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.199989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.200710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.204908 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-26c29116-339c-40a8-8c71-27a2c04d8bd4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1266 microversion: 2.1 time: 0.345757 Nov 02 12:41:39.214198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.214708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.221007 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2065/4101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:38 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:39.252929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:39.253991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:39.272860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.273417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.273886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.276615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.277115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.279437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.607559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:39.635570 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8561575-f45a-4437-9004-3501f60ec113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1299 microversion: 2.1 time: 0.386631 Nov 02 12:41:39.639023 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2066/4102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:39 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1299 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:39.870258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:39.870895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:39.890795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.891887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.892639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.893654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.895353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.896094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:40.090756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:40.125410 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0feb0960-8397-4655-aa10-f537108458b2 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 0.943956 Nov 02 12:41:40.126647 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2037/4103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:39 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:40.235439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:40.236576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:40.254506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.262672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.263576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:40.266865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.267619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.268798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.621726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:41.635136 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7411ff22-baba-44b8-a698-019e2e6eff7b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1528 microversion: 2.1 time: 1.770193 Nov 02 12:41:41.642418 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2067/4104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:39 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1528 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:41.649253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:41.649887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:41.681717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:41.689920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.690868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.691660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.692568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.694719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.695393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.697954 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6daffc8e-2948-4910-9319-9c4b17f95514 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 1.467092 Nov 02 12:41:41.699362 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2038/4105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:40 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:41.724826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-aaf81979-0aee-45af-9651-4dc0e4997bc8 req-525b7f76-2546-4556-a4ff-dbf5f78b0ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abd2e9d-c4a7-47f8-8772-fbfcc8da8981", "name": "network-vif-plugged", "status": "completed", "tag": "b277df25-393c-4bb3-b95b-4fb7ccecb28a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:41.763116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aaf81979-0aee-45af-9651-4dc0e4997bc8 req-525b7f76-2546-4556-a4ff-dbf5f78b0ed9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.764056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aaf81979-0aee-45af-9651-4dc0e4997bc8 req-525b7f76-2546-4556-a4ff-dbf5f78b0ed9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.764734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aaf81979-0aee-45af-9651-4dc0e4997bc8 req-525b7f76-2546-4556-a4ff-dbf5f78b0ed9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.812248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-aaf81979-0aee-45af-9651-4dc0e4997bc8 req-525b7f76-2546-4556-a4ff-dbf5f78b0ed9 service nova] Creating event network-vif-plugged:b277df25-393c-4bb3-b95b-4fb7ccecb28a for instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 on n-h2-855650-5 Nov 02 12:41:41.835743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-aaf81979-0aee-45af-9651-4dc0e4997bc8 req-525b7f76-2546-4556-a4ff-dbf5f78b0ed9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134040 Nov 02 12:41:41.836857 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2039/4106] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:41.845183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:41.847434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:41.857108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.858245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.858998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.860510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.861388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.862359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.896382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:41.923312 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93f2b758-691c-4406-9b61-dd0a67904326 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1299 microversion: 2.1 time: 0.278838 Nov 02 12:41:41.928541 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2068/4107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:41 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1299 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:42.531316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:42.540652 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fce92000-960b-4ed9-bdc5-5e8e38bf09db tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1309 microversion: 2.1 time: 0.702198 Nov 02 12:41:42.554197 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2040/4108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:41 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1309 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:42.675088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:42.675845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:42.696215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.696697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.697080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.697820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.698315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.698736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.734383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:42.735068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:42.763487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.765203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.766745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.767492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.768090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.768525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.057402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:44.069112 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9163941-5d08-435b-9bed-9ec58f71b3b4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 1.340497 Nov 02 12:41:44.074316 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2041/4109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:42 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:44.087214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.087790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:44.113406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.113911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.114591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.115633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.116330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.116996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.540869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:44.572942 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f229883c-a763-422b-b845-5d4709e92edd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1528 microversion: 2.1 time: 1.900300 Nov 02 12:41:44.573937 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2069/4110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:42 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1528 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:44.585096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.587536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:44.604883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.606204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.607790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.609653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.610463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.611379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.851192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lazy-loading 'services' on Instance uuid 170451bf-340f-489f-87d4-4fda741d2b9f {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:41:45.033436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:45.128359 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d993fcc-dcd0-4c2e-9944-6652f074f916 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments/ec72e2d0-f7ad-4e12-9905-b5c3d9bb7650" status: 202 len: 0 microversion: 2.1 time: 0.549491 Nov 02 12:41:45.140470 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2070/4111] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:41:44 2022] DELETE /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments/ec72e2d0-f7ad-4e12-9905-b5c3d9bb7650 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:41:45.179190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:45.180797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:45.195366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:45.196940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:45.206106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:45.206106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:45.206106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:45.207246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.079727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:46.098809 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d63846d3-397b-4b0f-98ef-a3bc36ebb4f2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 2.022787 Nov 02 12:41:46.100292 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2042/4112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:44 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:46.113678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:46.114949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:46.126534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.127564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.128166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.129590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.130351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.130928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.195497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:46.681900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=14 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:46.787639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:46.840809 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-682567da-f763-4a2c-a717-f641247e163e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1489 microversion: 2.1 time: 1.698230 Nov 02 12:41:46.851172 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2071/4113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:45 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1489 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:46.884748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:46.901371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:46.952347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:46.969855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:46.972923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.977814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.979863 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0e1a4f61-cca9-44be-924b-4770ac71715f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 0.878095 Nov 02 12:41:46.983067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.984361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.985398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.985575 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2043/4114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:46 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:46.995051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.013480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:47.021899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:47.034397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.035661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.038849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.040059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.040850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.042781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.261297 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f2a40a9-6aa7-47f3-9329-63bba23927af tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.408007 Nov 02 12:41:47.283782 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2072/4115] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:41:46 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments => generated 197 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:47.303592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9b9accad-f948-4ecf-bf5f-c0d2cce3236d req-e66e63da-066f-48ca-bb9c-74e946ba48ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e8f175-bce2-4c4e-94f9-40faf81ae640", "tag": "4593c611-0931-4c62-90f2-5a5c433c3c9a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:47.359743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9b9accad-f948-4ecf-bf5f-c0d2cce3236d req-e66e63da-066f-48ca-bb9c-74e946ba48ec service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.360454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9b9accad-f948-4ecf-bf5f-c0d2cce3236d req-e66e63da-066f-48ca-bb9c-74e946ba48ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.361027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9b9accad-f948-4ecf-bf5f-c0d2cce3236d req-e66e63da-066f-48ca-bb9c-74e946ba48ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.391772 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9b9accad-f948-4ecf-bf5f-c0d2cce3236d req-e66e63da-066f-48ca-bb9c-74e946ba48ec service nova] Creating event network-changed:4593c611-0931-4c62-90f2-5a5c433c3c9a for instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 on n-h1-855650-5 Nov 02 12:41:47.404734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9b9accad-f948-4ecf-bf5f-c0d2cce3236d req-e66e63da-066f-48ca-bb9c-74e946ba48ec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118866 Nov 02 12:41:47.407453 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2073/4116] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:47.435213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-330847956"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:47.449320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:47.469567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.471369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.473425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.475483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.477550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.480199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.683631 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c9b217b-8470-48cc-83a9-4e83025bb087 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "PUT /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1073 microversion: 2.1 time: 0.267399 Nov 02 12:41:47.690278 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2074/4117] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:41:47 2022] PUT /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1073 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:47.709219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:47.710965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:47.729897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.730979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.731638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.734256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.736970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.739934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:48.607442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:48.617737 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3df6844a-bb56-463e-98c5-31d8e375ffb3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 1.629920 Nov 02 12:41:48.621321 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2044/4118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:46 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:48.626358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:48.635948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:48.650557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:48.652295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:48.659239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:48.660380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:48.661047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:48.661801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:48.782556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:48.792807 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-252ee0eb-243b-4c04-ae3f-8977f5f8044c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 1.100965 Nov 02 12:41:48.797624 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2075/4119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:47 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:48.807900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:48.822434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:48.839790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:48.840368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:48.843588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:48.851994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:48.853593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:48.854141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.346809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:49.357390 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8eb2855b-00ba-45e9-b876-6c9467cde301 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1499 microversion: 2.1 time: 0.734710 Nov 02 12:41:49.364730 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2045/4120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:48 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1499 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:49.374775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3c91d89b-3cb3-47ec-bc2f-c1da51ef0881 req-4e8565ec-d169-4f84-acca-36d2b76d59c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7621dc5d-4750-4b8a-b0d7-94b4346154f7", "name": "network-vif-plugged", "status": "completed", "tag": "6bb13b0f-1da4-4f25-a516-241809c392c5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:49.402015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3c91d89b-3cb3-47ec-bc2f-c1da51ef0881 req-4e8565ec-d169-4f84-acca-36d2b76d59c4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.403062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3c91d89b-3cb3-47ec-bc2f-c1da51ef0881 req-4e8565ec-d169-4f84-acca-36d2b76d59c4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.406364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3c91d89b-3cb3-47ec-bc2f-c1da51ef0881 req-4e8565ec-d169-4f84-acca-36d2b76d59c4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.443379 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3c91d89b-3cb3-47ec-bc2f-c1da51ef0881 req-4e8565ec-d169-4f84-acca-36d2b76d59c4 service nova] Creating event network-vif-plugged:6bb13b0f-1da4-4f25-a516-241809c392c5 for instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 on n-h2-855650-5 Nov 02 12:41:49.452005 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3c91d89b-3cb3-47ec-bc2f-c1da51ef0881 req-4e8565ec-d169-4f84-acca-36d2b76d59c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085217 Nov 02 12:41:49.459435 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2046/4121] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:49.470498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:49.480748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:49.494572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.499141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.499923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.503697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.506476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.508817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.597012 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-81f35bf4-1cd4-4c99-b7b2-36ad89c5eef0 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132984 Nov 02 12:41:49.599120 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2047/4122] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:41:49 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:49.605912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:49.618080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:49.637542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.642074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.643082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.644143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.644944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.646238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.666771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:49.673800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:49.702325 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-80f1efcc-f09b-48ee-9eae-e368c76a93e4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 0.901559 Nov 02 12:41:49.710598 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2076/4123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:48 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:49.721909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:49.734953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:49.759380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.762808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.763561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.764561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.767077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.789692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:50.766011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:50.786874 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c595a72-cf04-4f26-a85d-e5ca7c2b6ea0 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1499 microversion: 2.1 time: 1.186337 Nov 02 12:41:50.793309 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2048/4124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:49 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1499 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:50.811195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-aee8af67-e64f-4569-b1ea-448c0818a2db req-990b8827-557b-459a-94f0-e916e2c3c079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849b433f-9fa9-413b-8f1e-21a92e07c013", "tag": "5931d485-b7de-4d4b-b0fd-bbc183e4d3ac"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:50.843401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aee8af67-e64f-4569-b1ea-448c0818a2db req-990b8827-557b-459a-94f0-e916e2c3c079 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:50.850972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aee8af67-e64f-4569-b1ea-448c0818a2db req-990b8827-557b-459a-94f0-e916e2c3c079 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:50.853469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aee8af67-e64f-4569-b1ea-448c0818a2db req-990b8827-557b-459a-94f0-e916e2c3c079 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:50.904537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-aee8af67-e64f-4569-b1ea-448c0818a2db req-990b8827-557b-459a-94f0-e916e2c3c079 service nova] Creating event network-changed:5931d485-b7de-4d4b-b0fd-bbc183e4d3ac for instance 849b433f-9fa9-413b-8f1e-21a92e07c013 on n-h1-855650-5 Nov 02 12:41:50.922996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-aee8af67-e64f-4569-b1ea-448c0818a2db req-990b8827-557b-459a-94f0-e916e2c3c079 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123412 Nov 02 12:41:50.925125 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2049/4125] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:50.950169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:50.950906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:50.974710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:50.975220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:50.975678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:50.976472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:50.977058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:50.977558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:51.094573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:51.107979 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0672a6dd-15c8-4e82-b4fd-25ca3b65a6a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 1.393737 Nov 02 12:41:51.120676 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2077/4126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:49 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:51.133125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:51.140882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:51.152974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:51.167646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:51.168594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:51.169637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:51.170790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:51.171399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:51.250488 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5986dee0-3088-4d7e-be52-206ec85c5456 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128351 Nov 02 12:41:51.255040 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2078/4127] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:41:51 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:51.267127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:51.273226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:51.287027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:51.287942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:51.290471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:51.291505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:51.292246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:51.293729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:52.899427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:52.916987 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0e8f2bae-f312-4dfc-b41d-caec859a7447 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 1.985979 Nov 02 12:41:52.917723 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2050/4128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:50 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:52.929095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b918ac7-4bbb-40a3-8a80-1b30af7c8330 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:52.947549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:52.950446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b918ac7-4bbb-40a3-8a80-1b30af7c8330 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:52.953810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b918ac7-4bbb-40a3-8a80-1b30af7c8330 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:52.954418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b918ac7-4bbb-40a3-8a80-1b30af7c8330 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:53.022944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b918ac7-4bbb-40a3-8a80-1b30af7c8330 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Going to try to stop instance {{(pid=120722) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:41:53.109608 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b918ac7-4bbb-40a3-8a80-1b30af7c8330 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "POST /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981/action" status: 202 len: 0 microversion: 2.1 time: 0.188851 Nov 02 12:41:53.112993 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2051/4129] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:41:52 2022] POST /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:41:53.136743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:53.151091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:53.165782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:53.174803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:53.175522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:53.176440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:53.177054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:53.177660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:53.574031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:53.604109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-24113904-7133-455d-b404-d4071fb1bc1f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 2.343902 Nov 02 12:41:53.619362 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2079/4130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:51 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:53.624874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:53.641905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:53.665198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:53.665761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:53.666257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:53.667061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:53.667538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:53.668020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:53.776359 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b0f213d9-e035-4b12-9e1d-af7ad435b0c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166646 Nov 02 12:41:53.781130 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2080/4131] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:41:53 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:53.794198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:53.795113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:53.811493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:53.812155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:53.812669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:53.813768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:53.814611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:53.815366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:54.889250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:54.912244 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da98cef2-5773-4214-acb7-adc908b539d5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 1.782277 Nov 02 12:41:54.913569 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2052/4132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:53 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:54.950002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:54.952295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:55.003985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:55.007784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:55.008491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:55.009416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:55.019190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:55.019915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:55.355484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:55.369364 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-68ffdbbd-8b0f-4fca-8e50-2b3f771488c1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1509 microversion: 2.1 time: 1.590923 Nov 02 12:41:55.386209 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2081/4133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:53 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1509 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:55.391408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:55.404499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:55.423433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:55.430570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:55.431946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:55.441141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:55.448322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:55.449759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:55.771931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:55.822481 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f80e3f71-32c6-42c1-8d28-adadecbd73a2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 0.901559 Nov 02 12:41:55.824017 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2053/4134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:54 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:55.835470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:55.845456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:55.890306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:55.894513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:55.904670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:55.921156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:55.930644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:55.931041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:56.053326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:56.115925 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24c58359-9c43-45e0-b4cb-a21815b24cc7 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.284863 Nov 02 12:41:56.118261 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2054/4135] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:41:55 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments => generated 197 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:56.130166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:56.137373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:56.177758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:56.180359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:56.182085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:56.191365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:56.192633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:56.193888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:56.364829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:56.380704 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02437a85-4595-4192-bada-25fa211cbdff tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 0.993060 Nov 02 12:41:56.391424 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2082/4136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:55 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:56.413859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:56.414429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:56.424713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:56.425223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:56.434665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:56.436848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:56.437506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:56.441939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.338352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:59.353874 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6eed6723-ecd5-46b8-a3de-c9598c9dd183 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 3.234215 Nov 02 12:41:59.356741 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2055/4137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:56 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 3237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:59.370326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:59.371933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:59.390605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:59.394314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:59.395707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.398659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:59.402457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:59.403120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.454258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:59.468316 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e39cb7bc-c299-4b81-a057-3143a8fac17d tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1509 microversion: 2.1 time: 3.058549 Nov 02 12:41:59.469574 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2083/4138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:56 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1509 bytes in 3061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:59.478480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:59.481183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:59.512109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:59.513903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:59.516641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.519734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:59.520541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:59.521181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.603023 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-86cc1632-c1c8-437f-bddb-9d226bd5d70e tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131047 Nov 02 12:41:59.603675 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2084/4139] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:41:59 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:59.622590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:59.624786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:59.647871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:59.648866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:59.652155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.653264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:59.653925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:59.654535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.841575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:59.869518 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f501255-cc10-4767-aa2c-236e359e23b6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 0.511372 Nov 02 12:41:59.870706 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2056/4140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:59 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:00.304698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:00.313423 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-76c9b265-48ad-4838-8717-27b16c0fb9a6 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 0.707765 Nov 02 12:42:00.318954 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2085/4141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:59 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:00.391911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:00.394019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:00.416872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:00.420478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:00.422878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:00.427031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:00.430482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:00.431305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:00.497936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:00.498661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:00.515773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:00.516294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:00.516744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:00.525621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:00.526552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:00.527021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.445056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:01.454083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:01.457219 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba5dbd32-944f-4822-9d15-6bb719d96e07 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 1.077199 Nov 02 12:42:01.461057 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2057/4142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:00 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:01.463705 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-328f3847-4f3e-4b11-8634-27b49baf9210 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1509 microversion: 2.1 time: 0.970760 Nov 02 12:42:01.469685 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2086/4143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:00 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1509 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:01.482043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:01.483120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:01.489983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:01.494310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:01.495211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:01.498677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.500719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:01.501089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:01.502523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:01.504528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.509076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:01.509885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:01.510618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.511786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:01.512824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:01.513471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.595761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e28e4613-2217-47f7-93f6-9c2dcdc0353a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111071 Nov 02 12:42:01.618534 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2058/4144] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:42:01 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:42:01.632277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:01.633342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:01.651328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:01.652412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:01.653205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.654329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:01.655163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:01.657105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.533238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:02.545786 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b29adb8-00c0-4f9c-bcea-ef29f39f5569 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 1.074668 Nov 02 12:42:02.566071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2087/4145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:01 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:02.576254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:02.583430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:02.599646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:02.608372 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dee25365-31b2-4071-8ed6-28a3e5135dc0 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 0.988302 Nov 02 12:42:02.611080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.611591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.612046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.613364 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2059/4146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:01 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:02.615578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.616063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.616514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.621772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:02.624159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:02.640583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.641094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.641548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.644234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.644745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.645193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.677174 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Cannot 'reboot' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786/action HTTP/1.1 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 28 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: {"reboot": {"type": "HARD"}} Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: exception: Cannot 'reboot' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'd1236ab7-d8c5-4f61-be01-9534bc36a786', 'body': {'reboot': {'type': 'HARD'}}} Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1236ab7-d8c5-4f61-be01-9534bc36a786 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:42:02.685234 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 409 to user: Cannot 'reboot' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8c6fcbbd-1f81-43de-b817-ab86ee23fa06 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786/action" status: 409 len: 145 microversion: 2.1 time: 0.119576 Nov 02 12:42:02.691499 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2088/4147] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:02 2022] POST /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786/action => generated 145 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:42:02.700967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:02.708870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:02.721897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.722680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.723798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.725287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.726269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.726883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:03.441575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:03.456341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69f7e8fa-e1c6-4868-9d73-3b6c0c76a677 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1509 microversion: 2.1 time: 0.767864 Nov 02 12:42:03.459263 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2089/4148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:02 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1509 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:03.469402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:03.481328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:03.494506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:03.495290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:03.497307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:03.500163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:03.501038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:03.501806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:03.542276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:03.551250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b877e41-78b2-41bb-99d5-71b18a519286 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 0.936715 Nov 02 12:42:03.551849 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2060/4149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:02 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:03.576237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:03.583676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:03.598899 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Cannot 'rebuild' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued Nov 02 12:42:03.606427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:03.611631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:03.612330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:03.613473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786/action HTTP/1.1 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 65 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: exception: Cannot 'rebuild' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'd1236ab7-d8c5-4f61-be01-9534bc36a786', 'body': {'rebuild': {'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a'}}} Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1236ab7-d8c5-4f61-be01-9534bc36a786 in vm_state rescued. Cannot rebuild while the instance is in this state. Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:03.615636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued Nov 02 12:42:03.619734 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:03.621696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:03.623899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:03.630500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 409 to user: Cannot 'rebuild' instance d1236ab7-d8c5-4f61-be01-9534bc36a786 while it is in vm_state rescued {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:03.631437 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e71d6715-80f1-4a0c-9896-076e7c0039ca tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "POST /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786/action" status: 409 len: 146 microversion: 2.1 time: 0.170914 Nov 02 12:42:03.632054 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2090/4150] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:03 2022] POST /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786/action => generated 146 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:42:03.642863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:03.652288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:03.668064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:03.672162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:03.672850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:03.673839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:03.675626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:03.677850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:04.386744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:04.401683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ef851f57-5162-458b-bcc9-fe51d53e2f71 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 0.764730 Nov 02 12:42:04.403226 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2091/4151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:03 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:04.413740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:04.417821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:04.436042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:04.436559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:04.437020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:04.437766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:04.443620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:04.444756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:04.463417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:04.480458 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42c778da-8750-4fcb-a524-ae87f0dc0e2f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 0.908111 Nov 02 12:42:04.485388 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2061/4152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:03 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:04.518784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:04.653719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:04.773220 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e6bf0774-6127-4191-932e-ca41ee91898f tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 204 len: 0 microversion: 2.1 time: 0.366093 Nov 02 12:42:04.778944 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2092/4153] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:04 2022] DELETE /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:04.795249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:04.796346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:04.823808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:04.825258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:04.825766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:04.830234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:04.834912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:04.836608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:05.066901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:05.067830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:05.098259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:05.100154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:05.101057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:05.102265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:05.106281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:05.107172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:05.777147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:05.790955 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-067a7050-60df-427b-9bb4-4237a467aec4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 1.009744 Nov 02 12:42:05.791563 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2093/4154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:04 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:05.808800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:05.809427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:05.836018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:05.836540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:05.837007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:05.847090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:05.847642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:05.848162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:06.262268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:06.271940 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0e1c9cc-51c8-461e-925d-91447e4d6903 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1509 microversion: 2.1 time: 1.783081 Nov 02 12:42:06.279112 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2062/4155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:04 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1509 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:06.292666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:06.294702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:06.335357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:06.336894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:06.337607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:06.343901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:06.347648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:06.352616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:06.420693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:06.434674 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36a46a3b-8b35-40c6-b789-ba00694c19d9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1691 microversion: 2.1 time: 0.641451 Nov 02 12:42:06.443104 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2094/4156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:05 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1691 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:06.448495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:06.455412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:06.467257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:06.471844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:06.473746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:06.474952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:06.475938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:06.477031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:07.760635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:07.772987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:07.773536 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1f5cf73-cd90-4af0-8606-885975d4460f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 1.492666 Nov 02 12:42:07.782110 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ef399876-6bc7-47d3-a633-1132b245dc30 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 1.337332 Nov 02 12:42:07.787959 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2095/4157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:06 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:07.792808 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2063/4158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:06 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:07.802190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:07.803990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:07.806844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:07.807504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:07.821424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:07.822927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:07.824437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:07.826442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:07.826694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:07.827452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:07.828144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:07.830441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:07.830979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:07.847428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:07.848775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:07.849528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:08.475548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:08.484756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-56c9981b-2afd-43db-a8bc-36def622561e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 0.694545 Nov 02 12:42:08.493026 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2096/4159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:07 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:08.498944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:08.504445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:08.519195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.523666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.524414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:08.525417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.526064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.526656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:08.580174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:08.638154 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-69e3d587-2851-418f-b3c3-20d8e77d1717 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1509 microversion: 2.1 time: 0.823671 Nov 02 12:42:08.652084 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2064/4160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:07 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1509 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:08.822791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:08.824286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:08.837103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.842217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.843052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:08.845132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.849222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.850066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:09.268919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:09.278313 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ea97301-1550-45fa-af36-4c00db0dd6c6 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1691 microversion: 2.1 time: 0.783753 Nov 02 12:42:09.289651 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2097/4161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:08 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1691 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:09.298923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:09.313066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:09.342362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:09.351301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:09.351953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:09.352748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:09.353235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:09.371894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:09.898505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:09.943763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1004899f-4885-4212-a8ee-73258b9bd488 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 1.128043 Nov 02 12:42:09.966852 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2065/4162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:08 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:10.103352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fcddf75a-fd0c-44e9-8483-24dc53596c14 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Action: 'create', calling method: .version_select at 0x7f228ea3a5e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1364499944", "policies": ["affinity"]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:10.172123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:10.183077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fcddf75a-fd0c-44e9-8483-24dc53596c14 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:10.187456 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3033b8ff-63a2-4957-a78d-09740cf04f27 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 0.889937 Nov 02 12:42:10.188795 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2098/4163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:09 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:10.208977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:10.209662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:10.233780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fcddf75a-fd0c-44e9-8483-24dc53596c14 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:10.239186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.239959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.241474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:10.242427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.245421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.246106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:10.387470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fcddf75a-fd0c-44e9-8483-24dc53596c14 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:10.401359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fcddf75a-fd0c-44e9-8483-24dc53596c14 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:10.437519 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fcddf75a-fd0c-44e9-8483-24dc53596c14 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.469049 Nov 02 12:42:10.439080 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2066/4164] 10.222.0.45 () {60 vars in 1174 bytes} [Wed Nov 2 12:42:09 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:10.444058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-72810da6-1e64-48d6-a096-be7fc47632bf req-9a293e8d-19b3-4079-a07c-3ab0e51ac597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849b433f-9fa9-413b-8f1e-21a92e07c013", "name": "network-vif-plugged", "status": "completed", "tag": "5931d485-b7de-4d4b-b0fd-bbc183e4d3ac"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:10.472447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-72810da6-1e64-48d6-a096-be7fc47632bf req-9a293e8d-19b3-4079-a07c-3ab0e51ac597 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.472961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-72810da6-1e64-48d6-a096-be7fc47632bf req-9a293e8d-19b3-4079-a07c-3ab0e51ac597 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.473417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-72810da6-1e64-48d6-a096-be7fc47632bf req-9a293e8d-19b3-4079-a07c-3ab0e51ac597 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:10.499999 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-72810da6-1e64-48d6-a096-be7fc47632bf req-9a293e8d-19b3-4079-a07c-3ab0e51ac597 service nova] Creating event network-vif-plugged:5931d485-b7de-4d4b-b0fd-bbc183e4d3ac for instance 849b433f-9fa9-413b-8f1e-21a92e07c013 on n-h1-855650-5 Nov 02 12:42:10.517319 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-72810da6-1e64-48d6-a096-be7fc47632bf req-9a293e8d-19b3-4079-a07c-3ab0e51ac597 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076589 Nov 02 12:42:10.518544 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2067/4165] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:10.527900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:10.529071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:10.539348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.540538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.541239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:10.542267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.543187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.543867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:11.311450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:11.369195 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb5d4527-7c47-4efa-ac4f-f225598872f9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1509 microversion: 2.1 time: 0.848907 Nov 02 12:42:11.399764 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2068/4166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:10 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1509 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:11.427402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:11.428651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:11.436725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:11.438012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:11.444720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:11.445933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:11.446985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:11.447599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:11.478697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:11.508929 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b705c03-69ed-412b-a605-e6059c2f25b6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 1.315027 Nov 02 12:42:11.523397 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2099/4167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:10 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:11.551594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce6b580b-edc6-445d-9c44-408eb45776d6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Action: 'create', calling method: .version_select at 0x7f228e1cf430>, body: {"server_group": {"name": "tempest-server-group-1368233569", "policies": ["affinity"]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:11.664118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ce6b580b-edc6-445d-9c44-408eb45776d6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:11.684341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ce6b580b-edc6-445d-9c44-408eb45776d6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:11.817796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ce6b580b-edc6-445d-9c44-408eb45776d6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:11.837508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ce6b580b-edc6-445d-9c44-408eb45776d6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:11.874112 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce6b580b-edc6-445d-9c44-408eb45776d6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.348621 Nov 02 12:42:11.883584 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2100/4168] 10.222.0.45 () {60 vars in 1173 bytes} [Wed Nov 2 12:42:11 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:11.900301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:11.906584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:11.935152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:11.936642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:11.939198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:11.946020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:11.946902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:11.947517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:12.415176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:12.456984 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c0fff81-9380-480c-b6f1-f778a23a2a59 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1691 microversion: 2.1 time: 1.045756 Nov 02 12:42:12.459009 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2069/4169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:11 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1691 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:12.491454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:12.494217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:12.531217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:12.533601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:12.535092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:12.540690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:12.542265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:12.543295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:12.727887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:12.763939 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ce93a90-85c3-449f-9ed4-89df5106d98f tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 0.870261 Nov 02 12:42:12.796310 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2101/4170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:11 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:12.801640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c1152d7-4d80-4bb9-8193-8eb8b2df7863 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Action: 'create', calling method: .version_select at 0x7f228e093820>, body: {"server_group": {"name": "tempest-server-group-1368233569", "policies": ["affinity"]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:12.878017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8c1152d7-4d80-4bb9-8193-8eb8b2df7863 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:12.891413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8c1152d7-4d80-4bb9-8193-8eb8b2df7863 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:12.934366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:13.125676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8c1152d7-4d80-4bb9-8193-8eb8b2df7863 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:13.149783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8c1152d7-4d80-4bb9-8193-8eb8b2df7863 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:13.222492 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8c1152d7-4d80-4bb9-8193-8eb8b2df7863 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.424503 Nov 02 12:42:13.232387 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2102/4171] 10.222.0.45 () {60 vars in 1173 bytes} [Wed Nov 2 12:42:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:13.252260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:13.253476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:13.275256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:13.275752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:13.276363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:13.277808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:13.278502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:13.280327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:13.713396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:13.763979 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf80699f-422f-4638-9e22-095ee4ce853d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1367 microversion: 2.1 time: 1.301224 Nov 02 12:42:13.770251 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2070/4172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:12 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1367 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:13.808885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:13.814261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:13.883684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:13.886584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:13.894646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:13.902981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:13.909387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:13.911163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:15.263926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:15.308948 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3a59d2f-5aef-42a9-8c5b-5014956e0b85 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1509 microversion: 2.1 time: 2.074889 Nov 02 12:42:15.310822 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2103/4173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:13 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1509 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:15.316891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-39e711f0-c551-4b02-8b92-cda90a8823f0 req-4a836777-5ac3-4bde-819d-0bcc110053c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e8f175-bce2-4c4e-94f9-40faf81ae640", "name": "network-vif-plugged", "status": "completed", "tag": "4593c611-0931-4c62-90f2-5a5c433c3c9a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:15.330787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-39e711f0-c551-4b02-8b92-cda90a8823f0 req-4a836777-5ac3-4bde-819d-0bcc110053c6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:15.334056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-39e711f0-c551-4b02-8b92-cda90a8823f0 req-4a836777-5ac3-4bde-819d-0bcc110053c6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:15.335037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-39e711f0-c551-4b02-8b92-cda90a8823f0 req-4a836777-5ac3-4bde-819d-0bcc110053c6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:15.384057 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-39e711f0-c551-4b02-8b92-cda90a8823f0 req-4a836777-5ac3-4bde-819d-0bcc110053c6 service nova] Creating event network-vif-plugged:4593c611-0931-4c62-90f2-5a5c433c3c9a for instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 on n-h1-855650-5 Nov 02 12:42:15.415146 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-39e711f0-c551-4b02-8b92-cda90a8823f0 req-4a836777-5ac3-4bde-819d-0bcc110053c6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090068 Nov 02 12:42:15.420911 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2104/4174] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:15.445439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f60a6c74-1b4a-49be-bf12-29dab778864a tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:15.531899 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f60a6c74-1b4a-49be-bf12-29dab778864a tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee" status: 204 len: 0 microversion: 2.1 time: 0.109033 Nov 02 12:42:15.533106 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2105/4175] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:15 2022] DELETE /compute/v2.1/os-server-groups/1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:15.541923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:15.543022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:15.569608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:15.570439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:15.573497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:15.575790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:15.577945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:15.579081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:15.656945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:15.671268 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6ce3c540-1153-41e0-a812-9c543cf163d2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1523 microversion: 2.1 time: 1.893797 Nov 02 12:42:15.675321 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2071/4176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:13 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1523 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:15.691419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:15.692982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:15.712183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:15.713438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:15.714647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:15.716112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:15.718988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:15.720962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:15.757725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:15.772897 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-25cf199c-86bd-49ec-91c5-9759e38c0663 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 200 len: 1623 microversion: 2.1 time: 0.238443 Nov 02 12:42:15.773517 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2106/4177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:15 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 1623 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:15.793566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:15.803167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:15.829413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:15.832997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:15.833853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:15.837567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:15.840068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:15.840726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:16.171614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:16.176093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:16.190560 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7c9a854-eff3-4a35-987b-2a4ba46fd820 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1308 microversion: 2.1 time: 0.511099 Nov 02 12:42:16.193784 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2072/4178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:15 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:16.212933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b503b08-d289-496b-906f-ee032eaa90ee tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:16.260246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b503b08-d289-496b-906f-ee032eaa90ee tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.063538 Nov 02 12:42:16.262654 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2073/4179] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:42:16 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:16.269377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:16.283380 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4cb38a24-7d87-48c6-a1e9-74f16236503d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1557 microversion: 2.1 time: 0.506610 Nov 02 12:42:16.283926 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2107/4180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:15 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1557 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:16.316191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0fc8e92c-4bb6-4fa8-a76e-1007616502a7 req-7b9a0c20-4101-4269-a6df-591a0ee1c09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170451bf-340f-489f-87d4-4fda741d2b9f", "name": "network-vif-deleted", "tag": "ada2ad3a-0f3a-4cfe-a928-0307223c9de6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:16.361425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0fc8e92c-4bb6-4fa8-a76e-1007616502a7 req-7b9a0c20-4101-4269-a6df-591a0ee1c09f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:16.362110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0fc8e92c-4bb6-4fa8-a76e-1007616502a7 req-7b9a0c20-4101-4269-a6df-591a0ee1c09f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:16.362616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0fc8e92c-4bb6-4fa8-a76e-1007616502a7 req-7b9a0c20-4101-4269-a6df-591a0ee1c09f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:16.382105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1064943178", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "2801addb-a569-4a5c-b679-76ca6bd3fd3b"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:16.396534 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0fc8e92c-4bb6-4fa8-a76e-1007616502a7 req-7b9a0c20-4101-4269-a6df-591a0ee1c09f service nova] Creating event network-vif-deleted:ada2ad3a-0f3a-4cfe-a928-0307223c9de6 for instance 170451bf-340f-489f-87d4-4fda741d2b9f on n-h1-855650-5 Nov 02 12:42:16.412187 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0fc8e92c-4bb6-4fa8-a76e-1007616502a7 req-7b9a0c20-4101-4269-a6df-591a0ee1c09f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115229 Nov 02 12:42:16.419618 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2108/4181] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:16.440856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd51a3f8-cc92-4b2f-9ec0-805457e74896 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:16.495969 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd51a3f8-cc92-4b2f-9ec0-805457e74896 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/9e5e51db-7329-43e2-9e4a-ea179e554673" status: 204 len: 0 microversion: 2.1 time: 0.074352 Nov 02 12:42:16.496845 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2109/4182] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:16 2022] DELETE /compute/v2.1/os-server-groups/9e5e51db-7329-43e2-9e4a-ea179e554673 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:16.511002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:16.511640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:16.532431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:16.533166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:16.533769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:16.534706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:16.535326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:16.535946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:16.562319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] validate_networks() for [('2801addb-a569-4a5c-b679-76ca6bd3fd3b', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:16.801503 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-628a4cd1-ed7f-4d47-be43-c1d6041d4ded tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295570 Nov 02 12:42:16.806119 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2110/4183] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:42:16 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:16.811681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:16.814950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:16.831951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:16.832744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:16.833376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:16.834467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:16.836762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:16.840887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:17.511870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:17.527164 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab439e12-3b83-4aa8-8c03-f94e1624aa08 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1486 microversion: 2.1 time: 0.719466 Nov 02 12:42:17.527801 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2111/4184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:16 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1486 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:17.533230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3eb31c0d-2ba8-4e4a-b868-353a8c048bad tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:17.576844 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3eb31c0d-2ba8-4e4a-b868-353a8c048bad tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.047891 Nov 02 12:42:17.579767 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2112/4185] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:42:17 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:17.606914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:17.607793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:17.617610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:17.619329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:17.623790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:17.625432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:17.626461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:17.627202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:18.465762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:18.553090 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d39b661-f0cb-4683-8ea2-e9b2e7228e54 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1505 microversion: 2.1 time: 0.957432 Nov 02 12:42:18.555184 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2113/4186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:17 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:18.582589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:18.585667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 170451bf-340f-489f-87d4-4fda741d2b9f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:18.608187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:18.609095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:18.609630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:18.610539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:18.611091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:18.611574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:18.629687 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Instance 170451bf-340f-489f-87d4-4fda741d2b9f could not be found. Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f HTTP/1.1 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 170451bf-340f-489f-87d4-4fda741d2b9f could not be found. Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '170451bf-340f-489f-87d4-4fda741d2b9f'} Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 170451bf-340f-489f-87d4-4fda741d2b9f could not be found. Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 170451bf-340f-489f-87d4-4fda741d2b9f could not be found. Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.631755 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 170451bf-340f-489f-87d4-4fda741d2b9f could not be found. Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 404 to user: Instance 170451bf-340f-489f-87d4-4fda741d2b9f could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:18.635768 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-999a98e2-a332-4d8c-9ab3-71393435dc2a tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f" status: 404 len: 111 microversion: 2.1 time: 0.070504 Nov 02 12:42:18.642095 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2114/4187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:18 2022] GET /compute/v2.1/servers/170451bf-340f-489f-87d4-4fda741d2b9f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:18.645427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:18.646205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:18.652983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:18.653834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:18.654552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:18.655485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:18.656221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:18.657855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.016608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:42:19.017149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:42:19.019089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:42:19.019564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:42:19.020312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:42:19.041463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.045009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.048812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.049874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.053041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.055441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.121402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Getting quotas for project 2aeecc4b6cf54d3e895ce20209650799. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:19.140802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Getting quotas for user 98c8ba78504f419a85c9349c94ad51e4 and project 2aeecc4b6cf54d3e895ce20209650799. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:19.174781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:42:19.180588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:42:19.350986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:19.391732 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cecc1e6e-e3d1-4a61-926e-c5a32f61289e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1488 microversion: 2.1 time: 0.752316 Nov 02 12:42:19.392673 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2115/4188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:18 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1488 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:19.425648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-013cf84e-3477-448e-9966-d6e356861563 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.160388 Nov 02 12:42:19.436282 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2074/4189] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:42:19.444058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1203372047"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:19.449344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-289edcce-99c3-4470-9edb-256211c8272e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Action: 'create', calling method: .version_select at 0x7f2292aca310>, body: {"server_group": {"name": "tempest-server-group-87354257", "policies": ["affinity"]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:19.470195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:19.508616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-289edcce-99c3-4470-9edb-256211c8272e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:19.510930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.523664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-289edcce-99c3-4470-9edb-256211c8272e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:19.534091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.534757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.535544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.536079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.536471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.598268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:19.604612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:19.671179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-289edcce-99c3-4470-9edb-256211c8272e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:19.707075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-289edcce-99c3-4470-9edb-256211c8272e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:19.779733 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-289edcce-99c3-4470-9edb-256211c8272e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.342179 Nov 02 12:42:19.783076 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2075/4190] 10.222.0.45 () {60 vars in 1173 bytes} [Wed Nov 2 12:42:19 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:19.802543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4932bd10-61d8-4c45-9abd-57efb30d88c9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '.version_select at 0x7f2292a963a0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:19.880996 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b71e8efa-752b-4616-a1ea-80573b83b1e4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "PUT /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1060 microversion: 2.1 time: 0.467191 Nov 02 12:42:19.895800 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2116/4191] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:42:19 2022] PUT /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1060 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:19.905635 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4932bd10-61d8-4c45-9abd-57efb30d88c9 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934330112" status: 202 len: 0 microversion: 2.1 time: 0.113809 Nov 02 12:42:19.909623 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2076/4192] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934330112 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:19.915418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:19.916327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:19.932373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f8c9399b-a12d-4c2c-a1c0-a690db8a3666 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:19.933014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8c9399b-a12d-4c2c-a1c0-a690db8a3666 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:19.949716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.952041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.952819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.955157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.955899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.957021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:20.070883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:20.402100 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-37ec3b87-545d-4321-b8af-e03fb59cb6c4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 204 len: 0 microversion: 2.1 time: 0.506449 Nov 02 12:42:20.403195 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2117/4193] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:19 2022] DELETE /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:20.412125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:20.418030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:20.442095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8c9399b-a12d-4c2c-a1c0-a690db8a3666 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:20.442663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:20.452220 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f8c9399b-a12d-4c2c-a1c0-a690db8a3666 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1217 microversion: 2.1 time: 0.532898 Nov 02 12:42:20.452856 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2077/4194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:19 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1217 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:20.480424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:20.481726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:20.483647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65b03215-030b-479e-9a58-5ce599f58de6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:20.487413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:20.489670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:20.495051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:20.584587 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65b03215-030b-479e-9a58-5ce599f58de6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/67e1d05c-4946-48fb-9b51-16cd355f488a" status: 204 len: 0 microversion: 2.1 time: 0.130570 Nov 02 12:42:20.590483 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2078/4195] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:20 2022] DELETE /compute/v2.1/os-server-groups/67e1d05c-4946-48fb-9b51-16cd355f488a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:20.615105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:20.619660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:20.649822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:20.650852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:20.651836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:20.657989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:20.662715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:20.664803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.144889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:21.160670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b91d8f69-9be9-4235-91a8-37afe9e3e281 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 200 len: 1508 microversion: 2.1 time: 0.755952 Nov 02 12:42:21.162178 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2118/4196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:20 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 1508 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:21.167836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:21.168781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:21.198938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.199723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.200394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.201428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.202890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.204425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.496826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:21.509474 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d3aec72-6f2c-4c4b-908e-d2f553bec628 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1487 microversion: 2.1 time: 0.916769 Nov 02 12:42:21.549663 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2079/4197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:20 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1487 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:21.555642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0940296d-f8a9-4283-9bff-f8225408d692 req-51cb8bea-985b-46ab-a4f6-3475cdd96cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849b433f-9fa9-413b-8f1e-21a92e07c013", "tag": "5931d485-b7de-4d4b-b0fd-bbc183e4d3ac"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:21.590918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0940296d-f8a9-4283-9bff-f8225408d692 req-51cb8bea-985b-46ab-a4f6-3475cdd96cd8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.591445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0940296d-f8a9-4283-9bff-f8225408d692 req-51cb8bea-985b-46ab-a4f6-3475cdd96cd8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.591891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0940296d-f8a9-4283-9bff-f8225408d692 req-51cb8bea-985b-46ab-a4f6-3475cdd96cd8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.618651 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0940296d-f8a9-4283-9bff-f8225408d692 req-51cb8bea-985b-46ab-a4f6-3475cdd96cd8 service nova] Creating event network-changed:5931d485-b7de-4d4b-b0fd-bbc183e4d3ac for instance 849b433f-9fa9-413b-8f1e-21a92e07c013 on n-h1-855650-5 Nov 02 12:42:21.645626 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0940296d-f8a9-4283-9bff-f8225408d692 req-51cb8bea-985b-46ab-a4f6-3475cdd96cd8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093620 Nov 02 12:42:21.647155 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2080/4198] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:21.659304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e31b8ef0-3c92-4233-a81f-3bae767526cd tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:21.690731 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e31b8ef0-3c92-4233-a81f-3bae767526cd tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.041717 Nov 02 12:42:21.695685 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2081/4199] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:42:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:21.709436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:21.710783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:21.727942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.731755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.732644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.733793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.736782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.737424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.819724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:21.835962 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.compute.api [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Working on deleting snapshot 05eb946e-2f83-4844-a040-6db368df36da from shelved instance... Nov 02 12:42:21.837043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:21.852781 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a973da6-d604-4250-be84-2f18197cda83 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1494 microversion: 2.1 time: 0.684550 Nov 02 12:42:21.853477 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2119/4200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:21 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1494 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:21.888446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:21.889185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:21.923676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.926755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.927456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.929169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.930044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.930778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:23.012488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Doing local delete in cell 65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) {{(pid=120722) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 12:42:23.039353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:23.043783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:23.046961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:23.050868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:23.055187 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.compute.api [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 12:42:23.074473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] deallocate_for_instance() {{(pid=120722) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 12:42:23.075959 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b05ec794-86cb-447d-a52a-4f7388802ee8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1213 microversion: 2.1 time: 1.201839 Nov 02 12:42:23.083497 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2120/4201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:21 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1213 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:23.090545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:23.091412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:23.099817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:23.100885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:23.101623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:23.102831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:23.103520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:23.104198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:23.188910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=16 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:23.738389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:23.752142 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b2f04dc-90cd-4e87-b97d-605c43793ce9 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1487 microversion: 2.1 time: 0.667183 Nov 02 12:42:23.758120 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2121/4202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:23 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1487 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:23.765618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-550065ab-2d0b-49ed-8cc5-1809231c8770 req-c418b4cc-7b9a-4d50-8b1d-8e605092e3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7621dc5d-4750-4b8a-b0d7-94b4346154f7", "name": "network-vif-unplugged", "status": "completed", "tag": "6bb13b0f-1da4-4f25-a516-241809c392c5"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:23.799762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-550065ab-2d0b-49ed-8cc5-1809231c8770 req-c418b4cc-7b9a-4d50-8b1d-8e605092e3e9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:23.800490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-550065ab-2d0b-49ed-8cc5-1809231c8770 req-c418b4cc-7b9a-4d50-8b1d-8e605092e3e9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:23.801093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-550065ab-2d0b-49ed-8cc5-1809231c8770 req-c418b4cc-7b9a-4d50-8b1d-8e605092e3e9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:23.831270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.compute.server_external_events [req-550065ab-2d0b-49ed-8cc5-1809231c8770 req-c418b4cc-7b9a-4d50-8b1d-8e605092e3e9 service nova] Unable to find a host for instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7. Dropping event network-vif-unplugged {{(pid=120723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:42:23.837354 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-550065ab-2d0b-49ed-8cc5-1809231c8770 req-c418b4cc-7b9a-4d50-8b1d-8e605092e3e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077147 Nov 02 12:42:23.841175 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2122/4203] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 12:42:23.858479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-623a69a9-c97b-4519-9b06-9727fc5a8485 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Action: 'create', calling method: .version_select at 0x7f228e166c10>, body: {"server_group": {"name": "tempest-server-group-1888564674", "policies": ["anti-affinity"]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:23.913094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-623a69a9-c97b-4519-9b06-9727fc5a8485 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:23.927019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-623a69a9-c97b-4519-9b06-9727fc5a8485 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:24.035493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-623a69a9-c97b-4519-9b06-9727fc5a8485 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:24.047204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-623a69a9-c97b-4519-9b06-9727fc5a8485 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_groups'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:24.055959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:24.080773 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-623a69a9-c97b-4519-9b06-9727fc5a8485 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.236998 Nov 02 12:42:24.094122 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2123/4204] 10.222.0.45 () {60 vars in 1173 bytes} [Wed Nov 2 12:42:23 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:24.106550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:24.110070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:24.126772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:24.133792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:24.134905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:24.136342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:24.137301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:24.138246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:25.163344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:25.174067 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08e64737-530c-4eec-8b53-c658683ae923 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 200 len: 1494 microversion: 2.1 time: 1.077373 Nov 02 12:42:25.179281 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2124/4205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:24 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 1494 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:25.190892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:25.201732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:25.232884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:25.235745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:25.236687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:25.238609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:25.239297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:25.240954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:25.380367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:25.599556 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-005f7408-3635-4f2a-a355-c0061187d38a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 204 len: 0 microversion: 2.1 time: 0.418013 Nov 02 12:42:25.601584 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2125/4206] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:25 2022] DELETE /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:25.612269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-00d93672-770e-438b-bf68-4028def13cc7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:25.658797 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-00d93672-770e-438b-bf68-4028def13cc7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/24b14c33-00b2-4fec-8105-c367f0b6dea4" status: 204 len: 0 microversion: 2.1 time: 0.054889 Nov 02 12:42:25.660356 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2126/4207] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:25 2022] DELETE /compute/v2.1/os-server-groups/24b14c33-00b2-4fec-8105-c367f0b6dea4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:25.679594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:25.680838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:25.692387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:25.695211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:25.696039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:25.697299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:25.698810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:25.699639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:25.791968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Updating instance_info_cache with network_info: [] {{(pid=120722) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:42:25.839305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:25.853350 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-630f3806-9bda-4f7d-9ea2-8bd9f5c52b1d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1275 microversion: 2.1 time: 0.189041 Nov 02 12:42:25.854619 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2127/4208] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:25 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1275 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:25.860764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-873ec3f7-f15a-4e21-9af6-81e1aff688c5 req-92836cae-d057-4b5c-90fa-12cbe8a9203d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e8f175-bce2-4c4e-94f9-40faf81ae640", "name": "network-vif-deleted", "tag": "4593c611-0931-4c62-90f2-5a5c433c3c9a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:25.945836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-873ec3f7-f15a-4e21-9af6-81e1aff688c5 req-92836cae-d057-4b5c-90fa-12cbe8a9203d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:25.949757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-873ec3f7-f15a-4e21-9af6-81e1aff688c5 req-92836cae-d057-4b5c-90fa-12cbe8a9203d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:25.955378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-873ec3f7-f15a-4e21-9af6-81e1aff688c5 req-92836cae-d057-4b5c-90fa-12cbe8a9203d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:25.975642 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-873ec3f7-f15a-4e21-9af6-81e1aff688c5 req-92836cae-d057-4b5c-90fa-12cbe8a9203d service nova] Creating event network-vif-deleted:4593c611-0931-4c62-90f2-5a5c433c3c9a for instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 on n-h1-855650-5 Nov 02 12:42:25.995078 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-873ec3f7-f15a-4e21-9af6-81e1aff688c5 req-92836cae-d057-4b5c-90fa-12cbe8a9203d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136405 Nov 02 12:42:25.996583 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2128/4209] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:26.014840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:26.017257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:26.034441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:26.035690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:26.036833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:26.038872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:26.040860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:26.042118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:26.421476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:26.442498 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ce0fea8-229b-4d80-8439-55468c3e3860 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1493 microversion: 2.1 time: 0.443380 Nov 02 12:42:26.448014 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2129/4210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:25 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1493 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:26.458685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ced6b4e-ae2f-4faa-8d44-a1a5f46522c2 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:26.482626 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ced6b4e-ae2f-4faa-8d44-a1a5f46522c2 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034884 Nov 02 12:42:26.483261 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2130/4211] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:42:26 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:26.506063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:26.507528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:26.517697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:26.518407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:26.518868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:26.519926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:26.520681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:26.521311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:26.546987 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8879f07b-2df6-4f55-a004-79e82de77a0b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 204 len: 0 microversion: 2.1 time: 4.849376 Nov 02 12:42:26.548823 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2082/4212] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:21 2022] DELETE /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 0 bytes in 4852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:26.552700 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 HTTP/1.1 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '81e8f175-bce2-4c4e-94f9-40faf81ae640'} Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.554919 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a31c61c-2084-4d06-8a88-350708523624 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 404 len: 111 microversion: 2.1 time: 0.072544 Nov 02 12:42:26.563357 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2131/4213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:26 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:26.564234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:26.566396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:26.572087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a37a8813-dc61-493c-9293-63e2ce85472d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e872dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:26.584285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:26.587670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:26.588348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:26.589642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:26.590299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:26.590993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:26.615734 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 HTTP/1.1 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '7621dc5d-4750-4b8a-b0d7-94b4346154f7'} Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:26.619373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:26.623253 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c3d4017-a115-46c3-bc75-5fac32181596 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 404 len: 111 microversion: 2.1 time: 0.067876 Nov 02 12:42:26.643559 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2083/4214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:26 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:42:26.676842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-524741922", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "7b78ee05-ae64-4625-ac64-110c7d8ebde6"}]}, "os:scheduler_hints": {"group": "571df35b-8105-4622-b0c2-6138f708ce79"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:26.801806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] validate_networks() for [('7b78ee05-ae64-4625-ac64-110c7d8ebde6', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:27.644632 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a37a8813-dc61-493c-9293-63e2ce85472d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 204 len: 0 microversion: 2.1 time: 1.078736 Nov 02 12:42:27.655854 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2132/4215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:26 2022] DELETE /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 0 bytes in 1086 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:27.667324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:27.668782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:27.682434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:27.687511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:27.697714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:27.699384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:27.700454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:27.701781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:27.726246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:42:27.726859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:42:27.727508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:42:27.728021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:42:27.728719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:42:27.761847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:27.762828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:27.763645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:27.764883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:27.765598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:27.766263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:27.791521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:27.804051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:27.814975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:27.824906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:42:27.829074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:42:27.833368 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-24772b62-647e-40fc-a41a-684ee67b86fa tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1275 microversion: 2.1 time: 0.174060 Nov 02 12:42:27.835369 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2133/4216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:27 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:27.846865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-133681552", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a20add55-dae0-40be-a4a7-4b9397826fb8"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:27.955738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] validate_networks() for [('a20add55-dae0-40be-a4a7-4b9397826fb8', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:27.966389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:27.982461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:28.117486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:28.154957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Getting quotas for user f3bd703da4ba4900a1ff905eaa8da916 and project 976fc7d898a0450daa91d33cc0e26c6f. Resources: {'server_group_members'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:28.319306 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d9c1ce0-a250-44c1-9477-7845dda138a6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.671600 Nov 02 12:42:28.332067 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2084/4217] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:42:28.339611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:28.346777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:28.368033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:28.374823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:28.375981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:28.377109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:28.377834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:28.381756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.059059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:29.077739 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17f8b265-b924-4508-80f1-830f19777d9e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1493 microversion: 2.1 time: 0.754915 Nov 02 12:42:29.081501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2085/4218] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:28 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1493 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:29.095784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:29.108243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:29.147094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.149512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.150036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.154517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.155029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.155485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.180355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:42:29.181912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:42:29.182828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:42:29.183780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:42:29.184553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:42:29.230045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.232382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.235548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.239346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.243739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.244838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:29.245988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.364371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:29.392371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for user 6488e600776547958e00ab146f079c46 and project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:29.461671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:42:29.476368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:42:29.541418 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-27fc8304-54ce-46dc-9254-d8d916aaf1ba tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 204 len: 0 microversion: 2.1 time: 0.452196 Nov 02 12:42:29.558857 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2086/4219] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:29 2022] DELETE /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:29.589310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8bd68f6d-af91-4687-846e-59bbfe8e428e req-03aec85b-30f1-4f2a-827b-8f5dabb76fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7621dc5d-4750-4b8a-b0d7-94b4346154f7", "name": "network-vif-deleted", "tag": "6bb13b0f-1da4-4f25-a516-241809c392c5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:29.615118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=89,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:29.654563 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8615db55-817a-426a-9406-2f92e9c919f9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.814171 Nov 02 12:42:29.659991 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2134/4220] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:42:29.669355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bd68f6d-af91-4687-846e-59bbfe8e428e req-03aec85b-30f1-4f2a-827b-8f5dabb76fe4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.681385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bd68f6d-af91-4687-846e-59bbfe8e428e req-03aec85b-30f1-4f2a-827b-8f5dabb76fe4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.682342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bd68f6d-af91-4687-846e-59bbfe8e428e req-03aec85b-30f1-4f2a-827b-8f5dabb76fe4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.683364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:29.684524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:29.697406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.699026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.699917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.701399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.702342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.706625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.781111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.server_external_events [req-8bd68f6d-af91-4687-846e-59bbfe8e428e req-03aec85b-30f1-4f2a-827b-8f5dabb76fe4 service nova] Unable to find a host for instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7. Dropping event network-vif-deleted {{(pid=120722) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:42:29.783124 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8bd68f6d-af91-4687-846e-59bbfe8e428e req-03aec85b-30f1-4f2a-827b-8f5dabb76fe4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.220285 Nov 02 12:42:29.784164 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2087/4221] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 224 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 12:42:29.804661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:29.806251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:29.824518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.825694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.831959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.833424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.836703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.838011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:30.094631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:30.131327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:30.143347 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-598c5473-585c-4eaf-b579-840f97899387 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1216 microversion: 2.1 time: 0.468234 Nov 02 12:42:30.186701 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2135/4222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:29 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1216 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:30.204211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-31a8143e-724a-4939-8c69-b5110e9bc69d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:30.210008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-31a8143e-724a-4939-8c69-b5110e9bc69d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:30.539011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-31a8143e-724a-4939-8c69-b5110e9bc69d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:30.567892 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-31a8143e-724a-4939-8c69-b5110e9bc69d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1214 microversion: 2.1 time: 0.378938 Nov 02 12:42:30.573223 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2136/4223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:30 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1214 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:30.591158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1279756609", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "6073314f-95a7-4839-bb88-cbb45aac3413"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:30.743861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:30.754339 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa32284d-e7a3-4b05-bfb9-e396ca505bd4 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.968430 Nov 02 12:42:30.756398 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2088/4224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:29 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:30.763078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:30.764336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:30.774695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:30.776355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:30.777212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:30.778381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:30.779055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:30.779823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:30.824637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] validate_networks() for [('6073314f-95a7-4839-bb88-cbb45aac3413', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:31.670886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:31.682231 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a075d08-e4e9-44f7-b96a-abcfcdaa7ae4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1493 microversion: 2.1 time: 0.924267 Nov 02 12:42:31.683565 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2089/4225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:30 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1493 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:31.691649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0d0bcac2-b3c3-4bff-83fc-862ec58a1518 req-745c424d-2c36-4375-b71c-78be72cea20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abd2e9d-c4a7-47f8-8772-fbfcc8da8981", "name": "network-vif-unplugged", "status": "completed", "tag": "b277df25-393c-4bb3-b95b-4fb7ccecb28a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:31.718028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0d0bcac2-b3c3-4bff-83fc-862ec58a1518 req-745c424d-2c36-4375-b71c-78be72cea20b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:31.724242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0d0bcac2-b3c3-4bff-83fc-862ec58a1518 req-745c424d-2c36-4375-b71c-78be72cea20b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:31.724879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0d0bcac2-b3c3-4bff-83fc-862ec58a1518 req-745c424d-2c36-4375-b71c-78be72cea20b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:31.754343 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0d0bcac2-b3c3-4bff-83fc-862ec58a1518 req-745c424d-2c36-4375-b71c-78be72cea20b service nova] Creating event network-vif-unplugged:b277df25-393c-4bb3-b95b-4fb7ccecb28a for instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 on n-h2-855650-5 Nov 02 12:42:31.767303 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0d0bcac2-b3c3-4bff-83fc-862ec58a1518 req-745c424d-2c36-4375-b71c-78be72cea20b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081608 Nov 02 12:42:31.770598 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2090/4226] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:31.779466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:31.783026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:31.816665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:31.817545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:31.824685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:31.825674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:31.826419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:31.827241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:31.902140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:31.988715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:31.998983 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a17fd288-033e-4784-bd53-9f2b23b5e4f0 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1208 microversion: 2.1 time: 0.226126 Nov 02 12:42:32.003895 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2091/4227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:31 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1208 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:32.019436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:32.036778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:32.061930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:32.070253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:32.073141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:32.074999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:32.078389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:32.079892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:32.374832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:32.416361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:42:32.417997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:42:32.419446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:42:32.420651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:42:32.425928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:42:32.435667 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-582b0d75-ee9b-4ee5-820d-eee9b3b9690d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1210 microversion: 2.1 time: 0.426434 Nov 02 12:42:32.439503 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2092/4228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:32 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1210 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:32.463439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:32.468800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:32.471150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:32.493213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:32.496905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:32.507110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:32.511120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:32.512309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:32.524062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:32.525364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:32.527287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:32.537248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:32.538478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:32.539541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:32.622491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:32.663631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Getting quotas for user beeb8b4fa7354185ba8aff3194bf9e06 and project c7d26923875a41c8bd0161fdd1d306b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:32.721208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:42:32.727791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:42:32.926217 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5971d924-2c25-4e7f-a4ab-e5ad82328acc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.350082 Nov 02 12:42:32.945029 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2137/4229] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:42:32.964746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:32.966885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:32.989990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:32.990596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:32.996451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:33.007068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:33.007849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:33.013371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:33.137362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:33.149729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f3ac4c3-5936-4d39-8a41-988b0782fe46 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.707807 Nov 02 12:42:33.151029 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2093/4230] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:32 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:33.157280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2673c38-a643-4fa6-bd61-16a07b4b6d30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:33.158213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2673c38-a643-4fa6-bd61-16a07b4b6d30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:33.743063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2673c38-a643-4fa6-bd61-16a07b4b6d30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:33.756085 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2673c38-a643-4fa6-bd61-16a07b4b6d30 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1208 microversion: 2.1 time: 0.603777 Nov 02 12:42:33.756686 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2094/4231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:33 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1208 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:33.797015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:33.797644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:33.845959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:33.851130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:33.851614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:33.852368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:33.858822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:33.864834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:33.881835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:33.904340 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f4b1c5f-ece4-4c07-9460-a7f37f50d47c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 200 len: 1451 microversion: 2.1 time: 0.958010 Nov 02 12:42:33.926943 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2138/4232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:32 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 1451 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:33.939138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a62bba71-4dbd-4f06-be59-b22eea54424a req-84856ad2-3beb-4028-9b7d-8af196180c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abd2e9d-c4a7-47f8-8772-fbfcc8da8981", "name": "network-vif-deleted", "tag": "b277df25-393c-4bb3-b95b-4fb7ccecb28a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:33.966362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a62bba71-4dbd-4f06-be59-b22eea54424a req-84856ad2-3beb-4028-9b7d-8af196180c5d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:33.974906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a62bba71-4dbd-4f06-be59-b22eea54424a req-84856ad2-3beb-4028-9b7d-8af196180c5d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:33.976808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a62bba71-4dbd-4f06-be59-b22eea54424a req-84856ad2-3beb-4028-9b7d-8af196180c5d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:34.007739 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a62bba71-4dbd-4f06-be59-b22eea54424a req-84856ad2-3beb-4028-9b7d-8af196180c5d service nova] Creating event network-vif-deleted:b277df25-393c-4bb3-b95b-4fb7ccecb28a for instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 on n-h2-855650-5 Nov 02 12:42:34.018748 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a62bba71-4dbd-4f06-be59-b22eea54424a req-84856ad2-3beb-4028-9b7d-8af196180c5d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089164 Nov 02 12:42:34.022359 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2139/4233] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:34.037733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:34.038904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:34.056235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:34.058413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:34.060388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:34.061411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:34.062157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:34.064254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:34.383546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:34.392582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1f53ed1-f812-456e-b10f-2ccdf02f7134 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1270 microversion: 2.1 time: 0.614479 Nov 02 12:42:34.393255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2095/4234] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:33 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1270 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:34.401626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:34.423420 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb7b4a43-6b1d-46b6-a7a6-d4eda72b4858 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1266 microversion: 2.1 time: 0.399441 Nov 02 12:42:34.432446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:34.433413 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2140/4235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:34 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:34.440559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:34.467368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:34.469722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:34.471054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:34.472388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:34.473140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:34.473923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:34.787841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:34.788876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:34.806762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:34.810843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:34.814682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:34.816405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:34.826819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:34.827843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.101752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:35.119510 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d3513575-428c-478c-9186-aaa278980a60 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1204 microversion: 2.1 time: 0.338396 Nov 02 12:42:35.134063 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2141/4236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:34 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1204 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:35.140835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.141560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:35.148997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.154406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.157163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.158563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.163291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.164105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.211598 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 HTTP/1.1 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '5abd2e9d-c4a7-47f8-8772-fbfcc8da8981'} Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.213471 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.218100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:35.218100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:35.218100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:35.218100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:35.218100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.218100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.218100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:35.218100 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0784801-cbf4-42bd-bf2c-bf84280d8f23 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 404 len: 111 microversion: 2.1 time: 0.079666 Nov 02 12:42:35.226614 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2142/4237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:35 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:35.236085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.236723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:35.250205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.254744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.255550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.256301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.256949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.262507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.301394 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 HTTP/1.1 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '5abd2e9d-c4a7-47f8-8772-fbfcc8da8981'} Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:35.304613 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.310363 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.312994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:35.314062 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-856c72be-12bb-40e0-ad67-d2f2e1e35b61 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 404 len: 111 microversion: 2.1 time: 0.083097 Nov 02 12:42:35.318423 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2143/4238] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:35 2022] DELETE /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:42:35.340274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.341919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:35.355119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:35.367252 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d8fbb15-7ce8-424e-83b6-7ef095ab7e1b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.957179 Nov 02 12:42:35.369534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.373328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.374721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.382415 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2096/4239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:34 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:35.385098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.386329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.387513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.423592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.424879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:35.449728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 HTTP/1.1 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '5abd2e9d-c4a7-47f8-8772-fbfcc8da8981'} Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.453271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.460257 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:35.460257 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:35.460257 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:35.460257 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:35.460257 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. Nov 02 12:42:35.460257 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.461018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.461018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.461018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.461018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.461018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.461018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.464509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:35.466609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c18e18ab-e0e8-4968-acc7-35a60a37dc9b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981" status: 404 len: 111 microversion: 2.1 time: 0.146433 Nov 02 12:42:35.470133 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2144/4240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:35 2022] GET /compute/v2.1/servers/5abd2e9d-c4a7-47f8-8772-fbfcc8da8981 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:35.502651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.503120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:35.517347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.517864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.518452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.519961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.520441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.520889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.737600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:35.761616 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2381ff54-c2a8-411d-aa89-c994cfd34f4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1272 microversion: 2.1 time: 0.285815 Nov 02 12:42:35.774428 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2145/4241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:35 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:35.787568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.788094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:35.803584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.804097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.804551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.805285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.809206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.809896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.852231 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 HTTP/1.1 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c78c62e3-b683-4b22-96d5-4a1db73eb2e7'} Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:35.858386 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:35.862962 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:35.865179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:35.868479 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-01192893-03ca-4f2c-9104-894cac771ee1 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 404 len: 111 microversion: 2.1 time: 0.092510 Nov 02 12:42:35.872274 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2146/4242] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:35 2022] DELETE /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:35.888003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.893151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: c78c62e3-b683-4b22-96d5-4a1db73eb2e7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:35.928933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.932222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.940524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:35.943118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:35.949813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:35.951137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.005090 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 HTTP/1.1 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c78c62e3-b683-4b22-96d5-4a1db73eb2e7'} Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.007511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.012611 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.012611 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.012611 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:36.012611 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:36.012611 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. Nov 02 12:42:36.012611 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.014901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance c78c62e3-b683-4b22-96d5-4a1db73eb2e7 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:36.016829 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-beb992c6-4cc6-4d7b-89bb-4b69dfd6e727 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7" status: 404 len: 111 microversion: 2.1 time: 0.139066 Nov 02 12:42:36.018169 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2147/4243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:35 2022] GET /compute/v2.1/servers/c78c62e3-b683-4b22-96d5-4a1db73eb2e7 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:36.028961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.029781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:36.039122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.040274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.041318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.042819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.044303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.046055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.093357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:36.112626 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd1051de-37b5-40b0-86ea-5b3097030c71 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.696399 Nov 02 12:42:36.113430 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2097/4244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:35 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:36.122037 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 HTTP/1.1 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '10e9bebf-7306-4b45-b442-18b8f8de9a96'} Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:36.127574 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.133296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:36.144682 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d9a68b7b-46d1-406f-bc2c-4ea1654ab919 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 404 len: 111 microversion: 2.1 time: 0.113381 Nov 02 12:42:36.151071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2148/4245] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:36 2022] DELETE /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:36.153310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.154558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:36.159121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.160727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 10e9bebf-7306-4b45-b442-18b8f8de9a96] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:36.165167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.166063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.167220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.168331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.168967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.172444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.173340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.178624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.181118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.184271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.184385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.187337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.260400 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 HTTP/1.1 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '10e9bebf-7306-4b45-b442-18b8f8de9a96'} Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.277323 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.286039 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.286039 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.286039 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:36.286039 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:36.286039 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. Nov 02 12:42:36.286039 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.288818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 10e9bebf-7306-4b45-b442-18b8f8de9a96 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:36.290812 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f720ffc8-cc12-49ed-b810-c5ee30d3e54a tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96" status: 404 len: 111 microversion: 2.1 time: 0.137836 Nov 02 12:42:36.298670 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2149/4246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:36 2022] GET /compute/v2.1/servers/10e9bebf-7306-4b45-b442-18b8f8de9a96 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:36.320363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d61d29cb-d305-4922-864d-6a05cd4e7ed7 req-4651440c-27d2-4d90-aa4a-8e2f45a353d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3470b9e7-d8fc-4cd0-bd43-5217fe7030a4", "name": "network-vif-deleted", "tag": "6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:36.364056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d61d29cb-d305-4922-864d-6a05cd4e7ed7 req-4651440c-27d2-4d90-aa4a-8e2f45a353d7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.365000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d61d29cb-d305-4922-864d-6a05cd4e7ed7 req-4651440c-27d2-4d90-aa4a-8e2f45a353d7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.365787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d61d29cb-d305-4922-864d-6a05cd4e7ed7 req-4651440c-27d2-4d90-aa4a-8e2f45a353d7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.418624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d61d29cb-d305-4922-864d-6a05cd4e7ed7 req-4651440c-27d2-4d90-aa4a-8e2f45a353d7 service nova] Creating event network-vif-deleted:6c7d614c-cdf0-4aa1-8bc4-3d5d72bb390c for instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 on n-h1-855650-5 Nov 02 12:42:36.442992 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d61d29cb-d305-4922-864d-6a05cd4e7ed7 req-4651440c-27d2-4d90-aa4a-8e2f45a353d7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141592 Nov 02 12:42:36.443968 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2150/4247] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:36.454805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.456243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:36.470677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.471985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.472970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.474301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.475130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.475918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.505378 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e HTTP/1.1 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1cb56fdc-ed37-4237-a01a-70221545fb3e'} Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:36.508592 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:36.517040 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1246ceb9-496b-4bd0-ae83-8af43d42007c tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 404 len: 111 microversion: 2.1 time: 0.065166 Nov 02 12:42:36.520735 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2151/4248] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:36 2022] DELETE /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:36.527223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.528360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:36.536573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:36.538356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:36.542786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.544101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.546231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.547704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.548580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.549228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.586560 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd4ed18d-8bfb-4386-b3e5-5129ca812988 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1268 microversion: 2.1 time: 0.442559 Nov 02 12:42:36.587624 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2098/4249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:36 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1268 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:36.616899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.617769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:36.632301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.633166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.634751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.636075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.637081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.637855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.683206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:36.831946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b87c57d8-a64b-41e8-a5df-e569957b2be2 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 204 len: 0 microversion: 2.1 time: 0.236922 Nov 02 12:42:36.839177 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2099/4250] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:36 2022] DELETE /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:36.851495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.853583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1cb56fdc-ed37-4237-a01a-70221545fb3e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:36.866595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.868027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.869472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.871504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.872823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.874075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.906424 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e HTTP/1.1 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1cb56fdc-ed37-4237-a01a-70221545fb3e'} Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.910613 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:36.917358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:36.917358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:36.917358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:36.917358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:36.917358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. Nov 02 12:42:36.917358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:36.917358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 1cb56fdc-ed37-4237-a01a-70221545fb3e could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:36.918280 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6da55af2-280d-48c4-bbd8-a274eb5b7473 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e" status: 404 len: 111 microversion: 2.1 time: 0.075983 Nov 02 12:42:36.923515 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2100/4251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:36 2022] GET /compute/v2.1/servers/1cb56fdc-ed37-4237-a01a-70221545fb3e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:36.932244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.933956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:36.948728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.950264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.951431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:36.953197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:36.955206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:36.956329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.461769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:37.472288 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d88de0b-cdf1-4ad1-8075-6aaba2dc1992 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1272 microversion: 2.1 time: 0.548976 Nov 02 12:42:37.490426 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2101/4252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:36 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1272 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:37.497889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:37.499123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:37.506748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.507545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.508171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.509094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.509768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.510437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.753446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:37.776285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:37.786945 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e382bf53-e918-4e84-8139-ff77a1f752fd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 1.266721 Nov 02 12:42:37.841208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:37.850070 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2152/4253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:36 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:37.855315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:37.856068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:37.864247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.865030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.865706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.866657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.867348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.868060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.881494 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb300298-32a1-44e3-a15d-9f8854776872 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1507 microversion: 2.1 time: 0.388878 Nov 02 12:42:37.886641 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2102/4254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:37 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:37.893785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:37.904243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:37.904652 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b HTTP/1.1 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b'} Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:37.911477 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:37.921157 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.925842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:37.926972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.928126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.929140 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7bd1e724-4ab1-4a67-9263-2a51c0b7e02b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 404 len: 111 microversion: 2.1 time: 0.077358 Nov 02 12:42:37.929878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.933549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2153/4255] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:37 2022] DELETE /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:37.934799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.938369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.939096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.948766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:37.953613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:37.974151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.974757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.976232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.980275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.982522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.984014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.181835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:38.193228 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e85da788-dd9c-4430-99e0-e25e5b3893be tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1266 microversion: 2.1 time: 0.260702 Nov 02 12:42:38.194179 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2154/4256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:37 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:38.201719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.202946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.213345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.214233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.215019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.216402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.217057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.219049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.247432 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b HTTP/1.1 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b'} Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.251912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5a208b2-05ca-4a21-801a-1482d004208e tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b" status: 404 len: 111 microversion: 2.1 time: 0.058825 Nov 02 12:42:38.259726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2155/4257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:38 2022] GET /compute/v2.1/servers/1a5fa311-d69c-4fc1-80fe-f06cd8b4aa9b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:38.274747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.276367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.287593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.289543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.290452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.291292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.292064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.292819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.341538 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 HTTP/1.1 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '38de7e0e-7703-4ae0-81ac-5b1b8a2319e1'} Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:38.345081 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.350044 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.354485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:38.356165 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b1070092-c658-4cf5-abc9-ca02cd401212 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 404 len: 111 microversion: 2.1 time: 0.095153 Nov 02 12:42:38.359021 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2156/4258] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:38 2022] DELETE /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:38.367374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.371349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.380726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.381127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.381577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.382369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.382836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.383278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.406826 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 HTTP/1.1 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '38de7e0e-7703-4ae0-81ac-5b1b8a2319e1'} Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.412514 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4a57d03c-59cf-475c-9ca6-c0f4bffa6ec4 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1" status: 404 len: 111 microversion: 2.1 time: 0.051989 Nov 02 12:42:38.419498 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2157/4259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:38 2022] GET /compute/v2.1/servers/38de7e0e-7703-4ae0-81ac-5b1b8a2319e1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:42:38.445065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24ac7367-c4f8-4388-8efe-4f1c749f81ee tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.446173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-24ac7367-c4f8-4388-8efe-4f1c749f81ee tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 15965c79-c4ac-4da3-9eba-a0ba3775fe1c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.449282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:38.460173 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-24ac7367-c4f8-4388-8efe-4f1c749f81ee tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24ac7367-c4f8-4388-8efe-4f1c749f81ee tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c HTTP/1.1 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '15965c79-c4ac-4da3-9eba-a0ba3775fe1c'} Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.462588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24ac7367-c4f8-4388-8efe-4f1c749f81ee tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-24ac7367-c4f8-4388-8efe-4f1c749f81ee tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c" status: 404 len: 111 microversion: 2.1 time: 0.032481 Nov 02 12:42:38.471779 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2158/4260] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:38 2022] DELETE /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:38.487252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d1b0c00-0fcd-40d2-8395-46b5bc1b662b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.488136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d1b0c00-0fcd-40d2-8395-46b5bc1b662b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: 15965c79-c4ac-4da3-9eba-a0ba3775fe1c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.492502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2756061-57d2-4f52-94f9-55773e3e3d93 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.603412 Nov 02 12:42:38.504656 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-5d1b0c00-0fcd-40d2-8395-46b5bc1b662b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d1b0c00-0fcd-40d2-8395-46b5bc1b662b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c HTTP/1.1 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '15965c79-c4ac-4da3-9eba-a0ba3775fe1c'} Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:38.506295 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:38.510694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:38.510694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:38.510694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. Nov 02 12:42:38.510694 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:38.510694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d1b0c00-0fcd-40d2-8395-46b5bc1b662b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance 15965c79-c4ac-4da3-9eba-a0ba3775fe1c could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:38.510694 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d1b0c00-0fcd-40d2-8395-46b5bc1b662b tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c" status: 404 len: 111 microversion: 2.1 time: 0.027380 Nov 02 12:42:38.510694 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2159/4261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:38 2022] GET /compute/v2.1/servers/15965c79-c4ac-4da3-9eba-a0ba3775fe1c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:38.514108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.515015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.522502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.522923 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2103/4262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:37 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:38.523644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.524313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.525292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.525911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.526529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.543926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.544924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.560873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.562214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.564800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.565791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.566689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.567535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.609898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:38.688992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:38.712673 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac1793a4-daf7-4eca-8b9a-417350a8c1eb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1272 microversion: 2.1 time: 0.202288 Nov 02 12:42:38.715379 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2160/4263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:38 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:38.723498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a063a9c7-823e-43e9-88d7-3d2b2ab1aa92 req-e3484aef-0bfc-44d8-951d-c431a89447eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7673a5b-d1fc-4a1c-93b6-8044da813c37", "tag": "abdb98f4-9451-4702-a7a1-b32ab40cd0c0"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:38.742109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a063a9c7-823e-43e9-88d7-3d2b2ab1aa92 req-e3484aef-0bfc-44d8-951d-c431a89447eb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.743173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a063a9c7-823e-43e9-88d7-3d2b2ab1aa92 req-e3484aef-0bfc-44d8-951d-c431a89447eb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.743967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a063a9c7-823e-43e9-88d7-3d2b2ab1aa92 req-e3484aef-0bfc-44d8-951d-c431a89447eb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.803241 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aec9dfb7-bf12-4a22-97fb-c02214a0bd80 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 204 len: 0 microversion: 2.1 time: 0.278060 Nov 02 12:42:38.807327 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2104/4264] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:38 2022] DELETE /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:38.825172 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a063a9c7-823e-43e9-88d7-3d2b2ab1aa92 req-e3484aef-0bfc-44d8-951d-c431a89447eb service nova] Creating event network-changed:abdb98f4-9451-4702-a7a1-b32ab40cd0c0 for instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 on n-h2-855650-5 Nov 02 12:42:38.830442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.833189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.848629 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a063a9c7-823e-43e9-88d7-3d2b2ab1aa92 req-e3484aef-0bfc-44d8-951d-c431a89447eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131130 Nov 02 12:42:38.850973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.851469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2161/4265] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:38.854111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.856311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.858736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.861214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.862936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.873936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.875824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.887024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.887950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.888559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:38.889569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:38.913304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:38.914354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.469818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:39.498498 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08c8b04b-36f7-43ee-b08f-b8a055dd322d tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.645019 Nov 02 12:42:39.499701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:39.514032 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2162/4266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:38 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:39.521452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3541162d-97f6-4aa5-a3e2-8ad34f46862c req-0cad11e9-e2fb-4404-8529-72fa898155c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd41952f-9895-4231-a0fb-582dd387baca", "tag": "4f6373c9-a8fb-4cc9-b1d2-28f4076ed99c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:39.525389 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3bc69fe-deb3-4521-8e63-ae7a9a615a77 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1478 microversion: 2.1 time: 0.709183 Nov 02 12:42:39.527473 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2105/4267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:38 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1478 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:39.550503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:39.551446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:39.558628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3541162d-97f6-4aa5-a3e2-8ad34f46862c req-0cad11e9-e2fb-4404-8529-72fa898155c3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.559685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3541162d-97f6-4aa5-a3e2-8ad34f46862c req-0cad11e9-e2fb-4404-8529-72fa898155c3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.560564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3541162d-97f6-4aa5-a3e2-8ad34f46862c req-0cad11e9-e2fb-4404-8529-72fa898155c3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.576137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.576865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.577271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.578069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.578545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.578982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.591664 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3541162d-97f6-4aa5-a3e2-8ad34f46862c req-0cad11e9-e2fb-4404-8529-72fa898155c3 service nova] Creating event network-changed:4f6373c9-a8fb-4cc9-b1d2-28f4076ed99c for instance fd41952f-9895-4231-a0fb-582dd387baca on n-h1-855650-5 Nov 02 12:42:39.604628 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3541162d-97f6-4aa5-a3e2-8ad34f46862c req-0cad11e9-e2fb-4404-8529-72fa898155c3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098119 Nov 02 12:42:39.616110 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2163/4268] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:39.616862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:39.633434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:39.634435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:39.644817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.645428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.645956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.648040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.648773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.649405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.731602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:39.767922 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b46e198-fcd3-4d63-aef9-d416619cf99b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1292 microversion: 2.1 time: 0.237640 Nov 02 12:42:39.780935 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2106/4269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:39 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1292 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:39.798867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:39.799510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:39.809145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.810230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.810230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.810871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.811340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.811780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.877616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:39.893322 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c0178a48-d59b-428a-8457-5380ba0b12f2 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1266 microversion: 2.1 time: 0.274056 Nov 02 12:42:39.895330 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2164/4270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:39 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:39.906927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:39.908171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:39.923275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.923901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.924437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:39.926013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:39.928183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:39.930722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:40.383185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:40.395669 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-29d2cf53-8954-4746-bb7b-8706c3cbabc6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.496283 Nov 02 12:42:40.410145 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2165/4271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:39 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:40.410373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:40.421397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-213a96fc-0f10-4d94-bbc5-d10e3a2150b8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.638960 Nov 02 12:42:40.430521 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2107/4272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:39 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:40.530722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:40.532196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:40.542525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:40.543573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:40.545260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:40.547988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:40.548763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:40.556979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:40.558173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:40.561944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:40.565865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:40.570139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:40.571521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:40.575391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:40.576286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:40.576820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.051232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:41.059927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:41.068972 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-413e24ce-4e8c-4a32-9848-5c96a196a6db tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.543068 Nov 02 12:42:41.080809 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2166/4273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:40 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:41.093134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:41.107556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:41.128248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.132575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.133416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.134382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.135287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.135884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.161023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:41.178146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-232a4c9b-8c9b-4608-98bf-d4caef64de19 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1478 microversion: 2.1 time: 0.626879 Nov 02 12:42:41.190510 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2108/4274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:40 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1478 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:41.203076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:41.211359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:41.212194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.214387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.215686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.216860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lazy-loading 'fault' on Instance uuid d1236ab7-d8c5-4f61-be01-9534bc36a786 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:42:41.230249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.231073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.237238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.238652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.239468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.240256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.344702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:41.367477 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb5b5a06-ce67-4788-858b-95cbd054b816 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1311 microversion: 2.1 time: 0.284210 Nov 02 12:42:41.369426 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2167/4275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:41 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1311 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:41.432848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:41.432848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:41.445613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.446626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.447527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.448989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.449941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.452364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.686067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:41.696822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f74d4f36-6453-44f1-b93b-e81166338284 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.504394 Nov 02 12:42:41.697890 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2109/4276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:41 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:41.705509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:41.706834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:41.714617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.715904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.716575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.717761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.718623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.720090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.770599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:41.785552 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-787d8340-e452-4174-996d-2aa9b841ad49 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.364575 Nov 02 12:42:41.786535 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2168/4277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:41 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:41.794914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7f6b8cf8-0c9f-4b74-84b2-f1137fc7c474 req-fbd9d885-6d06-43f7-993b-ac6d840ea993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1236ab7-d8c5-4f61-be01-9534bc36a786", "name": "network-vif-deleted", "tag": "31888f16-6862-4ba6-bf43-2c94c53f126f"}, {"server_uuid": "f3385330-4644-4f56-a4ab-2e2c3b617ce1", "name": "network-vif-deleted", "tag": "533513ee-b7a3-4462-89a7-a06deab93dc9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:41.815360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f6b8cf8-0c9f-4b74-84b2-f1137fc7c474 req-fbd9d885-6d06-43f7-993b-ac6d840ea993 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.816021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f6b8cf8-0c9f-4b74-84b2-f1137fc7c474 req-fbd9d885-6d06-43f7-993b-ac6d840ea993 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.816516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7f6b8cf8-0c9f-4b74-84b2-f1137fc7c474 req-fbd9d885-6d06-43f7-993b-ac6d840ea993 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.842905 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7f6b8cf8-0c9f-4b74-84b2-f1137fc7c474 req-fbd9d885-6d06-43f7-993b-ac6d840ea993 service nova] Creating event network-vif-deleted:31888f16-6862-4ba6-bf43-2c94c53f126f for instance d1236ab7-d8c5-4f61-be01-9534bc36a786 on n-h2-855650-5 Nov 02 12:42:41.844646 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7f6b8cf8-0c9f-4b74-84b2-f1137fc7c474 req-fbd9d885-6d06-43f7-993b-ac6d840ea993 service nova] Creating event network-vif-deleted:533513ee-b7a3-4462-89a7-a06deab93dc9 for instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 on n-h2-855650-5 Nov 02 12:42:41.866550 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7f6b8cf8-0c9f-4b74-84b2-f1137fc7c474 req-fbd9d885-6d06-43f7-993b-ac6d840ea993 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076434 Nov 02 12:42:41.867540 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2169/4278] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:41.991193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:42.006838 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a9600ab-0e25-46ca-9692-934b147c4a86 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.306325 Nov 02 12:42:42.007766 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2110/4279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:41 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:42.127951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:42.130121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:42.139748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.141337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.142146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.143801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.144841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.145603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.219534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:42.227053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:42.255678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.256707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.257642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.259313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.260120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.262087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.433591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94e46a856ed4b418efb28ff0405a48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b234bec6b94a66b2f4dad457c5bc80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:42.492043 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d47e80d-8eb0-4861-86d1-5f5143f28857 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 200 len: 1436 microversion: 2.1 time: 0.281724 Nov 02 12:42:42.505998 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2111/4280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:42 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 1436 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:42.515488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-230e6015-4e43-4a73-b121-e2771f9f1d6d req-3f59e6bf-aec9-4258-a557-44e552e9bd28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c23ca4-d827-4c9e-8c8b-c4b430b573f2", "tag": "379f0f3d-118d-4b63-9dfd-7b1e8a924161"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:42.554511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-230e6015-4e43-4a73-b121-e2771f9f1d6d req-3f59e6bf-aec9-4258-a557-44e552e9bd28 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.554986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-230e6015-4e43-4a73-b121-e2771f9f1d6d req-3f59e6bf-aec9-4258-a557-44e552e9bd28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.560022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-230e6015-4e43-4a73-b121-e2771f9f1d6d req-3f59e6bf-aec9-4258-a557-44e552e9bd28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.582713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:42.585820 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-230e6015-4e43-4a73-b121-e2771f9f1d6d req-3f59e6bf-aec9-4258-a557-44e552e9bd28 service nova] Creating event network-changed:379f0f3d-118d-4b63-9dfd-7b1e8a924161 for instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 on n-h1-855650-5 Nov 02 12:42:42.587167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:42.596329 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-230e6015-4e43-4a73-b121-e2771f9f1d6d req-3f59e6bf-aec9-4258-a557-44e552e9bd28 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100799 Nov 02 12:42:42.604261 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2112/4281] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:42.613305 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa03cd0d-b745-4f0a-9bc4-01abd675132e tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.495348 Nov 02 12:42:42.618035 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2170/4282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:42 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:42.624707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:42.630819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:42.653829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.655115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.657845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.661061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.661790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.666918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.733678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:42.737544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:42.746911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=22 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:42.757220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.759306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.761467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.765851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.767332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.771025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.782074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.784876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.786770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.787746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lazy-loading 'fault' on Instance uuid d1236ab7-d8c5-4f61-be01-9534bc36a786 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:42:42.988405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:43.001794 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5720d6e7-8b09-42ca-956f-7c63e091882b tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 200 len: 1311 microversion: 2.1 time: 0.395778 Nov 02 12:42:43.002801 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2113/4283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:42 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:43.009681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:43.010660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:43.028994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:43.029822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:43.030496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.036036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:43.036865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:43.037698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.111703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:43.121906 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1cbbdbb0-3b22-4e6b-98f8-a0d5fbaf2e1a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.394715 Nov 02 12:42:43.125428 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2171/4284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:42 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:43.130722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:43.149695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:43.177427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:43.179613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:43.183360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.184395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:43.185042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:43.185675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.638305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:43.650954 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bc8e4226-4597-4ce0-a0fb-9c1520593c03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.646829 Nov 02 12:42:43.665685 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2114/4285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:43 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:43.671080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:43.671998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] [instance: f3385330-4644-4f56-a4ab-2e2c3b617ce1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:43.680117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:43.680883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:43.681525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.682467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:43.683140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:43.683765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.702488 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] HTTP exception thrown: Instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 could not be found. Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Request method failure captured: Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 HTTP/1.1 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmRwiz2s73hvQD2-s-fH5E_Pq4xCpvtFVA2ouk8iSnN1I26jQqjzmKxn5lHqzLgikUAfI2-NNQYT0U1a7wgta9Ly3OsyUnxJfShMkqQtjg5TV6zap2QjIUFGkL6ABBoo7qe9dbIoSAnwok00A902YLNzj5ObMxQdkTW45Q1p5V0zMOs Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07b234bec6b94a66b2f4dad457c5bc80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersTestJSON-421655181 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 07b234bec6b94a66b2f4dad457c5bc80 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersTestJSON-421655181 Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersTestJSON-421655181-project Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f94e46a856ed4b418efb28ff0405a48e Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersTestJSON-421655181-project Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 could not be found. Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'f3385330-4644-4f56-a4ab-2e2c3b617ce1'} Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 could not be found. Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 could not be found. Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:43.705766 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:43.709371 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:43.709371 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:43.709371 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:43.709371 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:43.709371 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 could not be found. Nov 02 12:42:43.709371 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:43.711340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] Returning 404 to user: Instance f3385330-4644-4f56-a4ab-2e2c3b617ce1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:43.712239 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-088bc3a2-2599-4cc1-a158-d118bdc06613 tempest-ServersTestJSON-421655181 tempest-ServersTestJSON-421655181-project] 10.222.0.45 "GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1" status: 404 len: 111 microversion: 2.1 time: 0.045422 Nov 02 12:42:43.712822 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2115/4286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:43 2022] GET /compute/v2.1/servers/f3385330-4644-4f56-a4ab-2e2c3b617ce1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:43.718005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:43.718988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:43.726529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:43.727402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:43.728052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.729024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:43.729709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:43.730186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.754988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=40 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:43.846012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:43.855998 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-804d00cc-d9a7-4c54-b2b5-77e97a2e0443 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.729083 Nov 02 12:42:43.870258 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2172/4287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:43 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:44.046277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:44.047972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: d1236ab7-d8c5-4f61-be01-9534bc36a786] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:44.062931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.063741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.064394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.066191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.067262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.068119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.110177 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Instance d1236ab7-d8c5-4f61-be01-9534bc36a786 could not be found. Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 HTTP/1.1 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance d1236ab7-d8c5-4f61-be01-9534bc36a786 could not be found. Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'd1236ab7-d8c5-4f61-be01-9534bc36a786'} Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1236ab7-d8c5-4f61-be01-9534bc36a786 could not be found. Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1236ab7-d8c5-4f61-be01-9534bc36a786 could not be found. Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:44.114193 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1236ab7-d8c5-4f61-be01-9534bc36a786 could not be found. Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 404 to user: Instance d1236ab7-d8c5-4f61-be01-9534bc36a786 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2116d6eb-9201-480c-8380-d0bf6f504b58 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786" status: 404 len: 111 microversion: 2.1 time: 0.074399 Nov 02 12:42:44.118328 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2173/4288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:44 2022] GET /compute/v2.1/servers/d1236ab7-d8c5-4f61-be01-9534bc36a786 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:42:44.141342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:44.144569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:44.146515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:44.158146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3444c5a0-317e-4591-b209-16ea7008aed9 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.443823 Nov 02 12:42:44.159767 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2116/4289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:43 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:44.167116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:44.168913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:44.178095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.178614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.179072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.179815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.180280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.180719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.184621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.185084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.185616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.186480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.187754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.188315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.272566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:44.437870 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e6a8f94c-2cdc-42e6-b4d1-134f19d979bb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 204 len: 0 microversion: 2.1 time: 0.302856 Nov 02 12:42:44.439745 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2174/4290] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:44 2022] DELETE /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:44.455067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:44.456332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:44.468954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.469759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.470604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.472772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.472772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.473300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:45.294409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:45.306298 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-54dd5767-7e51-4aff-b048-7d11779cfd1b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 1.144445 Nov 02 12:42:45.307793 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2117/4291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:44 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:45.316989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:45.318503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:45.326950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:45.338054 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e19de18-84b2-4097-a6bf-188f511e53e4 tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 0.891864 Nov 02 12:42:45.344295 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2175/4292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:44 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:45.354467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:45.354467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:45.354467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:45.354467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:45.354467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:45.354467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:45.379831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:45.380843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:45.388100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:45.388956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:45.389619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:45.391122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:45.391844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:45.392368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:45.806977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:45.819886 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f837656-1704-402a-8962-1fe3c42346c1 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.507329 Nov 02 12:42:45.820565 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2118/4293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:45 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:45.828938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:45.839482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:45.850309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:45.855600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:45.862430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:45.863602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:45.864421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:45.865064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:46.109717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:46.123199 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-77bc9b1b-bf27-407c-9bc7-5e60ed163bcb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.753720 Nov 02 12:42:46.124465 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2176/4294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:45 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:46.165115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-41ef4fc3-62ae-4999-bcac-52dd338d394a req-46762a96-1ae0-464d-9220-919e35e86174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7673a5b-d1fc-4a1c-93b6-8044da813c37", "name": "network-vif-plugged", "status": "completed", "tag": "abdb98f4-9451-4702-a7a1-b32ab40cd0c0"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:46.180608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-41ef4fc3-62ae-4999-bcac-52dd338d394a req-46762a96-1ae0-464d-9220-919e35e86174 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:46.181505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-41ef4fc3-62ae-4999-bcac-52dd338d394a req-46762a96-1ae0-464d-9220-919e35e86174 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:46.183617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-41ef4fc3-62ae-4999-bcac-52dd338d394a req-46762a96-1ae0-464d-9220-919e35e86174 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:46.200478 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-41ef4fc3-62ae-4999-bcac-52dd338d394a req-46762a96-1ae0-464d-9220-919e35e86174 service nova] Creating event network-vif-plugged:abdb98f4-9451-4702-a7a1-b32ab40cd0c0 for instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 on n-h2-855650-5 Nov 02 12:42:46.206845 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-41ef4fc3-62ae-4999-bcac-52dd338d394a req-46762a96-1ae0-464d-9220-919e35e86174 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046989 Nov 02 12:42:46.208300 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2177/4295] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:42:46.275629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:46.285180 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b7b7d8e-0f19-44a5-bcdf-db6b8d896cef tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.460818 Nov 02 12:42:46.304775 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2119/4296] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:45 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:46.343151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:46.344567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:46.357568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:46.358343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:46.358951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:46.360018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:46.360578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:46.361107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:46.372793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:46.373596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:46.388852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:46.391172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:46.395912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:46.397468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:46.398581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:46.406605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:47.230380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:47.242968 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94705fbd-7442-4f19-b180-60da40ad6bb4 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.904678 Nov 02 12:42:47.244100 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2178/4297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:46 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:47.251399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-dd711583-5524-473c-b86c-ca84793f97f4 req-f4a033a2-f5f5-4f23-b6fd-2c6a6fb5b154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d048db-1aa0-49d7-a2c1-ecbcfac7e36c", "tag": "568dfa43-bfea-4535-bafb-580643eb5f97"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:47.266251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd711583-5524-473c-b86c-ca84793f97f4 req-f4a033a2-f5f5-4f23-b6fd-2c6a6fb5b154 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.266995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd711583-5524-473c-b86c-ca84793f97f4 req-f4a033a2-f5f5-4f23-b6fd-2c6a6fb5b154 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.268278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dd711583-5524-473c-b86c-ca84793f97f4 req-f4a033a2-f5f5-4f23-b6fd-2c6a6fb5b154 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:47.286988 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-dd711583-5524-473c-b86c-ca84793f97f4 req-f4a033a2-f5f5-4f23-b6fd-2c6a6fb5b154 service nova] Creating event network-changed:568dfa43-bfea-4535-bafb-580643eb5f97 for instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c on n-h2-855650-5 Nov 02 12:42:47.292871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-dd711583-5524-473c-b86c-ca84793f97f4 req-f4a033a2-f5f5-4f23-b6fd-2c6a6fb5b154 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046999 Nov 02 12:42:47.294304 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2179/4298] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:47.301906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:47.304269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:47.305720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:47.317469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.321473 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ccf2074-8b00-4d2a-9051-fb60fb1208fb tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1522 microversion: 2.1 time: 0.952724 Nov 02 12:42:47.333999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.333999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:47.333999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.333999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.333999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:47.334486 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2120/4299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:46 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1522 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:47.341829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:47.341829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:47.355447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.356850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.357781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:47.360008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.361885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.362492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:47.726321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:47.747368 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0611fa3f-7c0f-467e-b68d-0fb446a2cd8d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.419389 Nov 02 12:42:47.748891 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2121/4300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:47 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:47.761535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:47.764220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:47.777959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:47.790672 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66c282b5-3927-458a-8400-8a8836b1e6ae tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.494610 Nov 02 12:42:47.791285 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2180/4301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:47 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:47.794789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.794789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.795238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:47.796025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.796809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.797263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:48.185009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:48.195282 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-72cb4f88-4b30-4386-81b9-7d010b6756ed tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.443298 Nov 02 12:42:48.195282 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2122/4302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:47 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:48.243613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ff54a0cf-b44f-45f4-ad0a-28e4b538e8d7 req-29f24802-f337-4cf9-9042-8790cef297f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd41952f-9895-4231-a0fb-582dd387baca", "name": "network-vif-plugged", "status": "completed", "tag": "4f6373c9-a8fb-4cc9-b1d2-28f4076ed99c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:48.272029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ff54a0cf-b44f-45f4-ad0a-28e4b538e8d7 req-29f24802-f337-4cf9-9042-8790cef297f0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:48.273360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ff54a0cf-b44f-45f4-ad0a-28e4b538e8d7 req-29f24802-f337-4cf9-9042-8790cef297f0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:48.274497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ff54a0cf-b44f-45f4-ad0a-28e4b538e8d7 req-29f24802-f337-4cf9-9042-8790cef297f0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:48.286742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:48.287810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:48.304392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:48.305578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:48.306488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:48.308536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:48.309594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:48.310348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:48.337956 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ff54a0cf-b44f-45f4-ad0a-28e4b538e8d7 req-29f24802-f337-4cf9-9042-8790cef297f0 service nova] Creating event network-vif-plugged:4f6373c9-a8fb-4cc9-b1d2-28f4076ed99c for instance fd41952f-9895-4231-a0fb-582dd387baca on n-h1-855650-5 Nov 02 12:42:48.345551 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ff54a0cf-b44f-45f4-ad0a-28e4b538e8d7 req-29f24802-f337-4cf9-9042-8790cef297f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111745 Nov 02 12:42:48.348448 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2181/4303] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:48.360117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:48.361755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:48.373258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:48.374791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:48.375865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:48.377504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:48.378715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:48.379766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:48.701783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:48.715156 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3a5dafc0-68aa-4f90-adda-21ad4bdc3a7d tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1480 microversion: 2.1 time: 0.364398 Nov 02 12:42:48.716147 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2182/4304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:48 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1480 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:48.775347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:48.775978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:48.799854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:48.800633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:48.801297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:48.802229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:48.812674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:48.823095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:49.271144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:49.283783 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec7ff54f-6e11-41d4-a691-bf52a1bf5a8a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 1.004293 Nov 02 12:42:49.284705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2123/4305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:48 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:49.298522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:49.299824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:49.316115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:49.317343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:49.318985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:49.318985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:49.319554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:49.319996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:49.396178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:49.655035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:49.664791 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-757efbb9-6ff1-4ec8-ac7e-537fab4e11ff tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.894989 Nov 02 12:42:49.674096 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2183/4306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:48 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:49.694777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:49.700288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:49.721881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:49.723411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:49.725283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:49.727061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:49.728721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:49.729542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:49.936590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:49.949658 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5bc15822-1ccd-4e9a-bbd0-b024435f6f46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.663253 Nov 02 12:42:49.960518 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2124/4307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:49 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:49.967106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f700da70-b994-4d92-9135-1dceb0047564 req-d8615182-4015-45eb-a03b-9722cd0fd15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef4fe0d-6f31-447d-b886-353ade395208", "name": "network-vif-deleted", "tag": "656c809f-ee4f-4ae5-b058-fa0c45b86dd5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:49.984872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f700da70-b994-4d92-9135-1dceb0047564 req-d8615182-4015-45eb-a03b-9722cd0fd15f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:49.985448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f700da70-b994-4d92-9135-1dceb0047564 req-d8615182-4015-45eb-a03b-9722cd0fd15f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:49.986152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f700da70-b994-4d92-9135-1dceb0047564 req-d8615182-4015-45eb-a03b-9722cd0fd15f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.003924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f700da70-b994-4d92-9135-1dceb0047564 req-d8615182-4015-45eb-a03b-9722cd0fd15f service nova] Creating event network-vif-deleted:656c809f-ee4f-4ae5-b058-fa0c45b86dd5 for instance 9ef4fe0d-6f31-447d-b886-353ade395208 on n-h1-855650-5 Nov 02 12:42:50.009884 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f700da70-b994-4d92-9135-1dceb0047564 req-d8615182-4015-45eb-a03b-9722cd0fd15f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048473 Nov 02 12:42:50.011548 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2125/4308] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:50.020947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:50.022437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:50.040263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.041294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.041763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.042566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.043140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.043762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.064976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:50.073852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:50.091715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.092441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.092983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.094134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lazy-loading 'fault' on Instance uuid 9ef4fe0d-6f31-447d-b886-353ade395208 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:42:50.102981 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5a0ebf8f-a9b0-4ee1-a84b-78b840195896 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1317 microversion: 2.1 time: 0.426863 Nov 02 12:42:50.103793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2184/4309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:49 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:50.190185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f2191cdfa640ed9a7f71d4744c9999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29944ce70b2d4abea5c2f205a3814881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:50.206884 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-085d5abf-0b65-46b4-959c-ca3fe112b82c tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 200 len: 1312 microversion: 2.1 time: 0.192915 Nov 02 12:42:50.207686 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2126/4310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:50 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:50.344099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:50.345578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:50.365912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.366538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.367016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.371345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.371983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.377920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.695207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:50.697626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:50.713440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.715482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.716562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.720986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.723728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.724603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.783377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:50.801126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1563f02f-a423-43d5-9721-90b72deb6262 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.476456 Nov 02 12:42:50.807610 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2185/4311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:50 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:50.975833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:50.977253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:50.984837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.985430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.986011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:50.986799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:50.987402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:50.987893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:51.544859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:51.558399 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f6201b5-e85f-412c-9ca3-3bc2e2d237b6 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1312 microversion: 2.1 time: 0.869607 Nov 02 12:42:51.574224 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2127/4312] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:50 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1312 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:51.587114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:51.588086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:51.599026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:51.618016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:51.618624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:51.619084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:51.619832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:51.620436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:51.621240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:51.697457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:51.714484 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ead13c3f-d9a6-4223-b4c3-e73c28358c0f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.741952 Nov 02 12:42:51.717432 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2186/4313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:50 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:51.727007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:51.728067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] [instance: 9ef4fe0d-6f31-447d-b886-353ade395208] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:51.748358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:51.748871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:51.755002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:51.757886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:51.759597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:51.761299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:51.784191 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] HTTP exception thrown: Instance 9ef4fe0d-6f31-447d-b886-353ade395208 could not be found. Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Request method failure captured: Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 HTTP/1.1 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmP1cuMw32MneWZmzRgfyLbRq2XfmxG2rjSAxW-V5O--SbldzZGxhiqSM7_4Yd840sd-x4D7_YWbETt6WPFjZYIuLm9IrKfEfKnwxiRcmXbs3WMBT38IEcyw6dSLPj9BU2e2iBAu9oQLum5C0FVUFKnXbHK0aF7rkC1M77T07gSw8I4 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29944ce70b2d4abea5c2f205a3814881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 29944ce70b2d4abea5c2f205a3814881 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1103140519 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 11f2191cdfa640ed9a7f71d4744c9999 Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1103140519-project Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 9ef4fe0d-6f31-447d-b886-353ade395208 could not be found. Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '9ef4fe0d-6f31-447d-b886-353ade395208'} Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef4fe0d-6f31-447d-b886-353ade395208 could not be found. Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef4fe0d-6f31-447d-b886-353ade395208 could not be found. Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:51.787223 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:51.790833 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:51.790833 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:51.790833 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:51.790833 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:51.790833 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:51.790833 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:51.790833 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef4fe0d-6f31-447d-b886-353ade395208 could not be found. Nov 02 12:42:51.790833 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:51.793954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] Returning 404 to user: Instance 9ef4fe0d-6f31-447d-b886-353ade395208 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:51.796329 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d2f05500-0967-49f1-b0ae-c4b6ee6d4ffa tempest-ServerRescueNegativeTestJSON-1103140519 tempest-ServerRescueNegativeTestJSON-1103140519-project] 10.222.0.45 "GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208" status: 404 len: 111 microversion: 2.1 time: 0.075792 Nov 02 12:42:51.798043 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2187/4314] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:51 2022] GET /compute/v2.1/servers/9ef4fe0d-6f31-447d-b886-353ade395208 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:51.833240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:51.834120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:51.846845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:51.847372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:51.848076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:51.848613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:51.849094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:51.854961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.205226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:52.217229 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6ed5725-83db-4086-a9bf-5c8f8ac7d703 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1506 microversion: 2.1 time: 0.641761 Nov 02 12:42:52.219579 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2128/4315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:51 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:52.242466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:52.243310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:52.250753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.251661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.252405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.253356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.254098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.255118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.310558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:52.311640 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-480ccc06-b456-4251-bd6c-26af4632beca tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37/os-instance-actions/req-013cf84e-3477-448e-9966-d6e356861563" status: 200 len: 313 microversion: 2.1 time: 0.073440 Nov 02 12:42:52.313458 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2129/4316] 10.222.0.45 () {58 vars in 1419 bytes} [Wed Nov 2 12:42:52 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37/os-instance-actions/req-013cf84e-3477-448e-9966-d6e356861563 => generated 313 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:42:52.327145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:52.332446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:52.349724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.350870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.352344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.353352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.354084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.354752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.400260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:52.422010 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36de01c9-0521-4330-a714-4d021d253f87 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.592420 Nov 02 12:42:52.440792 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2188/4317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:51 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:52.493702 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c5953310-f882-4e9b-95ea-f051f804a6f1 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "POST /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37/action" status: 202 len: 0 microversion: 2.1 time: 0.169691 Nov 02 12:42:52.495406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2130/4318] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:52 2022] POST /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:42:52.503571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:52.504212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:52.522087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.525632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.526284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.527752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.528482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.529078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.588997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:52.589868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:52.603259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.605654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.606426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.607838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.609613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.613270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.959816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:52.973735 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a62884e-fc38-43f9-973d-32ff161f92c8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1508 microversion: 2.1 time: 0.472862 Nov 02 12:42:52.979037 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2189/4319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:52 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1508 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:53.005559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:53.006621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:53.016234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.017362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.018088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.019094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.019780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.020427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.024825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:53.040679 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3355a96-6433-47d9-8748-ba6b20d602c8 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1497 microversion: 2.1 time: 0.457932 Nov 02 12:42:53.042549 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2131/4320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:52 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:53.068628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b7dfbdbf-a6ee-4e22-abcf-2164f35e7679 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:53.120282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.server_groups [None req-b7dfbdbf-a6ee-4e22-abcf-2164f35e7679 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Querying cell 65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) for 1 instances {{(pid=120722) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:42:53.122583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7dfbdbf-a6ee-4e22-abcf-2164f35e7679 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.125978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7dfbdbf-a6ee-4e22-abcf-2164f35e7679 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.127415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7dfbdbf-a6ee-4e22-abcf-2164f35e7679 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.176346 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b7dfbdbf-a6ee-4e22-abcf-2164f35e7679 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/571df35b-8105-4622-b0c2-6138f708ce79" status: 200 len: 222 microversion: 2.1 time: 0.112257 Nov 02 12:42:53.179081 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2132/4321] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:42:53 2022] GET /compute/v2.1/os-server-groups/571df35b-8105-4622-b0c2-6138f708ce79 => generated 222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:42:53.197686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:53.200218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:53.219035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.222667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.223450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.225937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.227083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.228522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.316858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:53.418959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:53.430600 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-835321e4-56e4-4fa8-b66e-d4c24e3ede2a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.430721 Nov 02 12:42:53.444038 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2190/4322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:52 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:53.459765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:53.460882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:53.470342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.471191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.471856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.472741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.473689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.474509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.493415 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b38a4e8-6036-4cba-9468-c925a3797a2f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 204 len: 0 microversion: 2.1 time: 0.307106 Nov 02 12:42:53.498686 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2133/4323] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:53 2022] DELETE /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:53.514089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:53.515447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:53.530358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.532447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.533177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.535677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.536639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.537253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.954056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:53.976356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:53.977192 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92062d08-8e26-40a2-9533-d1138f9be1cb tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1503 microversion: 2.1 time: 0.474756 Nov 02 12:42:53.978477 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2134/4324] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:53 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1503 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:54.011867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:54.015551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:54.034292 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b39bfad6-8462-44d5-b08d-705082d460c3 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.567180 Nov 02 12:42:54.035461 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2191/4325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:53 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:54.049746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:54.055114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:54.060841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:54.063322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:54.067125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:54.072872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:54.145514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-92e05f37-0e32-4f8a-8c12-c8fea5136be5 req-f6e4f685-eca9-4bbe-8727-f60aaa45c009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c23ca4-d827-4c9e-8c8b-c4b430b573f2", "name": "network-vif-plugged", "status": "completed", "tag": "379f0f3d-118d-4b63-9dfd-7b1e8a924161"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:54.162998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-92e05f37-0e32-4f8a-8c12-c8fea5136be5 req-f6e4f685-eca9-4bbe-8727-f60aaa45c009 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:54.166772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-92e05f37-0e32-4f8a-8c12-c8fea5136be5 req-f6e4f685-eca9-4bbe-8727-f60aaa45c009 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:54.182432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-92e05f37-0e32-4f8a-8c12-c8fea5136be5 req-f6e4f685-eca9-4bbe-8727-f60aaa45c009 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:54.223839 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-92e05f37-0e32-4f8a-8c12-c8fea5136be5 req-f6e4f685-eca9-4bbe-8727-f60aaa45c009 service nova] Creating event network-vif-plugged:379f0f3d-118d-4b63-9dfd-7b1e8a924161 for instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 on n-h1-855650-5 Nov 02 12:42:54.237715 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-92e05f37-0e32-4f8a-8c12-c8fea5136be5 req-f6e4f685-eca9-4bbe-8727-f60aaa45c009 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098406 Nov 02 12:42:54.240079 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2192/4326] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:42:54.465150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:54.466332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:54.474839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:54.485605 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64a920a8-012a-4851-a75c-09ae982d4bea tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1508 microversion: 2.1 time: 0.481073 Nov 02 12:42:54.486714 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2135/4327] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:54 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:54.517905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:54.527025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:54.529223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:54.536266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:54.537870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:54.538650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:54.850637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:54.861823 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4507225e-6a8d-492a-874f-dc2a8d4381fc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.404691 Nov 02 12:42:54.863050 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2193/4328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:54 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:55.005220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:55.008964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:55.022454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.023850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.024784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.026186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.027037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.028388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.074514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:55.076946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:55.086434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.087110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.087797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.103636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.106371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.106830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.421576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:55.434319 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1da9adbb-6afc-49fb-aa16-6c569228e275 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.364142 Nov 02 12:42:55.438661 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2194/4329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:55 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:55.444357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:55.462909 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5a9b37e7-913c-4234-a968-e02470c3db65 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1503 microversion: 2.1 time: 0.465873 Nov 02 12:42:55.466741 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2136/4330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:54 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1503 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:55.537355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:55.538355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:55.553882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.554433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.554874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.555599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.563046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.563740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.831572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:55.854501 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08bccf5e-b38f-4381-bc97-856660008dc6 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1506 microversion: 2.1 time: 0.326845 Nov 02 12:42:55.856459 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2195/4331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:55 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:55.880543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '.version_select at 0x7f228e4fa9d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:55.881727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:55.898702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:55.899786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.900723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:55.901500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.902938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.905788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.908400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.909201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.919444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.920604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.921805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.925131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.926714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.933191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.007878 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca1bf96c-7660-4a1e-912a-b164636b131c tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.131535 Nov 02 12:42:56.008706 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2137/4332] 10.222.0.45 () {58 vars in 1296 bytes} [Wed Nov 2 12:42:55 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37/os-instance-actions => generated 611 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:56.023787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:56.027868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:56.050541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.052766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.053408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.055072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.057056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.058288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.113425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:56.131482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:56.292913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18a6535c-a6ce-46d8-a05d-b36aad3050f5 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 204 len: 0 microversion: 2.1 time: 0.273039 Nov 02 12:42:56.293935 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2138/4333] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:56 2022] DELETE /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:42:56.315190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c1d3e0c1-d286-4ac1-9eca-a574c16d223b req-e2aa2c3a-03ed-48e5-a934-32917b7fbc19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d048db-1aa0-49d7-a2c1-ecbcfac7e36c", "name": "network-vif-plugged", "status": "completed", "tag": "568dfa43-bfea-4535-bafb-580643eb5f97"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:56.328241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c1d3e0c1-d286-4ac1-9eca-a574c16d223b req-e2aa2c3a-03ed-48e5-a934-32917b7fbc19 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.329071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c1d3e0c1-d286-4ac1-9eca-a574c16d223b req-e2aa2c3a-03ed-48e5-a934-32917b7fbc19 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.329690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c1d3e0c1-d286-4ac1-9eca-a574c16d223b req-e2aa2c3a-03ed-48e5-a934-32917b7fbc19 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.338485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:56.345062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c1d3e0c1-d286-4ac1-9eca-a574c16d223b req-e2aa2c3a-03ed-48e5-a934-32917b7fbc19 service nova] Creating event network-vif-plugged:568dfa43-bfea-4535-bafb-580643eb5f97 for instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c on n-h2-855650-5 Nov 02 12:42:56.350521 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c1d3e0c1-d286-4ac1-9eca-a574c16d223b req-e2aa2c3a-03ed-48e5-a934-32917b7fbc19 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047102 Nov 02 12:42:56.354608 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d22d2f1d-5596-483d-b051-a81de74ac780 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1314 microversion: 2.1 time: 0.459849 Nov 02 12:42:56.355740 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2139/4334] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:56.362111 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2196/4335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:55 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:56.363768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:56.365638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:56.373903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.375783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.376625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.377819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.378905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.379690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.582435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:56.591654 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48ff7d4d-213d-43c1-8208-c45d6f0e2fdd tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1512 microversion: 2.1 time: 0.234393 Nov 02 12:42:56.606463 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2140/4336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:56 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:56.611637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:56.612408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:56.619511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.620009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.620460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.621133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.621586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.622348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.652061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ad3dedee-f3b4-47a0-9f3f-690359681630 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Action: 'create', calling method: .version_select at 0x7f228dc43b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-799998012"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:57.070856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:57.095372 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-60a6ce41-6994-4471-8328-9a2d36dfa2de tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.486749 Nov 02 12:42:57.098904 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2141/4337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:56 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:57.120182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:57.121385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:57.134864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.137104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.137870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.140896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.141832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.145044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.255611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.256531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.257319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.258102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lazy-loading 'fault' on Instance uuid fd41952f-9895-4231-a0fb-582dd387baca {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:42:57.434872 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ad3dedee-f3b4-47a0-9f3f-690359681630 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.992174 Nov 02 12:42:57.435803 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2197/4338] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Nov 2 12:42:56 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 994 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:42:57.444791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3f27e009-d049-4e91-971b-44bea371759f req-34476157-3f9e-40f7-a23c-00814fe65ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd41952f-9895-4231-a0fb-582dd387baca", "name": "network-vif-deleted", "tag": "4f6373c9-a8fb-4cc9-b1d2-28f4076ed99c"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:57.454889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3bd703da4ba4900a1ff905eaa8da916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc7d898a0450daa91d33cc0e26c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:57.455955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3f27e009-d049-4e91-971b-44bea371759f req-34476157-3f9e-40f7-a23c-00814fe65ef9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.456623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3f27e009-d049-4e91-971b-44bea371759f req-34476157-3f9e-40f7-a23c-00814fe65ef9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.457330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3f27e009-d049-4e91-971b-44bea371759f req-34476157-3f9e-40f7-a23c-00814fe65ef9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.465744 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18f2ac11-9e48-49be-86ee-7d8340070a2e tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 200 len: 1302 microversion: 2.1 time: 0.365424 Nov 02 12:42:57.468574 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2142/4339] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:57 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 1302 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:57.480467 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3f27e009-d049-4e91-971b-44bea371759f req-34476157-3f9e-40f7-a23c-00814fe65ef9 service nova] Creating event network-vif-deleted:4f6373c9-a8fb-4cc9-b1d2-28f4076ed99c for instance fd41952f-9895-4231-a0fb-582dd387baca on n-h1-855650-5 Nov 02 12:42:57.503769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:57.507834 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3f27e009-d049-4e91-971b-44bea371759f req-34476157-3f9e-40f7-a23c-00814fe65ef9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070577 Nov 02 12:42:57.508541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:57.512488 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2198/4340] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:57.521034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f7d9906-3376-4fbb-8249-244b39bc8721 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228e1cfee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:57.524470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.525362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.526241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.527425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.532485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.533776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.636824 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f7d9906-3376-4fbb-8249-244b39bc8721 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 200 len: 344 microversion: 2.1 time: 0.122599 Nov 02 12:42:57.637422 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2199/4341] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:42:57 2022] GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 344 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:57.643360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:57.644373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:57.652186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:57.654484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.655322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.655946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.656866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.657490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.658952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.270511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:58.286099 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a4034f2f-1449-48be-b304-c9787bc993b8 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1512 microversion: 2.1 time: 0.646369 Nov 02 12:42:58.286754 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2200/4342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:57 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1512 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:58.311477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:58.312539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:58.320330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.321160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.321822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.322854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.323522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.324211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.344529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:58.371580 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8d89c2f0-ffe2-438e-8f9a-ab9b37d346db tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1501 microversion: 2.1 time: 0.885854 Nov 02 12:42:58.390150 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2143/4343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:57 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1501 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:58.407610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb13f59a-1dec-41e4-85cf-355fec6c6605 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:58.421522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb13f59a-1dec-41e4-85cf-355fec6c6605 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.422055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb13f59a-1dec-41e4-85cf-355fec6c6605 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.423380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb13f59a-1dec-41e4-85cf-355fec6c6605 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.484768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb13f59a-1dec-41e4-85cf-355fec6c6605 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Going to try to stop instance {{(pid=120722) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:42:58.550613 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb13f59a-1dec-41e4-85cf-355fec6c6605 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2/action" status: 202 len: 0 microversion: 2.1 time: 0.150026 Nov 02 12:42:58.551753 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2144/4344] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:58 2022] POST /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:42:58.567370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:58.579978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:58.596904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.600487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.601239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.602291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.604912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.605810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.636648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] HTTP exception thrown: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Request method failure captured: Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca HTTP/1.1 Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmWgl_5mBcsGQMVFQEFpe8ZqQv-Tc5qUTTFThXYhi7wr1rQm4RkAlYhiDH8QnaKilpm4RdiPDFDWZlrlPc7hSBSXNlTFsBXnb4CSU4gsh2fkmAslGIG_CigGFTSM0Y4Mk1AsD9Nfkqm8SQehPtm7n-yyd80XRGq1wbZUsG-KEOaYrTo Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f3bd703da4ba4900a1ff905eaa8da916 Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'fd41952f-9895-4231-a0fb-582dd387baca'} Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:58.639741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:58.645616 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:58.645616 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:58.645616 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:58.645616 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:58.645616 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:58.645616 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:58.645616 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:58.646494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:58.648577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Returning 404 to user: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:58.649913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-651d1af8-626a-4b6c-9577-e0a6ebd2e5e7 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 404 len: 111 microversion: 2.1 time: 0.096501 Nov 02 12:42:58.651277 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2145/4345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:58 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:58.654910 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3bee3501-5870-49af-97c3-6c1d71df39bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1308 microversion: 2.1 time: 0.364634 Nov 02 12:42:58.656386 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2201/4346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:58 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:58.670122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:58.670122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:58.678226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.678226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.678226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.678226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.678957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.679511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.695476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc5beb48-e8f2-4219-b823-c6bf3c6581b4 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f2292a2e5e0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:58.854396 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dc5beb48-e8f2-4219-b823-c6bf3c6581b4 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 200 len: 344 microversion: 2.1 time: 0.180969 Nov 02 12:42:58.855501 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2202/4347] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:42:58 2022] GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 344 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:58.866424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52c1eb6d-4f4d-4051-b26b-ca2150d2a05d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:58.902067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.compute.server_groups [None req-52c1eb6d-4f4d-4051-b26b-ca2150d2a05d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Querying cell 65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) for 1 instances {{(pid=120723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:42:58.903069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52c1eb6d-4f4d-4051-b26b-ca2150d2a05d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.903784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52c1eb6d-4f4d-4051-b26b-ca2150d2a05d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.904445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52c1eb6d-4f4d-4051-b26b-ca2150d2a05d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.964957 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52c1eb6d-4f4d-4051-b26b-ca2150d2a05d tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.108118 Nov 02 12:42:58.981609 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2203/4348] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:42:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:58.987463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-62221c33-e0dd-4a23-823d-b64b59723d82 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.025995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.compute.server_groups [None req-62221c33-e0dd-4a23-823d-b64b59723d82 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Querying cell 65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) for 1 instances {{(pid=120723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:42:59.027535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62221c33-e0dd-4a23-823d-b64b59723d82 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.028032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62221c33-e0dd-4a23-823d-b64b59723d82 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.028611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62221c33-e0dd-4a23-823d-b64b59723d82 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.052836 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-62221c33-e0dd-4a23-823d-b64b59723d82 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/571df35b-8105-4622-b0c2-6138f708ce79" status: 200 len: 184 microversion: 2.1 time: 0.069916 Nov 02 12:42:59.053434 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2204/4349] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:42:58 2022] GET /compute/v2.1/os-server-groups/571df35b-8105-4622-b0c2-6138f708ce79 => generated 184 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:59.066622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.070793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:59.082790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.083557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.084157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.084958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.085536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.086095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.105205 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] HTTP exception thrown: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Request method failure captured: Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca HTTP/1.1 Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmWgl_5mBcsGQMVFQEFpe8ZqQv-Tc5qUTTFThXYhi7wr1rQm4RkAlYhiDH8QnaKilpm4RdiPDFDWZlrlPc7hSBSXNlTFsBXnb4CSU4gsh2fkmAslGIG_CigGFTSM0Y4Mk1AsD9Nfkqm8SQehPtm7n-yyd80XRGq1wbZUsG-KEOaYrTo Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f3bd703da4ba4900a1ff905eaa8da916 Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'fd41952f-9895-4231-a0fb-582dd387baca'} Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:59.109529 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Returning 404 to user: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:59.113162 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2fed7ba-1af3-4b41-9399-65b6d92905e5 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 404 len: 111 microversion: 2.1 time: 0.049905 Nov 02 12:42:59.113893 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2205/4350] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:59 2022] DELETE /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:42:59.129257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.130055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:59.130296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] [instance: fd41952f-9895-4231-a0fb-582dd387baca] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:59.142320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.143426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.144295 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eef793c9-80b1-4d67-80f9-e87742e1ebed tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.488336 Nov 02 12:42:59.148147 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2146/4351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:58 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:59.153867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.158061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.158685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.159392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.193316 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] HTTP exception thrown: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Request method failure captured: Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca HTTP/1.1 Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmWgl_5mBcsGQMVFQEFpe8ZqQv-Tc5qUTTFThXYhi7wr1rQm4RkAlYhiDH8QnaKilpm4RdiPDFDWZlrlPc7hSBSXNlTFsBXnb4CSU4gsh2fkmAslGIG_CigGFTSM0Y4Mk1AsD9Nfkqm8SQehPtm7n-yyd80XRGq1wbZUsG-KEOaYrTo Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f3bd703da4ba4900a1ff905eaa8da916 Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'fd41952f-9895-4231-a0fb-582dd387baca'} Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.196618 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Returning 404 to user: Instance fd41952f-9895-4231-a0fb-582dd387baca could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:59.200411 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8976585b-7eba-4d37-912b-437d120fe3e4 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca" status: 404 len: 111 microversion: 2.1 time: 0.078723 Nov 02 12:42:59.207569 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2206/4352] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:59 2022] GET /compute/v2.1/servers/fd41952f-9895-4231-a0fb-582dd387baca => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:59.219773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea215334-e93e-4c8b-ac5b-cf629fe8ee0f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.229525 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-ea215334-e93e-4c8b-ac5b-cf629fe8ee0f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] HTTP exception thrown: Instance group 24b14c33-00b2-4fec-8105-c367f0b6dea4 could not be found. Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea215334-e93e-4c8b-ac5b-cf629fe8ee0f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Request method failure captured: Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-server-groups/24b14c33-00b2-4fec-8105-c367f0b6dea4 HTTP/1.1 Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmWgl_5mBcsGQMVFQEFpe8ZqQv-Tc5qUTTFThXYhi7wr1rQm4RkAlYhiDH8QnaKilpm4RdiPDFDWZlrlPc7hSBSXNlTFsBXnb4CSU4gsh2fkmAslGIG_CigGFTSM0Y4Mk1AsD9Nfkqm8SQehPtm7n-yyd80XRGq1wbZUsG-KEOaYrTo Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f3bd703da4ba4900a1ff905eaa8da916 Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance group 24b14c33-00b2-4fec-8105-c367f0b6dea4 could not be found. Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '24b14c33-00b2-4fec-8105-c367f0b6dea4'} Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 24b14c33-00b2-4fec-8105-c367f0b6dea4 could not be found. Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 24b14c33-00b2-4fec-8105-c367f0b6dea4 could not be found. Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.232831 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.237034 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.237034 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.237034 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:59.237034 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:59.237034 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 24b14c33-00b2-4fec-8105-c367f0b6dea4 could not be found. Nov 02 12:42:59.237034 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.239422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea215334-e93e-4c8b-ac5b-cf629fe8ee0f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Returning 404 to user: Instance group 24b14c33-00b2-4fec-8105-c367f0b6dea4 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:59.240600 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea215334-e93e-4c8b-ac5b-cf629fe8ee0f tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/24b14c33-00b2-4fec-8105-c367f0b6dea4" status: 404 len: 117 microversion: 2.1 time: 0.029897 Nov 02 12:42:59.252018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-07729be3-e895-40ab-905a-d1b6b0a20537 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.257219 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2147/4353] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:59 2022] DELETE /compute/v2.1/os-server-groups/24b14c33-00b2-4fec-8105-c367f0b6dea4 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:42:59.260484 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-07729be3-e895-40ab-905a-d1b6b0a20537 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] HTTP exception thrown: Instance group 67e1d05c-4946-48fb-9b51-16cd355f488a could not be found. Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-07729be3-e895-40ab-905a-d1b6b0a20537 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Request method failure captured: Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-server-groups/67e1d05c-4946-48fb-9b51-16cd355f488a HTTP/1.1 Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmWgl_5mBcsGQMVFQEFpe8ZqQv-Tc5qUTTFThXYhi7wr1rQm4RkAlYhiDH8QnaKilpm4RdiPDFDWZlrlPc7hSBSXNlTFsBXnb4CSU4gsh2fkmAslGIG_CigGFTSM0Y4Mk1AsD9Nfkqm8SQehPtm7n-yyd80XRGq1wbZUsG-KEOaYrTo Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f3bd703da4ba4900a1ff905eaa8da916 Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance group 67e1d05c-4946-48fb-9b51-16cd355f488a could not be found. Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '67e1d05c-4946-48fb-9b51-16cd355f488a'} Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 67e1d05c-4946-48fb-9b51-16cd355f488a could not be found. Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 67e1d05c-4946-48fb-9b51-16cd355f488a could not be found. Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.262530 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.266647 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.266647 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.266647 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:59.266647 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:59.266647 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 67e1d05c-4946-48fb-9b51-16cd355f488a could not be found. Nov 02 12:42:59.266647 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.269232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-07729be3-e895-40ab-905a-d1b6b0a20537 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Returning 404 to user: Instance group 67e1d05c-4946-48fb-9b51-16cd355f488a could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:59.270519 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-07729be3-e895-40ab-905a-d1b6b0a20537 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/67e1d05c-4946-48fb-9b51-16cd355f488a" status: 404 len: 117 microversion: 2.1 time: 0.024222 Nov 02 12:42:59.271620 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2207/4354] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:59 2022] DELETE /compute/v2.1/os-server-groups/67e1d05c-4946-48fb-9b51-16cd355f488a => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:59.282799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08b2d7b0-9be8-40cf-bee3-37d6e4407c89 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.290920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-08b2d7b0-9be8-40cf-bee3-37d6e4407c89 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] HTTP exception thrown: Instance group 9e5e51db-7329-43e2-9e4a-ea179e554673 could not be found. Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08b2d7b0-9be8-40cf-bee3-37d6e4407c89 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Request method failure captured: Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-server-groups/9e5e51db-7329-43e2-9e4a-ea179e554673 HTTP/1.1 Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmWgl_5mBcsGQMVFQEFpe8ZqQv-Tc5qUTTFThXYhi7wr1rQm4RkAlYhiDH8QnaKilpm4RdiPDFDWZlrlPc7hSBSXNlTFsBXnb4CSU4gsh2fkmAslGIG_CigGFTSM0Y4Mk1AsD9Nfkqm8SQehPtm7n-yyd80XRGq1wbZUsG-KEOaYrTo Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f3bd703da4ba4900a1ff905eaa8da916 Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance group 9e5e51db-7329-43e2-9e4a-ea179e554673 could not be found. Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9e5e51db-7329-43e2-9e4a-ea179e554673'} Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9e5e51db-7329-43e2-9e4a-ea179e554673 could not be found. Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9e5e51db-7329-43e2-9e4a-ea179e554673 could not be found. Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.292897 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.296684 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.296684 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.296684 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:59.296684 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:59.296684 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9e5e51db-7329-43e2-9e4a-ea179e554673 could not be found. Nov 02 12:42:59.296684 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.297012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08b2d7b0-9be8-40cf-bee3-37d6e4407c89 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Returning 404 to user: Instance group 9e5e51db-7329-43e2-9e4a-ea179e554673 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:59.298708 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08b2d7b0-9be8-40cf-bee3-37d6e4407c89 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/9e5e51db-7329-43e2-9e4a-ea179e554673" status: 404 len: 117 microversion: 2.1 time: 0.021880 Nov 02 12:42:59.302028 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2148/4355] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:59 2022] DELETE /compute/v2.1/os-server-groups/9e5e51db-7329-43e2-9e4a-ea179e554673 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:59.311106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41fabbca-0f33-4223-be56-fcf383d2c645 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.321193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.325995 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-41fabbca-0f33-4223-be56-fcf383d2c645 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] HTTP exception thrown: Instance group 1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee could not be found. Nov 02 12:42:59.326881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41fabbca-0f33-4223-be56-fcf383d2c645 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Request method failure captured: Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/os-server-groups/1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee HTTP/1.1 Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmWgl_5mBcsGQMVFQEFpe8ZqQv-Tc5qUTTFThXYhi7wr1rQm4RkAlYhiDH8QnaKilpm4RdiPDFDWZlrlPc7hSBSXNlTFsBXnb4CSU4gsh2fkmAslGIG_CigGFTSM0Y4Mk1AsD9Nfkqm8SQehPtm7n-yyd80XRGq1wbZUsG-KEOaYrTo Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_976fc7d898a0450daa91d33cc0e26c6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 976fc7d898a0450daa91d33cc0e26c6f Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerGroupTestJSON-1034645120 Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f3bd703da4ba4900a1ff905eaa8da916 Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerGroupTestJSON-1034645120-project Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance group 1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee could not be found. Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee'} Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee could not be found. Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee could not be found. Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.332227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:59.335754 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:59.335754 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:59.335754 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:59.335754 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:59.335754 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee could not be found. Nov 02 12:42:59.335754 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:42:59.343786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41fabbca-0f33-4223-be56-fcf383d2c645 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Returning 404 to user: Instance group 1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:59.343786 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41fabbca-0f33-4223-be56-fcf383d2c645 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee" status: 404 len: 117 microversion: 2.1 time: 0.035364 Nov 02 12:42:59.343786 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2208/4356] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:59 2022] DELETE /compute/v2.1/os-server-groups/1ad1ecd7-fc8b-41e9-a6a0-2c2ab9b43aee => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:59.352538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dad0c889-39bb-4ce7-9ba8-ffb34d918ef2 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.354806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.355955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.356627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.357630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.358446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.358972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.412079 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dad0c889-39bb-4ce7-9ba8-ffb34d918ef2 tempest-ServerGroupTestJSON-1034645120 tempest-ServerGroupTestJSON-1034645120-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/571df35b-8105-4622-b0c2-6138f708ce79" status: 204 len: 0 microversion: 2.1 time: 0.063643 Nov 02 12:42:59.416646 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2209/4357] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 12:42:59 2022] DELETE /compute/v2.1/os-server-groups/571df35b-8105-4622-b0c2-6138f708ce79 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:59.685831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.687386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:59.701682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.703099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.703776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.705138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.706052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.706749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:00.096757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:00.110003 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-081e4a3f-ea87-4ee2-bba4-47d76aaaa57b tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1489 microversion: 2.1 time: 0.428283 Nov 02 12:43:00.111875 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2210/4358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:59 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1489 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:00.117435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-175cdfab-0310-4a02-b896-7218fdb4bf6c tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228f1f2af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:00.146863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:00.176296 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4b81ce74-ac88-4392-9856-98dd14e5d49b tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1512 microversion: 2.1 time: 0.858171 Nov 02 12:43:00.187650 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-175cdfab-0310-4a02-b896-7218fdb4bf6c tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 200 len: 345 microversion: 2.1 time: 0.072700 Nov 02 12:43:00.198538 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2211/4360] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:00 2022] GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:00.199823 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2149/4360] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:59 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1512 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:00.211556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1898974680"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:00.212678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:00.213873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:00.217658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:00.229803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:00.232020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:00.233182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:00.234595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:00.235405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:00.235886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:00.236044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:00.236751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:00.236895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:00.241506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:00.242237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:00.244092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:00.479884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:00.500371 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3ac8550-fbd7-4e5f-8d81-21dcc741bdb2 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.298226 Nov 02 12:43:00.517561 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2150/4361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:00 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:00.525327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-73e1c927-257e-48cf-b8e4-2fa78f17e346 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Action: 'create', calling method: .version_select at 0x7f228e540f70>, body: {"snapshot": {"volume_id": "7cc4b7fd-80d4-41cd-9983-b165a811ce8a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-348650609"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:00.545128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:00.650278 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ad0696ce-e26b-427a-8b6b-2ea6ae59d07c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "POST /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c/action" status: 202 len: 0 microversion: 2.1 time: 0.449324 Nov 02 12:43:00.660616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2212/4362] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:43:00 2022] POST /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:43:00.672891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-42f7debd-91d5-4b7b-b03b-778c81d78867 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228dc3d160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:00.771482 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-42f7debd-91d5-4b7b-b03b-778c81d78867 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07" status: 200 len: 1414 microversion: 2.1 time: 0.108582 Nov 02 12:43:00.783781 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2213/4363] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:00 2022] GET /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:00.809846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c323970b-994a-4818-aa81-285305c9a9df tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292a08dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:00.933720 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c323970b-994a-4818-aa81-285305c9a9df tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07" status: 200 len: 1414 microversion: 2.1 time: 0.148271 Nov 02 12:43:00.954607 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2214/4364] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:00 2022] GET /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07 => generated 1414 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:00.973047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0718b6f-7c04-4b77-b82e-3dd0c3e43749 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e1709d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.010142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-73e1c927-257e-48cf-b8e4-2fa78f17e346 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.491380 Nov 02 12:43:01.014073 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2151/4365] 10.222.0.45 () {60 vars in 1162 bytes} [Wed Nov 2 12:43:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:01.025761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a40cdf8e-1619-4c7c-924b-67c1ee48a34a tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228e7a1e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.232000 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a40cdf8e-1619-4c7c-924b-67c1ee48a34a tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 200 len: 286 microversion: 2.1 time: 0.210654 Nov 02 12:43:01.232624 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2152/4366] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:01 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:01.239454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.239454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:01.259775 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0718b6f-7c04-4b77-b82e-3dd0c3e43749 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07" status: 204 len: 0 microversion: 2.1 time: 0.293968 Nov 02 12:43:01.260388 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2215/4367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:00 2022] DELETE /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:43:01.266704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-141faed7-5630-48d1-b7f4-1451b12d9cde tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f22929ee700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.270560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:01.271080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:01.274456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:01.278671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:01.279301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:01.280258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:01.372742 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-141faed7-5630-48d1-b7f4-1451b12d9cde tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.111232 Nov 02 12:43:01.373739 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2216/4368] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Nov 2 12:43:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:01.379751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01a4262a-b95e-48a7-a74a-0d0c21d1533d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f2292a58160>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.419312 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-01a4262a-b95e-48a7-a74a-0d0c21d1533d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Image not found. Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01a4262a-b95e-48a7-a74a-0d0c21d1533d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07 HTTP/1.1 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'cd1d17f4-b825-4123-ba88-8f7f0e242f07'} Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cd1d17f4-b825-4123-ba88-8f7f0e242f07 Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:43:01.421808 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd1d17f4-b825-4123-ba88-8f7f0e242f07 could not be found. Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01a4262a-b95e-48a7-a74a-0d0c21d1533d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-01a4262a-b95e-48a7-a74a-0d0c21d1533d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07" status: 404 len: 62 microversion: 2.1 time: 0.048537 Nov 02 12:43:01.426037 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2217/4369] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:01 2022] GET /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:01.433844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a62f550f-1e3d-4b1d-b5fd-36333eceb62b tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228e290c10>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.509188 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a62f550f-1e3d-4b1d-b5fd-36333eceb62b tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 200 len: 286 microversion: 2.1 time: 0.083633 Nov 02 12:43:01.511386 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2218/4370] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:01 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:01.518934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.522943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:01.579171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:01.580169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:01.580792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:01.582295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:01.582937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:01.583815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:01.617737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c8ba78504f419a85c9349c94ad51e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeecc4b6cf54d3e895ce20209650799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:01.631241 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ff0808d-0eba-477b-93cf-8949fd1fd062 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 200 len: 1470 microversion: 2.1 time: 0.397117 Nov 02 12:43:01.631846 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2153/4371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:01 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:01.636521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-78d45e08-1556-439e-82ae-a194b6a3112d req-fded85c8-64ec-4c3d-ad08-33a5404368a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7673a5b-d1fc-4a1c-93b6-8044da813c37", "name": "network-vif-deleted", "tag": "abdb98f4-9451-4702-a7a1-b32ab40cd0c0"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:01.697668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-78d45e08-1556-439e-82ae-a194b6a3112d req-fded85c8-64ec-4c3d-ad08-33a5404368a8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:01.700705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-78d45e08-1556-439e-82ae-a194b6a3112d req-fded85c8-64ec-4c3d-ad08-33a5404368a8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:01.703022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-78d45e08-1556-439e-82ae-a194b6a3112d req-fded85c8-64ec-4c3d-ad08-33a5404368a8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:01.740342 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-78d45e08-1556-439e-82ae-a194b6a3112d req-fded85c8-64ec-4c3d-ad08-33a5404368a8 service nova] Creating event network-vif-deleted:abdb98f4-9451-4702-a7a1-b32ab40cd0c0 for instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 on n-h2-855650-5 Nov 02 12:43:01.749415 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-78d45e08-1556-439e-82ae-a194b6a3112d req-fded85c8-64ec-4c3d-ad08-33a5404368a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115203 Nov 02 12:43:01.751991 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2154/4372] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:01.762258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.763362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:01.773213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:01.799405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:01.800460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:01.805459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:01.808166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:01.809863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:02.124816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:02.138664 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4dacca99-2379-4b47-bf35-bf131353a654 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1501 microversion: 2.1 time: 0.625625 Nov 02 12:43:02.146764 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2219/4373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:01 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1501 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:02.329656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:02.369647 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0acb64e-0c73-455b-9137-025cea9033a8 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.610011 Nov 02 12:43:02.394289 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2155/4374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:01 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:02.528780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4845d2e4-caf6-4988-a28a-4ab9aa042171 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f22929bcc10>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:02.604198 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4845d2e4-caf6-4988-a28a-4ab9aa042171 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 200 len: 286 microversion: 2.1 time: 0.082909 Nov 02 12:43:02.610973 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2220/4375] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:02 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:02.664409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:02.665206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] [instance: d7673a5b-d1fc-4a1c-93b6-8044da813c37] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:02.674424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:02.685252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:02.686189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:02.690735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:02.694387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:02.695470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:02.750096 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] HTTP exception thrown: Instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 could not be found. Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Request method failure captured: Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 HTTP/1.1 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmWni6adoPS1iYa_APS2LHZxyhXO8NpGGPcCX8barH6lD9j7Oo8eQLyV5stRHzDoVou7HQOQI56aAqdMk4QNLwpe9Eg6kTW3eVSWQJ6FMvk-ol1lYDpTl-PXFRU0rnqG_sCMpvV-7xZKEp4JwYtcFnlB_GTA-5wdXvulXwfWhE0M7P4 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 2aeecc4b6cf54d3e895ce20209650799 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-InstanceActionsTestJSON-1008008268 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2aeecc4b6cf54d3e895ce20209650799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2aeecc4b6cf54d3e895ce20209650799"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2aeecc4b6cf54d3e895ce20209650799"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2aeecc4b6cf54d3e895ce20209650799"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-InstanceActionsTestJSON-1008008268 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 2aeecc4b6cf54d3e895ce20209650799 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1008008268 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-InstanceActionsTestJSON-1008008268-project Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 98c8ba78504f419a85c9349c94ad51e4 Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-InstanceActionsTestJSON-1008008268-project Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 could not be found. Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'd7673a5b-d1fc-4a1c-93b6-8044da813c37'} Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 could not be found. Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 could not be found. Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:02.755643 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:02.759917 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:02.759917 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:02.759917 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:02.759917 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:02.759917 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:02.759917 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 could not be found. Nov 02 12:43:02.759917 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:02.774909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] Returning 404 to user: Instance d7673a5b-d1fc-4a1c-93b6-8044da813c37 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:02.775802 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4203630-61a3-4dfa-977d-993069f22237 tempest-InstanceActionsTestJSON-1008008268 tempest-InstanceActionsTestJSON-1008008268-project] 10.222.0.45 "GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37" status: 404 len: 111 microversion: 2.1 time: 0.115391 Nov 02 12:43:02.776392 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2156/4376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:02 2022] GET /compute/v2.1/servers/d7673a5b-d1fc-4a1c-93b6-8044da813c37 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:03.177139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:03.177996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:03.202889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:03.203655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:03.204169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:03.205598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:03.206312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:03.207179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:03.620740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:03.652179 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d187773-5da7-479b-aaf9-7ebbe46bae00 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1507 microversion: 2.1 time: 0.479583 Nov 02 12:43:03.677571 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2221/4377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:03 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1507 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:03.683792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bfb4ef4e-3748-4207-90cc-393bfa95eb9b tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f2292a588b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:03.723608 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bfb4ef4e-3748-4207-90cc-393bfa95eb9b tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 200 len: 286 microversion: 2.1 time: 0.044683 Nov 02 12:43:03.724466 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2222/4378] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:03 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:03.852111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:03.853503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:03.864832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:03.867063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:03.868195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:03.869367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:03.870228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:03.870943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:04.092659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:04.101655 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15389fc1-bd2c-4cb9-9b72-71f27e5f5aa0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.704246 Nov 02 12:43:04.102763 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2157/4379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:03 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:04.690036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:04.690700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:04.704244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:04.707627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:04.708317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:04.709256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:04.709732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:04.710223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:04.737089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-136e3951-1282-4b88-963a-5c03fe384a67 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228e6c1430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:04.805162 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-136e3951-1282-4b88-963a-5c03fe384a67 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 200 len: 287 microversion: 2.1 time: 0.072208 Nov 02 12:43:04.805893 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2158/4380] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:04 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:04.818093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-50ae5e55-d41f-45ed-9998-2b9a19e2eeae tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228e6c5d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:04.943862 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-50ae5e55-d41f-45ed-9998-2b9a19e2eeae tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 202 len: 0 microversion: 2.1 time: 0.129348 Nov 02 12:43:04.947306 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2159/4381] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Nov 2 12:43:04 2022] DELETE /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:43:04.953464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dfa29c7b-1446-40fb-9138-283a2d7df0a5 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f2292acae50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:05.018099 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dfa29c7b-1446-40fb-9138-283a2d7df0a5 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 200 len: 286 microversion: 2.1 time: 0.069232 Nov 02 12:43:05.018702 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2160/4382] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:04 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:05.135932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:05.137283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:05.163385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:05.165444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:05.166826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:05.171847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:05.172605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:05.178383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:05.240709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:05.254163 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e21b3654-4be7-4952-be80-6bf00f702683 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1507 microversion: 2.1 time: 0.566412 Nov 02 12:43:05.257256 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2223/4383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:04 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:05.650692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:05.669436 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-654e0784-4e22-4c62-a5a2-8a102c45c0bc tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.547367 Nov 02 12:43:05.675158 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2161/4384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:05 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:06.036329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f9ae80b0-37d5-4f3e-8f8a-e1468a9ee15f tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228ea681f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:06.120159 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f9ae80b0-37d5-4f3e-8f8a-e1468a9ee15f tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 200 len: 286 microversion: 2.1 time: 0.092427 Nov 02 12:43:06.121668 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2224/4385] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:06 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:06.314827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:06.315682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:06.330775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:06.331464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:06.335268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:06.337701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:06.340583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:06.341210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:06.572671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1296362694", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": "none"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:06.646111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:06.664068 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-83d23174-9d71-4d3f-af95-16284e1349fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1507 microversion: 2.1 time: 0.354017 Nov 02 12:43:06.692250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:06.692982 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2225/4386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:06 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:06.693117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:06.693690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:06.694464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:06.694982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:06.705379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:06.707156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:06.722925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:06.740958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:06.745641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:06.746639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:06.747448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:06.747980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:06.748678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:06.749509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:06.750429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:06.754992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:06.757230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:06.763093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:06.772426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:06.806254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Getting quotas for project 6dd1a3f1c8b847a88e9d7643a2f91002. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:06.822981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Getting quotas for user df50a0f04ea344a6bcd353447b1a9a8b and project 6dd1a3f1c8b847a88e9d7643a2f91002. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:06.865671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:43:06.869560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:43:07.008436 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f79ab5f8-8d5b-4a42-b71d-4f44ea536d23 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.747699 Nov 02 12:43:07.012419 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2162/4387] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:43:07.030763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fda82fae-1a61-4c3f-80f4-1503a3394884 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:07.031671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fda82fae-1a61-4c3f-80f4-1503a3394884 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:07.183334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:07.228948 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b7ec8abc-d95b-4c32-96f9-c9ca7923517a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.525343 Nov 02 12:43:07.229825 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2226/4388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:06 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:07.241265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d0ac14f-b003-4788-9932-9731a31c01d0 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228dc28940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:07.286992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fda82fae-1a61-4c3f-80f4-1503a3394884 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:07.307358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fda82fae-1a61-4c3f-80f4-1503a3394884 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:07.313086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fda82fae-1a61-4c3f-80f4-1503a3394884 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:07.319949 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fda82fae-1a61-4c3f-80f4-1503a3394884 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1278 microversion: 2.54 time: 0.299288 Nov 02 12:43:07.334074 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2163/4389] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:07 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1278 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:07.355641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3f2dcda9-bf20-4f6f-96b4-6715d8615fe6 req-d76460e6-f49e-4a81-9e88-092ac0f75075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d048db-1aa0-49d7-a2c1-ecbcfac7e36c", "name": "network-vif-plugged", "status": "completed", "tag": "568dfa43-bfea-4535-bafb-580643eb5f97"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:07.359706 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d0ac14f-b003-4788-9932-9731a31c01d0 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 200 len: 286 microversion: 2.1 time: 0.128989 Nov 02 12:43:07.360791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2227/4390] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:07 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:07.393000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3f2dcda9-bf20-4f6f-96b4-6715d8615fe6 req-d76460e6-f49e-4a81-9e88-092ac0f75075 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.397477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3f2dcda9-bf20-4f6f-96b4-6715d8615fe6 req-d76460e6-f49e-4a81-9e88-092ac0f75075 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.398174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3f2dcda9-bf20-4f6f-96b4-6715d8615fe6 req-d76460e6-f49e-4a81-9e88-092ac0f75075 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.434040 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3f2dcda9-bf20-4f6f-96b4-6715d8615fe6 req-d76460e6-f49e-4a81-9e88-092ac0f75075 service nova] Creating event network-vif-plugged:568dfa43-bfea-4535-bafb-580643eb5f97 for instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c on n-h2-855650-5 Nov 02 12:43:07.453339 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3f2dcda9-bf20-4f6f-96b4-6715d8615fe6 req-d76460e6-f49e-4a81-9e88-092ac0f75075 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117064 Nov 02 12:43:07.458492 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2164/4391] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:07.698977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:07.700220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:07.720897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.727903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.732344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.748354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.763387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.764111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:08.269135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:08.271171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:08.287046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:08.289121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:08.291256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:08.299575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:08.300573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:08.301807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:09.107402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:09.121355 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-abc97e46-cded-4fcd-9bef-6ef5b0bad907 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1507 microversion: 2.1 time: 1.429976 Nov 02 12:43:09.138412 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2228/4392] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:07 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1507 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:09.144949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:09.145864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:09.153413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:09.154356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:09.155544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:09.156674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:09.157333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:09.158055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:09.233984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:09.250171 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8627ca33-b4f4-41e8-a2cd-04ea5a01cf4a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.986593 Nov 02 12:43:09.252364 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2165/4393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:08 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:09.260787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4563dc0f-838f-40c8-9828-6ef898111a28 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228ee5ed30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:09.303349 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-4563dc0f-838f-40c8-9828-6ef898111a28 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] HTTP exception thrown: Snapshot 62603458-1b14-4168-833f-4ab259a58ceb could not be found. Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4563dc0f-838f-40c8-9828-6ef898111a28 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Request method failure captured: Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb HTTP/1.1 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmXQDVyekV5SFBnuJ0q-pYRro9Kv-LPNz5rWIdHX-wl1cigD3RiViC8m47pfcBYb7-Q1tAC_iCxORvv3uS7Bvdna63466_xvAYvahXZE0oMcNsULC-hl3WeVN-gRcG0DATZ5WuQ4brtswLjXs6RbdYw_HPqZnx_iLfch_cD_v6mPJVQ Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0089ed396bba4358a2263a453ba7ba75 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0089ed396bba4358a2263a453ba7ba75 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotsTestJSON-24008700-project Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5811b2180bce4410ae7dfba8a36b5ccd Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-24008700-project Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: exception: Snapshot 62603458-1b14-4168-833f-4ab259a58ceb could not be found. Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '62603458-1b14-4168-833f-4ab259a58ceb'} Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 62603458-1b14-4168-833f-4ab259a58ceb could not be found. (HTTP 404) (Request-ID: req-c54a1332-ed83-4853-af5e-cb47d67510a3) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:43:09.315465 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 62603458-1b14-4168-833f-4ab259a58ceb could not be found. Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 62603458-1b14-4168-833f-4ab259a58ceb could not be found. Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 62603458-1b14-4168-833f-4ab259a58ceb could not be found. Nov 02 12:43:09.320679 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:09.326509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4563dc0f-838f-40c8-9828-6ef898111a28 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Returning 404 to user: Snapshot 62603458-1b14-4168-833f-4ab259a58ceb could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:09.330987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:09.344246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4563dc0f-838f-40c8-9828-6ef898111a28 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb" status: 404 len: 111 microversion: 2.1 time: 0.071212 Nov 02 12:43:09.345955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:09.351270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:09.354318 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3d05808-6f1e-4e0f-a8ce-52c166044ee6 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1330 microversion: 2.54 time: 0.214150 Nov 02 12:43:09.358104 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2166/4394] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Nov 2 12:43:09 2022] GET /compute/v2.1/os-snapshots/62603458-1b14-4168-833f-4ab259a58ceb => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:09.368452 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2229/4395] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:09 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1330 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:09.368904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5415be23-6431-46bb-a251-613cf4a9c4d7 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228e540e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:09.482351 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5415be23-6431-46bb-a251-613cf4a9c4d7 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 202 len: 0 microversion: 2.1 time: 0.118615 Nov 02 12:43:09.483195 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2167/4396] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:43:09 2022] DELETE /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:43:09.491642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20748ee6-09f0-4e03-b38d-6ce25a65be6c tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f2292a58ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:09.581598 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20748ee6-09f0-4e03-b38d-6ce25a65be6c tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 200 len: 344 microversion: 2.1 time: 0.093794 Nov 02 12:43:09.582574 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2230/4397] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:09 2022] GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:10.155410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:10.156831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:10.187388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.188966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.190973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.193450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.197845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.199382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.288929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:10.290687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:10.307120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.308275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.308972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.310951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.312142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.312734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.946016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:10.958655 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f633e4fd-e846-403e-a9d2-f9225ab61fd5 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1489 microversion: 2.1 time: 0.811043 Nov 02 12:43:10.984482 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2168/4398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:10 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1489 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:10.994118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:10.994762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:11.009517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:11.011432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.016015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.016486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.019164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.020954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.022909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.132548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:11.143445 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b1f1b649-251c-40ac-b31b-9055833abe1c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.862348 Nov 02 12:43:11.154403 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2231/4399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:10 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:11.162868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-54768322-3afa-4828-8fbf-af043d8d577d tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228eac8ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:11.252160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:11.258917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-54768322-3afa-4828-8fbf-af043d8d577d tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 200 len: 344 microversion: 2.1 time: 0.101560 Nov 02 12:43:11.260708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2232/4400] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:11 2022] GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:11.276706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:11.279629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:11.280073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:11.280903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:11.282398 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-932d0ccd-cc0a-479c-9df2-7d7bdbaeaa1a tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1336 microversion: 2.54 time: 0.296034 Nov 02 12:43:11.303734 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2169/4401] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:10 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1336 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:11.316359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.317236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.317789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.318588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.319161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.319741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.367868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:11.595589 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-513c6d39-b0a4-4241-b893-7b94eaf297ed tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 204 len: 0 microversion: 2.1 time: 0.325654 Nov 02 12:43:11.600087 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2233/4402] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:11 2022] DELETE /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:11.613153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eba3d06f-55cd-4e41-929a-f2f66890505d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228da879d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:11.664556 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-eba3d06f-55cd-4e41-929a-f2f66890505d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Image not found. Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eba3d06f-55cd-4e41-929a-f2f66890505d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07 HTTP/1.1 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'cd1d17f4-b825-4123-ba88-8f7f0e242f07'} Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd1d17f4-b825-4123-ba88-8f7f0e242f07 to delete Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd1d17f4-b825-4123-ba88-8f7f0e242f07 could not be found. Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:11.666612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eba3d06f-55cd-4e41-929a-f2f66890505d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eba3d06f-55cd-4e41-929a-f2f66890505d tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07" status: 404 len: 62 microversion: 2.1 time: 0.060670 Nov 02 12:43:11.673519 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2170/4403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:11 2022] DELETE /compute/v2.1/images/cd1d17f4-b825-4123-ba88-8f7f0e242f07 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:11.679778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:11.680398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:11.697487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.697901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.700929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.705150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.705845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.708753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.791028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:11.926107 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.compute.api [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Instance is already in deleting state, ignoring this request Nov 02 12:43:11.927374 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c4dbaa15-b01c-44ed-8ca6-8fd9d852dcc1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 204 len: 0 microversion: 2.1 time: 0.252321 Nov 02 12:43:11.932043 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2234/4404] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:11 2022] DELETE /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:43:11.941560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:11.942329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:11.953331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.954101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.957823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.959058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.960985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.961701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:12.205375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:12.206501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:12.221514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:12.224646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:12.228618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:12.229647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:12.233463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:12.234307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:12.534775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:12.544268 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d15c5c51-f455-4a02-b3fd-6538901ab092 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1495 microversion: 2.1 time: 0.607930 Nov 02 12:43:12.546354 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2171/4405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:11 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1495 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:12.551444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de232dbb-9176-473e-99b5-7d2e73bb7923 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228e4d2430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:12.695392 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de232dbb-9176-473e-99b5-7d2e73bb7923 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 200 len: 344 microversion: 2.1 time: 0.147722 Nov 02 12:43:12.696029 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2172/4406] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:12 2022] GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:12.701057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:12.701944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:12.726495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:12.729738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:12.730464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:12.731429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:12.731930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:12.732349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:12.811118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:12.836937 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78148e07-e66a-4745-9f2e-39f85798449f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.668628 Nov 02 12:43:12.841707 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2235/4407] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:12 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:12.848822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3c4206ea-51a2-43b5-8f89-a2ac57831e3c req-7be55a3b-85a3-4dce-80d1-5c51a2d5c297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d048db-1aa0-49d7-a2c1-ecbcfac7e36c", "name": "network-vif-unplugged", "status": "completed", "tag": "568dfa43-bfea-4535-bafb-580643eb5f97"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:12.866280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3c4206ea-51a2-43b5-8f89-a2ac57831e3c req-7be55a3b-85a3-4dce-80d1-5c51a2d5c297 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:12.867102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3c4206ea-51a2-43b5-8f89-a2ac57831e3c req-7be55a3b-85a3-4dce-80d1-5c51a2d5c297 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:12.867940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3c4206ea-51a2-43b5-8f89-a2ac57831e3c req-7be55a3b-85a3-4dce-80d1-5c51a2d5c297 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:12.963756 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3c4206ea-51a2-43b5-8f89-a2ac57831e3c req-7be55a3b-85a3-4dce-80d1-5c51a2d5c297 service nova] Creating event network-vif-unplugged:568dfa43-bfea-4535-bafb-580643eb5f97 for instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c on n-h2-855650-5 Nov 02 12:43:12.982387 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3c4206ea-51a2-43b5-8f89-a2ac57831e3c req-7be55a3b-85a3-4dce-80d1-5c51a2d5c297 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136226 Nov 02 12:43:12.989678 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2236/4408] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:13.026352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:13.041283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:13.047367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:13.050945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ff9567e-08f2-43d7-9c7c-b88138707f54 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1336 microversion: 2.54 time: 0.353425 Nov 02 12:43:13.053670 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2173/4409] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:12 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1336 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:13.577153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:13.578710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:13.588254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:13.589250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:13.590137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:13.591676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:13.592906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:13.593869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:13.712198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8aad7fad-0b93-4330-b3e2-86cd8734b901 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228e5248b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:13.800603 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8aad7fad-0b93-4330-b3e2-86cd8734b901 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] HTTP exception thrown: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8aad7fad-0b93-4330-b3e2-86cd8734b901 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Request method failure captured: Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a HTTP/1.1 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmXQDVyekV5SFBnuJ0q-pYRro9Kv-LPNz5rWIdHX-wl1cigD3RiViC8m47pfcBYb7-Q1tAC_iCxORvv3uS7Bvdna63466_xvAYvahXZE0oMcNsULC-hl3WeVN-gRcG0DATZ5WuQ4brtswLjXs6RbdYw_HPqZnx_iLfch_cD_v6mPJVQ Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0089ed396bba4358a2263a453ba7ba75 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0089ed396bba4358a2263a453ba7ba75 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotsTestJSON-24008700-project Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5811b2180bce4410ae7dfba8a36b5ccd Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-24008700-project Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: exception: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '7cc4b7fd-80d4-41cd-9983-b165a811ce8a'} Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. (HTTP 404) (Request-ID: req-c0b783bd-7642-4abd-bc6f-0b1547c5c377) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:43:13.802908 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.808041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.815107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8aad7fad-0b93-4330-b3e2-86cd8734b901 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Returning 404 to user: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:13.816442 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8aad7fad-0b93-4330-b3e2-86cd8734b901 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 404 len: 109 microversion: 2.1 time: 0.108755 Nov 02 12:43:13.818279 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2174/4410] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:13 2022] GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:13.831498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a569fd88-c1e8-47e6-b3b1-60ebc2318aaa tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f228ec7b700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:13.907529 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a569fd88-c1e8-47e6-b3b1-60ebc2318aaa tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] HTTP exception thrown: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a569fd88-c1e8-47e6-b3b1-60ebc2318aaa tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Request method failure captured: Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a HTTP/1.1 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmXQDVyekV5SFBnuJ0q-pYRro9Kv-LPNz5rWIdHX-wl1cigD3RiViC8m47pfcBYb7-Q1tAC_iCxORvv3uS7Bvdna63466_xvAYvahXZE0oMcNsULC-hl3WeVN-gRcG0DATZ5WuQ4brtswLjXs6RbdYw_HPqZnx_iLfch_cD_v6mPJVQ Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0089ed396bba4358a2263a453ba7ba75 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0089ed396bba4358a2263a453ba7ba75 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotsTestJSON-24008700-project Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5811b2180bce4410ae7dfba8a36b5ccd Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-24008700-project Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: exception: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '7cc4b7fd-80d4-41cd-9983-b165a811ce8a'} Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. (HTTP 404) (Request-ID: req-eaf78fad-8234-4155-9c87-d0647249bc97) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:43:13.910142 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:13.913774 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:13.923062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a569fd88-c1e8-47e6-b3b1-60ebc2318aaa tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Returning 404 to user: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:13.924271 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a569fd88-c1e8-47e6-b3b1-60ebc2318aaa tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 404 len: 109 microversion: 2.1 time: 0.100596 Nov 02 12:43:13.925462 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2175/4411] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:43:13 2022] DELETE /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:43:13.932634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:13.933773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:13.934263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:13.944903 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b6aebbfa-6fff-41ae-9151-03e26b0baa73 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1495 microversion: 2.1 time: 0.372149 Nov 02 12:43:13.951449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:13.953185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:13.953783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:13.954759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:13.955428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:13.956130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:13.970251 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2237/4412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:13 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1495 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:13.985068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30e177c7-b456-4fac-b758-e6a228718ce4 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Calling method '.version_select at 0x7f2292a5b9d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:14.071770 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-30e177c7-b456-4fac-b758-e6a228718ce4 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] HTTP exception thrown: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30e177c7-b456-4fac-b758-e6a228718ce4 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Request method failure captured: Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a HTTP/1.1 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmXQDVyekV5SFBnuJ0q-pYRro9Kv-LPNz5rWIdHX-wl1cigD3RiViC8m47pfcBYb7-Q1tAC_iCxORvv3uS7Bvdna63466_xvAYvahXZE0oMcNsULC-hl3WeVN-gRcG0DATZ5WuQ4brtswLjXs6RbdYw_HPqZnx_iLfch_cD_v6mPJVQ Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 0089ed396bba4358a2263a453ba7ba75 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0089ed396bba4358a2263a453ba7ba75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 0089ed396bba4358a2263a453ba7ba75 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-24008700 Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-VolumesSnapshotsTestJSON-24008700-project Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5811b2180bce4410ae7dfba8a36b5ccd Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-24008700-project Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: exception: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7cc4b7fd-80d4-41cd-9983-b165a811ce8a'} Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. (HTTP 404) (Request-ID: req-507074c6-f098-4f10-9fd6-dfab65a5dd4f) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:43:14.077170 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. Nov 02 12:43:14.080917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:14.090320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30e177c7-b456-4fac-b758-e6a228718ce4 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] Returning 404 to user: Volume 7cc4b7fd-80d4-41cd-9983-b165a811ce8a could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:14.091267 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30e177c7-b456-4fac-b758-e6a228718ce4 tempest-VolumesSnapshotsTestJSON-24008700 tempest-VolumesSnapshotsTestJSON-24008700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a" status: 404 len: 109 microversion: 2.1 time: 0.119761 Nov 02 12:43:14.097859 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2238/4413] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:13 2022] GET /compute/v2.1/os-volumes/7cc4b7fd-80d4-41cd-9983-b165a811ce8a => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:14.105194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:14.105194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:14.121443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:14.124675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:14.125016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:14.125767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:14.128532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:14.130592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:14.146291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:14.231132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:14.261929 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c85f7684-8ca7-4c6b-baae-1d13d90f1bb9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.329144 Nov 02 12:43:14.267778 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2176/4414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:13 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:14.313879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:14.323614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:14.344551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:14.344950 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab063241-4b98-48de-bb23-bbe677df45e9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1336 microversion: 2.54 time: 0.245452 Nov 02 12:43:14.346041 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2239/4415] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:14 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1336 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:14.972646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:14.975285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:14.984732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:14.985412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:14.986050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:14.996061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:14.996553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:14.997001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:15.236420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:15.248200 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33944ce6-bceb-4978-aac7-2d49254c78d9 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1495 microversion: 2.1 time: 0.278576 Nov 02 12:43:15.249887 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2177/4416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:14 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1495 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:15.291260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:15.291888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:15.310364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:15.312415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:15.313644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:15.314870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:15.315334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:15.315827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:15.375708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:15.376330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:15.382757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:15.383468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:15.384059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:15.384990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:15.385893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:15.386554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:15.475287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:15.498653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:15.507162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:15.509183 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fde2132f-05e9-4042-b3d5-42dc55206d0f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1336 microversion: 2.54 time: 0.138096 Nov 02 12:43:15.510350 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2178/4417] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:15 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1336 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:15.559530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:15.572017 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8fd85214-a3e1-41f4-a3e9-8c50df8ceb03 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.285437 Nov 02 12:43:15.574170 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2240/4418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:15 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:15.963656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-133822746", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": "none"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:16.053409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:16.054052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:16.054940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:16.055538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:16.056334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:16.068210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.069577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.070250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.071243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.071737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.072197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.093655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Getting quotas for project c5bd7e1bf50e4862bedfe599c5eff64d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:16.102197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Getting quotas for user 16205d7e87df417b83011e342371c127 and project c5bd7e1bf50e4862bedfe599c5eff64d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:16.117047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:43:16.120208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:43:16.192054 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c5f3009c-7372-4676-bd6a-8d320fe25ee0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.541905 Nov 02 12:43:16.195055 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2179/4419] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:43:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:43:16.211065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f71f0c65-a5ce-4775-b96b-6330e18160f4 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:16.211745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f71f0c65-a5ce-4775-b96b-6330e18160f4 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:16.229399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-54ae0f00-3957-4334-a0eb-ebb2ee187afe req-0fe801dc-2039-4552-8fe1-2264db077d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d048db-1aa0-49d7-a2c1-ecbcfac7e36c", "name": "network-vif-deleted", "tag": "568dfa43-bfea-4535-bafb-580643eb5f97"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:16.243230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-54ae0f00-3957-4334-a0eb-ebb2ee187afe req-0fe801dc-2039-4552-8fe1-2264db077d1a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.244527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-54ae0f00-3957-4334-a0eb-ebb2ee187afe req-0fe801dc-2039-4552-8fe1-2264db077d1a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.245428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-54ae0f00-3957-4334-a0eb-ebb2ee187afe req-0fe801dc-2039-4552-8fe1-2264db077d1a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.259761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-54ae0f00-3957-4334-a0eb-ebb2ee187afe req-0fe801dc-2039-4552-8fe1-2264db077d1a service nova] Creating event network-vif-deleted:568dfa43-bfea-4535-bafb-580643eb5f97 for instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c on n-h2-855650-5 Nov 02 12:43:16.267684 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-54ae0f00-3957-4334-a0eb-ebb2ee187afe req-0fe801dc-2039-4552-8fe1-2264db077d1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042838 Nov 02 12:43:16.273535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2180/4420] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:16.280368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:16.281833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:16.292760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.293724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.294881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.296128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.296968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.297698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.329578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f71f0c65-a5ce-4775-b96b-6330e18160f4 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.343415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f71f0c65-a5ce-4775-b96b-6330e18160f4 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.346814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f71f0c65-a5ce-4775-b96b-6330e18160f4 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.350690 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f71f0c65-a5ce-4775-b96b-6330e18160f4 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1277 microversion: 2.57 time: 0.147444 Nov 02 12:43:16.353317 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2241/4421] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:16 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:16.413842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beeb8b4fa7354185ba8aff3194bf9e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d26923875a41c8bd0161fdd1d306b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.426169 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c7d3cd9-687e-41fc-93ab-d96e49ef0484 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 200 len: 1453 microversion: 2.1 time: 0.149500 Nov 02 12:43:16.427511 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2181/4422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:16 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:16.534264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:16.535046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:16.545858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.546062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.553067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.553829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.554471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.555317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.597994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:16.599186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:16.611948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.612539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.613003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.613709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.620788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.624965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.716363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.732507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.736125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.743628 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-406ab9da-a91c-4a14-b8af-4aa1f356c2a7 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1357 microversion: 2.54 time: 0.213151 Nov 02 12:43:16.754032 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2242/4423] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:16 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:16.781011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e4108879-b7c7-4863-8bd3-43dd28597726 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Action: 'create', calling method: .version_select at 0x7f2292a5b040>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-873048975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBhqDtqp1GclSPlZ8djLPjsD4XgehHkzt5+/muNhl8Kc8L7+gWTdtiICFmWXbjpy5WscOla+JZcNtknkuYkj4jkdMn+6hoNfRxwb7zgKUdqVxjjopkXXLNGzPOdTdseZw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:16.829533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e4108879-b7c7-4863-8bd3-43dd28597726 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Getting quotas for project 6dd1a3f1c8b847a88e9d7643a2f91002. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:16.836382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e4108879-b7c7-4863-8bd3-43dd28597726 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Getting quotas for user df50a0f04ea344a6bcd353447b1a9a8b and project 6dd1a3f1c8b847a88e9d7643a2f91002. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:16.871583 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e4108879-b7c7-4863-8bd3-43dd28597726 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.095773 Nov 02 12:43:16.874791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2243/4424] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 12:43:16 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 02 12:43:16.918294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-873048975", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:16.938951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:16.964235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.964800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.965178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.971235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.971853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.972313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.001628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:17.017631 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c509f19b-2751-4aac-80e0-c5267c79f0f4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.424903 Nov 02 12:43:17.021541 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2182/4425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:16 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:17.196052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:17.199865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:17.200426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:17.203775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:17.207412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:17.385907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:17.386820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:17.392969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:17.410394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.410924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.411372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.412557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.413241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.413703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.414309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.416023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.418271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.419168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.424331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.426355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.519465 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84629dae-121b-462a-a46d-63426e7a0a4e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "POST /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048/action" status: 202 len: 1139 microversion: 2.54 time: 0.630472 Nov 02 12:43:17.520636 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2244/4426] 10.222.0.45 () {62 vars in 1320 bytes} [Wed Nov 2 12:43:16 2022] POST /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048/action => generated 1139 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:43:17.526314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:17.526942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:17.535279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.536042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.536520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.538066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.538557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.539645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.570218 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c could not be found. Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c HTTP/1.1 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c could not be found. Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '04d048db-1aa0-49d7-a2c1-ecbcfac7e36c'} Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c could not be found. Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c could not be found. Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.574088 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.583122 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:17.583122 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:17.583122 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:17.583122 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:17.583122 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c could not be found. Nov 02 12:43:17.583122 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.586206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 04d048db-1aa0-49d7-a2c1-ecbcfac7e36c could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:17.589481 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66bedbf0-73f7-4f69-945e-fbbdb4a180fd tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c" status: 404 len: 111 microversion: 2.1 time: 0.066457 Nov 02 12:43:17.591035 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2245/4427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:17 2022] GET /compute/v2.1/servers/04d048db-1aa0-49d7-a2c1-ecbcfac7e36c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:17.603027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:17.604890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:17.622892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.624316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.625485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.628042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.629163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.629882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.693702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:17.711614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:17.715338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:17.719918 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-076f838f-515c-4134-a213-61654718b73c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1273 microversion: 2.57 time: 0.338423 Nov 02 12:43:17.722111 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2183/4428] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:17 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:17.730511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:17.732128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:17.745107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.746775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.747834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.750075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.751115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.752406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.776006 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 HTTP/1.1 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '81e8f175-bce2-4c4e-94f9-40faf81ae640'} Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:17.778077 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.782705 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.784535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:17.786354 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e871670-ccdb-4a94-becb-9a887238e663 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 404 len: 111 microversion: 2.1 time: 0.062312 Nov 02 12:43:17.793042 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2184/4429] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:17 2022] DELETE /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:17.846945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:17.865946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:17.872554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:17.877996 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8199b9af-5a99-4ef3-8fdb-7c69ff3b7155 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.284275 Nov 02 12:43:17.879880 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2246/4430] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:17 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:17.891766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:17.894502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 81e8f175-bce2-4c4e-94f9-40faf81ae640] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:17.902763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.903512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.904352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.917846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.920823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.921631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.965234 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 HTTP/1.1 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '81e8f175-bce2-4c4e-94f9-40faf81ae640'} Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.971479 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:17.976869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:17.976869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:17.976869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:17.976869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:17.976869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. Nov 02 12:43:17.976869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:17.979512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 81e8f175-bce2-4c4e-94f9-40faf81ae640 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:17.980658 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7105ab13-bfc7-4b27-a7a5-27a17ac5dcec tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640" status: 404 len: 111 microversion: 2.1 time: 0.099560 Nov 02 12:43:17.981899 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2247/4431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:17 2022] GET /compute/v2.1/servers/81e8f175-bce2-4c4e-94f9-40faf81ae640 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:17.991544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4075f48-c9de-4bc8-a4d8-43c1e53ab438 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e1709d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.027888 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f4075f48-c9de-4bc8-a4d8-43c1e53ab438 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Image not found. Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4075f48-c9de-4bc8-a4d8-43c1e53ab438 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 HTTP/1.1 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '9e68830e-fda7-46bb-9c4b-f62580219a29'} Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9e68830e-fda7-46bb-9c4b-f62580219a29 to delete Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9e68830e-fda7-46bb-9c4b-f62580219a29 could not be found. Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.031419 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.035600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4075f48-c9de-4bc8-a4d8-43c1e53ab438 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:18.036953 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f4075f48-c9de-4bc8-a4d8-43c1e53ab438 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29" status: 404 len: 62 microversion: 2.1 time: 0.049402 Nov 02 12:43:18.037628 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2248/4432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:17 2022] DELETE /compute/v2.1/images/9e68830e-fda7-46bb-9c4b-f62580219a29 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:43:18.057769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.058327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:18.100859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:18.129250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.131156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.131770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.135200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.137586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.142659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.188586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a533f32-23a9-4e3f-963d-58bf4cbe7bce tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Action: 'create', calling method: .version_select at 0x7f228e540f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1456239692", "metadata": {"Type": "work"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:18.196748 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 HTTP/1.1 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3470b9e7-d8fc-4cd0-bd43-5217fe7030a4'} Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:18.199000 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.204496 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.220120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:18.227017 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bcf66bba-577f-4478-84d3-46a20f63322c tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 404 len: 111 microversion: 2.1 time: 0.177472 Nov 02 12:43:18.227017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2249/4433] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:18 2022] DELETE /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:18.233217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.233730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:18.243845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.244359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.244819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.245554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.246054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.246679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.459217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:18.468054 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58289319-1c15-465d-a05b-ef7dc6201429 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.242179 Nov 02 12:43:18.468632 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2250/4434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:18 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:18.474942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.476073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:18.485505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.486908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.487534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.488575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.489336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.490217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.516275 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 HTTP/1.1 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3470b9e7-d8fc-4cd0-bd43-5217fe7030a4'} Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.527151 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65974125-66ce-41aa-b5a9-edc006c712bc tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4" status: 404 len: 111 microversion: 2.1 time: 0.060338 Nov 02 12:43:18.530682 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2251/4435] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:18 2022] GET /compute/v2.1/servers/3470b9e7-d8fc-4cd0-bd43-5217fe7030a4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:18.549672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e721000-bea9-4d06-affd-3ab2063b1266 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228db82b80>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.591703 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6e721000-bea9-4d06-affd-3ab2063b1266 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Image not found. Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e721000-bea9-4d06-affd-3ab2063b1266 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 HTTP/1.1 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '15f3e328-90b9-4d2b-b670-e541e159d688'} Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 15f3e328-90b9-4d2b-b670-e541e159d688 to delete Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15f3e328-90b9-4d2b-b670-e541e159d688 could not be found. Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.594511 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:18.598430 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.602059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e721000-bea9-4d06-affd-3ab2063b1266 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:18.603401 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e721000-bea9-4d06-affd-3ab2063b1266 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688" status: 404 len: 62 microversion: 2.1 time: 0.064777 Nov 02 12:43:18.608789 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2252/4436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:18 2022] DELETE /compute/v2.1/images/15f3e328-90b9-4d2b-b670-e541e159d688 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:18.616269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.617134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:18.645109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.645717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.646327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.649083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.649689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.650222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.686650 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 HTTP/1.1 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '47ccf37f-d6ce-40ad-a868-e7950e02dd60'} Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:18.689762 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.693304 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.699103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:18.701739 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02f8358a-1e26-4b11-beed-6bb4b2d08a2a tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 404 len: 111 microversion: 2.1 time: 0.090186 Nov 02 12:43:18.702645 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2253/4437] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:18 2022] DELETE /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:18.722936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.725530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 47ccf37f-d6ce-40ad-a868-e7950e02dd60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:18.732589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.734814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.735528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.736729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.737446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.738170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.766008 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 HTTP/1.1 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '47ccf37f-d6ce-40ad-a868-e7950e02dd60'} Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.768956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.772937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.772937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.772937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:18.772937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:18.772937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. Nov 02 12:43:18.772937 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.775087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 47ccf37f-d6ce-40ad-a868-e7950e02dd60 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:18.776782 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b80c47cf-1108-41dd-aa09-b26260d4f046 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60" status: 404 len: 111 microversion: 2.1 time: 0.068603 Nov 02 12:43:18.778130 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2254/4438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:18 2022] GET /compute/v2.1/servers/47ccf37f-d6ce-40ad-a868-e7950e02dd60 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:18.785350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.786357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:18.793391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.794206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.795714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.796665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.797344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.799451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.849941 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a533f32-23a9-4e3f-963d-58bf4cbe7bce tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.054443 Nov 02 12:43:18.851049 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2185/4439] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Nov 2 12:43:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1056 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:43:18.865158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a89a8069-2de1-4b87-83d6-ce6c2a94bf69 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e521550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.920233 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a89a8069-2de1-4b87-83d6-ce6c2a94bf69 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Image not found. Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a89a8069-2de1-4b87-83d6-ce6c2a94bf69 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b HTTP/1.1 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'b29b699a-5ee3-4d7a-b9d6-7f59d37f432b'} Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b29b699a-5ee3-4d7a-b9d6-7f59d37f432b to delete Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b29b699a-5ee3-4d7a-b9d6-7f59d37f432b could not be found. Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.923075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a89a8069-2de1-4b87-83d6-ce6c2a94bf69 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:18.926716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a89a8069-2de1-4b87-83d6-ce6c2a94bf69 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b" status: 404 len: 62 microversion: 2.1 time: 0.064493 Nov 02 12:43:18.933783 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2186/4440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:18 2022] DELETE /compute/v2.1/images/b29b699a-5ee3-4d7a-b9d6-7f59d37f432b => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:18.955492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a051f8d4-7bb4-441b-90e4-f2aec0d25352 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f228e73a310>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:19.012949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:19.038894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:19.046391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:19.047876 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d644210b-a61b-497c-adce-71502e952c49 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1337 microversion: 2.57 time: 0.268346 Nov 02 12:43:19.051297 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2255/4441] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:18 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1337 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:19.071001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:19.077560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:19.081604 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a051f8d4-7bb4-441b-90e4-f2aec0d25352 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 200 len: 353 microversion: 2.1 time: 0.146426 Nov 02 12:43:19.082268 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2187/4442] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:18 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:19.088126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:19.088643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:19.095339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.096183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.101505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.103161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.104519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.105165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.122473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.123807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.124902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.125851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.126518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.127127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.146124 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 HTTP/1.1 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '613fc845-dfd6-49ca-b8ff-9c4cebce08d3'} Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:19.148402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.152227 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.155306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:19.159108 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-32132256-8854-4d12-91e7-a4e841499115 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 404 len: 111 microversion: 2.1 time: 0.075516 Nov 02 12:43:19.160555 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2188/4443] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:19 2022] DELETE /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:19.177139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:19.177784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 613fc845-dfd6-49ca-b8ff-9c4cebce08d3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:19.207653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.208161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.208900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.209386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.210070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.210784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.229516 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 HTTP/1.1 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '613fc845-dfd6-49ca-b8ff-9c4cebce08d3'} Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.231298 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 613fc845-dfd6-49ca-b8ff-9c4cebce08d3 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-114f7288-73c8-439c-b18b-2de09f7208f1 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3" status: 404 len: 111 microversion: 2.1 time: 0.066780 Nov 02 12:43:19.238395 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2189/4444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:19 2022] GET /compute/v2.1/servers/613fc845-dfd6-49ca-b8ff-9c4cebce08d3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:19.247487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f72ef30-0ace-41ea-ad34-b0af73d5727e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '.version_select at 0x7f228e5290d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:19.283985 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0f72ef30-0ace-41ea-ad34-b0af73d5727e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Image not found. Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f72ef30-0ace-41ea-ad34-b0af73d5727e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 HTTP/1.1 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c81726b3-e835-4c3f-8b1d-26ad30bfb448'} Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c81726b3-e835-4c3f-8b1d-26ad30bfb448 to delete Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c81726b3-e835-4c3f-8b1d-26ad30bfb448 could not be found. Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.285869 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.290953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f72ef30-0ace-41ea-ad34-b0af73d5727e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:19.293070 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f72ef30-0ace-41ea-ad34-b0af73d5727e tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448" status: 404 len: 62 microversion: 2.1 time: 0.051005 Nov 02 12:43:19.293070 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2190/4445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:19 2022] DELETE /compute/v2.1/images/c81726b3-e835-4c3f-8b1d-26ad30bfb448 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:19.304115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:19.304916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:19.315294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.315823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.316272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.317205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.317775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.318349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.343744 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 HTTP/1.1 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '542f92f5-8985-475e-b090-6e8e2e413847'} Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:19.346733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.350453 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.352994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:19.358612 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bcbfffca-5828-43b5-b04a-4a1d4f157d04 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "DELETE /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 404 len: 111 microversion: 2.1 time: 0.057810 Nov 02 12:43:19.359703 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2191/4446] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:19 2022] DELETE /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:19.365853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:19.369213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:19.375122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] [instance: 542f92f5-8985-475e-b090-6e8e2e413847] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:19.377873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:19.384077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:19.385364 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5cb1db06-e104-4e87-a9ff-afb913dd465c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.331507 Nov 02 12:43:19.390503 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2256/4447] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:19 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:19.410891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.411926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.412916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.414453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.417911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.421038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.459895 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] HTTP exception thrown: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Request method failure captured: Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 HTTP/1.1 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmQoU3n5YY8TJ3e5o3dg30vLWDphNTc_bAMx0kOVJYaIQ4F5GipEhcOmMAubh1EMBq8l9Z8m12NNnFFsA2F4tupM_X7P7atDca5xp6zhduXl1wBofPSTDnqDUoOUA4BIGrjZNYKnAi6bscAjunuP0JMa7RlnudKhWtByzx-0nDQAijI Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7d26923875a41c8bd0161fdd1d306b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c7d26923875a41c8bd0161fdd1d306b6 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesTestJSON-1155435590 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: beeb8b4fa7354185ba8aff3194bf9e06 Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesTestJSON-1155435590-project Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '542f92f5-8985-475e-b090-6e8e2e413847'} Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.463638 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:19.469877 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:19.469877 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:19.469877 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:19.469877 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:19.469877 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. Nov 02 12:43:19.469877 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:19.469877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] Returning 404 to user: Instance 542f92f5-8985-475e-b090-6e8e2e413847 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:19.469877 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5a73c2e9-ee9b-42e4-901c-5b5e042c7160 tempest-ImagesTestJSON-1155435590 tempest-ImagesTestJSON-1155435590-project] 10.222.0.45 "GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847" status: 404 len: 111 microversion: 2.1 time: 0.101029 Nov 02 12:43:19.472065 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2192/4448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:19 2022] GET /compute/v2.1/servers/542f92f5-8985-475e-b090-6e8e2e413847 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:19.495092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:19.495913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:19.511162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.515177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.516243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.521104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:19.521605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:19.522097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.943378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:19.959294 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-481a6040-e3d5-4dfb-b430-99e7d954995b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.468071 Nov 02 12:43:19.959916 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2257/4449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:19 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:20.100283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ae47a0a4-d116-4a85-8de0-4a030b79167f tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f228ecf68b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:20.106398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:20.107138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:20.147270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:20.147930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:20.151500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:20.152276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:20.152619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:20.153059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:20.207421 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ae47a0a4-d116-4a85-8de0-4a030b79167f tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 200 len: 353 microversion: 2.1 time: 0.113839 Nov 02 12:43:20.208839 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2258/4450] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:20 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:20.360823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:20.383826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:20.387797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:20.390128 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36e2ae88-dcdd-4d59-8fad-c2004cd8c6b7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1335 microversion: 2.57 time: 0.313106 Nov 02 12:43:20.396603 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2193/4451] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:20 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1335 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:20.422984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:20.423680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:20.475787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:20.488731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:20.491849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:20.493650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:20.494786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:20.539433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:20.772766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:20.784485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:20.786635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:20.787750 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60376a42-1a9a-46ac-8807-e53b6957fc1f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.376429 Nov 02 12:43:20.788966 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2259/4452] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:20 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:20.987681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:20.989382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:21.004748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:21.005248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:21.005870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:21.006841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:21.008025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:21.009927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:21.230154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13452867-f2ea-471d-a4ad-c585b962269e tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f2292a588b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:21.376271 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-13452867-f2ea-471d-a4ad-c585b962269e tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 200 len: 354 microversion: 2.1 time: 0.154712 Nov 02 12:43:21.378281 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2260/4453] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:21 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:21.398500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de8828d2-5bfe-4311-80e0-eba5d2589715 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f2292a38790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:21.500040 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de8828d2-5bfe-4311-80e0-eba5d2589715 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 200 len: 354 microversion: 2.1 time: 0.105278 Nov 02 12:43:21.510079 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2261/4454] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:21 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:21.510079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:21.510079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:21.564666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:21.565589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:21.566443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:21.567753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:21.568621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:21.580289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:21.971433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:21.981746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:22.000679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:22.001912 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3518bf6a-3c93-45a1-b650-a10ab0d9c7d0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1335 microversion: 2.57 time: 0.499273 Nov 02 12:43:22.006252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2262/4455] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:21 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1335 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:22.031178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6fafd414-9ae4-4d1f-9c17-0f6cfdf44f62 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f228eb8ad30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:22.118336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:22.145245 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec698ab2-28f5-4bb4-8eaf-1c795b26400d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 1.161801 Nov 02 12:43:22.145367 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2194/4456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:20 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:22.164847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:22.167230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:22.199959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:22.204700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:22.205570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:22.207473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:22.208400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:22.209280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:22.236967 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6fafd414-9ae4-4d1f-9c17-0f6cfdf44f62 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 202 len: 0 microversion: 2.1 time: 0.216938 Nov 02 12:43:22.237534 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2263/4457] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:43:22 2022] DELETE /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:22.248322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-33763437-d847-46ab-a278-56d434540b2c tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f2292a58af0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:22.410441 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-33763437-d847-46ab-a278-56d434540b2c tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 200 len: 353 microversion: 2.1 time: 0.167545 Nov 02 12:43:22.412388 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2264/4458] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:22 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:22.496268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:22.509327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:22.518158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:22.523015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:22.525880 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0961e8d-e0db-44e8-adfb-7283c7f8a246 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.372522 Nov 02 12:43:22.530415 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2195/4459] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:22 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:23.043227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:23.051210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:23.095192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:23.100405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:23.103904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:23.110966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:23.111479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:23.112248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:23.175414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:23.178029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:23.216932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:23.217736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:23.225604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:23.226782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:23.235401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:23.236131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:23.609666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:23.629845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:23.638814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:23.644916 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d9aed890-f9b2-4afc-88e8-37e894677d67 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1335 microversion: 2.57 time: 0.607885 Nov 02 12:43:23.649516 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2265/4460] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:23 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1335 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:23.667743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8bb98951-a90a-4eec-8684-cc78fee51024 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f228edfa700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:23.772720 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8bb98951-a90a-4eec-8684-cc78fee51024 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 200 len: 353 microversion: 2.1 time: 0.119169 Nov 02 12:43:23.774118 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2266/4461] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:23 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:23.780063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:23.782054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:23.797602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:23.799354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:23.803561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:23.805590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:23.806431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:23.807074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:23.846168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:24.016392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:24.038482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:24.042244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:24.048274 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ffa66df-f72d-4360-8ff0-bab83d6950f0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.270181 Nov 02 12:43:24.049946 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2267/4462] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:23 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:24.148175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:24.177729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1228a8ef-a0fa-4212-880e-7f8690a277d0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 1.008059 Nov 02 12:43:24.193994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2196/4463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:23 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:24.690028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:24.691701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:24.722617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:24.727841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:24.731509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:24.740775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:24.742284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:24.743302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:24.791900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5118e998-adc9-4fd6-810f-8f3fb73c6b21 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f228e7304c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:24.942341 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5118e998-adc9-4fd6-810f-8f3fb73c6b21 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 200 len: 353 microversion: 2.1 time: 0.157134 Nov 02 12:43:24.943969 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2197/4464] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:24 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:24.996304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:25.027973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:25.032816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:25.046065 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e691e549-5487-47b0-8341-8bb3245c0619 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1356 microversion: 2.57 time: 0.368914 Nov 02 12:43:25.081987 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2268/4465] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:24 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1356 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:25.095783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:25.100451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:25.100853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:25.101318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:25.112620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.114132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.114765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.116312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.119012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.119665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.122491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.123210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.123819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.124503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.125819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.125950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.286667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:25.306681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:25.308126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:25.309321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:25.310235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:25.311087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:25.312242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:25.319639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:25.338789 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c68b96b4-2055-45c3-8a3d-5371ce847dac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.241466 Nov 02 12:43:25.343798 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2269/4466] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:25 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:25.357770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:25.366808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:25.413220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.424703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.425414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.429396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.430435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.431621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.554004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:25.586120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.586721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.587269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.588028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.588500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.589560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.681787 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7a69e287-22b4-4d56-8d19-cc802a31d0fd tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "POST /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190/action" status: 202 len: 1137 microversion: 2.57 time: 0.592202 Nov 02 12:43:25.694436 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2198/4467] 10.222.0.45 () {62 vars in 1320 bytes} [Wed Nov 2 12:43:25 2022] POST /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190/action => generated 1137 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 12:43:25.715701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:25.719878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:25.739315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.752074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.753805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:25.758036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:25.758908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:25.759867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:26.037690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:26.065629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:26.080860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:26.096107 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f81f5094-ba16-44a8-848f-fd68265976c6 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.391156 Nov 02 12:43:26.115511 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2199/4468] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:25 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:26.140609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9519fea2-4066-4c62-9822-21c218324025 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f228e520f70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:26.197749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:26.203424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=14 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:26.358911 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9519fea2-4066-4c62-9822-21c218324025 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 200 len: 353 microversion: 2.1 time: 0.239959 Nov 02 12:43:26.359527 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2200/4469] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:26 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:26.394180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:26.398967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:26.431830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:26.434443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:26.440177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:26.445341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:26.446825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:26.449117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:26.450558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:26.467094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cc2e2d8c-9733-4754-b673-13c6936d78f0 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 1.117862 Nov 02 12:43:26.467922 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2270/4470] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:25 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:26.678712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:26.695990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:26.699829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:26.704938 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f96adf50-d0cb-439e-824a-729210f7c17b tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.332068 Nov 02 12:43:26.708130 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2201/4471] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:26 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:27.130387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:27.131068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:27.139506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:27.190758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:27.193244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:27.196258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:27.202323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:27.204604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:27.208315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:27.376532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1ea5ab-7b6a-48ee-b81e-8f8df0e31064 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Calling method '.version_select at 0x7f228e6f3c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:27.432036 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5d1ea5ab-7b6a-48ee-b81e-8f8df0e31064 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] HTTP exception thrown: Volume 25d2737f-cde8-4ec8-afca-ec33c2137ec8 could not be found. Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1ea5ab-7b6a-48ee-b81e-8f8df0e31064 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Request method failure captured: Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 HTTP/1.1 Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmXlRYh8liQEHdFoL3mnTkF11sAzdzpZDi_C7x29_qigqgE_5fNja5V0Ov6crAnFuGARAeAKrhPK-VmHTvxgQCTq0-59vM7zieK2y-Ts9FvqM9vqujJAsCmtpDlWJPVIKMs0NRKKfKiTeyU-v6sOR0oAlCq73io8rD-5pQyDyDE4Jdg Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 641c27d1ad26453f8ef9d69719d5508f Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesGetTestJSON-1385439135 Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/641c27d1ad26453f8ef9d69719d5508f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/641c27d1ad26453f8ef9d69719d5508f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/641c27d1ad26453f8ef9d69719d5508f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_641c27d1ad26453f8ef9d69719d5508f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesGetTestJSON-1385439135 Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 641c27d1ad26453f8ef9d69719d5508f Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesGetTestJSON-1385439135 Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesGetTestJSON-1385439135-project Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6717e8bb4a7e4238963c41259a2256d6 Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesGetTestJSON-1385439135-project Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: exception: Volume 25d2737f-cde8-4ec8-afca-ec33c2137ec8 could not be found. Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '25d2737f-cde8-4ec8-afca-ec33c2137ec8'} Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25d2737f-cde8-4ec8-afca-ec33c2137ec8 could not be found. (HTTP 404) (Request-ID: req-aa9bba51-1421-4781-8333-747116d0dff3) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:43:27.434773 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25d2737f-cde8-4ec8-afca-ec33c2137ec8 could not be found. Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25d2737f-cde8-4ec8-afca-ec33c2137ec8 could not be found. Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25d2737f-cde8-4ec8-afca-ec33c2137ec8 could not be found. Nov 02 12:43:27.439900 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:27.443071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1ea5ab-7b6a-48ee-b81e-8f8df0e31064 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] Returning 404 to user: Volume 25d2737f-cde8-4ec8-afca-ec33c2137ec8 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:27.446290 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5d1ea5ab-7b6a-48ee-b81e-8f8df0e31064 tempest-VolumesGetTestJSON-1385439135 tempest-VolumesGetTestJSON-1385439135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8" status: 404 len: 109 microversion: 2.1 time: 0.075119 Nov 02 12:43:27.446290 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2202/4472] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:43:27 2022] GET /compute/v2.1/os-volumes/25d2737f-cde8-4ec8-afca-ec33c2137ec8 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:27.483387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:27.503613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:27.507518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:27.523494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:27.531835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:27.532601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:27.534579 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4b3f747a-9fc0-444d-8e69-60517f1bacb2 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.412342 Nov 02 12:43:27.535623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:27.537678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:27.555959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:27.556839 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2271/4473] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:27 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:27.563599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:27.565705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:27.771223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:27.772675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:27.787294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:27.788485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:27.792827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:27.794817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:27.795756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:27.796488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:28.150446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:28.186516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:28.193904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:28.196003 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-efcb3c28-81a5-40c0-b796-a066669d4753 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.432405 Nov 02 12:43:28.197000 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2272/4474] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:27 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:28.257928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:28.277563 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25df263e-0f08-4c82-9e8f-8b475cca697e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1511 microversion: 2.1 time: 0.774352 Nov 02 12:43:28.279124 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2203/4475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:27 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1511 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:28.582741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:28.584343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:28.607844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:28.620241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:28.621144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:28.622317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:28.623502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:28.624094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:28.893803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:28.914391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:28.926166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:28.936939 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d64dd34b-4c2a-45eb-a33e-9da6e1a68727 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.360591 Nov 02 12:43:28.936939 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2273/4476] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:28 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:29.232540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:29.235095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:29.251359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:29.254858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:29.255570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:29.262142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:29.264098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:29.265701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:29.316753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:29.323827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:29.356856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:29.359732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:29.363747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:29.365223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:29.366294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:29.367096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:29.495238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:29.548927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:29.590287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:29.592982 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-521beca2-e847-4ba5-a059-ee94b847aa66 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.366630 Nov 02 12:43:29.595355 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2204/4477] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:29 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:29.689919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:29.701624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c9dffaf0-f29e-462e-90e8-218bd82283c9 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1488 microversion: 2.1 time: 0.392931 Nov 02 12:43:29.703666 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2274/4478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:29 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1488 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:29.747858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:29.748616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:29.760572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:29.766483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:29.767722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:29.768569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:29.769096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:29.772253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:29.849154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:29.973821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:29.974481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:29.988722 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c6a6680-a1be-41e3-9720-eaaedd788548 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 204 len: 0 microversion: 2.1 time: 0.246694 Nov 02 12:43:29.989910 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2205/4479] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:29 2022] DELETE /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:29.994124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:29.995846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:29.997583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:29.999887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:30.001472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:30.002158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:30.002280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:30.003380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:30.012594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:30.013164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:30.013664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:30.014506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:30.014977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:30.015681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:30.182714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:30.200948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:30.205679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:30.207939 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78481f0f-2fb6-4104-9eba-9f9b41e8f65f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.241236 Nov 02 12:43:30.225670 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2275/4480] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:29 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:30.292937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:30.307620 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e00b363b-072f-4493-baf0-3b434fa8351f tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1494 microversion: 2.1 time: 0.312128 Nov 02 12:43:30.310120 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2206/4481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:29 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1494 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:30.630582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:30.632247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:30.644222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:30.645257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:30.646132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:30.650507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:30.651441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:30.652856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:30.758240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:30.776130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:30.779489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:30.781486 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f8065dfc-dfd6-42b5-a95c-a72adf1db61c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.160631 Nov 02 12:43:30.782813 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2207/4482] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:30 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:30.857292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-430213464", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "eb1ee50c-f1c1-4ca6-8226-a3693694bbbb"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:30.956995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] validate_networks() for [('eb1ee50c-f1c1-4ca6-8226-a3693694bbbb', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:43:31.239937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:31.240963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:31.253007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:31.254065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:31.254774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:31.256036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:31.256504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:31.257151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:31.561027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:31.581899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:31.588034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:31.592763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-41812a92-8276-4f62-8b4a-7adfce9e52be tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.355704 Nov 02 12:43:31.609123 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2208/4483] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:31 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:31.624375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:31.627843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:31.639643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:31.640507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:31.641345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:31.642579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:31.644246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:31.645271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:31.712245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:31.712918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:31.713572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:31.714284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:31.717798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:31.756491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:31.757000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:31.757841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:31.760212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:31.760977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:31.761682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:31.838230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Getting quotas for project f5113f5c6d4c4d1bb1b01ebfa02c1f97. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:31.855419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Getting quotas for user 96762e4b3b16498eba80137ac2c80470 and project f5113f5c6d4c4d1bb1b01ebfa02c1f97. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:31.895829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:43:31.900845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:43:32.005144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.021573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8774e5e-27e3-442f-9eeb-db7e4ef315d4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1494 microversion: 2.1 time: 0.410360 Nov 02 12:43:32.023827 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2209/4484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:31 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1494 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:32.028091 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-12c51972-3007-49e3-b411-e57cb1b43f2b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.603576 Nov 02 12:43:32.029815 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2276/4485] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:43:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:43:32.088403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:32.090226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:32.125481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:32.136158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:32.138795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:32.141890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:32.148957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:32.151257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:32.343850 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20faa393-ae73-44bd-96b2-f19fa779d2c4 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] 10.222.0.45 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.318081 Nov 02 12:43:32.346228 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2210/4486] 10.222.0.45 () {58 vars in 1128 bytes} [Wed Nov 2 12:43:32 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:43:32.366866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af57b4cd-287b-4b57-8d24-8e60dda29839 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:32.369759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af57b4cd-287b-4b57-8d24-8e60dda29839 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:32.428356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.461841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.466835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.470882 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-453fdfc0-dbdf-469f-8c88-60cce7efc9aa tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.437144 Nov 02 12:43:32.472165 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2277/4487] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:32 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:32.513044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49f4d427-8ade-457f-8889-b22605938f59 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Calling method '.version_select at 0x7f228edfa9d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:32.549988 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-49f4d427-8ade-457f-8889-b22605938f59 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] HTTP exception thrown: Image not found. Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49f4d427-8ade-457f-8889-b22605938f59 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Request method failure captured: Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmXzrsfN44XnjkFDmNx6wDeRqqYH1dgeEPcrPyDASqroqjcyB4fbwErBRFfqvwXk6yZI8S3C8IOb6RYqcEyI2Fku5mVFRo0T89zO1vigJ53tB0iivm2_GjOO01fz76LzmPATsf80IzLTQHwRfEKQmSyqiHovSstbqjuXE0Iqf69GZb0 Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5ba4ffbbc0ca4adbbf427342ce2d8dda Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '-1'} Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.551945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49f4d427-8ade-457f-8889-b22605938f59 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49f4d427-8ade-457f-8889-b22605938f59 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] 10.222.0.45 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.077451 Nov 02 12:43:32.559776 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2278/4488] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Nov 2 12:43:32 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:32.568751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c905c74-bf73-4773-b338-97505d784509 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Calling method '.version_select at 0x7f2292a58790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:32.608000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af57b4cd-287b-4b57-8d24-8e60dda29839 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.619367 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7c905c74-bf73-4773-b338-97505d784509 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] HTTP exception thrown: Image not found. Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c905c74-bf73-4773-b338-97505d784509 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Request method failure captured: Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/images/13f820ee-79bf-4a3d-98c8-8fd25bf1977j HTTP/1.1 Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmXzrsfN44XnjkFDmNx6wDeRqqYH1dgeEPcrPyDASqroqjcyB4fbwErBRFfqvwXk6yZI8S3C8IOb6RYqcEyI2Fku5mVFRo0T89zO1vigJ53tB0iivm2_GjOO01fz76LzmPATsf80IzLTQHwRfEKQmSyqiHovSstbqjuXE0Iqf69GZb0 Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5ba4ffbbc0ca4adbbf427342ce2d8dda Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '13f820ee-79bf-4a3d-98c8-8fd25bf1977j'} Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 13f820ee-79bf-4a3d-98c8-8fd25bf1977j to delete Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13f820ee-79bf-4a3d-98c8-8fd25bf1977j could not be found. Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.621617 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c905c74-bf73-4773-b338-97505d784509 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c905c74-bf73-4773-b338-97505d784509 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] 10.222.0.45 "DELETE /compute/v2.1/images/13f820ee-79bf-4a3d-98c8-8fd25bf1977j" status: 404 len: 62 microversion: 2.1 time: 0.059223 Nov 02 12:43:32.629325 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2279/4489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:32 2022] DELETE /compute/v2.1/images/13f820ee-79bf-4a3d-98c8-8fd25bf1977j => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:32.635932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03fa7045-9c28-4c34-9be1-3a7f76088bd8 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Calling method '.version_select at 0x7f22929eef70>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:32.641178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af57b4cd-287b-4b57-8d24-8e60dda29839 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.658735 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-03fa7045-9c28-4c34-9be1-3a7f76088bd8 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] HTTP exception thrown: Image not found. Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03fa7045-9c28-4c34-9be1-3a7f76088bd8 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Request method failure captured: Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/images/606fdd0d-7b36-4216-a587-b3dab606d5ee1 HTTP/1.1 Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmXzrsfN44XnjkFDmNx6wDeRqqYH1dgeEPcrPyDASqroqjcyB4fbwErBRFfqvwXk6yZI8S3C8IOb6RYqcEyI2Fku5mVFRo0T89zO1vigJ53tB0iivm2_GjOO01fz76LzmPATsf80IzLTQHwRfEKQmSyqiHovSstbqjuXE0Iqf69GZb0 Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5ba4ffbbc0ca4adbbf427342ce2d8dda Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '606fdd0d-7b36-4216-a587-b3dab606d5ee1'} Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 606fdd0d-7b36-4216-a587-b3dab606d5ee1 to delete Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 606fdd0d-7b36-4216-a587-b3dab606d5ee1 could not be found. Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.664494 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:32.668652 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.670896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af57b4cd-287b-4b57-8d24-8e60dda29839 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.673996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03fa7045-9c28-4c34-9be1-3a7f76088bd8 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:32.673996 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-03fa7045-9c28-4c34-9be1-3a7f76088bd8 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] 10.222.0.45 "DELETE /compute/v2.1/images/606fdd0d-7b36-4216-a587-b3dab606d5ee1" status: 404 len: 62 microversion: 2.1 time: 0.043109 Nov 02 12:43:32.673996 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2280/4490] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:32 2022] DELETE /compute/v2.1/images/606fdd0d-7b36-4216-a587-b3dab606d5ee1 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:43:32.681147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:32.683925 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af57b4cd-287b-4b57-8d24-8e60dda29839 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1261 microversion: 2.26 time: 0.325851 Nov 02 12:43:32.686284 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2211/4491] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:32 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1261 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:32.689875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:32.692983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b07bb398-ace5-4ab0-86ae-8ce290095df3 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Calling method '.version_select at 0x7f228dd061f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:32.714666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:32.715200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:32.715645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:32.716435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:32.717047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:32.717481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:32.759357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-b07bb398-ace5-4ab0-86ae-8ce290095df3 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] HTTP exception thrown: Image not found. Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b07bb398-ace5-4ab0-86ae-8ce290095df3 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Request method failure captured: Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/images/tempest-invalid-3102685 HTTP/1.1 Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmXzrsfN44XnjkFDmNx6wDeRqqYH1dgeEPcrPyDASqroqjcyB4fbwErBRFfqvwXk6yZI8S3C8IOb6RYqcEyI2Fku5mVFRo0T89zO1vigJ53tB0iivm2_GjOO01fz76LzmPATsf80IzLTQHwRfEKQmSyqiHovSstbqjuXE0Iqf69GZb0 Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5ba4ffbbc0ca4adbbf427342ce2d8dda Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'tempest-invalid-3102685'} Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-3102685 to delete Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-3102685 could not be found. Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.761982 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:32.767883 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.776876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b07bb398-ace5-4ab0-86ae-8ce290095df3 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:32.776876 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b07bb398-ace5-4ab0-86ae-8ce290095df3 tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] 10.222.0.45 "DELETE /compute/v2.1/images/tempest-invalid-3102685" status: 404 len: 62 microversion: 2.1 time: 0.082643 Nov 02 12:43:32.776876 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2212/4492] 10.222.0.45 () {58 vars in 1197 bytes} [Wed Nov 2 12:43:32 2022] DELETE /compute/v2.1/images/tempest-invalid-3102685 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:32.783606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9877af3-077b-4c43-9cbf-623652958e0e tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Calling method '.version_select at 0x7f228dcd1820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:32.818955 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-c9877af3-077b-4c43-9cbf-623652958e0e tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] HTTP exception thrown: Image not found. Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9877af3-077b-4c43-9cbf-623652958e0e tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Request method failure captured: Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/images/b8b31972-c00c-4c70-aeaf-da0bfc4a5265 HTTP/1.1 Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmXzrsfN44XnjkFDmNx6wDeRqqYH1dgeEPcrPyDASqroqjcyB4fbwErBRFfqvwXk6yZI8S3C8IOb6RYqcEyI2Fku5mVFRo0T89zO1vigJ53tB0iivm2_GjOO01fz76LzmPATsf80IzLTQHwRfEKQmSyqiHovSstbqjuXE0Iqf69GZb0 Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d46ce70ca5ec4bbc9074a8fe41b4dc8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d46ce70ca5ec4bbc9074a8fe41b4dc8c Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769 Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5ba4ffbbc0ca4adbbf427342ce2d8dda Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1036989769-project Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: exception: Image not found. Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'b8b31972-c00c-4c70-aeaf-da0bfc4a5265'} Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b8b31972-c00c-4c70-aeaf-da0bfc4a5265 to delete Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b8b31972-c00c-4c70-aeaf-da0bfc4a5265 could not be found. Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.820810 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9877af3-077b-4c43-9cbf-623652958e0e tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] Returning 404 to user: Image not found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:32.836226 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9877af3-077b-4c43-9cbf-623652958e0e tempest-ImagesDeleteNegativeTestJSON-1036989769 tempest-ImagesDeleteNegativeTestJSON-1036989769-project] 10.222.0.45 "DELETE /compute/v2.1/images/b8b31972-c00c-4c70-aeaf-da0bfc4a5265" status: 404 len: 62 microversion: 2.1 time: 0.043341 Nov 02 12:43:32.848771 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2213/4493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:32 2022] DELETE /compute/v2.1/images/b8b31972-c00c-4c70-aeaf-da0bfc4a5265 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:32.861588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.886215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.887900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:32.890623 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32f42076-b35e-47e9-a734-25e3f46295f0 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.215296 Nov 02 12:43:32.891909 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2281/4494] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:32 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:33.061033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:33.062216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:33.120420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.129509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.131345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:33.132758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.133632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.164232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:33.282271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-00c49030-993e-478e-ab3c-594cde5e1957 req-c3bd2ff4-556c-4d52-89f3-2365e36959b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c23ca4-d827-4c9e-8c8b-c4b430b573f2", "name": "network-vif-deleted", "tag": "379f0f3d-118d-4b63-9dfd-7b1e8a924161"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:33.344285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-00c49030-993e-478e-ab3c-594cde5e1957 req-c3bd2ff4-556c-4d52-89f3-2365e36959b4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.357493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-00c49030-993e-478e-ab3c-594cde5e1957 req-c3bd2ff4-556c-4d52-89f3-2365e36959b4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.368820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-00c49030-993e-478e-ab3c-594cde5e1957 req-c3bd2ff4-556c-4d52-89f3-2365e36959b4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:33.409004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:33.427206 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b664f339-a576-4a7f-9d9c-7b5f8796dfa3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1452 microversion: 2.1 time: 0.371574 Nov 02 12:43:33.432503 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2214/4495] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:33 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1452 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:33.493111 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-00c49030-993e-478e-ab3c-594cde5e1957 req-c3bd2ff4-556c-4d52-89f3-2365e36959b4 service nova] Creating event network-vif-deleted:379f0f3d-118d-4b63-9dfd-7b1e8a924161 for instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 on n-h1-855650-5 Nov 02 12:43:33.507225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:33.509035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:33.533212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.534197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.540198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:33.544038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.545492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.545920 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-00c49030-993e-478e-ab3c-594cde5e1957 req-c3bd2ff4-556c-4d52-89f3-2365e36959b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270303 Nov 02 12:43:33.546687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:33.547571 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2282/4496] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:33.767065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:33.780983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:33.786292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:33.789749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:33.802940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:33.808671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:33.810533 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7a55334-2dea-41fe-96f2-7c887d8d7f22 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.308270 Nov 02 12:43:33.819461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.820011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.820469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:33.827782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.830136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.831665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:33.835187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2215/4497] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:33 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:33.921239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:33.921856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:33.946958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.947489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.947941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:33.948782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:33.949228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:33.949687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:34.051509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:34.066401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:34.068492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:34.070218 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-682ac5f9-07c8-4915-8672-876eac7a9fe4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1257 microversion: 2.26 time: 0.335245 Nov 02 12:43:34.071817 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2283/4498] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:33 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1257 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:34.147781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:34.168762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:34.173835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:34.177653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f723174c-8990-4f35-92b8-6d01d67eba73 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.259099 Nov 02 12:43:34.179432 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2216/4499] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:33 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:34.474488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:34.478799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:34.519753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:34.527702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:34.532732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:34.549150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:34.557668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:34.563702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:34.657362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:34.659679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:34.662901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:34.663917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lazy-loading 'fault' on Instance uuid 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:34.754431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:34.764955 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-37cd3370-a5fe-48f0-a4ae-881437de0dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 200 len: 1304 microversion: 2.1 time: 0.296506 Nov 02 12:43:34.779655 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2284/4500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:34 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 1304 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:34.842964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:34.843611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:34.854127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:34.854820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:34.855468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:34.856343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:34.856963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:34.857476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:35.046782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:35.047397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:35.060832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:35.063421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:35.064268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:35.068057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:35.070888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:35.071854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:35.172264 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67f36afe-8023-44d1-91cd-352c55cda26c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/ips" status: 200 len: 150 microversion: 2.1 time: 0.128256 Nov 02 12:43:35.173312 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2285/4501] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:43:35 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/ips => generated 150 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:35.192001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:35.194897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:35.210021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:35.211437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:35.213682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:35.215469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:35.216899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:35.218639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:35.753029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:35.773495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:35.795403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:35.802006 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64d7a1ef-f647-472f-87be-a9f8af83352e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.962241 Nov 02 12:43:35.806286 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2217/4502] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:34 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:35.829336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:35.833815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:35.855152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:35.857993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:35.863473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:35.864994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:35.865981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:35.866619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:35.867072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:35.880144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:35.882779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:35.884965 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97d727c5-4b13-461a-b3b3-ac1c376caf97 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1321 microversion: 2.26 time: 0.708819 Nov 02 12:43:35.899070 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2286/4503] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:35 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1321 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:35.914560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:35.920994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:35.939547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:35.943243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:35.945520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:35.946851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:35.947654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:35.949884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:36.018504 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 HTTP/1.1 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '87c23ca4-d827-4c9e-8c8b-c4b430b573f2'} Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:36.025409 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.029956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:36.029956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:36.029956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:36.029956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:36.029956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:36.029956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:43:36.029956 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.034269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:36.037539 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-26380edb-4da6-488c-a482-cae7f76f6cd6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 404 len: 111 microversion: 2.1 time: 0.135271 Nov 02 12:43:36.040611 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2287/4504] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:35 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:36.101953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:36.125510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:36.133740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:36.139896 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2ebe5859-1611-4cf6-a070-874c8aa1bd03 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.329451 Nov 02 12:43:36.142401 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2218/4505] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:35 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:36.287305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-155431088", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a20add55-dae0-40be-a4a7-4b9397826fb8"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:36.480108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] validate_networks() for [('a20add55-dae0-40be-a4a7-4b9397826fb8', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:43:36.901127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:36.901772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:36.927030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:36.928031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:36.929331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:36.932953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:36.933934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:36.934581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.119444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:37.136124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:37.147108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:37.148901 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5d59de63-43f4-4210-89e7-b64d5fbfbd18 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.255979 Nov 02 12:43:37.154763 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2219/4506] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:36 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:37.174748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:37.175745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:37.186484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:37.190163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.192428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.196273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.197576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.200897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.201456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.822817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:37.843650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:37.845558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:37.847194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf0f1dfe-3054-4829-a3b1-d179e7b5b6d0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 0.688901 Nov 02 12:43:37.849525 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2220/4507] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:37 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:37.855148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:37.856059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:37.864522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.865340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.865955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.867087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.868041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.868730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.880353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:37.881216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:37.882372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:37.883322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:37.884316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:37.905583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.906894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.907958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.909814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.911603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.912793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.961728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:37.975092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Getting quotas for user 6488e600776547958e00ab146f079c46 and project f63f35f097be4c2b8ebdd5b27e3b73e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:38.000611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:43:38.004384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:43:38.054630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.080504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.082979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.085576 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be883b8d-87ee-4fe3-8de9-6b8971c30a46 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809955 Nov 02 12:43:38.086541 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2288/4508] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:43:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:43:38.099401 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e43de7e3-7018-4e92-89b3-2fc5a0a9bf77 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.246657 Nov 02 12:43:38.130460 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2221/4509] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:37 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:38.144183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5357656c-33e7-4362-9e1b-8f68754769ec tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:38.145863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5357656c-33e7-4362-9e1b-8f68754769ec tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:38.288457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5357656c-33e7-4362-9e1b-8f68754769ec tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.298884 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5357656c-33e7-4362-9e1b-8f68754769ec tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1214 microversion: 2.1 time: 0.167025 Nov 02 12:43:38.302729 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2222/4510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:38 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:38.326826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:38.328346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:38.366626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:38.369662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:38.371377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:38.374284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:38.377074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:38.378192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:38.521882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.536707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.541685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.544047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9ca6e34-9c93-4ab1-ba4f-1a47d256c5c9 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.238153 Nov 02 12:43:38.549710 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2223/4511] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:38 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:38.566520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a226dd3-1368-468a-b1fa-de8059c89400"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:38.586148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:38.592430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:38.593725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:38.597951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:38.600362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:38.601183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:38.602309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:38.643475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-456c0e68-2e71-4db5-893a-1d6f87e222db tempest-ListImageFiltersNegativeTestJSON-276202114 tempest-ListImageFiltersNegativeTestJSON-276202114-project] Calling method '.version_select at 0x7f228e8df820>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:38.675514 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-456c0e68-2e71-4db5-893a-1d6f87e222db tempest-ListImageFiltersNegativeTestJSON-276202114 tempest-ListImageFiltersNegativeTestJSON-276202114-project] HTTP exception thrown: Image not found. Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-456c0e68-2e71-4db5-893a-1d6f87e222db tempest-ListImageFiltersNegativeTestJSON-276202114 tempest-ListImageFiltersNegativeTestJSON-276202114-project] Request method failure captured: Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/images/7674fabf-8372-44ce-a335-9bb4c527a0eb HTTP/1.1 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmX5MXfO2401fhbDyIogvAKqOo768hTysG4001oKxhzshKQe51ly2eYBQgSY94tQPEGs8IgWWWmDYH-SRDzybcESB8SPymEDhLHnjvZ9PhUF-7XYfl1_snxyuoa21XNX-7Y0NvNkwBsLTXI_uTFcb3b_VirB0l66Rqjcc1JsHZCVZR4 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 946cf704542f48f587d9c1b0e8eefd3f Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-276202114 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/946cf704542f48f587d9c1b0e8eefd3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/946cf704542f48f587d9c1b0e8eefd3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/946cf704542f48f587d9c1b0e8eefd3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_946cf704542f48f587d9c1b0e8eefd3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-276202114 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 946cf704542f48f587d9c1b0e8eefd3f Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-276202114 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListImageFiltersNegativeTestJSON-276202114-project Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 2dd5ef7a01ee4199b60bcaefd29297b3 Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-276202114-project Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: method: Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: exception: Image not found. Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7674fabf-8372-44ce-a335-9bb4c527a0eb'} Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7674fabf-8372-44ce-a335-9bb4c527a0eb Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:43:38.678442 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7674fabf-8372-44ce-a335-9bb4c527a0eb could not be found. Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:43:38.683588 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:38.687815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-456c0e68-2e71-4db5-893a-1d6f87e222db tempest-ListImageFiltersNegativeTestJSON-276202114 tempest-ListImageFiltersNegativeTestJSON-276202114-project] Returning 404 to user: Image not found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:38.688870 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-456c0e68-2e71-4db5-893a-1d6f87e222db tempest-ListImageFiltersNegativeTestJSON-276202114 tempest-ListImageFiltersNegativeTestJSON-276202114-project] 10.222.0.45 "GET /compute/v2.1/images/7674fabf-8372-44ce-a335-9bb4c527a0eb" status: 404 len: 62 microversion: 2.1 time: 0.600960 Nov 02 12:43:38.690316 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2289/4512] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:38 2022] GET /compute/v2.1/images/7674fabf-8372-44ce-a335-9bb4c527a0eb => generated 62 bytes in 603 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:43:38.880046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:38.880821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:38.897225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:38.897825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:38.898522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:38.899424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:38.900057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:38.900727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.234137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.236819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:39.252864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.254185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.255395 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-728d1929-5ad1-4df4-a5bb-b445bec3dff0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 0.380520 Nov 02 12:43:39.262369 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91cf5546-bbf2-4ecb-b33b-bf8d6008f1c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709236 Nov 02 12:43:39.264575 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2224/4513] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:43:38 2022] POST /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:39.275278 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2290/4514] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:38 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:39.291827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:39.292848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:39.310642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.314741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.315402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.316442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.317698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.320355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.338850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:39.339886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:39.369224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.372340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.374557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.376196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.377864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.378528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.555653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.569014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.577029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.581273 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-def628dc-421a-4484-ab81-8102e288a42c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.306288 Nov 02 12:43:39.584024 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2225/4515] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:39 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:39.599699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-aa4a11cf-1873-40d7-8cd2-8deb4c572190 req-ff09e9e1-a4ba-41ca-ba0f-f6ea0241ca4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b256ebc-5cba-4a1d-a718-3b25c66ff0a5", "tag": "1baba708-04fd-4e85-ab80-1b7222d0ed41"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:39.638470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.644526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa4a11cf-1873-40d7-8cd2-8deb4c572190 req-ff09e9e1-a4ba-41ca-ba0f-f6ea0241ca4e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.656602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa4a11cf-1873-40d7-8cd2-8deb4c572190 req-ff09e9e1-a4ba-41ca-ba0f-f6ea0241ca4e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.659219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa4a11cf-1873-40d7-8cd2-8deb4c572190 req-ff09e9e1-a4ba-41ca-ba0f-f6ea0241ca4e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.660498 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b523f614-28bc-4706-92ef-b8367da192a7 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1218 microversion: 2.1 time: 0.328178 Nov 02 12:43:39.683461 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2291/4516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:39 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1218 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:39.699005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:39.701796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:39.715703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.719705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.720483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.721318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.723974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.724544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.725150 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-aa4a11cf-1873-40d7-8cd2-8deb4c572190 req-ff09e9e1-a4ba-41ca-ba0f-f6ea0241ca4e service nova] Creating event network-changed:1baba708-04fd-4e85-ab80-1b7222d0ed41 for instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 on n-h2-855650-5 Nov 02 12:43:39.775576 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-aa4a11cf-1873-40d7-8cd2-8deb4c572190 req-ff09e9e1-a4ba-41ca-ba0f-f6ea0241ca4e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183224 Nov 02 12:43:39.782969 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2226/4517] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:39.943194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.958140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.960070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.961737 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a4ab2fb-b9ce-43b4-a579-28eee6b0cd2e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.270652 Nov 02 12:43:39.963277 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2292/4518] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:39 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:40.314548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:40.321744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:40.360193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:40.366312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:40.367466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:40.374545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:40.376279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:40.377302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:40.615684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:40.616614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:40.634682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:40.635213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:40.635690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:40.636491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:40.637340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:40.638293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:40.853035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:40.863971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:40.865702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:40.872341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e31b1900-7f43-4cc4-b3a0-2268a9c84454 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.261700 Nov 02 12:43:40.891830 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2293/4519] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:40 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:40.920268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:40.922306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:40.945380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:40.948216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:40.955161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:40.956560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:40.960679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:40.962563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:41.041390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:41.063258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:41.066349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:41.070042 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9694156-205e-4542-bfee-bd85d05159a4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 0.768946 Nov 02 12:43:41.072236 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2227/4520] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:40 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:41.101894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:41.102442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:41.113719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:41.114388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:41.114920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:41.115655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:41.116126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:41.116549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:41.243284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:41.259298 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-769ae9d5-6ec3-44e6-b26f-f5a2efd3cd31 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1284 microversion: 2.1 time: 0.352263 Nov 02 12:43:41.264891 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2294/4521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:40 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1284 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:41.305431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:41.320523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:41.338044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:41.339848 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e45ceb8-c869-4543-bee7-fd05921b3cdc tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.266115 Nov 02 12:43:41.362727 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2228/4522] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:41 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:41.917143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:41.918242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:41.944805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:41.951234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:41.955795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:41.958206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:41.964559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:41.966431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:41.967553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.106287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:42.108382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:42.121404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.136277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.139650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.143888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.144415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.145614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.146809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.149999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.151406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.154023 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64d9973b-b04d-464a-a546-c105f2a438f7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.242591 Nov 02 12:43:42.177543 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2295/4523] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:41 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:42.288350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:42.289014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:42.305191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.305993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.310916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.311568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.311875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.314977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.761949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.778131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.790183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.791762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e60ed1b9-ac3f-4e73-8bc5-090a34d8b39b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 0.696779 Nov 02 12:43:42.792869 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2229/4524] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:42 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:42.802136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:42.804836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:42.817478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.818408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.819015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.821056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.831982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.835715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.862632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.881046 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-354e0cd8-9837-42fd-81ff-98c131be5fcd tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 0.596478 Nov 02 12:43:42.894362 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2296/4525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:42 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:43.015347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.038681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.040359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.041730 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01219b09-2f40-4f19-af37-52e0d852477e tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1408 microversion: 2.54 time: 0.247662 Nov 02 12:43:43.051184 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2230/4526] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:42 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:43.192018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:43.195728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:43.217826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:43.220055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:43.224249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:43.225532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:43.226249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:43.226942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:43.581014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.618381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.621669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.636948 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bfcc54e0-096d-40cc-89c0-b683a78efc29 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.450514 Nov 02 12:43:43.639480 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2297/4527] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:43 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:43.829399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:43.838842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:43.863409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:43.866460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:43.869002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:43.869511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:43.870158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:43.870940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:43.945556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:43.951506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:43.977057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:43.978128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:43.978862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:43.980173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:43.981025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:43.981840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.713113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:44.762401 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d704b87-0849-41e6-a39e-936dda2f008b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 0.838605 Nov 02 12:43:44.765704 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2298/4528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:43 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:44.789284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:44.798109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:44.855258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.864871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:44.865438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.867639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.875222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.877598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.878549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.882587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:44.884191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:44.885451 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9012e55f-2e83-444d-8108-0814e8d873e4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 1.064053 Nov 02 12:43:44.901534 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2231/4529] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:43 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:44.920086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:44.920871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:44.959835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.960382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.960840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.961600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.962138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.962581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:45.272848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.297038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.307019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.316700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.318682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:45.323984 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-46c128db-d587-491f-a04a-ad052cbc756f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1414 microversion: 2.54 time: 0.555218 Nov 02 12:43:45.334794 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2299/4530] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:44 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1414 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:45.336021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.339410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.347085 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-74bbb76c-d207-4ec0-bece-79f0e5bd5610 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.444212 Nov 02 12:43:45.360933 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2232/4531] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:44 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:45.791329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:45.792423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:45.802668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:45.803178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:45.803641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:45.804381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:45.804843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:45.805277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:45.954192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:45.960767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:45.992896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.016004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.017201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.018913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.020307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.021741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.681887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:46.734834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:46.743705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:46.750749 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a15b68dd-7492-495d-95c8-5542b32a7bee tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 0.804283 Nov 02 12:43:46.771770 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2233/4532] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:45 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:46.816826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:46.829063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:46.830169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:46.851005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-22addadc-cbca-42c1-8287-cbcc0ee794a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 1.063514 Nov 02 12:43:46.857431 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2300/4533] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:45 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:46.865482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.867080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.867868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.888277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.889102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.889856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.898129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:46.899178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:46.936206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.937163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.941162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.942544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.943354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.944124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:47.214826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:47.256188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:47.260180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:47.264970 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99ade9ab-0444-4411-be7e-df4da1fe40ac tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1414 microversion: 2.54 time: 0.476385 Nov 02 12:43:47.268550 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2234/4534] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:46 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1414 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:47.278458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4ee6aa79-94cb-49d9-ada6-13e904d13485 req-2ca69858-669a-4acf-838f-24ac1732ab79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68b97b7-35d5-4a3d-bd0d-74d59317786d", "tag": "9405ae64-068c-4512-b294-8a68c6940bfa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:47.288458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:47.375687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:47.375951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4ee6aa79-94cb-49d9-ada6-13e904d13485 req-2ca69858-669a-4acf-838f-24ac1732ab79 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:47.376873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4ee6aa79-94cb-49d9-ada6-13e904d13485 req-2ca69858-669a-4acf-838f-24ac1732ab79 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:47.380004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4ee6aa79-94cb-49d9-ada6-13e904d13485 req-2ca69858-669a-4acf-838f-24ac1732ab79 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:47.386977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:47.392479 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02e43828-022d-4c8e-8aea-b51cf15a7214 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.531399 Nov 02 12:43:47.395008 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2301/4535] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:46 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:47.404057 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4ee6aa79-94cb-49d9-ada6-13e904d13485 req-2ca69858-669a-4acf-838f-24ac1732ab79 service nova] Creating event network-changed:9405ae64-068c-4512-b294-8a68c6940bfa for instance c68b97b7-35d5-4a3d-bd0d-74d59317786d on n-h1-855650-5 Nov 02 12:43:47.411814 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4ee6aa79-94cb-49d9-ada6-13e904d13485 req-2ca69858-669a-4acf-838f-24ac1732ab79 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140780 Nov 02 12:43:47.412880 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2235/4536] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:47.813118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:47.813759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:47.830016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:47.830644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:47.831104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:47.835858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:47.836463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:47.836934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:47.899483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:47.900506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:47.926962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:47.927706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:47.928498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:47.931134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:47.931947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:47.933782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:47.943809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:47.993256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:48.297200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:48.381673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.392164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.399973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.401567 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-95c4af09-6e66-4da9-929e-8608d5955c26 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 0.593861 Nov 02 12:43:48.407117 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2302/4537] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:47 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:48.431885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:48.441117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:48.456946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.457648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.458567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.459716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.460382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.461002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.763782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.788834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.805419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.807497 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5982f5aa-7ef5-44bd-a27f-e084fb6514b0 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1414 microversion: 2.54 time: 0.382257 Nov 02 12:43:48.810936 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2303/4538] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:48 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1414 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:48.831538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:48.833740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:48.898157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.899050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.899671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.900671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.901306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.901930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:49.029540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:49.052707 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17975e7b-9cfd-4e13-af3b-0833225bc28d tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 1.159082 Nov 02 12:43:49.071656 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2236/4539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:47 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:49.213116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7277708b-75a5-4698-9845-693cec1a53c8 req-10906dbe-a670-4fa5-974b-71f913f6a7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b256ebc-5cba-4a1d-a718-3b25c66ff0a5", "name": "network-vif-plugged", "status": "completed", "tag": "1baba708-04fd-4e85-ab80-1b7222d0ed41"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:49.296272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7277708b-75a5-4698-9845-693cec1a53c8 req-10906dbe-a670-4fa5-974b-71f913f6a7e0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:49.296829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7277708b-75a5-4698-9845-693cec1a53c8 req-10906dbe-a670-4fa5-974b-71f913f6a7e0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:49.299668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7277708b-75a5-4698-9845-693cec1a53c8 req-10906dbe-a670-4fa5-974b-71f913f6a7e0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:49.336228 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7277708b-75a5-4698-9845-693cec1a53c8 req-10906dbe-a670-4fa5-974b-71f913f6a7e0 service nova] Creating event network-vif-plugged:1baba708-04fd-4e85-ab80-1b7222d0ed41 for instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 on n-h2-855650-5 Nov 02 12:43:49.347735 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7277708b-75a5-4698-9845-693cec1a53c8 req-10906dbe-a670-4fa5-974b-71f913f6a7e0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143166 Nov 02 12:43:49.353748 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2237/4540] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:49.445745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:49.459125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:49.478998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:49.484978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:49.487036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:49.487999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:49.488681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:49.490081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:49.498399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:49.512670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:49.523534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:49.527918 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d3ca4f47-ce3a-4844-a55f-0d6c78795990 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.715212 Nov 02 12:43:49.529322 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2304/4541] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:48 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:49.849322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:49.850167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:49.868832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:49.869594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:49.873436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:49.874579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:49.876492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:49.881200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:49.942953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:49.952211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:49.953589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:49.967784 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6261e6fa-8126-43c8-8fdb-c3df24f542bd tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 0.525898 Nov 02 12:43:49.968985 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2238/4542] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:49 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:50.087653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.088339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:50.099066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.115936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.117701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.122208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.122715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.123171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.125553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.126215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.127670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2dedc7a-ae6b-4954-94e6-853dd4ccbb95 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1399 microversion: 2.54 time: 0.282695 Nov 02 12:43:50.131042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.149944 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2305/4543] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:49 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1399 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:50.181288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4373646-a784-488c-9e3c-47018b92b33f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '.version_select at 0x7f228e8b2dc0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.263463 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b4373646-a784-488c-9e3c-47018b92b33f tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-873048975" status: 204 len: 0 microversion: 2.54 time: 0.097348 Nov 02 12:43:50.264865 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2306/4544] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Nov 2 12:43:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-873048975 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:50.278364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.295212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:50.318697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.319860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.320878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.322099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.322803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.323711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.387153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:50.459456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:50.594377 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea266400-0af2-42b8-84a4-f18062da3281 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 204 len: 0 microversion: 2.54 time: 0.319650 Nov 02 12:43:50.598717 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2307/4545] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:43:50 2022] DELETE /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:50.605545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.607238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:50.614493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.615267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.615874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.616758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.617395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.618005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.789025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.802627 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ef84c45-1caa-4294-b37a-67280412cfcf tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 0.719321 Nov 02 12:43:50.810257 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2239/4546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:50 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:50.822206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.825686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:50.836670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.842004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.842847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.843821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.844511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.845102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.868022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.886383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.888657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.901408 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6094be58-4d73-4ee5-8ed6-923dc0a5a201 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.289775 Nov 02 12:43:50.902410 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2308/4547] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:50 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:50.991026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.998021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.999217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:51.010076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.019193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.019965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.020916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.021582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.022274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.039903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:51.045802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:51.049995 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-895fa89b-d452-4f20-ba7d-2e2bab07649c tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1405 microversion: 2.54 time: 0.237814 Nov 02 12:43:51.050858 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2240/4548] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:50 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:51.834877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:51.836046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:51.872800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.878774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.883329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.884986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.888850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.889901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:52.203609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.228755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.230593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.232054 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a3af60c-3f46-4cc3-98fb-d4312791fba7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1361 microversion: 2.26 time: 1.238898 Nov 02 12:43:52.233333 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2309/4549] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:50 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1361 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:52.242673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:52.243748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:52.253441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:52.254622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:52.255482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:52.257074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:52.258213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:52.258947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:52.407705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.422554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.430146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5276ebf0-e5af-4a7c-be0d-b63ab6db86fb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 0.595541 Nov 02 12:43:52.437608 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2241/4550] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:51 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:52.465855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:52.467085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:52.473569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.476993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.480149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:52.480662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:52.481166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:52.481949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:52.482154 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf9857b2-47ce-4adf-95a1-d24b2acf4f71 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1365 microversion: 2.57 time: 0.245759 Nov 02 12:43:52.482479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:52.482915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:52.484619 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2310/4551] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:52 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:52.639921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.649040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.650410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.655449 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c60d2908-1141-42dd-8883-40bc0049b2e5 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1405 microversion: 2.54 time: 0.216190 Nov 02 12:43:52.657264 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2242/4552] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:52 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:53.279945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:53.280597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:53.314418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.323354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.324024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.325039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.325451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.326469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.498960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:53.501458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:53.523970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.525314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.526280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.531294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.532776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.533895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.781778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:53.796091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:53.798181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:53.799742 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ded90698-8c63-40e5-8537-bba43bc9de67 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1544 microversion: 2.26 time: 0.524623 Nov 02 12:43:53.801608 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2311/4553] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:53 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1544 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:53.806878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:53.807717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:53.816520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.817015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.817461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.818214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.818691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.819120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.963768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:53.971674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:53.981955 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9289836-e86b-4c26-b603-9098daf5ac10 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 0.493925 Nov 02 12:43:53.984898 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2243/4554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:53 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:53.999924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.002068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:54.016474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.017811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.020418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.022522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.023291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.025208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:54.026698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.026851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:54.039862 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d104b12-2736-4f71-826d-44d0a1224112 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1371 microversion: 2.57 time: 0.236694 Nov 02 12:43:54.042043 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2312/4555] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:53 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:54.049401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228edb5670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.086540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.087600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.107963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.112302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:54.140687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.141351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.146344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.147296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.153127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.153590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.213331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.214213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.214909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.239555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.240305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.241665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.277469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:54.306027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:54.312904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df50a0f04ea344a6bcd353447b1a9a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd1a3f1c8b847a88e9d7643a2f91002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:54.321605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:54.343591 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0b1a724-5d03-4a45-9581-ee09b5cd3d68 tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 200 len: 1405 microversion: 2.54 time: 0.356395 Nov 02 12:43:54.350051 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2244/4556] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:53 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 1405 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:54.350875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e46faad-5f0c-4425-877c-20ba34526b0d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1792458199" status: 201 len: 0 microversion: 2.26 time: 0.307387 Nov 02 12:43:54.352101 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2313/4557] 10.222.0.45 () {62 vars in 1380 bytes} [Wed Nov 2 12:43:54 2022] PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1792458199 => generated 0 bytes in 309 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 12:43:54.366512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6d252ee9-e7a7-41d9-b088-dd4ed3fdd0f4 req-e16789c7-1454-414b-a53e-602abc29b9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68b97b7-35d5-4a3d-bd0d-74d59317786d", "name": "network-vif-plugged", "status": "completed", "tag": "9405ae64-068c-4512-b294-8a68c6940bfa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:54.373197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-638b4ab5-7d16-4c9f-8508-d0defc0a12b4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228eb8a1f0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.391678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638b4ab5-7d16-4c9f-8508-d0defc0a12b4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.392431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638b4ab5-7d16-4c9f-8508-d0defc0a12b4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.393082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-638b4ab5-7d16-4c9f-8508-d0defc0a12b4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.401917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d252ee9-e7a7-41d9-b088-dd4ed3fdd0f4 req-e16789c7-1454-414b-a53e-602abc29b9d9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.402604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d252ee9-e7a7-41d9-b088-dd4ed3fdd0f4 req-e16789c7-1454-414b-a53e-602abc29b9d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.403252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d252ee9-e7a7-41d9-b088-dd4ed3fdd0f4 req-e16789c7-1454-414b-a53e-602abc29b9d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.424968 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-638b4ab5-7d16-4c9f-8508-d0defc0a12b4 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1792458199" status: 204 len: 0 microversion: 2.26 time: 0.066492 Nov 02 12:43:54.426413 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2314/4558] 10.222.0.45 () {60 vars in 1361 bytes} [Wed Nov 2 12:43:54 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1792458199 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:54.437662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f2292a58040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.441795 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6d252ee9-e7a7-41d9-b088-dd4ed3fdd0f4 req-e16789c7-1454-414b-a53e-602abc29b9d9 service nova] Creating event network-vif-plugged:9405ae64-068c-4512-b294-8a68c6940bfa for instance c68b97b7-35d5-4a3d-bd0d-74d59317786d on n-h1-855650-5 Nov 02 12:43:54.449239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.450388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.451041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.452090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:54.459765 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6d252ee9-e7a7-41d9-b088-dd4ed3fdd0f4 req-e16789c7-1454-414b-a53e-602abc29b9d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108105 Nov 02 12:43:54.461038 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2245/4559] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:54.467959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.469134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.470153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.471635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.473283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.474379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.562753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.564092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.567598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.608655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:54.632554 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1fd02440-ce1f-4da5-ab82-33133f8ca892 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.201830 Nov 02 12:43:54.634088 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2315/4560] 10.222.0.45 () {60 vars in 1295 bytes} [Wed Nov 2 12:43:54 2022] DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:54.647275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9dd8d934-13fc-484d-b8c4-ce16c1322cf2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228e6f3820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.666747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dd8d934-13fc-484d-b8c4-ce16c1322cf2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.674892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dd8d934-13fc-484d-b8c4-ce16c1322cf2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.678617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dd8d934-13fc-484d-b8c4-ce16c1322cf2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.742535 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9dd8d934-13fc-484d-b8c4-ce16c1322cf2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 200 len: 12 microversion: 2.26 time: 0.101345 Nov 02 12:43:54.743588 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2246/4561] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:43:54 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 12 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:54.770503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228ea1c670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.833411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.835772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.836839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.838264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:54.858152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.860277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.861374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.863647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.864782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.865835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.952178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.953369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.954197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.986365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.986859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.987832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.011517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.012743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.024756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.027472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.029744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.030723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.032900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.034138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.056917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:55.091592 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5d6039e-615b-4b31-a195-e9a2faf9f719 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1917611732" status: 201 len: 0 microversion: 2.26 time: 0.337335 Nov 02 12:43:55.092306 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2316/4562] 10.222.0.45 () {62 vars in 1380 bytes} [Wed Nov 2 12:43:54 2022] PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1917611732 => generated 0 bytes in 339 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 12:43:55.102932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.110575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.124229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.126685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.128491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.129402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.130680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.131752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.353372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.367205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.368985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.379085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5f71a78-a636-4a7f-8b09-14abecba9a44 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1371 microversion: 2.57 time: 0.273838 Nov 02 12:43:55.380101 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2317/4563] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:55.390711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-28dfd64a-ada4-4d25-8eab-f2e58de5566b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228e8c2430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.412181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28dfd64a-ada4-4d25-8eab-f2e58de5566b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.412903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28dfd64a-ada4-4d25-8eab-f2e58de5566b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.413387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28dfd64a-ada4-4d25-8eab-f2e58de5566b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.441798 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-28dfd64a-ada4-4d25-8eab-f2e58de5566b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 200 len: 36 microversion: 2.26 time: 0.057030 Nov 02 12:43:55.452313 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2318/4564] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 36 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:55.463002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.463697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] [instance: fc480135-452e-4ed3-90a4-9b6a44fb7048] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.499359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.500207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.503887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.504970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.505662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.507312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.532336 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] HTTP exception thrown: Instance fc480135-452e-4ed3-90a4-9b6a44fb7048 could not be found. Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Request method failure captured: Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 HTTP/1.1 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmXZpAEFBC8YVZv6cDrrzSaWbuaUQW2f_mvkiCtgGVBGnG4-XfFuyGu7l3iZtnQ9S2LrXdkdimgU9KV1qi8WIO7xpEKFtytJ6QrVaGq2VEgoGK1oynZCNMp2tIW5zGFIknsUHFN2NcEtjiWEqFgvkVnwvT5vt5DpgYY7Jjq8-SAJlzs Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.54 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 6dd1a3f1c8b847a88e9d7643a2f91002 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerShowV254Test-1829764729 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd1a3f1c8b847a88e9d7643a2f91002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6dd1a3f1c8b847a88e9d7643a2f91002"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd1a3f1c8b847a88e9d7643a2f91002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6dd1a3f1c8b847a88e9d7643a2f91002"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerShowV254Test-1829764729 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 6dd1a3f1c8b847a88e9d7643a2f91002 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerShowV254Test-1829764729 Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerShowV254Test-1829764729-project Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: df50a0f04ea344a6bcd353447b1a9a8b Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerShowV254Test-1829764729-project Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance fc480135-452e-4ed3-90a4-9b6a44fb7048 could not be found. Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'fc480135-452e-4ed3-90a4-9b6a44fb7048'} Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc480135-452e-4ed3-90a4-9b6a44fb7048 could not be found. Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc480135-452e-4ed3-90a4-9b6a44fb7048 could not be found. Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:55.534643 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:55.538657 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:55.538657 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:55.538657 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:55.538657 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:55.538657 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:55.538657 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc480135-452e-4ed3-90a4-9b6a44fb7048 could not be found. Nov 02 12:43:55.538657 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:43:55.545028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] Returning 404 to user: Instance fc480135-452e-4ed3-90a4-9b6a44fb7048 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:55.549236 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-96238b56-033c-4165-8a6d-22a6ab7927cd tempest-ServerShowV254Test-1829764729 tempest-ServerShowV254Test-1829764729-project] 10.222.0.45 "GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048" status: 404 len: 111 microversion: 2.54 time: 0.093480 Nov 02 12:43:55.550945 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2319/4565] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/fc480135-452e-4ed3-90a4-9b6a44fb7048 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:43:55.563848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228f0973a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.578561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.581469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.582018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.582582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.590019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.590804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.591265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.591991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.592521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.592955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.648552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.654373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.655678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.681192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:55.710612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:55.738702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.745531 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9847a668-5041-4028-88c1-51456f532fe0 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1917611732" status: 204 len: 0 microversion: 2.26 time: 0.193312 Nov 02 12:43:55.748560 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2320/4566] 10.222.0.45 () {60 vars in 1364 bytes} [Wed Nov 2 12:43:55 2022] DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1917611732 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:55.758936 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95ba4a7f-fdf8-4a43-838c-54a443bdc924 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 0.749603 Nov 02 12:43:55.759529 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2247/4567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:55.760917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f4dbbd6-6747-4822-9d5c-527376f7c91d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228ecff4c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.802437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f4dbbd6-6747-4822-9d5c-527376f7c91d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.803494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f4dbbd6-6747-4822-9d5c-527376f7c91d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.804009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f4dbbd6-6747-4822-9d5c-527376f7c91d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.820356 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f4dbbd6-6747-4822-9d5c-527376f7c91d tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 200 len: 12 microversion: 2.26 time: 0.068079 Nov 02 12:43:55.821675 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2321/4568] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:55.834803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228e521c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.851543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.854159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.854928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.859813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.878603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.880084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.881074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.881847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.882484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.883119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.959089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.959591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.966768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.996494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:56.058636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08201496-c2b4-4006-a624-1bb47fd79334 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.228452 Nov 02 12:43:56.060328 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2248/4569] 10.222.0.45 () {60 vars in 1295 bytes} [Wed Nov 2 12:43:55 2022] DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:56.074556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228e2939d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.104411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.104918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.105370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.105868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.126278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.126650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.129629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.130373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.130857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.131307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.218761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.219274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.219750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.240282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.240784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.241236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.301397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:56.320737 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff2c5b15-a3f5-4a18-80b4-7282ec42eef7 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1162383816" status: 201 len: 0 microversion: 2.26 time: 0.254916 Nov 02 12:43:56.321828 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2322/4570] 10.222.0.45 () {62 vars in 1380 bytes} [Wed Nov 2 12:43:56 2022] PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1162383816 => generated 0 bytes in 257 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Nov 02 12:43:56.334512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f22929f0790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.358130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.358641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.359092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.364596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.371243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.372111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.372632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.373724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.374273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.374898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.406117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.406760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.420002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.420380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.420834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.421571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.422066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.440250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.440962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.442675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.442860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.457304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.458362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.459134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.507462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:56.522269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:56.557641 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b4338bb-00c0-4c27-91db-693283089fb5 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1302336506" status: 201 len: 0 microversion: 2.26 time: 0.228601 Nov 02 12:43:56.560566 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2249/4571] 10.222.0.45 () {62 vars in 1380 bytes} [Wed Nov 2 12:43:56 2022] PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1302336506 => generated 0 bytes in 232 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 12:43:56.571165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228e502ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.583323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.584310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.585000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.585733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.593922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.594712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.595342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.596423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.597074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.597698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.628575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.629225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.635018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:56.642405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.654006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:56.658057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:56.659798 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a346ee30-89f3-40e5-be8b-daa14ca01e90 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1371 microversion: 2.57 time: 0.258482 Nov 02 12:43:56.662778 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2323/4572] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:56 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:56.685869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:56.723191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5de5ade0-167b-459e-b406-2a3e05bd3b05 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.157193 Nov 02 12:43:56.729912 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2250/4573] 10.222.0.45 () {60 vars in 1295 bytes} [Wed Nov 2 12:43:56 2022] DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:56.747734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c79547e-4f76-42d2-9961-e1647478dfcf tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228eed7280>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.781682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c79547e-4f76-42d2-9961-e1647478dfcf tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.785477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c79547e-4f76-42d2-9961-e1647478dfcf tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.788389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.789014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c79547e-4f76-42d2-9961-e1647478dfcf tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.790346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.800509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.801383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.802939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.807378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.808738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.810538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.836481 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c79547e-4f76-42d2-9961-e1647478dfcf tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 200 len: 12 microversion: 2.26 time: 0.099820 Nov 02 12:43:56.838157 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2324/4574] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:43:56 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 12 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:56.850596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228edfae50>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.866701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.867835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.868532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.869585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.879526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.880309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.881524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.883316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.884071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.886318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.927652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.928314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.928769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.961907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:57.017306 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6bbfee3-d16d-4529-96ea-d615501c6655 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.171432 Nov 02 12:43:57.019387 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2325/4575] 10.222.0.45 () {60 vars in 1295 bytes} [Wed Nov 2 12:43:56 2022] DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 12:43:57.040296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228ecf68b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:57.076689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.077196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.077849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.078902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:57.091545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.092211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.092678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.095772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.096539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.097148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.181669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.182216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.187793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.227034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:57.253834 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84f717d9-53a8-4e00-bd30-3ebbad86b163 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 0.460673 Nov 02 12:43:57.255129 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2251/4576] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:56 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:57.290057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.291529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.294943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.377672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:57.419154 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-517baec5-28f2-48aa-8c96-73064a84f436 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1276169914" status: 201 len: 0 microversion: 2.26 time: 0.393691 Nov 02 12:43:57.428043 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2326/4577] 10.222.0.45 () {62 vars in 1380 bytes} [Wed Nov 2 12:43:57 2022] PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-1276169914 => generated 0 bytes in 403 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 12:43:57.440729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228daff670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:57.471275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.472473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.473236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.477787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:57.500871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.502893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.504475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.505456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.506113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.507033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.561218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.562627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.563324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.578113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.579239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.579900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.629993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:57.677829 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-756f445c-38a0-4774-a52f-34f59d70ec0f tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-2104377497" status: 201 len: 0 microversion: 2.26 time: 0.244586 Nov 02 12:43:57.678972 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2252/4578] 10.222.0.45 () {62 vars in 1380 bytes} [Wed Nov 2 12:43:57 2022] PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags/tempest-tag-2104377497 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 12:43:57.690326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Action: 'update_all', calling method: .version_select at 0x7f2292a58040>, body: {"tags": ["tempest-tag-992441046", "tempest-tag-1354062482"]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:57.706994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:57.711241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:57.721792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.724125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.724603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.727472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:57.728758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.729395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.729992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.732264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.736987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.737605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.744856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.745390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.748989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.752226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.752796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.753256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.810399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.813757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.815197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.877197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:57.914763 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0aa7d174-81f9-4e08-a15e-7a7ec518875b tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 200 len: 61 microversion: 2.26 time: 0.228248 Nov 02 12:43:57.922420 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2327/4579] 10.222.0.45 () {62 vars in 1312 bytes} [Wed Nov 2 12:43:57 2022] PUT /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 61 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:57.936527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91393ad4-9000-4a8d-ae7d-080eda42bb18 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228e992940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:57.954981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91393ad4-9000-4a8d-ae7d-080eda42bb18 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.958151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91393ad4-9000-4a8d-ae7d-080eda42bb18 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.958829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91393ad4-9000-4a8d-ae7d-080eda42bb18 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.977405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:57.982476 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91393ad4-9000-4a8d-ae7d-080eda42bb18 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 200 len: 61 microversion: 2.26 time: 0.057560 Nov 02 12:43:57.990882 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2328/4580] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Nov 2 12:43:57 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 61 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:57.999352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.002558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '.version_select at 0x7f228e9929d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:58.004452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.005915 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e75f85c6-241d-4e55-acd7-980d0e05161c tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1371 microversion: 2.57 time: 0.312424 Nov 02 12:43:58.008421 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2253/4581] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:57 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:58.014147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.014989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.015713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.016419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:58.023739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.024791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.025862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.027047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.028324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.028975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.099812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.100639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.101299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.135482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'flavor' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:58.176715 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49d0f9c5-61ea-49c3-9b74-ae6e941045eb tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.179256 Nov 02 12:43:58.177384 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2329/4582] 10.222.0.45 () {60 vars in 1295 bytes} [Wed Nov 2 12:43:57 2022] DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5/tags => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 12:43:58.189164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:58.189879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:58.205542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.206432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.206902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.209211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.210893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.212010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.275680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:58.298239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:58.298863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:58.309817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.314257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.314785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.315645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.316120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.316608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.526138 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6d0d9ea-059f-4a69-8d9a-484753d07a80 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 204 len: 0 microversion: 2.26 time: 0.342296 Nov 02 12:43:58.528225 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2254/4583] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:43:58 2022] DELETE /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:58.548641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:58.550243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:58.561220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.562575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.563350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.564512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.565219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.566307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.621200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.631950 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d5142a9-d3a1-4bbd-9dc3-d8ff360ac84e tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1314 microversion: 2.1 time: 0.338945 Nov 02 12:43:58.647063 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2330/4584] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:58 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:58.846341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.867169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.870819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.873005 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-abab0997-09bd-4d8f-99e0-67f1a4a08899 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1550 microversion: 2.26 time: 0.331980 Nov 02 12:43:58.873993 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2255/4585] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:58 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1550 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:59.041922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:59.042531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:59.067235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.068117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.068832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.069777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.070514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.071194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.210411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.229781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.232128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.233646 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c24336c1-2819-4eab-805a-690a5450d923 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1356 microversion: 2.57 time: 0.196374 Nov 02 12:43:59.248005 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2331/4586] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:59 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1356 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:59.278244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:59.282833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:59.322344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.347933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.349237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.352909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.353831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.356537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.437678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:59.605138 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-06b4d2ed-535a-4049-90c4-c13459fc9754 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "DELETE /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 204 len: 0 microversion: 2.57 time: 0.337341 Nov 02 12:43:59.606473 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2256/4587] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:43:59 2022] DELETE /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:59.619700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:59.620915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:59.630664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:59.632492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.633260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.633686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.634547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.635002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.636299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.661020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:59.662061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:59.674397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.675181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:DELETE=4,nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:59.675880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.678611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.679731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.684708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.685432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.792946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.808075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.812992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.814299 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7355e6cf-1a34-4317-bb76-9640c5b5d2d7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1362 microversion: 2.57 time: 0.199075 Nov 02 12:43:59.826028 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2332/4588] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:59 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:59.909760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:59.910765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:59.938128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.957117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.957117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.957117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.957117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.957117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.182257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:00.194924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ebd6d05-6f46-4397-ae08-0a6b7f2b8951 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1502 microversion: 2.1 time: 0.537207 Nov 02 12:44:00.198569 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2257/4589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:59 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1502 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:00.209259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30732130-b101-4642-ba4a-ddb444e85076 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: .version_select at 0x7f228e520940>, body: {"keypair": {"name": "tempest-keypair-1330897564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9GXvPJbaDHqrN09rhjKwTl/WF7PTwmJ/AAjv0+8I+CvviAZEp/I+hWK4duOJqlKjzTebSWma4r1gLHmLkjh4rfaHfs2oQytlaR6ho5rUfWjGNYYWYUPnopQlqCuQ7J/g=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:00.243938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:00.269224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-30732130-b101-4642-ba4a-ddb444e85076 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:00.285518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-30732130-b101-4642-ba4a-ddb444e85076 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for user be15916efb09427eb892d0104e3db5ff and project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:00.390329 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30732130-b101-4642-ba4a-ddb444e85076 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189504 Nov 02 12:44:00.396439 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2258/4590] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:44:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:00.430779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:00.438739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:00.464855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.466578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.469782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.473664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.480517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.481608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.513800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lazy-loading 'flavor' on Instance uuid c68b97b7-35d5-4a3d-bd0d-74d59317786d {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:00.610356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=4,nova_cell1:RELEASE=1,nova_cell1:UPDATE=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:00.636583 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02c83028-0bf8-486a-a043-619349790610 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "POST /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d/action" status: 202 len: 0 microversion: 2.1 time: 0.221902 Nov 02 12:44:00.638051 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2259/4591] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:44:00 2022] POST /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:44:00.652532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:00.662501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:00.667835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:00.679072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.687715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:00.688080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.688878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.689865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.690591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.691251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.704895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:00.751233 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dbd96329-5d10-4952-a71d-2350dfe4d7b2 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1550 microversion: 2.26 time: 0.846671 Nov 02 12:44:00.757240 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2333/4592] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:59 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1550 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:44:00.850878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:00.851771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:00.883771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.885353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.887664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.892416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.894953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.896178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.169819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:01.179710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:01.188324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:01.190492 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52379d04-034e-4e54-ac82-f0b0abe2d141 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1362 microversion: 2.57 time: 0.344536 Nov 02 12:44:01.200528 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2334/4593] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:44:00 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:44:01.477039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:01.489035 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-533729eb-1cda-4a83-a9f2-3f4fc985b529 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1510 microversion: 2.1 time: 0.846603 Nov 02 12:44:01.491445 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2260/4594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:00 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1510 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:01.787023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:01.787518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:01.799829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.800396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.800939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.801771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.803153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.803610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:02.229010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:02.229668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:02.250193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:02.250704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:02.251236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:02.260214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:02.260849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:02.264057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.015229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:03.024333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:03.025884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:03.053208 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab9fb6cf-0210-4135-8faa-5f4f6fb45452 tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1508 microversion: 2.26 time: 1.270672 Nov 02 12:44:03.063066 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2335/4595] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:44:01 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1508 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:44:03.086203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:03.086678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:03.125005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.125509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.125997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.141540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:03.142125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.142584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.142762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.162019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:03.163580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:03.164956 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d2d1f9de-9163-45af-acc6-df2e731daa79 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1362 microversion: 2.57 time: 0.940187 Nov 02 12:44:03.192244 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2261/4596] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:44:02 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1362 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:44:03.537310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a30e45db-2b6e-4ddc-b971-afeca19dc452 req-71d249c7-9463-4f9e-89ac-41208b46c0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b256ebc-5cba-4a1d-a718-3b25c66ff0a5", "name": "network-vif-deleted", "tag": "1baba708-04fd-4e85-ab80-1b7222d0ed41"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:03.558217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a30e45db-2b6e-4ddc-b971-afeca19dc452 req-71d249c7-9463-4f9e-89ac-41208b46c0ad service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.559815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a30e45db-2b6e-4ddc-b971-afeca19dc452 req-71d249c7-9463-4f9e-89ac-41208b46c0ad service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.560477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a30e45db-2b6e-4ddc-b971-afeca19dc452 req-71d249c7-9463-4f9e-89ac-41208b46c0ad service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.591593 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a30e45db-2b6e-4ddc-b971-afeca19dc452 req-71d249c7-9463-4f9e-89ac-41208b46c0ad service nova] Creating event network-vif-deleted:1baba708-04fd-4e85-ab80-1b7222d0ed41 for instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 on n-h2-855650-5 Nov 02 12:44:03.603905 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a30e45db-2b6e-4ddc-b971-afeca19dc452 req-71d249c7-9463-4f9e-89ac-41208b46c0ad service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072417 Nov 02 12:44:03.610359 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2262/4597] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:04.099471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:04.102880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:04.150357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.150989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.151469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.152257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.157257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.159243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.285950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.287616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.289293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.292556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lazy-loading 'fault' on Instance uuid 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:04.293036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.307871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b2dfe892-1817-4e9c-8c33-a7968ecc2300 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1493 microversion: 2.1 time: 1.239208 Nov 02 12:44:04.310484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2336/4598] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:03 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1493 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:04.322695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:04.325763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:04.342058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.342979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.343715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.344807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.346334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.347070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.496974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.500447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.504697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.509761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lazy-loading 'fault' on Instance uuid 102a0ccb-7488-4cf2-9c89-49c064e81190 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:04.583039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.607654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.614163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96762e4b3b16498eba80137ac2c80470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5113f5c6d4c4d1bb1b01ebfa02c1f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.618061 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-41bfd891-024d-4f55-97d3-6c7441b7d87a tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 200 len: 1351 microversion: 2.26 time: 0.527822 Nov 02 12:44:04.627381 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2263/4599] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:44:04 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 1351 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:44:04.635969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:04.641093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:04.671190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.672273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.673025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.678808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.680348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.684452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.781409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.821386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.824036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:44:04.832811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16205d7e87df417b83011e342371c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bd7e1bf50e4862bedfe599c5eff64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.836095 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de60519b-1cd2-43f7-becf-e270a534230f tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 200 len: 1367 microversion: 2.57 time: 0.524011 Nov 02 12:44:04.844411 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2337/4600] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:44:04 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:44:05.050064 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a89ded6f-b8c1-4d2c-99c6-8aaf3a353875 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 204 len: 0 microversion: 2.1 time: 0.420311 Nov 02 12:44:05.053041 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2264/4601] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:04 2022] DELETE /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:44:05.062439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:05.063185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:05.077622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.082751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.083210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.083957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.084418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.084848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.422813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:05.458814 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ec31664e-9ecb-4bb6-b36d-66fd7e6deaba tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1499 microversion: 2.1 time: 0.399167 Nov 02 12:44:05.462154 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2338/4602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:05 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1499 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:05.550140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-407696457", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "d47b9766-9ea9-4dab-8372-6928029c0b78"}, {"uuid": "5dcaa484-59bb-49a9-b8d2-0908e32c7463"}, {"uuid": "d47b9766-9ea9-4dab-8372-6928029c0b78"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:05.661271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:05.662362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] [instance: 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:05.674893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.675600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.676996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.679061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.679548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.679983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.689744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] validate_networks() for [('d47b9766-9ea9-4dab-8372-6928029c0b78', None, None, None, None, None), ('5dcaa484-59bb-49a9-b8d2-0908e32c7463', None, None, None, None, None), ('d47b9766-9ea9-4dab-8372-6928029c0b78', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:44:05.716324 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] HTTP exception thrown: Instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 could not be found. Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Request method failure captured: Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 HTTP/1.1 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmXxT2LN0RpKymu5AZuKtrh8tE6K9P1ZDATILzsr_FNU0E8oUKnxwVnIzkljb47LhC8XGJvETvRwdDknoX2-XfhDIiluU4hOFrT_NgeREA3BMHZd89OWCYowNsLoRjlshgftTu7gVptPd7HaEYnpdmo5hf3XcN6DvmtYQJ1GQABKjCU Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.26 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f5113f5c6d4c4d1bb1b01ebfa02c1f97 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerTagsTestJSON-310194296 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5113f5c6d4c4d1bb1b01ebfa02c1f97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f5113f5c6d4c4d1bb1b01ebfa02c1f97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f5113f5c6d4c4d1bb1b01ebfa02c1f97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f5113f5c6d4c4d1bb1b01ebfa02c1f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerTagsTestJSON-310194296 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f5113f5c6d4c4d1bb1b01ebfa02c1f97 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerTagsTestJSON-310194296 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerTagsTestJSON-310194296-project Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 96762e4b3b16498eba80137ac2c80470 Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerTagsTestJSON-310194296-project Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 could not be found. Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1b256ebc-5cba-4a1d-a718-3b25c66ff0a5'} Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 could not be found. Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 could not be found. Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:05.721227 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 could not be found. Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] Returning 404 to user: Instance 1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:05.725764 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-81e3f96f-9a6d-4784-87ed-bc9a46ff28ed tempest-ServerTagsTestJSON-310194296 tempest-ServerTagsTestJSON-310194296-project] 10.222.0.45 "GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5" status: 404 len: 111 microversion: 2.26 time: 0.066868 Nov 02 12:44:05.740153 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2339/4603] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:44:05 2022] GET /compute/v2.1/servers/1b256ebc-5cba-4a1d-a718-3b25c66ff0a5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:44:05.874860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:05.875738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] [instance: 102a0ccb-7488-4cf2-9c89-49c064e81190] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:05.886284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.897939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.898436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.902774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.903333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.904304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.952664 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] HTTP exception thrown: Instance 102a0ccb-7488-4cf2-9c89-49c064e81190 could not be found. Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Request method failure captured: Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 HTTP/1.1 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmXjFgsvPvazd3zZJiPZIdbgNvuIxJCYviOkA_EJOWTSplCvQv9Dp7UijruYRyCPllMxdLhy74x3TO8gJt3pX_nlxJ9grgZE1jQThRIwHf5x628osX1iHDekhEVpUgWUEuZxSBz6ZATPhsRKAiycVY5k0APvyjJtHZ48ULBYlGI09Go Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.57 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c5bd7e1bf50e4862bedfe599c5eff64d Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerShowV257Test-571211887 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c5bd7e1bf50e4862bedfe599c5eff64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c5bd7e1bf50e4862bedfe599c5eff64d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c5bd7e1bf50e4862bedfe599c5eff64d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c5bd7e1bf50e4862bedfe599c5eff64d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerShowV257Test-571211887 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c5bd7e1bf50e4862bedfe599c5eff64d Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerShowV257Test-571211887 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerShowV257Test-571211887-project Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 16205d7e87df417b83011e342371c127 Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerShowV257Test-571211887-project Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 102a0ccb-7488-4cf2-9c89-49c064e81190 could not be found. Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '102a0ccb-7488-4cf2-9c89-49c064e81190'} Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102a0ccb-7488-4cf2-9c89-49c064e81190 could not be found. Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102a0ccb-7488-4cf2-9c89-49c064e81190 could not be found. Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:05.954507 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102a0ccb-7488-4cf2-9c89-49c064e81190 could not be found. Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] Returning 404 to user: Instance 102a0ccb-7488-4cf2-9c89-49c064e81190 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ced91c59-cb8b-466f-9577-4c0818a35da7 tempest-ServerShowV257Test-571211887 tempest-ServerShowV257Test-571211887-project] 10.222.0.45 "GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190" status: 404 len: 111 microversion: 2.57 time: 0.085966 Nov 02 12:44:05.959549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2340/4604] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:44:05 2022] GET /compute/v2.1/servers/102a0ccb-7488-4cf2-9c89-49c064e81190 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:44:06.501626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:06.504824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:06.524846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:06.525359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:06.525802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:06.526560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:06.527018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:06.527493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:07.479404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:07.490060 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-caeba373-050b-496a-8025-c4f823cf1370 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1499 microversion: 2.1 time: 0.992299 Nov 02 12:44:07.490657 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2341/4605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:06 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1499 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:08.319428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-623605204", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92a568cc-930f-412f-9bc6-cc5b26f3a471"}], "security_groups": [{"name": "tempest-securitygroup--1226997459"}], "key_name": "tempest-keypair-1330897564", "user_data": "}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:08.883328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] validate_networks() for [('92a568cc-930f-412f-9bc6-cc5b26f3a471', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:44:09.345649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:44:09.348970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:44:09.349323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:44:09.349769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:44:09.350243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:44:09.379475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:09.380219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:09.381495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:09.386743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:09.387283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:09.390479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:09.510912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Getting quotas for project d0dcd863d02d453abfdff23c335b1d19. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:09.532513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Getting quotas for user f74d8e5e8ac74a3e99d602abe159308e and project d0dcd863d02d453abfdff23c335b1d19. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:09.595476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:44:09.608404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:44:09.785291 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70ff665e-8664-4aa1-aa7e-d48c2d337a67 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.241476 Nov 02 12:44:09.800535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2265/4606] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:44:09.827703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:09.830478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:09.850441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:09.853156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:09.853811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:09.854732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:09.857052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:09.860542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:10.022476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6488e600776547958e00ab146f079c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f35f097be4c2b8ebdd5b27e3b73e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:10.038596 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a8401b1-ff6f-49f3-9dc1-4194c8645cde tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 200 len: 1457 microversion: 2.1 time: 0.240837 Nov 02 12:44:10.040277 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2266/4607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:09 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 1457 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:10.046607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a16d86ce-c704-41b2-91fe-5588d0e7c37d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:10.047653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a16d86ce-c704-41b2-91fe-5588d0e7c37d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:10.176734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a16d86ce-c704-41b2-91fe-5588d0e7c37d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:10.189172 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a16d86ce-c704-41b2-91fe-5588d0e7c37d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1212 microversion: 2.1 time: 0.144150 Nov 02 12:44:10.189844 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2267/4608] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:10 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1212 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:10.341882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8542c5ed-ae4b-4966-9a48-b51f4c7a48f0 req-11250db2-4e2b-414c-81e4-4c8653a6929e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68b97b7-35d5-4a3d-bd0d-74d59317786d", "name": "network-vif-deleted", "tag": "9405ae64-068c-4512-b294-8a68c6940bfa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:10.400803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8542c5ed-ae4b-4966-9a48-b51f4c7a48f0 req-11250db2-4e2b-414c-81e4-4c8653a6929e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:10.409561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8542c5ed-ae4b-4966-9a48-b51f4c7a48f0 req-11250db2-4e2b-414c-81e4-4c8653a6929e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:10.417050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8542c5ed-ae4b-4966-9a48-b51f4c7a48f0 req-11250db2-4e2b-414c-81e4-4c8653a6929e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:10.485460 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8542c5ed-ae4b-4966-9a48-b51f4c7a48f0 req-11250db2-4e2b-414c-81e4-4c8653a6929e service nova] Creating event network-vif-deleted:9405ae64-068c-4512-b294-8a68c6940bfa for instance c68b97b7-35d5-4a3d-bd0d-74d59317786d on n-h1-855650-5 Nov 02 12:44:10.499753 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8542c5ed-ae4b-4966-9a48-b51f4c7a48f0 req-11250db2-4e2b-414c-81e4-4c8653a6929e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182201 Nov 02 12:44:10.506318 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2268/4609] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:10.868850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:44:10.869316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:44:10.869803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:44:10.870519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:44:10.871587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:44:10.884533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:10.884876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:10.886245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:10.887923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:10.889993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:10.890744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:10.924081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:10.933094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for user be15916efb09427eb892d0104e3db5ff and project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:10.956747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:44:10.959562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:44:11.051356 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-12e80f49-1782-48fd-bc20-c1cd10815655 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.736225 Nov 02 12:44:11.056380 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2342/4610] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:44:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:44:11.082556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.085661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.091056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-12946a85-5e41-4e9e-a5b3-5dba05b16a85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.092851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-12946a85-5e41-4e9e-a5b3-5dba05b16a85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.107803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.108631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.109400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.111249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.111978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.112737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.132744 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d HTTP/1.1 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c68b97b7-35d5-4a3d-bd0d-74d59317786d'} Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.135134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.139446 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.139446 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.139446 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.139446 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.139446 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.139446 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.139446 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.142031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.143080 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d97ce984-13ac-4dd6-b70e-604be966a91a tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 404 len: 111 microversion: 2.1 time: 0.077994 Nov 02 12:44:11.144545 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2269/4611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.158055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.158734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.165865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.166771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.167396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.168793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.170277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.171184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.212343 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d HTTP/1.1 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c68b97b7-35d5-4a3d-bd0d-74d59317786d'} Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.215959 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.220419 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.222866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.226871 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-13d36bf2-65cd-42bc-ab77-8cb291ded9d6 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 404 len: 111 microversion: 2.1 time: 0.072371 Nov 02 12:44:11.229896 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2270/4612] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:11 2022] DELETE /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.242491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.243618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.269923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.273414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.274312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.275580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.277052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.290372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.308613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-12946a85-5e41-4e9e-a5b3-5dba05b16a85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:11.321491 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-12946a85-5e41-4e9e-a5b3-5dba05b16a85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1241 microversion: 2.1 time: 0.249284 Nov 02 12:44:11.323323 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2343/4613] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1241 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:11.361503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.372615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: c68b97b7-35d5-4a3d-bd0d-74d59317786d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.396538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.397084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.397532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.398298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.398751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.400521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.456993 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d HTTP/1.1 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c68b97b7-35d5-4a3d-bd0d-74d59317786d'} Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.458658 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance c68b97b7-35d5-4a3d-bd0d-74d59317786d could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.462671 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-27c9f9e5-508e-40c2-9b08-fa1bf920b2f3 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d" status: 404 len: 111 microversion: 2.1 time: 0.135289 Nov 02 12:44:11.467885 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2344/4614] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] GET /compute/v2.1/servers/c68b97b7-35d5-4a3d-bd0d-74d59317786d => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.483764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.484599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.503737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.504334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.506732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.506858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.507986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.508421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.532883 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 HTTP/1.1 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '87c23ca4-d827-4c9e-8c8b-c4b430b573f2'} Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.534482 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb876bbf-c143-4eb0-adfa-1249b2cebdb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 404 len: 111 microversion: 2.1 time: 0.066799 Nov 02 12:44:11.539191 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2345/4615] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:11 2022] DELETE /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.547595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.548215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 87c23ca4-d827-4c9e-8c8b-c4b430b573f2] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.555226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.555632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.556256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.556972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.557426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.557880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.575274 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 HTTP/1.1 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '87c23ca4-d827-4c9e-8c8b-c4b430b573f2'} Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.577021 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.581676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.581676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.581676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.581676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.581676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.581676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. Nov 02 12:44:11.581676 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.583332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 87c23ca4-d827-4c9e-8c8b-c4b430b573f2 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.584852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7bde1a89-40ff-43a6-9ce9-8233427d2764 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2" status: 404 len: 111 microversion: 2.1 time: 0.041683 Nov 02 12:44:11.586029 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2346/4616] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] GET /compute/v2.1/servers/87c23ca4-d827-4c9e-8c8b-c4b430b573f2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.595495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.596307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.603847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.604643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.605491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.606583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.607339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.608051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.625737 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 HTTP/1.1 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7621dc5d-4750-4b8a-b0d7-94b4346154f7'} Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.628197 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.632546 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.638303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.639550 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8c66cf5-5bf8-449f-b955-3b046b36f49b tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 404 len: 111 microversion: 2.1 time: 0.049748 Nov 02 12:44:11.640752 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2347/4617] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:11 2022] DELETE /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.656018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.657042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 7621dc5d-4750-4b8a-b0d7-94b4346154f7] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.671416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.675709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.677672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.679099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.680812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.682454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.729020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 HTTP/1.1 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7621dc5d-4750-4b8a-b0d7-94b4346154f7'} Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.734715 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.738621 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.738621 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.738621 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.738621 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.738621 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.738621 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. Nov 02 12:44:11.738621 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.744145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 7621dc5d-4750-4b8a-b0d7-94b4346154f7 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.745544 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e94eea07-00cc-4291-bb5e-8ff4406d8617 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7" status: 404 len: 111 microversion: 2.1 time: 0.100423 Nov 02 12:44:11.749065 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2348/4618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] GET /compute/v2.1/servers/7621dc5d-4750-4b8a-b0d7-94b4346154f7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.765003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.766538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.785155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.787665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.789191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.791716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.796842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.797659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.836882 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e HTTP/1.1 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'ed14fcc4-b09f-4368-9370-e6c857e3826e'} Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.849189 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.852912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.853918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:11.857889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.859085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e3e2638f-c8c3-42e3-8f30-c72fcbf3ff35 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 404 len: 111 microversion: 2.1 time: 0.106475 Nov 02 12:44:11.860261 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2349/4619] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:11 2022] DELETE /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.869012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.870572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: ed14fcc4-b09f-4368-9370-e6c857e3826e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.879794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.881028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.882402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.882547 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-47158ea1-d8e3-4f46-81ed-891b90df260a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1208 microversion: 2.1 time: 0.650499 Nov 02 12:44:11.883038 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2271/4620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1208 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:11.884321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.885014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.885655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.945127 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e HTTP/1.1 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'ed14fcc4-b09f-4368-9370-e6c857e3826e'} Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.951042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.956544 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.956544 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.956544 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.956544 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.956544 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.956544 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. Nov 02 12:44:11.956544 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.959021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance ed14fcc4-b09f-4368-9370-e6c857e3826e could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.960721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d37518f-f982-4f20-863b-e240f0ea7dcb tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e" status: 404 len: 111 microversion: 2.1 time: 0.095875 Nov 02 12:44:11.961896 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2350/4621] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] GET /compute/v2.1/servers/ed14fcc4-b09f-4368-9370-e6c857e3826e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.969868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.970365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.991497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.992670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.995534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.998790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.003417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.004833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.079488 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 HTTP/1.1 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '57c35e27-dccd-4e41-a357-a686522b73d9'} Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:12.085624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.091172 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.097160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:12.099653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d613548d-13a8-43e7-885f-13495d0a2277 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9" status: 404 len: 111 microversion: 2.1 time: 0.132673 Nov 02 12:44:12.102173 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2272/4622] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:11 2022] DELETE /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:44:12.111774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:12.112628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 57c35e27-dccd-4e41-a357-a686522b73d9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:12.139112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.139624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.140082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.142695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.143341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.143793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.195003 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 HTTP/1.1 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '57c35e27-dccd-4e41-a357-a686522b73d9'} Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:12.196863 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.201907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:12.201907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:12.201907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:12.201907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:12.201907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:12.201907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. Nov 02 12:44:12.201907 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:12.206415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 57c35e27-dccd-4e41-a357-a686522b73d9 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:12.207497 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f4ec0f42-8c5f-4547-830f-8b68ab14b9a5 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9" status: 404 len: 111 microversion: 2.1 time: 0.101359 Nov 02 12:44:12.209954 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2351/4623] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:12 2022] GET /compute/v2.1/servers/57c35e27-dccd-4e41-a357-a686522b73d9 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:12.353424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:12.354627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:12.460593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.463116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.464830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.469187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.473078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.478478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.820319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:12.831123 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7bef2787-7029-47a8-ba53-58a716686cfc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1245 microversion: 2.1 time: 0.484974 Nov 02 12:44:12.862998 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2273/4624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:12 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1245 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:12.908551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:12.909945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:12.954668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.955201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.959783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.960549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.969600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.970246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:13.613008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:13.649945 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d778456-82be-4387-a3d6-f3be81b80825 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1270 microversion: 2.1 time: 0.744752 Nov 02 12:44:13.659573 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2352/4625] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:12 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1270 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:13.863222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:13.863842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:13.883312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:13.883821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:13.884301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:13.885050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:13.895884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:13.898771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:14.561018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:14.570070 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85f53d7f-db52-46ab-a441-197fd281a45f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1311 microversion: 2.1 time: 0.711368 Nov 02 12:44:14.577675 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2274/4626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:13 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1311 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:14.677835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:14.678809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:14.702015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:14.702960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:14.704377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:14.705414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:14.707646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:14.709414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:15.103109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:15.119603 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-563af973-bf83-426f-bfa2-02a03fba8a4f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1270 microversion: 2.1 time: 0.444597 Nov 02 12:44:15.138010 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2353/4627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:14 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1270 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:15.597828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:15.598383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:15.622971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:15.623400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:15.623848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:15.624577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:15.625035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:15.625465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.154430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:16.159367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:16.187192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:16.187720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:16.188691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.191785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:16.193436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:16.195511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.513030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:16.522657 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59f8f8ad-ff7c-4c3a-8855-e8b5c30da04c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1270 microversion: 2.1 time: 0.373728 Nov 02 12:44:16.523881 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2354/4628] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:16 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1270 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:16.636855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:16.657487 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-063073ce-4bed-4670-a158-fffca6147ddf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1299 microversion: 2.1 time: 1.061286 Nov 02 12:44:16.660886 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2275/4629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:15 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1299 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:17.548371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:17.551199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:17.580218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:17.584371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:17.587250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:17.587989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:17.588454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:17.595855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:17.695985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:17.699463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:17.732445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:17.733775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:17.734647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:17.736610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:17.740060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:17.751067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:18.670165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:18.678729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b12a85cf-3180-4866-bec7-8fa76ef8af3c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1367 microversion: 2.1 time: 0.989482 Nov 02 12:44:18.689116 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2276/4630] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:17 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1367 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:19.213955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:19.227901 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1cc7c48b-5ec3-406f-ad76-517c4845f695 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1312 microversion: 2.1 time: 1.683020 Nov 02 12:44:19.231001 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2355/4631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:17 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1312 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:19.347401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:19.348410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:19.356750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.364014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.364696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.366698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.370125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.372392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.414275 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 HTTP/1.1 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9f3e53a7-4714-4d91-83b1-537a2b0f9163'} Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:19.416075 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.420647 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.424594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:19.424594 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82002080-4c2c-40d4-a17b-c4f739358641 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 404 len: 111 microversion: 2.1 time: 0.080247 Nov 02 12:44:19.425285 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2277/4632] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:19 2022] DELETE /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:19.432756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:19.433922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: 9f3e53a7-4714-4d91-83b1-537a2b0f9163] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:19.446544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.447114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.448063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.449636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.450146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.450590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.488370 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 HTTP/1.1 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '9f3e53a7-4714-4d91-83b1-537a2b0f9163'} Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:19.493947 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.498662 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.498662 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:19.498662 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:19.498662 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:19.498662 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:19.498662 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. Nov 02 12:44:19.498662 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.501259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance 9f3e53a7-4714-4d91-83b1-537a2b0f9163 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:19.502389 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f3c39190-5bd9-4761-906c-a975e5057bb4 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163" status: 404 len: 111 microversion: 2.1 time: 0.073641 Nov 02 12:44:19.512056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:19.512567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:19.512706 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2356/4633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:19 2022] GET /compute/v2.1/servers/9f3e53a7-4714-4d91-83b1-537a2b0f9163 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:19.515111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:19.535759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.536611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.536750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.537539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.537844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.554551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.593573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 HTTP/1.1 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a1477d20-d864-4f64-bbf6-9b90259d4305'} Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:19.595352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.599487 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.601635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:19.602793 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a5be129a-e3b4-40b0-9319-bb75a0f20b72 tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 404 len: 111 microversion: 2.1 time: 0.095177 Nov 02 12:44:19.603958 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2278/4634] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:19 2022] DELETE /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:19.612439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:19.613299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] [instance: a1477d20-d864-4f64-bbf6-9b90259d4305] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:19.626099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.628888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.629590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.635053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.635782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.637017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.678079 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] HTTP exception thrown: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Request method failure captured: Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 HTTP/1.1 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmSpXa8JoS5edA0l9pCW-pCEkjGbbDL7WqugYAuWUHlmEK8UXIC1bVBooQ2i2c8jLF2hLneKvoJu1LA1CHjrZB33z5X9l9T63QRiceTpqRVuQRw8Oe8qHeUFX7fODpTxH0z0tFj0nNNXadLEbNmtGaRfy-L5YqoEWH0hG6kwUecSH1o Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f63f35f097be4c2b8ebdd5b27e3b73e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: f63f35f097be4c2b8ebdd5b27e3b73e6 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1659484943 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6488e600776547958e00ab146f079c46 Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-DeleteServersTestJSON-1659484943-project Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'a1477d20-d864-4f64-bbf6-9b90259d4305'} Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:19.680023 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.684401 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:19.684401 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:19.684401 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:19.684401 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:19.684401 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:19.684401 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. Nov 02 12:44:19.684401 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:44:19.686313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] Returning 404 to user: Instance a1477d20-d864-4f64-bbf6-9b90259d4305 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:19.687435 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64942a34-3626-4678-aacd-a92f495a041c tempest-DeleteServersTestJSON-1659484943 tempest-DeleteServersTestJSON-1659484943-project] 10.222.0.45 "GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305" status: 404 len: 111 microversion: 2.1 time: 0.079346 Nov 02 12:44:19.688223 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2357/4635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:19 2022] GET /compute/v2.1/servers/a1477d20-d864-4f64-bbf6-9b90259d4305 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:44:19.715909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:19.716766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:19.728929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.729689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.730831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.735250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.736147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.736758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:20.185466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:20.222421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0f87be03-670c-4c50-89fe-52980457dd0e req-e0882c79-e136-4d31-83ce-f49d86506393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3006885-3516-4839-9208-d9671c6626fe", "tag": "58ddbc96-c2f5-491d-bf23-63e798b424f7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:20.242776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0f87be03-670c-4c50-89fe-52980457dd0e req-e0882c79-e136-4d31-83ce-f49d86506393 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:20.247574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0f87be03-670c-4c50-89fe-52980457dd0e req-e0882c79-e136-4d31-83ce-f49d86506393 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:20.251824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0f87be03-670c-4c50-89fe-52980457dd0e req-e0882c79-e136-4d31-83ce-f49d86506393 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:20.274338 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0f87be03-670c-4c50-89fe-52980457dd0e req-e0882c79-e136-4d31-83ce-f49d86506393 service nova] Creating event network-changed:58ddbc96-c2f5-491d-bf23-63e798b424f7 for instance b3006885-3516-4839-9208-d9671c6626fe on n-h2-855650-5 Nov 02 12:44:20.287853 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0f87be03-670c-4c50-89fe-52980457dd0e req-e0882c79-e136-4d31-83ce-f49d86506393 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067798 Nov 02 12:44:20.290678 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2358/4636] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:20.305686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:20.307734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:20.325055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:20.329459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:20.330546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:20.333303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:20.334766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:20.338501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:20.350137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:20.483317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:20.496686 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07c0c2e6-baac-412a-9fc5-b83cb7525efe tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1367 microversion: 2.1 time: 0.784143 Nov 02 12:44:20.498501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2279/4637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:19 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1367 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:20.906593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:21.316487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:21.383982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:21.397063 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8d9fba3-eb67-4884-b8a7-0752c602519f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1312 microversion: 2.1 time: 1.102698 Nov 02 12:44:21.399561 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2359/4638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:20 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1312 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:21.527937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:21.529375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:21.548371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:21.558642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:21.559826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:21.564738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:21.565495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:21.566432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:22.422976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:22.423722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:22.437037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:22.442637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:22.443310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:22.444098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:22.444584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:22.445026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:22.528551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:22.539467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:22.545704 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9ca3b2a-9790-4906-bf72-c6b9f52659dc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1367 microversion: 2.1 time: 1.022562 Nov 02 12:44:22.546718 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2280/4639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:21 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1367 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:22.829797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:22.837679 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a0813152-d221-4181-a1e0-280b01e1b09a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1333 microversion: 2.1 time: 0.418951 Nov 02 12:44:22.841380 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2360/4640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:22 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1333 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:23.572632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:23.573256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:23.590382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:23.594484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:23.594948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:23.595703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:23.596174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:23.608520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:23.867827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:23.868577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:23.883411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:23.886581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:23.887231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:23.891287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:23.892025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:23.892619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:24.751721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:24.767197 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5af23463-c93c-4c8a-bd7a-10c8085077c2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1367 microversion: 2.1 time: 1.197736 Nov 02 12:44:24.787680 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2281/4641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:23 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1367 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:25.443891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:25.458528 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e12ce436-bcf0-4e11-99f2-753883f690a6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1333 microversion: 2.1 time: 1.596788 Nov 02 12:44:25.471320 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2361/4642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:23 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1333 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:25.801607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:25.802262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:25.844334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:25.845115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:25.850162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:25.851471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:25.852122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:25.854151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:26.483978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:26.485193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:26.498212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:26.498718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:26.499176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:26.501996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:26.514679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:26.515153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:26.897649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:26.919931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11b79f67-b14d-401c-bdae-580468d6f31e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1367 microversion: 2.1 time: 1.121371 Nov 02 12:44:26.920544 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2282/4643] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:25 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1367 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:27.572642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:27.592927 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c9c8077-e96a-4e34-999a-614ba374a3df tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1333 microversion: 2.1 time: 1.113195 Nov 02 12:44:27.593778 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2362/4644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:26 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1333 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:27.935386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-608a037e-80fb-4b8b-b621-57725c7d9e7f req-d1aa9bc0-290e-4170-b01c-fef2b6482179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3006885-3516-4839-9208-d9671c6626fe", "name": "network-vif-plugged", "status": "completed", "tag": "58ddbc96-c2f5-491d-bf23-63e798b424f7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:27.953627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:27.954311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:27.958398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-608a037e-80fb-4b8b-b621-57725c7d9e7f req-d1aa9bc0-290e-4170-b01c-fef2b6482179 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:27.968525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-608a037e-80fb-4b8b-b621-57725c7d9e7f req-d1aa9bc0-290e-4170-b01c-fef2b6482179 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:27.969001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-608a037e-80fb-4b8b-b621-57725c7d9e7f req-d1aa9bc0-290e-4170-b01c-fef2b6482179 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:27.969640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:27.970365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:27.970975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:27.972084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:27.972699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:27.973465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:28.003344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-608a037e-80fb-4b8b-b621-57725c7d9e7f req-d1aa9bc0-290e-4170-b01c-fef2b6482179 service nova] Creating event network-vif-plugged:58ddbc96-c2f5-491d-bf23-63e798b424f7 for instance b3006885-3516-4839-9208-d9671c6626fe on n-h2-855650-5 Nov 02 12:44:28.023113 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-608a037e-80fb-4b8b-b621-57725c7d9e7f req-d1aa9bc0-290e-4170-b01c-fef2b6482179 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092062 Nov 02 12:44:28.023754 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2283/4645] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:28.630617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:28.632010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:28.650353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:28.651298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:28.652172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:28.655862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:28.656541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:28.657095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:29.645176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:29.693542 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-95ae3237-46f8-4ac5-9b8c-531530d208ae tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1367 microversion: 2.1 time: 1.743440 Nov 02 12:44:29.695844 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2363/4646] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:27 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1367 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:30.351525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:30.372946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-666a1b51-7fb4-44dd-a13a-808713edbc24 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 1.748503 Nov 02 12:44:30.382096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2284/4647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:28 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:30.723960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:30.724906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:30.733268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:30.740133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:30.743387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:30.747103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:30.750952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:30.751696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:30.752391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:31.119243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-199307183", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:31.162959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:31.279256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] validate_networks() for [('c8f61405-3ba0-4101-8580-7b227f748cee', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:44:32.405447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:32.427769 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ed7eea4d-8bae-49b2-9cc2-d2914b31e535 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1557 microversion: 2.1 time: 1.706985 Nov 02 12:44:32.430786 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2285/4648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:30 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1557 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:32.449063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:32.460940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:32.476844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:32.478717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:32.486309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:32.487848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:32.488986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:32.490375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:33.806445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:44:33.806445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:44:33.806445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:44:33.806445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:44:33.806445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:44:33.857159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:33.862475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:33.873168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:33.879039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:33.880106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:33.888338 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ccf39035-3322-41a9-8c20-c838487f2683 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 1.453510 Nov 02 12:44:33.888963 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2286/4649] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:32 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:33.889938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:33.890581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:33.920615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:33.921214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:33.963893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:33.964413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:33.964878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:33.965654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:33.966169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:33.966611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:34.024963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Getting quotas for project 74689b473ca04e9199c55b3874096d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:34.072601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Getting quotas for user d76c51571bab4abf88e5affcdfad2d34 and project 74689b473ca04e9199c55b3874096d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:34.125244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:44:34.135326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:44:34.269811 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f91518f-991f-47f1-b252-33cbdd0201fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.970120 Nov 02 12:44:34.271942 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2364/4650] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:44:34.285166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-112edb8b-a4ff-46d1-a954-c2a6d3416f61 req-d1ec5f34-c910-49f9-8884-fa3b070adb91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "tag": "70a6b12d-ac77-4ab7-a116-6c2861c001d0"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:34.304417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-112edb8b-a4ff-46d1-a954-c2a6d3416f61 req-d1ec5f34-c910-49f9-8884-fa3b070adb91 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:34.305281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-112edb8b-a4ff-46d1-a954-c2a6d3416f61 req-d1ec5f34-c910-49f9-8884-fa3b070adb91 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:34.305955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-112edb8b-a4ff-46d1-a954-c2a6d3416f61 req-d1ec5f34-c910-49f9-8884-fa3b070adb91 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:34.334044 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-112edb8b-a4ff-46d1-a954-c2a6d3416f61 req-d1ec5f34-c910-49f9-8884-fa3b070adb91 service nova] Creating event network-changed:70a6b12d-ac77-4ab7-a116-6c2861c001d0 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:44:34.341627 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-112edb8b-a4ff-46d1-a954-c2a6d3416f61 req-d1ec5f34-c910-49f9-8884-fa3b070adb91 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067936 Nov 02 12:44:34.343529 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2365/4651] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:34.358750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88c89cbc-f641-4db1-a60b-92866e019153 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:34.360609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88c89cbc-f641-4db1-a60b-92866e019153 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:34.830503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-88c89cbc-f641-4db1-a60b-92866e019153 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:34.933329 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-88c89cbc-f641-4db1-a60b-92866e019153 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1216 microversion: 2.1 time: 0.586832 Nov 02 12:44:34.974263 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2366/4652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:34 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1216 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:34.996902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:35.001653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:35.042998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:35.044371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:35.045071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:35.046327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:35.053845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:35.063174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:35.152809 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f75ab6b3-a5cc-4966-9dbc-e6a938e80ac2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.262728 Nov 02 12:44:35.153435 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2287/4653] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:44:33 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe/os-interface => generated 284 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:35.641533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:35.661556 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-829142de-c909-485f-8145-59088aa28c0d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.685241 Nov 02 12:44:35.666575 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2367/4654] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:34 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:35.993415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:35.994082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:36.008680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:36.009206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:36.009672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:36.010516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:36.015074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:36.015939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:36.284106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-232447935", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "3509b334-5aab-4043-97c4-219f867f53b0"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:36.372555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] validate_networks() for [('3509b334-5aab-4043-97c4-219f867f53b0', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:44:36.848297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:36.860177 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3985cacb-310e-421b-a36b-2120366da695 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1268 microversion: 2.1 time: 0.869621 Nov 02 12:44:36.863086 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2288/4655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:35 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1268 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:36.905356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:36.908801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:36.930948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:36.931680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:36.932978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:36.933938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:36.939404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:36.940227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:37.731202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:37.752739 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5dcda51e-5747-4747-8d2b-3cefa63f2f83 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.883269 Nov 02 12:44:37.753371 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2289/4656] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:36 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:37.895242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:37.897010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:37.910989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:37.911959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:37.912625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:37.913754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:37.914492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:37.915277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:38.211327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:38.225055 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-399e7b87-f8aa-4b8a-98df-b414d13dabe1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1274 microversion: 2.1 time: 0.334643 Nov 02 12:44:38.226160 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2290/4657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:37 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1274 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:38.554368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:44:38.556736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:44:38.558952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:44:38.559663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:44:38.560438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:44:38.583144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:38.589144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:38.589959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:38.592968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:38.593916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:38.599252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:38.656074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Getting quotas for project 12e1560d183e49dfb7a5ed28c7468264. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:38.679468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Getting quotas for user 60fb27c5a05a4029b1241ef445ec14a4 and project 12e1560d183e49dfb7a5ed28c7468264. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:38.704145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:44:38.707894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:44:38.749539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6c10b0db-1c30-4522-aed8-2f75ead2e9f6 req-3195bcab-8333-41e6-89b4-885e6f99e593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "tag": "9edd0b5c-357f-455b-b282-e6346ca52ea2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:38.768203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6c10b0db-1c30-4522-aed8-2f75ead2e9f6 req-3195bcab-8333-41e6-89b4-885e6f99e593 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:38.768708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6c10b0db-1c30-4522-aed8-2f75ead2e9f6 req-3195bcab-8333-41e6-89b4-885e6f99e593 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:38.769150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6c10b0db-1c30-4522-aed8-2f75ead2e9f6 req-3195bcab-8333-41e6-89b4-885e6f99e593 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:38.789448 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6c10b0db-1c30-4522-aed8-2f75ead2e9f6 req-3195bcab-8333-41e6-89b4-885e6f99e593 service nova] Creating event network-changed:9edd0b5c-357f-455b-b282-e6346ca52ea2 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:44:38.805258 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6c10b0db-1c30-4522-aed8-2f75ead2e9f6 req-3195bcab-8333-41e6-89b4-885e6f99e593 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060906 Nov 02 12:44:38.806490 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2291/4658] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:38.817754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:38.818784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:38.831935 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-010391b0-7a8f-482c-b987-17ce23225b62 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.551852 Nov 02 12:44:38.832617 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2368/4659] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:44:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:44:38.845103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:38.845695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24806364-99bd-470d-ba5c-0ceabe1899de tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:38.846361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-24806364-99bd-470d-ba5c-0ceabe1899de tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:38.849277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:38.853856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:38.855588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:38.856254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:38.856887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:39.261611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-24806364-99bd-470d-ba5c-0ceabe1899de tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:39.275742 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-24806364-99bd-470d-ba5c-0ceabe1899de tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1213 microversion: 2.1 time: 0.435251 Nov 02 12:44:39.278026 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2369/4660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:38 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1213 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:39.292406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:39.293323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:39.313079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:39.313875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:39.314375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:39.320677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:39.321182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:39.321630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:40.755849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:40.779921 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ac6c4f6-6c2b-487a-844e-e510c73b33d3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 1.499870 Nov 02 12:44:40.780629 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2370/4661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:39 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:40.794900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9a95d6b1-1fd1-4783-8361-4205e3cc436f req-3904f26e-8b1b-421c-b3f0-0043534a45e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3006885-3516-4839-9208-d9671c6626fe", "tag": "58ddbc96-c2f5-491d-bf23-63e798b424f7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:40.796571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:40.829573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9a95d6b1-1fd1-4783-8361-4205e3cc436f req-3904f26e-8b1b-421c-b3f0-0043534a45e2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:40.830984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9a95d6b1-1fd1-4783-8361-4205e3cc436f req-3904f26e-8b1b-421c-b3f0-0043534a45e2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:40.833109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9a95d6b1-1fd1-4783-8361-4205e3cc436f req-3904f26e-8b1b-421c-b3f0-0043534a45e2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:40.833935 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3011d82-eef9-4128-97cd-2d045c49d85e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 2.020087 Nov 02 12:44:40.834643 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2292/4662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:38 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:40.845528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:40.846200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:40.865912 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9a95d6b1-1fd1-4783-8361-4205e3cc436f req-3904f26e-8b1b-421c-b3f0-0043534a45e2 service nova] Creating event network-changed:58ddbc96-c2f5-491d-bf23-63e798b424f7 for instance b3006885-3516-4839-9208-d9671c6626fe on n-h2-855650-5 Nov 02 12:44:40.877070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:40.877602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:40.880274 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9a95d6b1-1fd1-4783-8361-4205e3cc436f req-3904f26e-8b1b-421c-b3f0-0043534a45e2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096056 Nov 02 12:44:40.881291 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2371/4663] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:40.887412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:40.892801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:40.896372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:40.897232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:41.428254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:41.442630 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9cffad8-0e06-4431-b33b-0c055d3dbef7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1265 microversion: 2.1 time: 0.605346 Nov 02 12:44:41.444824 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2293/4664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:40 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1265 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:41.809032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:41.810458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:41.836374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:41.837531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:41.839426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:41.840452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:41.841310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:41.842614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:41.864540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:41.865348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:41.878177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:41.883530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:41.883530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:41.883530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:41.883530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:41.885093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:42.450252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:42.459690 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d7ac2c3-ff1a-4e6d-a33e-f09483ff0b38 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.601884 Nov 02 12:44:42.479756 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2294/4665] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:41 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:42.503313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:42.504206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:42.516758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:42.517258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:42.517700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:42.538884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:42.542299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:42.544426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:42.624250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:42.655962 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0c221d33-8a4c-4b04-b2c9-b379bdaa9a35 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.852659 Nov 02 12:44:42.658647 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2372/4666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:41 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:42.703341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:42.735323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fc0b57fb-9d74-4b50-83a4-3d18707eca82 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1271 microversion: 2.1 time: 0.252757 Nov 02 12:44:42.736558 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2295/4667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:42 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:42.883486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6a10a059-9e9d-4d06-85c6-c2e42596d42e req-966c5d62-cafd-4007-aa8d-21d4f9c22757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "tag": "421805bc-bb16-4f1a-980c-60f8cae16035"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:42.951930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6a10a059-9e9d-4d06-85c6-c2e42596d42e req-966c5d62-cafd-4007-aa8d-21d4f9c22757 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:42.952903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6a10a059-9e9d-4d06-85c6-c2e42596d42e req-966c5d62-cafd-4007-aa8d-21d4f9c22757 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:42.954009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6a10a059-9e9d-4d06-85c6-c2e42596d42e req-966c5d62-cafd-4007-aa8d-21d4f9c22757 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:42.988605 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6a10a059-9e9d-4d06-85c6-c2e42596d42e req-966c5d62-cafd-4007-aa8d-21d4f9c22757 service nova] Creating event network-changed:421805bc-bb16-4f1a-980c-60f8cae16035 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:44:43.013685 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6a10a059-9e9d-4d06-85c6-c2e42596d42e req-966c5d62-cafd-4007-aa8d-21d4f9c22757 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137664 Nov 02 12:44:43.014349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2373/4668] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:43.520709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:43.526246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:43.584482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:43.585456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:43.593669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:43.597952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:43.604158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:43.608887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:43.683002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:43.684108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:43.703805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:43.704671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:43.705334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:43.706304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:43.707005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:43.707648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:44.512518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:44.536531 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b16a834-41c5-4497-a4ff-e7e3ad3cef7d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.857609 Nov 02 12:44:44.541013 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2374/4669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:43 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:44.565830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:44.566706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:44.583885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:44.585159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:44.587187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:44.588330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:44.592912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:44.593615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:44.990464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:45.010940 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a7bfe62-c489-40c8-86c7-0b462c2b1f76 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 1.504601 Nov 02 12:44:45.013238 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2296/4670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:43 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:45.286868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c6326467-4001-4f47-a4d2-7e8632806a94 req-33b5f199-c46c-4d69-a033-38ce79e94c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f9ad93-6e10-49ae-86ca-8dc87c6b301b", "tag": "75616d16-546a-49d9-aa00-26848131158f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:45.303418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6326467-4001-4f47-a4d2-7e8632806a94 req-33b5f199-c46c-4d69-a033-38ce79e94c23 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:45.305709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6326467-4001-4f47-a4d2-7e8632806a94 req-33b5f199-c46c-4d69-a033-38ce79e94c23 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:45.306465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6326467-4001-4f47-a4d2-7e8632806a94 req-33b5f199-c46c-4d69-a033-38ce79e94c23 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:45.347344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c6326467-4001-4f47-a4d2-7e8632806a94 req-33b5f199-c46c-4d69-a033-38ce79e94c23 service nova] Creating event network-changed:75616d16-546a-49d9-aa00-26848131158f for instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b on n-h1-855650-5 Nov 02 12:44:45.355624 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c6326467-4001-4f47-a4d2-7e8632806a94 req-33b5f199-c46c-4d69-a033-38ce79e94c23 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073998 Nov 02 12:44:45.356674 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2297/4671] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:44:45.584456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:45.585735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:45.604772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:45.608757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:45.609628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:45.610571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:45.613629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:45.614361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:45.924141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:45.945526 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bfa4c7b6-49d3-4a75-85f6-8a9681a54432 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 1.398095 Nov 02 12:44:45.947067 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2375/4672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:44 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:46.079566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:46.085896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:46.116200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:46.119469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:46.121647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:46.126291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:46.129629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:46.132398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:46.203328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:46.219875 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f0cb6c6b-1347-4cec-873e-2fccfb698943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.640579 Nov 02 12:44:46.221069 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2298/4673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:45 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:46.715198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:46.737253 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2cccf143-0f66-4d2d-b029-842c84847b71 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.682199 Nov 02 12:44:46.743571 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2376/4674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:46 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:46.972128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:46.973055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:47.016991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:47.017825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:47.018466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:47.019677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:47.020386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:47.021718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:47.246769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:47.247454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:47.264002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:47.265124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:47.267729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:47.269990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:47.270499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:47.272590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:47.731311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:47.735038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:47.750520 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5844601b-16c4-4993-a0ee-a4450028e3fd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 0.784253 Nov 02 12:44:47.751757 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2299/4675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:46 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:47.776443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:47.777587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:47.788867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:47.789729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:47.792788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:47.794460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:47.796142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:47.796943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:48.080936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:48.098692 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-11a91588-5272-4b2e-aec7-1b55030fdad1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.856313 Nov 02 12:44:48.102085 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2377/4676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:47 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:48.486864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:48.503468 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9a9a925-6a04-485f-836a-a8d5f706e7c5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.733091 Nov 02 12:44:48.508887 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2300/4677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:47 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:48.650156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c99454cf-9c5d-4dc3-8002-62aefe53cb09 req-990d2e92-49a0-47b3-8786-f43b927f0f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211cd898-6019-4719-97c8-681b2c3e2e9c", "tag": "0e16814e-9cab-4555-9468-e631d979a7bb"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:48.660458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:48.677187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c99454cf-9c5d-4dc3-8002-62aefe53cb09 req-990d2e92-49a0-47b3-8786-f43b927f0f24 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:48.680398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c99454cf-9c5d-4dc3-8002-62aefe53cb09 req-990d2e92-49a0-47b3-8786-f43b927f0f24 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:48.686371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c99454cf-9c5d-4dc3-8002-62aefe53cb09 req-990d2e92-49a0-47b3-8786-f43b927f0f24 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:48.718735 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c99454cf-9c5d-4dc3-8002-62aefe53cb09 req-990d2e92-49a0-47b3-8786-f43b927f0f24 service nova] Creating event network-changed:0e16814e-9cab-4555-9468-e631d979a7bb for instance 211cd898-6019-4719-97c8-681b2c3e2e9c on n-h1-855650-5 Nov 02 12:44:48.734186 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c99454cf-9c5d-4dc3-8002-62aefe53cb09 req-990d2e92-49a0-47b3-8786-f43b927f0f24 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087920 Nov 02 12:44:48.738060 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2378/4678] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:44:48.780488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:48.781731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:48.792806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:48.793312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:48.793757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:48.794766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:48.799179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:48.803715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:49.125484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:49.126230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:49.137234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:49.141204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:49.143661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:49.144684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:49.150333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:49.152443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:49.266546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=16 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:49.397826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:49.433246 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-819b0978-25ff-4b62-b9f6-2856aae5858b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 0.656904 Nov 02 12:44:49.436923 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2301/4679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:48 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:49.508030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:49.523198 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-173ee8a0-11d5-4e0f-88d1-92637d496574 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.402567 Nov 02 12:44:49.524466 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2379/4680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:49 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:49.553485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:49.554422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:49.567832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:49.568616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:49.569229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:49.570230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:49.570864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:49.572153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:49.867073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:49.895248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9cff206c-009a-4f5b-bbf2-9b37a765db5a tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.353356 Nov 02 12:44:49.900667 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2302/4681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:49 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:50.473902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:50.476367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:50.502866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:50.506028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:50.511447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:50.512597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:50.513311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:50.514070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:50.522537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=90 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:50.566454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:50.567497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:50.584351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:50.589987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:50.590974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:50.592158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:50.598650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:50.599644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:51.451211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:51.475416 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7f3f0d72-d40b-42b7-994f-23cdfb5309bd tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 1.013604 Nov 02 12:44:51.490750 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2380/4682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:50 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:51.511465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:51.519702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:51.520324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:51.545576 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9350626b-c9b1-4d8a-a025-d99ec1344936 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.984492 Nov 02 12:44:51.547766 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2303/4683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:50 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:51.571032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:51.578425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:51.580609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:51.585402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:51.589290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:51.592570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:52.066153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:52.075913 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a0f5abb-7f1f-47cd-8657-504a8def9688 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.560929 Nov 02 12:44:52.076512 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2381/4684] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:51 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:52.504434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:52.505070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:52.526277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:52.529039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:52.535686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:52.536475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:52.536959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:52.537393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:52.570816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:52.571652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:52.598188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:52.598878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:52.599368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:52.600201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:52.600874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:52.601360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:53.078911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:53.094983 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acda06ee-c7b7-4f79-aac1-95c4be341692 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 0.593836 Nov 02 12:44:53.118605 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2304/4685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:52 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:53.129953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:53.130611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:53.163416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:53.165195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:53.169206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:53.170317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:53.173757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:53.174706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:53.309610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:53.343087 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe7bb922-b34f-47a9-894e-74f13eefd1fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.775885 Nov 02 12:44:53.344090 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2382/4686] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:52 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:53.805143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:53.821187 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-460b79a3-3ad2-4990-a8f1-ca29ae195147 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.700731 Nov 02 12:44:53.821808 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2305/4687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:53 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:54.149407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:54.150719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:54.178841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.181418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.184839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.186312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.187639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.190247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.368020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:54.368935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:54.381019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.381932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.388677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.389827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.390494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.391107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.530261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:54.559325 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d9ba0b5b-1f30-48c3-9dc8-1f4325dc5478 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 0.420579 Nov 02 12:44:54.574005 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2383/4688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:54 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:54.771699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:54.802220 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0e75e825-dd4f-4037-a7e4-a2d56b59ab3e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.436744 Nov 02 12:44:54.819486 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2306/4689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:54 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:54.872061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:54.873740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:54.894350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.895121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.895763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.896706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.897348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.897944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.955822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7c3eb845-cada-437b-b1ba-512db1a1e2db req-3c906500-ff11-441d-b548-95e315cbfda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f9ad93-6e10-49ae-86ca-8dc87c6b301b", "name": "network-vif-plugged", "status": "completed", "tag": "75616d16-546a-49d9-aa00-26848131158f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:54.980527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7c3eb845-cada-437b-b1ba-512db1a1e2db req-3c906500-ff11-441d-b548-95e315cbfda2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.981222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7c3eb845-cada-437b-b1ba-512db1a1e2db req-3c906500-ff11-441d-b548-95e315cbfda2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.982120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7c3eb845-cada-437b-b1ba-512db1a1e2db req-3c906500-ff11-441d-b548-95e315cbfda2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.997226 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7c3eb845-cada-437b-b1ba-512db1a1e2db req-3c906500-ff11-441d-b548-95e315cbfda2 service nova] Creating event network-vif-plugged:75616d16-546a-49d9-aa00-26848131158f for instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b on n-h1-855650-5 Nov 02 12:44:55.004553 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7c3eb845-cada-437b-b1ba-512db1a1e2db req-3c906500-ff11-441d-b548-95e315cbfda2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053249 Nov 02 12:44:55.008050 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2307/4690] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:44:55.589206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:55.589919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:55.605818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:55.615628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:55.616210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:55.616986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:55.617647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:55.618106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:55.817958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:55.833190 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2569f701-1376-425c-a3b7-4a5644a0f7a2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.967866 Nov 02 12:44:55.850837 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2384/4691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:54 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:55.864369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:55.872589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:55.889487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:55.890407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:55.891603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:55.892746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:55.893460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:55.894521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:56.352248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:56.363230 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71f6bfd4-659f-46ec-bf70-a211a4b24a39 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 0.779580 Nov 02 12:44:56.381666 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2308/4692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:55 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:56.707434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:56.741728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-674f6e56-d7de-4dc9-b0cc-76e3e9773525 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1316 microversion: 2.1 time: 0.886226 Nov 02 12:44:56.746821 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2385/4693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:55 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1316 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:56.866715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:56.867370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:56.877864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:56.878386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:56.881431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:56.887036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:56.887793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:56.890631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:57.384451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:57.393621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:57.394746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:57.404381 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e765947a-0b1a-42cf-96a0-7c306ce77d7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.541876 Nov 02 12:44:57.418489 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2309/4694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:56 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:57.459265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:57.463187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:57.467528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:57.472630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:57.473684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:57.477637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:57.773120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:57.773736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:57.794810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:57.795314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:57.795764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:57.796484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:57.796938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:57.797392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:58.253727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:58.267129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:58.280219 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bcc49551-a12a-462d-bb73-71fb2e9fba15 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 0.895482 Nov 02 12:44:58.282079 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2386/4695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:57 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:58.287649 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb335656-db4f-4d20-8b4d-b8c5eaedd642 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.518133 Nov 02 12:44:58.291860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2310/4696] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:57 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:58.430599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:58.431219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:58.461526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:58.468791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:58.474757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:58.478512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:58.479197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:58.480595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:58.536483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1904459936", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:58.659783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] validate_networks() for [('c8f61405-3ba0-4101-8580-7b227f748cee', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:00.094870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:00.112059 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5c896c6-5cbb-4f48-b1e8-d151c6a7829e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 1.683133 Nov 02 12:45:00.115083 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2387/4697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:58 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:00.127427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:00.131284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:00.147326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:00.148326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:00.149083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:00.150224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:00.151024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:00.151718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:00.790853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:00.803326 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e7c7bd8-a1ef-4913-a2f9-d9016bf745f5 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 0.685385 Nov 02 12:45:00.804997 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2388/4698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:00 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:01.121331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b53716fd-6887-40a7-8dde-ec5e1d4fecde req-921d5a1f-7c1a-4140-8d22-0f9d93492f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211cd898-6019-4719-97c8-681b2c3e2e9c", "name": "network-vif-plugged", "status": "completed", "tag": "0e16814e-9cab-4555-9468-e631d979a7bb"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:01.148282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b53716fd-6887-40a7-8dde-ec5e1d4fecde req-921d5a1f-7c1a-4140-8d22-0f9d93492f58 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:01.149819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b53716fd-6887-40a7-8dde-ec5e1d4fecde req-921d5a1f-7c1a-4140-8d22-0f9d93492f58 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:01.151460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b53716fd-6887-40a7-8dde-ec5e1d4fecde req-921d5a1f-7c1a-4140-8d22-0f9d93492f58 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:01.184112 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b53716fd-6887-40a7-8dde-ec5e1d4fecde req-921d5a1f-7c1a-4140-8d22-0f9d93492f58 service nova] Creating event network-vif-plugged:0e16814e-9cab-4555-9468-e631d979a7bb for instance 211cd898-6019-4719-97c8-681b2c3e2e9c on n-h1-855650-5 Nov 02 12:45:01.197605 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b53716fd-6887-40a7-8dde-ec5e1d4fecde req-921d5a1f-7c1a-4140-8d22-0f9d93492f58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080191 Nov 02 12:45:01.199162 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2389/4699] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:01.205729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:01.208137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:01.216873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:01.217653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:01.218361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:01.219307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:01.219975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:01.221654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:01.658691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:45:01.659361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:45:01.659921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:45:01.660555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:45:01.661145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:45:01.665166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=54 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:01.687292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:01.688324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:01.690642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:01.691875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:01.692370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:01.692930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:01.731360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Getting quotas for project 74689b473ca04e9199c55b3874096d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:45:01.746112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Getting quotas for user d76c51571bab4abf88e5affcdfad2d34 and project 74689b473ca04e9199c55b3874096d40. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:45:01.773396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:45:01.777265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:45:01.836089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:01.850451 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c18ae9f4-c0c7-4c87-ade1-a67aa049a866 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.649364 Nov 02 12:45:01.866227 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2390/4700] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:01 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:01.874197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:01.876926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:01.881575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:01.906660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:01.907640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:01.908277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:01.909372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:01.913061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:01.913711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:01.919490 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-805bc897-bda7-4531-bbba-c84824c450e4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.386609 Nov 02 12:45:01.927578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2311/4701] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:45:01.939999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb0bbcee-d061-4634-9e49-5138115047a1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:01.940628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb0bbcee-d061-4634-9e49-5138115047a1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:02.145882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb0bbcee-d061-4634-9e49-5138115047a1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:02.158353 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb0bbcee-d061-4634-9e49-5138115047a1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1217 microversion: 2.1 time: 0.228711 Nov 02 12:45:02.158958 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2312/4702] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:01 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:02.475373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:02.496113 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c39d0988-59b7-4a53-aacc-8f1a375c0c09 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1313 microversion: 2.1 time: 0.620889 Nov 02 12:45:02.497071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2391/4703] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:01 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:02.897751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:02.898819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:02.917506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:02.921538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:02.922228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:02.923629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:02.924848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:02.925518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:03.185214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a49e6cce-c6ad-41f0-80da-343b2e16094e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:03.186251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a49e6cce-c6ad-41f0-80da-343b2e16094e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:03.534222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a49e6cce-c6ad-41f0-80da-343b2e16094e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:03.550118 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a49e6cce-c6ad-41f0-80da-343b2e16094e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1217 microversion: 2.1 time: 0.368341 Nov 02 12:45:03.551790 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2392/4704] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:03 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1217 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:03.562592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:03.565761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:03.582141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:03.584724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:03.585503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:03.586601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:03.588920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:03.590827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:03.593573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:03.622340 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-217a90e3-a16d-499d-baeb-53b15a392f13 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.732740 Nov 02 12:45:03.637399 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2313/4705] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:02 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:03.825257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1655082e-d62b-4d71-9701-9b9401b7b999 req-f890e3ae-e577-4e5c-a995-7238dfff63a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "name": "network-vif-plugged", "status": "completed", "tag": "9edd0b5c-357f-455b-b282-e6346ca52ea2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:03.885156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1655082e-d62b-4d71-9701-9b9401b7b999 req-f890e3ae-e577-4e5c-a995-7238dfff63a1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:03.891977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1655082e-d62b-4d71-9701-9b9401b7b999 req-f890e3ae-e577-4e5c-a995-7238dfff63a1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:03.894332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1655082e-d62b-4d71-9701-9b9401b7b999 req-f890e3ae-e577-4e5c-a995-7238dfff63a1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:03.961445 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1655082e-d62b-4d71-9701-9b9401b7b999 req-f890e3ae-e577-4e5c-a995-7238dfff63a1 service nova] Creating event network-vif-plugged:9edd0b5c-357f-455b-b282-e6346ca52ea2 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:45:03.972177 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1655082e-d62b-4d71-9701-9b9401b7b999 req-f890e3ae-e577-4e5c-a995-7238dfff63a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150921 Nov 02 12:45:03.973500 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2314/4706] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:45:04.204639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:04.217094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-659e9333-95e9-4675-abe3-c6ec0412221b tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1498 microversion: 2.1 time: 0.663751 Nov 02 12:45:04.245826 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2393/4707] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:03 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1498 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:04.576497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:04.578773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:04.595690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:04.598975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:04.599719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:04.604047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:04.605028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:04.606398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:04.778175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:04.806494 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8c0c2a7-80fa-4dc5-a4b5-e7a787142217 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1269 microversion: 2.1 time: 0.234019 Nov 02 12:45:04.808650 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2394/4708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:04 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:04.813754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:04.814659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:04.826165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:04.826863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:04.827654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:04.828659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:04.829390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:04.830234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:05.183870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-972459598", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "26a94268-8d54-4d97-968e-58d352d8700b"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:05.345348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] validate_networks() for [('26a94268-8d54-4d97-968e-58d352d8700b', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:06.050466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:06.065639 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3035b279-88a5-441b-8faf-725ac2e97c66 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 1.255604 Nov 02 12:45:06.090568 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2395/4709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:04 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:06.098343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:06.100465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:06.108500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:06.109426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:06.110180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:06.112035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:06.112839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:06.113511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:06.145902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:45:06.244648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:06.327765 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-207b9a49-f6e5-4e00-82af-e24d94ecdb45 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "DELETE /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 204 len: 0 microversion: 2.1 time: 0.235325 Nov 02 12:45:06.332754 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2396/4710] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:45:06 2022] DELETE /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:45:06.352280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:06.353849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:06.369437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:06.370401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:06.371121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:06.372272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:06.376446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:06.377291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:07.165544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:07.180846 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-99678483-821a-4d08-ac5d-1c046ba2c35e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1275 microversion: 2.1 time: 0.846010 Nov 02 12:45:07.200541 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2397/4711] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:06 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1275 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:07.206848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:07.207886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:07.217172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:07.218000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:07.218748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:07.220203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:07.221057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:07.221827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:07.639952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:45:07.641070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:45:07.641853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:45:07.642540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:45:07.643227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:45:07.692017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:07.702934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:07.703917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:07.707486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:07.708196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:07.708736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:07.781238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Getting quotas for project 3423858b363a4bc09372edbc984b6667. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:45:07.793809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Getting quotas for user b17751538d574c96905bc8b1ba3fa22f and project 3423858b363a4bc09372edbc984b6667. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:45:07.816972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:45:07.821381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:45:07.935591 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d99fa2aa-fca4-42b2-9c72-5463296605fe tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.462433 Nov 02 12:45:07.937914 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2315/4712] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:45:07.941444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:07.956168 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-42bdee4c-ee43-4949-b6cd-bdab16c5d268 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1504 microversion: 2.1 time: 0.750768 Nov 02 12:45:07.971606 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2398/4713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:07 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1504 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:07.984882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:07.986407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:08.004429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:08.004938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:08.005386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:08.008494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:08.008983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:08.016206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:08.387624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-aa6d3eae-fb77-4fdd-8bf4-b0a777d789d7 req-4077a4ad-614a-4f05-877c-69f2465b45ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "name": "network-vif-plugged", "status": "completed", "tag": "70a6b12d-ac77-4ab7-a116-6c2861c001d0"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:08.429611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa6d3eae-fb77-4fdd-8bf4-b0a777d789d7 req-4077a4ad-614a-4f05-877c-69f2465b45ce service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:08.432208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa6d3eae-fb77-4fdd-8bf4-b0a777d789d7 req-4077a4ad-614a-4f05-877c-69f2465b45ce service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:08.433147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aa6d3eae-fb77-4fdd-8bf4-b0a777d789d7 req-4077a4ad-614a-4f05-877c-69f2465b45ce service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:08.464557 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-aa6d3eae-fb77-4fdd-8bf4-b0a777d789d7 req-4077a4ad-614a-4f05-877c-69f2465b45ce service nova] Creating event network-vif-plugged:70a6b12d-ac77-4ab7-a116-6c2861c001d0 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:45:08.482052 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-aa6d3eae-fb77-4fdd-8bf4-b0a777d789d7 req-4077a4ad-614a-4f05-877c-69f2465b45ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.536392 Nov 02 12:45:08.484493 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2316/4714] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:08.500464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6a3e2c81-e805-4b84-89ef-ae0d8eb5cf25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:08.501608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6a3e2c81-e805-4b84-89ef-ae0d8eb5cf25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:08.657463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:08.676608 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-182b85b3-90bb-465d-8bf8-0b7126d2a635 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.702825 Nov 02 12:45:08.677842 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2399/4715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:07 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:08.685525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:08.686764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:08.711294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:08.712499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:08.713355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:08.714513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:08.715466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:08.716165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:08.716490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6a3e2c81-e805-4b84-89ef-ae0d8eb5cf25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:08.737726 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6a3e2c81-e805-4b84-89ef-ae0d8eb5cf25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1227 microversion: 2.1 time: 0.250848 Nov 02 12:45:08.760853 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2317/4716] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:08 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1227 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:08.992296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:08.993382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:09.021936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:09.025759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:09.029089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:09.033012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:09.035185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:09.037839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:09.049531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:09.078433 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4cf81cda-a77f-4d3b-83b2-277ecc9fdb13 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1275 microversion: 2.1 time: 0.389069 Nov 02 12:45:09.100792 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2400/4717] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:08 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1275 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:09.363952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:09.379318 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8fd664c0-da43-4509-ad15-03dd80ab4e4e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1504 microversion: 2.1 time: 0.391354 Nov 02 12:45:09.382265 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2318/4718] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:08 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:09.703110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:09.704389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:09.724540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:09.732642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:09.738814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:09.742906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:09.744320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:09.752756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:09.787837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:09.790428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:09.820864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:09.828783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:09.829551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:09.831319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:09.840618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:09.843442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:10.024550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:10.034569 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be7c6df1-1eef-47c2-bfd5-8c2068baf341 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1279 microversion: 2.1 time: 0.250977 Nov 02 12:45:10.044821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2319/4719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:09 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:10.108827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:10.109591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:10.123094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:10.124352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:10.125032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:10.128806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:10.129565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:10.130134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:10.467662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:10.480073 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8820b8e-4205-407e-9e4e-f199a2a9fe1d tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.781624 Nov 02 12:45:10.481388 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2401/4720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:09 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:10.500648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:10.501601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:10.514265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:10.516560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:10.518245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:10.525172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:10.529786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:10.531552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:10.773305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:10.782154 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ee933db4-1906-442a-a7d5-ba4004d7ab07 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1317 microversion: 2.1 time: 0.677977 Nov 02 12:45:10.782782 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2320/4721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:10 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:10.787370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-5529185c-df4f-4494-9ccb-97eec4417447 req-e2ea6ded-8dbc-45c5-97ca-bad344ac5db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "name": "network-vif-plugged", "status": "completed", "tag": "421805bc-bb16-4f1a-980c-60f8cae16035"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:10.828519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5529185c-df4f-4494-9ccb-97eec4417447 req-e2ea6ded-8dbc-45c5-97ca-bad344ac5db2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:10.829173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5529185c-df4f-4494-9ccb-97eec4417447 req-e2ea6ded-8dbc-45c5-97ca-bad344ac5db2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:10.829433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5529185c-df4f-4494-9ccb-97eec4417447 req-e2ea6ded-8dbc-45c5-97ca-bad344ac5db2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:10.854250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-5529185c-df4f-4494-9ccb-97eec4417447 req-e2ea6ded-8dbc-45c5-97ca-bad344ac5db2 service nova] Creating event network-vif-plugged:421805bc-bb16-4f1a-980c-60f8cae16035 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:45:10.871965 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-5529185c-df4f-4494-9ccb-97eec4417447 req-e2ea6ded-8dbc-45c5-97ca-bad344ac5db2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087911 Nov 02 12:45:10.872806 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2321/4722] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:10.992733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:11.004851 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-72ba7fa6-76b5-4553-ad93-338e68c047d9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 200 len: 1504 microversion: 2.1 time: 0.522008 Nov 02 12:45:11.006086 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2402/4723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:10 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:11.075675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:11.076850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:11.091869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:11.092828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:11.093654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:11.094901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:11.098603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:11.099380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:11.159380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:11.256502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:11.275789 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d48150a-32e0-4c7a-84e8-56b5e458408c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1285 microversion: 2.1 time: 0.205402 Nov 02 12:45:11.277070 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2322/4724] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:11 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:11.507013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:11.507879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:11.527594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:11.530248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:11.532370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:11.533324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:11.533800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:11.534262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:11.645507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fd68f2e1-1a0b-4317-9c52-5cff4af49a32 req-9105735b-9514-4cc4-ad5f-6b773e63674e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211cd898-6019-4719-97c8-681b2c3e2e9c", "name": "network-vif-deleted", "tag": "0e16814e-9cab-4555-9468-e631d979a7bb"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:11.666781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fd68f2e1-1a0b-4317-9c52-5cff4af49a32 req-9105735b-9514-4cc4-ad5f-6b773e63674e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:11.667275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fd68f2e1-1a0b-4317-9c52-5cff4af49a32 req-9105735b-9514-4cc4-ad5f-6b773e63674e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:11.667716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fd68f2e1-1a0b-4317-9c52-5cff4af49a32 req-9105735b-9514-4cc4-ad5f-6b773e63674e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:11.705000 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fd68f2e1-1a0b-4317-9c52-5cff4af49a32 req-9105735b-9514-4cc4-ad5f-6b773e63674e service nova] Creating event network-vif-deleted:0e16814e-9cab-4555-9468-e631d979a7bb for instance 211cd898-6019-4719-97c8-681b2c3e2e9c on n-h1-855650-5 Nov 02 12:45:11.715391 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fd68f2e1-1a0b-4317-9c52-5cff4af49a32 req-9105735b-9514-4cc4-ad5f-6b773e63674e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073856 Nov 02 12:45:11.718492 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2323/4725] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:45:11.807553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:11.808373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:11.827443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:11.827965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:11.828412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:11.829141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:11.829702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:11.830029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:12.682685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:12.710094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c244a808-5b9e-4a25-a0d1-ba43cdee785b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 1.204767 Nov 02 12:45:12.711554 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2403/4726] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:11 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:12.721142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:12.723634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 211cd898-6019-4719-97c8-681b2c3e2e9c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:12.747567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:12.751135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:12.752396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:12.754207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:12.754940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:12.756890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:12.779213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:12.788365 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3c61aa7-4d81-455f-b065-fa54b8b47f5e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1317 microversion: 2.1 time: 0.987329 Nov 02 12:45:12.796138 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2324/4727] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:11 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1317 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:12.819999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:12.820630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:12.824236 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] HTTP exception thrown: Instance 211cd898-6019-4719-97c8-681b2c3e2e9c could not be found. Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Request method failure captured: Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c HTTP/1.1 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYvHmxrAR4D-nesWGH8kAqu_3iDBdiUeffzxzakoVGzD1I5h3DtOnyaz_sFDYYLiulc1pKVSYHSw0I9ZsweWDe0vWO_K9gBOw1S-TAXObQ7PmA4S5sKRka-zM07f_mHG_oD4DeehNiFHVPW1uF9UWX7wwG1_7em_i0ZtzYMEMNrCzY Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 12e1560d183e49dfb7a5ed28c7468264 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-VolumesActionsTest-987131523 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12e1560d183e49dfb7a5ed28c7468264"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12e1560d183e49dfb7a5ed28c7468264"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12e1560d183e49dfb7a5ed28c7468264"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12e1560d183e49dfb7a5ed28c7468264"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-VolumesActionsTest-987131523 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 12e1560d183e49dfb7a5ed28c7468264 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-VolumesActionsTest-987131523 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-VolumesActionsTest-987131523-project Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 60fb27c5a05a4029b1241ef445ec14a4 Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-VolumesActionsTest-987131523-project Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 211cd898-6019-4719-97c8-681b2c3e2e9c could not be found. Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '211cd898-6019-4719-97c8-681b2c3e2e9c'} Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211cd898-6019-4719-97c8-681b2c3e2e9c could not be found. Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211cd898-6019-4719-97c8-681b2c3e2e9c could not be found. Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:12.825997 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:12.831747 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:12.831747 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:12.831747 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:12.831747 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:12.831747 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:12.831747 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211cd898-6019-4719-97c8-681b2c3e2e9c could not be found. Nov 02 12:45:12.831747 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:12.832764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:12.832764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:12.832764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:12.832764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:12.832764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:12.832764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:12.839136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Returning 404 to user: Instance 211cd898-6019-4719-97c8-681b2c3e2e9c could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:12.840510 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fc5d772b-135e-409e-9264-ed1eb365f5f3 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c" status: 404 len: 111 microversion: 2.1 time: 0.127074 Nov 02 12:45:12.842309 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2404/4728] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:12 2022] GET /compute/v2.1/servers/211cd898-6019-4719-97c8-681b2c3e2e9c => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:45:12.847959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-33dda863-b85b-498c-aeee-a9e88786cf46 req-c3eddd9f-8de0-4f78-a8be-1a6dd4abe918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "438595d5-1ffa-4c37-a45a-86ee201a1db1", "tag": "82e2295e-b5cc-4232-bed5-646cee5ea3da"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:12.861433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-33dda863-b85b-498c-aeee-a9e88786cf46 req-c3eddd9f-8de0-4f78-a8be-1a6dd4abe918 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:12.862313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-33dda863-b85b-498c-aeee-a9e88786cf46 req-c3eddd9f-8de0-4f78-a8be-1a6dd4abe918 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:12.863082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-33dda863-b85b-498c-aeee-a9e88786cf46 req-c3eddd9f-8de0-4f78-a8be-1a6dd4abe918 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:12.881255 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-33dda863-b85b-498c-aeee-a9e88786cf46 req-c3eddd9f-8de0-4f78-a8be-1a6dd4abe918 service nova] Creating event network-changed:82e2295e-b5cc-4232-bed5-646cee5ea3da for instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 on n-h2-855650-5 Nov 02 12:45:12.889839 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-33dda863-b85b-498c-aeee-a9e88786cf46 req-c3eddd9f-8de0-4f78-a8be-1a6dd4abe918 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045934 Nov 02 12:45:12.895657 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2405/4729] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:12.959189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:12.969301 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a37d545-16c6-4f1a-9c78-e1feb1324127 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1285 microversion: 2.1 time: 0.155481 Nov 02 12:45:12.970980 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2325/4730] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:12 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:13.030911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-805813778", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "3509b334-5aab-4043-97c4-219f867f53b0"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:13.141672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] validate_networks() for [('3509b334-5aab-4043-97c4-219f867f53b0', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:13.541463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:13.735923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:13.736889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:13.750056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:13.750756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:13.751317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:13.753651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:13.755125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:13.756042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:14.297352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:45:14.298500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:45:14.299185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:45:14.299778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:45:14.300363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:45:14.348392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:14.355362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:14.356107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:14.357092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:14.357817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:14.358494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:14.400887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Getting quotas for project 12e1560d183e49dfb7a5ed28c7468264. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:45:14.407591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Getting quotas for user 60fb27c5a05a4029b1241ef445ec14a4 and project 12e1560d183e49dfb7a5ed28c7468264. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:45:14.432561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:45:14.437334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:45:14.504974 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60277c9e-fa9a-46f8-8524-a84645e82ef9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479760 Nov 02 12:45:14.506400 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2406/4731] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:45:14.523710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:14.525211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:14.543163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:14.544469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:14.546784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:14.547907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:14.548600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:14.549256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:14.580414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:14.588907 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d5cff072-78ad-4348-b1e3-ff1168b6db15 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1354 microversion: 2.1 time: 0.857747 Nov 02 12:45:14.589507 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2326/4732] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:13 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1354 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:14.630354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:14.631030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:14.652445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:14.652960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:14.653416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:14.654176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:14.654650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:14.664740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:14.985202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:14.995353 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f39557f-5fe5-4eaa-999e-77630e593ac3 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1285 microversion: 2.1 time: 0.381266 Nov 02 12:45:15.017184 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2327/4733] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:14 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1285 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:15.026903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:15.038145 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ef3db5c8-3d78-4838-93f2-54adebc438f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1317 microversion: 2.1 time: 0.529768 Nov 02 12:45:15.041732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ccdd13c4-b39a-42e8-a001-837a89ce5824 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:15.042796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ccdd13c4-b39a-42e8-a001-837a89ce5824 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:15.047248 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2407/4734] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:14 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:15.274001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ccdd13c4-b39a-42e8-a001-837a89ce5824 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:15.283202 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ccdd13c4-b39a-42e8-a001-837a89ce5824 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1213 microversion: 2.1 time: 0.257467 Nov 02 12:45:15.286593 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2328/4735] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:15 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1213 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:15.629589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:15.630260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:15.640613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:15.641680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:15.642012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:15.647700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:15.648190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:15.648634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:15.931266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:15.942033 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a39ebd2-7c0a-4da5-9e79-28900f4bb824 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1801 microversion: 2.1 time: 0.327906 Nov 02 12:45:15.943884 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2408/4736] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:15 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1801 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:15.971649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:15.972139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:15.980126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:15.980627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:15.981108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:15.981919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:15.992036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:15.992964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.045167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:16.046268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:16.053831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.059490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.060263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.064215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.065142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.068764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.095784 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43ddcd40-ebdc-4500-afa0-3ae8cc5bc0e5 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789/ips" status: 200 len: 215 microversion: 2.1 time: 0.128109 Nov 02 12:45:16.106923 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2329/4737] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:45:15 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789/ips => generated 215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:16.114709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:16.115374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:16.129592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.130402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.131430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.132301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.132922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.133494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.426811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:16.442760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-278d940c-f009-4589-a412-0cf8a46c1d23 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1317 microversion: 2.1 time: 0.339786 Nov 02 12:45:16.443473 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2330/4738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:16 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:16.444653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:16.449573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:16.450504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:16.457497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.458380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.459231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.460333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.461156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.462293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.463161 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3f15d63e-b025-4dd1-a360-f6613c6c76fc tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 0.422804 Nov 02 12:45:16.464104 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2409/4739] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:16 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:16.469167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:16.469841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:16.485599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.486129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.486577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.487295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.487756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.488191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.499669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:45:16.625294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:16.641239 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b1b0e458-d269-484f-b57c-a1fa6328bb56 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1265 microversion: 2.1 time: 0.175912 Nov 02 12:45:16.656298 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2410/4740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:16 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:16.681206 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb1f48b2-a078-4c66-90c8-ef1981c7ecab tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 204 len: 0 microversion: 2.1 time: 0.236110 Nov 02 12:45:16.682684 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2331/4741] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:45:16 2022] DELETE /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:45:16.691954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:16.693021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:16.730418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.733237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.734190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:16.736513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:16.737287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:16.739051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:17.229122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:17.277139 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d4107d43-d1e3-4055-aff7-81ce94cf919e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1807 microversion: 2.1 time: 0.589636 Nov 02 12:45:17.277765 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2411/4742] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:16 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1807 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:17.472518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:17.473248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:17.485134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:17.485900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:17.486476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:17.489291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:17.489769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:17.492321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:17.493617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:17.496496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:17.500664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:17.504201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:17.505051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:17.508749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:17.510437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:17.511214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:17.768711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:18.269347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:18.277363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:18.280243 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-990c9687-f178-4c2f-9692-15098ffd451e tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 0.798983 Nov 02 12:45:18.282516 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2412/4743] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:17 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:18.288806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:18.289349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:18.302763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da1c4dfa-2710-4cdc-9746-54b8d8e77e0e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1317 microversion: 2.1 time: 0.835066 Nov 02 12:45:18.317316 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2332/4744] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:17 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:18.317539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:18.317539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:18.317765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:18.317765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:18.318092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:18.318092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:18.318092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:18.318092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:18.331567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:18.340412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:18.342007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:18.343095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:18.344982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:18.345733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:18.567190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:18.576769 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7571a641-4f55-43f3-b2e4-192e7cf9d1a9 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1271 microversion: 2.1 time: 0.293145 Nov 02 12:45:18.591367 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2413/4745] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:18 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:18.807049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:18.819058 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11246929-1bdd-41d5-a2e9-1ab5ace2331f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1807 microversion: 2.1 time: 0.511804 Nov 02 12:45:18.828001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2333/4746] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:18 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1807 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:19.312382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:19.313064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:19.370671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:19.372959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:19.375925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:19.379207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:19.382254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:19.385120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:19.615326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7864547c-686a-4ce6-bf63-5149c3d108e5 req-0d2c7ef9-5bb1-450b-8fa7-2f68040d021b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63a4f4c-f12b-45a4-a311-7e908884aabc", "tag": "4e115bbc-c984-4658-a0e1-4fa895d33b31"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:19.643957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7864547c-686a-4ce6-bf63-5149c3d108e5 req-0d2c7ef9-5bb1-450b-8fa7-2f68040d021b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:19.644767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7864547c-686a-4ce6-bf63-5149c3d108e5 req-0d2c7ef9-5bb1-450b-8fa7-2f68040d021b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:19.645249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7864547c-686a-4ce6-bf63-5149c3d108e5 req-0d2c7ef9-5bb1-450b-8fa7-2f68040d021b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:19.692280 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7864547c-686a-4ce6-bf63-5149c3d108e5 req-0d2c7ef9-5bb1-450b-8fa7-2f68040d021b service nova] Creating event network-changed:4e115bbc-c984-4658-a0e1-4fa895d33b31 for instance a63a4f4c-f12b-45a4-a311-7e908884aabc on n-h1-855650-5 Nov 02 12:45:19.709649 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7864547c-686a-4ce6-bf63-5149c3d108e5 req-0d2c7ef9-5bb1-450b-8fa7-2f68040d021b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.528202 Nov 02 12:45:19.711128 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2414/4747] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:19.722946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:19.723665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:19.744094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:19.747099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:19.747781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:19.749759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:19.755668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:19.756194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:20.672394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:20.690800 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-19cb9a6d-0563-4719-afb2-7c96ccf0c43d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1317 microversion: 2.1 time: 0.974056 Nov 02 12:45:20.693410 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2415/4748] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:19 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1317 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:20.702623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:20.722052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:20.736220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:20.742096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:20.744119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:20.745020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:20.745607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:20.746188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:20.777446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:20.790460 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f14b246-c115-4a14-bf15-fc1dcd814dff tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 1.482164 Nov 02 12:45:20.791523 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2334/4749] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:19 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:20.801698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:20.805524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:20.819642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:20.822832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:20.826282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:20.830825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:20.836274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:20.836999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:20.837814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:21.258386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:21.291020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d709ba68-4536-4df4-b102-327d713f0332 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 0.595607 Nov 02 12:45:21.295038 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2416/4750] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:20 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:21.526787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:21.541353 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6c66d675-7b48-42e8-a88a-3ab1e4b9e9d6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1807 microversion: 2.1 time: 0.742936 Nov 02 12:45:21.542348 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2335/4751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:20 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1807 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:21.723344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:21.724388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:21.735804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:21.736324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:21.739935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:21.740705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:21.741208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:21.743777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:21.818426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:21.819451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:21.831998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:21.832507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:21.833779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:21.834551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:21.835025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:21.835468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:22.455680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:22.468961 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d151c6e6-1825-416f-b8a0-b2e2418ffeae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1317 microversion: 2.1 time: 0.750829 Nov 02 12:45:22.469833 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2417/4752] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:21 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:22.492654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-dc762331-a6b9-4f87-9349-e3a44d29540f req-3717a41c-502a-4285-a137-ac0962b75b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "438595d5-1ffa-4c37-a45a-86ee201a1db1", "name": "network-vif-plugged", "status": "completed", "tag": "82e2295e-b5cc-4232-bed5-646cee5ea3da"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:22.524232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dc762331-a6b9-4f87-9349-e3a44d29540f req-3717a41c-502a-4285-a137-ac0962b75b90 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:22.524876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dc762331-a6b9-4f87-9349-e3a44d29540f req-3717a41c-502a-4285-a137-ac0962b75b90 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:22.525346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-dc762331-a6b9-4f87-9349-e3a44d29540f req-3717a41c-502a-4285-a137-ac0962b75b90 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:22.579750 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-dc762331-a6b9-4f87-9349-e3a44d29540f req-3717a41c-502a-4285-a137-ac0962b75b90 service nova] Creating event network-vif-plugged:82e2295e-b5cc-4232-bed5-646cee5ea3da for instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 on n-h2-855650-5 Nov 02 12:45:22.591501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:22.608427 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-dc762331-a6b9-4f87-9349-e3a44d29540f req-3717a41c-502a-4285-a137-ac0962b75b90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125138 Nov 02 12:45:22.612192 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-864b8db3-85bb-40b8-a41a-8c0da61cf1db tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 0.795252 Nov 02 12:45:22.613408 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2336/4753] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:21 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:22.614714 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2418/4754] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:22.629752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:22.636318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:22.637886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:22.649435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:22.669572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:22.669914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:22.670126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:22.670555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:22.671285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:22.671750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:22.672183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:22.672579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:22.673914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:22.679191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:22.680271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:22.697547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:23.776761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:23.787873 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-947b50b0-f679-4524-9731-748260d736e0 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1786 microversion: 2.1 time: 1.170317 Nov 02 12:45:23.793052 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2419/4755] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:22 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1786 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:23.802979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e58ce122-cc81-4b22-b1a1-a0fde896bcaa req-b50cad50-3823-4fa2-8551-e1b608167b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "name": "network-vif-deleted", "tag": "421805bc-bb16-4f1a-980c-60f8cae16035"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:23.837883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e58ce122-cc81-4b22-b1a1-a0fde896bcaa req-b50cad50-3823-4fa2-8551-e1b608167b61 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:23.848605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e58ce122-cc81-4b22-b1a1-a0fde896bcaa req-b50cad50-3823-4fa2-8551-e1b608167b61 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:23.851087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e58ce122-cc81-4b22-b1a1-a0fde896bcaa req-b50cad50-3823-4fa2-8551-e1b608167b61 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:23.880239 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e58ce122-cc81-4b22-b1a1-a0fde896bcaa req-b50cad50-3823-4fa2-8551-e1b608167b61 service nova] Creating event network-vif-deleted:421805bc-bb16-4f1a-980c-60f8cae16035 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:45:23.884951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:23.904214 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e58ce122-cc81-4b22-b1a1-a0fde896bcaa req-b50cad50-3823-4fa2-8551-e1b608167b61 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109179 Nov 02 12:45:23.905194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5dafd363-6b06-44f1-ad02-5e04ae6f1342 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 1.286936 Nov 02 12:45:23.907221 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2337/4757] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:22 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:23.907451 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2420/4757] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:23.925139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:23.925861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:23.933168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:23.935264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:23.957275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:23.962784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:23.963363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:23.963807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:23.964566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:23.965020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:23.965922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:23.969871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:23.970671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:23.971144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:23.971578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:23.972638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:24.383022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:24.422987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:24.666557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:24.684909 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-897b2b39-0e0d-4639-ae1f-782ef337b74d tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 0.773631 Nov 02 12:45:24.698408 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2338/4758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:23 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:24.720076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1cb90c81-165e-4313-bd0e-9110efa25ed1 req-2c61c6e8-1652-49c0-b2f7-f671a4813485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "name": "network-vif-unplugged", "status": "completed", "tag": "9edd0b5c-357f-455b-b282-e6346ca52ea2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:24.780437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:24.792856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1cb90c81-165e-4313-bd0e-9110efa25ed1 req-2c61c6e8-1652-49c0-b2f7-f671a4813485 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:24.793495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1cb90c81-165e-4313-bd0e-9110efa25ed1 req-2c61c6e8-1652-49c0-b2f7-f671a4813485 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:24.798245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1cb90c81-165e-4313-bd0e-9110efa25ed1 req-2c61c6e8-1652-49c0-b2f7-f671a4813485 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:24.799732 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-606bf2b1-675b-44c2-8944-d5364e826870 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1317 microversion: 2.1 time: 0.890806 Nov 02 12:45:24.825238 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2421/4759] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:23 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1317 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:24.838464 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1cb90c81-165e-4313-bd0e-9110efa25ed1 req-2c61c6e8-1652-49c0-b2f7-f671a4813485 service nova] Creating event network-vif-unplugged:9edd0b5c-357f-455b-b282-e6346ca52ea2 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:45:24.842439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:24.844983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:24.854821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1cb90c81-165e-4313-bd0e-9110efa25ed1 req-2c61c6e8-1652-49c0-b2f7-f671a4813485 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157915 Nov 02 12:45:24.862365 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2339/4760] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:24.863563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:24.866196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:24.866950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:24.868240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:24.868933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:24.869642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:24.936601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:24.938840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:24.959538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:24.964400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:24.966462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:24.969442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:24.970237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:24.972318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:25.034033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:25.278530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=18 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:25.540002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:25.559518 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-686ee113-0aa6-4625-9caa-0fa696cfccf6 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1650 microversion: 2.1 time: 0.732230 Nov 02 12:45:25.560061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:25.573258 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62e05882-c47f-43aa-9a9d-fff39c27fb90 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 0.643968 Nov 02 12:45:25.575869 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2422/4761] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:24 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1650 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:25.578249 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2340/4762] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:24 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:25.713115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:25.713993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:25.723127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:25.725015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:25.725731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:25.727239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:25.727982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:25.728648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:25.827106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:25.827999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:25.843365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:25.843648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:25.844103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:25.844828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:25.845810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:25.845810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:26.457355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:26.466697 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02a200e7-8cc2-4da7-8d0b-ff1b50ee4e86 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 0.759214 Nov 02 12:45:26.490053 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2423/4763] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:25 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:26.502861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-120640a9-b680-4ec5-a33e-e131ff95fbbe req-bf33b842-d463-42ea-8a73-befcd910c2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bdc86e-6a17-4e74-a0bc-261ee60f6f66", "tag": "331e5e84-84fd-4e9c-bc8b-44fefef6ccda"}, {"server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "name": "network-vif-deleted", "tag": "70a6b12d-ac77-4ab7-a116-6c2861c001d0"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:26.524967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-120640a9-b680-4ec5-a33e-e131ff95fbbe req-bf33b842-d463-42ea-8a73-befcd910c2dc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:26.530614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:26.531349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-120640a9-b680-4ec5-a33e-e131ff95fbbe req-bf33b842-d463-42ea-8a73-befcd910c2dc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:26.532621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-120640a9-b680-4ec5-a33e-e131ff95fbbe req-bf33b842-d463-42ea-8a73-befcd910c2dc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:26.539134 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3ab9f7e-4048-483b-859e-f2e88f9cc401 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1507 microversion: 2.1 time: 0.716220 Nov 02 12:45:26.563859 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2341/4764] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:25 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1507 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:26.575009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:26.575592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:26.576751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-120640a9-b680-4ec5-a33e-e131ff95fbbe req-bf33b842-d463-42ea-8a73-befcd910c2dc service nova] Creating event network-changed:331e5e84-84fd-4e9c-bc8b-44fefef6ccda for instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 on n-h1-855650-5 Nov 02 12:45:26.577878 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-120640a9-b680-4ec5-a33e-e131ff95fbbe req-bf33b842-d463-42ea-8a73-befcd910c2dc service nova] Creating event network-vif-deleted:70a6b12d-ac77-4ab7-a116-6c2861c001d0 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:45:26.580375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:26.594606 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-120640a9-b680-4ec5-a33e-e131ff95fbbe req-bf33b842-d463-42ea-8a73-befcd910c2dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.102485 Nov 02 12:45:26.595707 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2424/4765] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:26.604242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:26.604745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:26.608153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:26.610370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:26.612663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:26.613124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:26.622449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:26.623259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:26.642864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:26.647477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:26.650503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:26.651591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:26.652262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:26.652892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:26.673366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:45:26.822166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:26.832542 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6caf688-d9d1-4b64-bb0b-d6a1686a8954 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1451 microversion: 2.1 time: 0.235455 Nov 02 12:45:26.834656 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2425/4766] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:26 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1451 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:26.855791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:26.858405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:26.869391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:26.870359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:26.871018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:26.871998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:26.872688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:26.873382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:26.989614 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cc895aea-883d-4c76-ace0-755e128f6dae tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "DELETE /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 204 len: 0 microversion: 2.1 time: 0.423419 Nov 02 12:45:26.990989 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2342/4767] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:45:26 2022] DELETE /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:45:27.007906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:27.009548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:27.024874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:27.027020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:27.029068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:27.031677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:27.032483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:27.034353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:27.358005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:27.370180 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1fe6d9e4-1ddc-4bb8-851c-e499342c453c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 0.533324 Nov 02 12:45:27.371420 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2426/4768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:26 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:27.373136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:27.382158 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b12ff3b1-0b44-4381-bb35-add6b387d571 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1513 microversion: 2.1 time: 0.385918 Nov 02 12:45:27.385626 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2343/4769] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:26 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:27.499628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:27.500334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:27.513498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:27.515853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:27.516727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:27.518534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:27.519852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:27.521077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:27.736780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:27.748556 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7986e195-eecf-4bd8-97f3-a03e313fc9f6 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 0.253075 Nov 02 12:45:27.749847 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2427/4770] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:27 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:27.864312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:27.865109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:27.878197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:27.879245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:27.884419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:27.885354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:27.885849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:27.886319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:27.963672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:27.964171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:27.964611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:27.965070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lazy-loading 'fault' on Instance uuid b190e70d-986d-4bf4-8df7-06b56e79b789 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:45:28.100622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:28.108970 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a25a4376-7022-490a-841b-73eead35256b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 200 len: 1302 microversion: 2.1 time: 0.250495 Nov 02 12:45:28.109759 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2344/4771] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:27 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 1302 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:28.396233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:28.396861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:28.410993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:28.412003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:28.421269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:28.422105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:28.423073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:28.425067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:28.425887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:28.426531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:28.444179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:28.448396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:28.449042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:28.455597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:28.456016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:28.456364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:28.962365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:28.984231 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6513b2ad-98d4-4107-8a30-73855e89959e tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 0.593534 Nov 02 12:45:28.985093 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2428/4772] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:28 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:28.994455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c114cade-0e04-4dd5-94f0-14f7cc7b895b req-df039664-5b92-41b2-abd1-f045b75fd1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b190e70d-986d-4bf4-8df7-06b56e79b789", "name": "network-vif-deleted", "tag": "9edd0b5c-357f-455b-b282-e6346ca52ea2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:29.017463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c114cade-0e04-4dd5-94f0-14f7cc7b895b req-df039664-5b92-41b2-abd1-f045b75fd1d0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:29.026501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c114cade-0e04-4dd5-94f0-14f7cc7b895b req-df039664-5b92-41b2-abd1-f045b75fd1d0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:29.027344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c114cade-0e04-4dd5-94f0-14f7cc7b895b req-df039664-5b92-41b2-abd1-f045b75fd1d0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:29.049802 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c114cade-0e04-4dd5-94f0-14f7cc7b895b req-df039664-5b92-41b2-abd1-f045b75fd1d0 service nova] Creating event network-vif-deleted:9edd0b5c-357f-455b-b282-e6346ca52ea2 for instance b190e70d-986d-4bf4-8df7-06b56e79b789 on n-h2-855650-5 Nov 02 12:45:29.055658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:29.066670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c114cade-0e04-4dd5-94f0-14f7cc7b895b req-df039664-5b92-41b2-abd1-f045b75fd1d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077826 Nov 02 12:45:29.071806 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2429/4773] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:29.073468 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-998ca81a-c151-472e-b733-598026c47c26 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1513 microversion: 2.1 time: 0.664085 Nov 02 12:45:29.074522 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2345/4774] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:28 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1513 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:29.078896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f76bc5b9-4f46-4444-8e64-dd5710b2aa88 req-cd9fdd70-09de-4e96-9bcd-84a59d5e4709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63a4f4c-f12b-45a4-a311-7e908884aabc", "name": "network-vif-plugged", "status": "completed", "tag": "4e115bbc-c984-4658-a0e1-4fa895d33b31"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:29.088869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:29.090290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:29.096264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:29.110168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f76bc5b9-4f46-4444-8e64-dd5710b2aa88 req-cd9fdd70-09de-4e96-9bcd-84a59d5e4709 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:29.110666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f76bc5b9-4f46-4444-8e64-dd5710b2aa88 req-cd9fdd70-09de-4e96-9bcd-84a59d5e4709 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:29.113232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f76bc5b9-4f46-4444-8e64-dd5710b2aa88 req-cd9fdd70-09de-4e96-9bcd-84a59d5e4709 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:29.117769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:29.124404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:29.145387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:29.148063 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f76bc5b9-4f46-4444-8e64-dd5710b2aa88 req-cd9fdd70-09de-4e96-9bcd-84a59d5e4709 service nova] Creating event network-vif-plugged:4e115bbc-c984-4658-a0e1-4fa895d33b31 for instance a63a4f4c-f12b-45a4-a311-7e908884aabc on n-h1-855650-5 Nov 02 12:45:29.156549 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f76bc5b9-4f46-4444-8e64-dd5710b2aa88 req-cd9fdd70-09de-4e96-9bcd-84a59d5e4709 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082958 Nov 02 12:45:29.160552 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2430/4775] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:29.164988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:29.170063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:29.171069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:29.171959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:29.173049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:29.188187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:29.194813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:29.195778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:29.196701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:29.197344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:29.200554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:29.236292 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] HTTP exception thrown: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Request method failure captured: Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 HTTP/1.1 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYOM-DNWwCzrjfeQ_XlzIDVNfbVqLkBVnGxfCJCi59oofIzXiOrERcVf8fPN2lXjHFeR4Luv0ehHNtZ13XWYjwn0VMBNL4Ouv7B1IduS9tiyoRGPkxEgWvuZphD1DvW_q6oDKzkaH_vA7Kc7nKpOFuul2fzbiTOm63UB9bzrQSyw08 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestMultiNic-2046179309 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f74d8e5e8ac74a3e99d602abe159308e Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b190e70d-986d-4bf4-8df7-06b56e79b789'} Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:29.245036 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Returning 404 to user: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0067202b-eb9d-49ce-956d-a80360cab903 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 404 len: 111 microversion: 2.1 time: 0.084880 Nov 02 12:45:29.252795 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2431/4776] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:29 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:45:29.757541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:29.770330 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8e27961-7ef7-45e1-8ce2-ff88207d5e25 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 0.692358 Nov 02 12:45:29.771189 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2346/4777] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:29 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:30.007680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:30.009916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:30.018422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:30.018992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:30.019740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:30.020697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:30.021482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:30.022035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:30.118290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:30.125828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:30.140336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:30.141336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:30.142173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:30.143097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:30.143747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:30.144562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:30.981024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:30.991694 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-52cc89b0-4033-479c-b3c6-e2a2ffde05c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1513 microversion: 2.1 time: 0.894891 Nov 02 12:45:31.001808 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2347/4778] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:30 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1513 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:31.019860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:31.020507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:31.033679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:31.034653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:31.035462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:31.036528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:31.038353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:31.039005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:31.068175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:31.132669 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d0fb975-1357-4164-845e-5c6f8091f037 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 1.124366 Nov 02 12:45:31.133868 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2432/4779] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:30 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:31.292895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a360aa1e-78b4-4f24-b071-c97cc742e02e req-3efd8c35-a378-4831-8c95-b0fb2c665c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "438595d5-1ffa-4c37-a45a-86ee201a1db1", "name": "network-vif-deleted", "tag": "82e2295e-b5cc-4232-bed5-646cee5ea3da"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:31.322545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a360aa1e-78b4-4f24-b071-c97cc742e02e req-3efd8c35-a378-4831-8c95-b0fb2c665c78 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:31.326141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a360aa1e-78b4-4f24-b071-c97cc742e02e req-3efd8c35-a378-4831-8c95-b0fb2c665c78 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:31.326965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a360aa1e-78b4-4f24-b071-c97cc742e02e req-3efd8c35-a378-4831-8c95-b0fb2c665c78 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:31.388019 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a360aa1e-78b4-4f24-b071-c97cc742e02e req-3efd8c35-a378-4831-8c95-b0fb2c665c78 service nova] Creating event network-vif-deleted:82e2295e-b5cc-4232-bed5-646cee5ea3da for instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 on n-h2-855650-5 Nov 02 12:45:31.408570 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a360aa1e-78b4-4f24-b071-c97cc742e02e req-3efd8c35-a378-4831-8c95-b0fb2c665c78 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114183 Nov 02 12:45:31.412594 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2433/4780] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:31.836802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:31.873943 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b04778ff-740e-48d9-9a9f-efaaf0660fe0 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1327 microversion: 2.1 time: 0.870100 Nov 02 12:45:31.877057 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2348/4781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:31 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1327 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:32.023297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:32.024464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:32.039842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:32.040645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:32.041424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:32.047822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:32.049185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:32.049994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:32.137442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:32.138785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:32.139788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:32.140865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lazy-loading 'fault' on Instance uuid 438595d5-1ffa-4c37-a45a-86ee201a1db1 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:45:32.158589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:32.159509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:32.172794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:32.173917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:32.174990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:32.176167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:32.176985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:32.177587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:32.457451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:32.470194 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-25e75310-2fec-46d6-b9ec-dd4dac6a2832 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 200 len: 1307 microversion: 2.1 time: 0.452488 Nov 02 12:45:32.473785 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2434/4782] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:32 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 1307 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:32.572672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:32.586368 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0a95240e-3de2-4a60-ad9c-301bf3a19e69 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 0.433215 Nov 02 12:45:32.591173 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2349/4783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:32 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:32.904394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:32.905079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:32.917800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:32.919586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:32.920983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:32.933302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:32.933808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:32.934711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:33.264650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:33.279377 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d4a0d9d5-8b60-499d-a5d6-58bc241c2f1a tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1527 microversion: 2.1 time: 0.377726 Nov 02 12:45:33.303024 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2435/4784] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:32 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1527 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:33.311536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:33.313089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:33.347438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:33.354365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:33.355290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:33.356571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:33.357510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:33.358439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:33.501115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:33.501743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:33.524254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:33.528920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:33.531562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:33.533731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:33.534786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:33.536961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:33.572614 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 HTTP/1.1 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '438595d5-1ffa-4c37-a45a-86ee201a1db1'} Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:33.576195 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:33.582225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:33.582225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:33.582225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:33.582225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:33.582225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:33.582225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:45:33.582225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:33.586298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:33.588807 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-10fc89f0-4a4b-4aee-be0f-0e6415845127 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 404 len: 111 microversion: 2.1 time: 0.091273 Nov 02 12:45:33.614885 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2436/4785] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:33 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:45:33.625295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:33.626648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:33.636050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:33.637017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:33.637700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:33.640182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:33.641180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:33.642763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:33.823031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:33.842349 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-edab20d1-d909-46ce-a85b-a31de197cf01 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1527 microversion: 2.1 time: 0.537215 Nov 02 12:45:33.847716 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2350/4786] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:33 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1527 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:33.885329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:33.886340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:33.901499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:33.902371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:33.903013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:33.904132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:33.904778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:33.905379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:34.329078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:34.337416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:34.362129 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20558120-ec86-47ad-b931-7b49fe6eb3b7 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 0.743120 Nov 02 12:45:34.367736 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2437/4787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:33 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:34.608109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:34.623236 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ef27435-21f7-4106-a4c7-08682c1dee1b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.761367 Nov 02 12:45:34.624962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2351/4788] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:33 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:34.753197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:34.753695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:34.764637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:34.766587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:34.768736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:34.770952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:34.772835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:34.786142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:34.833824 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] HTTP exception thrown: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Request method failure captured: Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc HTTP/1.1 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmZPniwHEDZLLLs9Hho2eGfW5egcgiyhu3mMSVVgCboJ5uDBCJzMPLQsPqqSLX6tDNebs8ZhLkEfML_l8trYGQIYbOEx0Ax6gEhmuc2PWSPUcs16shkve-zOiqx4DE5zgBq6BuzKGhgW1Jrr2It4FS47t4bd0cRSUUCBulrjLXXFKsc Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 063f0cb9a4514d18ae6521bd9cbe7516 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1228684692 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/063f0cb9a4514d18ae6521bd9cbe7516"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/063f0cb9a4514d18ae6521bd9cbe7516"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/063f0cb9a4514d18ae6521bd9cbe7516"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_063f0cb9a4514d18ae6521bd9cbe7516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1228684692 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 063f0cb9a4514d18ae6521bd9cbe7516 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1228684692 Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1228684692-project Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5404913982ed4cf78e5c546154305e6b Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1228684692-project Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'a63a4f4c-f12b-45a4-a311-7e908884aabc'} Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:45:34.835987 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Returning 404 to user: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:34.841319 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8952533d-7e19-4a08-bd7b-17cfae9feb73 tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 404 len: 111 microversion: 2.1 time: 0.460549 Nov 02 12:45:34.845523 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2438/4789] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:45:34 2022] DELETE /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 111 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:45:34.849610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:34.850396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:34.857463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:34.858354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:34.859063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:34.860012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:34.860689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:34.861353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:34.884490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79b5f374-4d22-4981-8512-c69039f67c89 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79b5f374-4d22-4981-8512-c69039f67c89 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 163 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": 12345, "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 12345 Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:45:34.891976 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 12:45:34.896982 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:34.900074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79b5f374-4d22-4981-8512-c69039f67c89 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:34.903200 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-79b5f374-4d22-4981-8512-c69039f67c89 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.027433 Nov 02 12:45:34.908646 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2439/4790] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:34 2022] POST /compute/v2.1/servers => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:45:34.925016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:34.927908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:34.947594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:34.947594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:34.947594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:34.948610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:34.950156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:34.951629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:35.427097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:35.436126 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dcccfe85-c394-49d3-ac10-277edb74dc56 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1527 microversion: 2.1 time: 0.590387 Nov 02 12:45:35.437344 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2352/4791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:34 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1527 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:35.450597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-92e0e6cd-88b7-4048-ba20-e6fc75b9d2ac req-513e63f0-5f53-4366-8413-79d26e1b80b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bdc86e-6a17-4e74-a0bc-261ee60f6f66", "name": "network-vif-plugged", "status": "completed", "tag": "331e5e84-84fd-4e9c-bc8b-44fefef6ccda"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:35.463923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-92e0e6cd-88b7-4048-ba20-e6fc75b9d2ac req-513e63f0-5f53-4366-8413-79d26e1b80b2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:35.464703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-92e0e6cd-88b7-4048-ba20-e6fc75b9d2ac req-513e63f0-5f53-4366-8413-79d26e1b80b2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:35.465300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-92e0e6cd-88b7-4048-ba20-e6fc75b9d2ac req-513e63f0-5f53-4366-8413-79d26e1b80b2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:35.482502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-92e0e6cd-88b7-4048-ba20-e6fc75b9d2ac req-513e63f0-5f53-4366-8413-79d26e1b80b2 service nova] Creating event network-vif-plugged:331e5e84-84fd-4e9c-bc8b-44fefef6ccda for instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 on n-h1-855650-5 Nov 02 12:45:35.488999 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-92e0e6cd-88b7-4048-ba20-e6fc75b9d2ac req-513e63f0-5f53-4366-8413-79d26e1b80b2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049476 Nov 02 12:45:35.490842 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2353/4792] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:35.500347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:35.501741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:35.525428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:35.526217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:35.526887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:35.527822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:35.528300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:35.528743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:35.558554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:35.584670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb6a11af-54d1-4553-91e7-275a918fa53e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.673125 Nov 02 12:45:35.591867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2440/4793] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:34 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:35.617391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Action: 'update', calling method: >, body: {"server": {"name": "a63a4f4c-f12b-45a4-a311-7e908884aabc_new"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:35.622935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:35.637984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:35.638697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:35.639301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:35.640250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:35.641064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:35.641662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:35.686112 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] HTTP exception thrown: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Request method failure captured: Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc HTTP/1.1 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 64 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmZPniwHEDZLLLs9Hho2eGfW5egcgiyhu3mMSVVgCboJ5uDBCJzMPLQsPqqSLX6tDNebs8ZhLkEfML_l8trYGQIYbOEx0Ax6gEhmuc2PWSPUcs16shkve-zOiqx4DE5zgBq6BuzKGhgW1Jrr2It4FS47t4bd0cRSUUCBulrjLXXFKsc Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 063f0cb9a4514d18ae6521bd9cbe7516 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1228684692 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/063f0cb9a4514d18ae6521bd9cbe7516"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/063f0cb9a4514d18ae6521bd9cbe7516"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/063f0cb9a4514d18ae6521bd9cbe7516"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_063f0cb9a4514d18ae6521bd9cbe7516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1228684692 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 063f0cb9a4514d18ae6521bd9cbe7516 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1228684692 Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1228684692-project Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5404913982ed4cf78e5c546154305e6b Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1228684692-project Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "a63a4f4c-f12b-45a4-a311-7e908884aabc_new"}} Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'a63a4f4c-f12b-45a4-a311-7e908884aabc', 'body': {'server': {'name': 'a63a4f4c-f12b-45a4-a311-7e908884aabc_new'}}} Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:35.687999 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:35.693003 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:35.697140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] Returning 404 to user: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:35.702894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-590004bb-2a0a-4c44-8c01-a85c53b33a9a tempest-ServersNegativeTestMultiTenantJSON-1228684692 tempest-ServersNegativeTestMultiTenantJSON-1228684692-project] 10.222.0.45 "PUT /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 404 len: 111 microversion: 2.1 time: 0.108168 Nov 02 12:45:35.704573 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2441/4794] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:45:35 2022] PUT /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:45:35.714002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:35.715246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:35.722763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:35.723368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:35.723894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:35.725930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:35.729097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:35.729641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:36.481267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:36.495989 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1998a56f-e196-4a59-9dc3-f34340ae6960 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 1.003083 Nov 02 12:45:36.496758 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2354/4795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:35 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:36.510428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:36.511348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:36.522953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:36.523451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:36.523946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:36.524673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:36.525081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:36.525723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:36.526866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:36.536555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9ea2751f-372a-4a14-8769-59c1eabcaa45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.830124 Nov 02 12:45:36.537166 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2442/4796] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:35 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:36.598000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:36.636255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:45:36.815610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e2dcca0-3400-4747-b335-23d41da55244 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 204 len: 0 microversion: 2.1 time: 0.315539 Nov 02 12:45:36.817379 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2355/4797] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:45:36 2022] DELETE /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:45:36.826564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:36.827883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:36.837566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:36.838469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:36.839518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:36.840535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:36.840983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:36.841472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:37.217933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:37.228295 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f76a9441-b346-4f97-bd0e-08e8630e587c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1533 microversion: 2.1 time: 0.406731 Nov 02 12:45:37.231473 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2443/4798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:36 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1533 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:37.529711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:37.531035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:37.544049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:37.544764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:37.545709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:37.549949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:37.550744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:37.551780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:37.784393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:37.796718 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66661e99-953a-42fe-9d80-68bcc04b93bf tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1313 microversion: 2.1 time: 0.272763 Nov 02 12:45:37.798451 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2356/4799] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:37 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:38.261080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:38.263575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:38.310907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:38.311854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:38.312930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:38.314232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:38.318877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:38.319772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:38.599663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:38.616635 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-036d6a9e-b658-42fd-9177-5aedae551aeb tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1533 microversion: 2.1 time: 0.359532 Nov 02 12:45:38.630571 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2444/4800] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:38 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1533 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:38.832256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:38.841941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:38.876278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:38.878491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:38.879208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:38.882759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:38.885274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:38.886647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:39.417540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:39.432137 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3db6d5cd-ae8c-4e99-bf23-38e41203984f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1497 microversion: 2.1 time: 0.607604 Nov 02 12:45:39.454635 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2357/4801] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:38 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1497 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:39.660508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:39.666930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:39.712409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:39.717873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:39.729570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:39.734191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:39.738171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:39.745790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:40.494560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4c5914a-83be-4b9f-858d-6b95726ca1d2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8343339", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "12ea6101-eac0-4265-8bb7-d9b4b5376086", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:40.527557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:40.553333 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a710a201-e24a-4539-aec5-ae44ff8934ce tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1533 microversion: 2.1 time: 0.911841 Nov 02 12:45:40.557636 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2445/4802] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:39 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1533 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:40.754467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:40.755611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:40.771157 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e4c5914a-83be-4b9f-858d-6b95726ca1d2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Block Device 12ea6101-eac0-4265-8bb7-d9b4b5376086 is not bootable. Nov 02 12:45:40.772425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:40.772939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:40.773390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:40.774250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:40.774734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:40.775174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4c5914a-83be-4b9f-858d-6b95726ca1d2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 355 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8343339", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "12ea6101-eac0-4265-8bb7-d9b4b5376086", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: exception: Block Device 12ea6101-eac0-4265-8bb7-d9b4b5376086 is not bootable. Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-8343339', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '12ea6101-eac0-4265-8bb7-d9b4b5376086'}], 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 12ea6101-eac0-4265-8bb7-d9b4b5376086 is not bootable. Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:40.783434 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 12ea6101-eac0-4265-8bb7-d9b4b5376086 is not bootable. Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 12ea6101-eac0-4265-8bb7-d9b4b5376086 is not bootable. Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4c5914a-83be-4b9f-858d-6b95726ca1d2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Block Device 12ea6101-eac0-4265-8bb7-d9b4b5376086 is not bootable. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4c5914a-83be-4b9f-858d-6b95726ca1d2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.301436 Nov 02 12:45:40.796570 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2358/4803] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:45:40.817579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:40.820658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:40.849746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:40.859878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:40.861125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:40.866502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:40.871089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:40.872533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:40.909045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:45:41.091920 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6444ad53-1937-4939-84e6-f8b9c6b4e44c tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "DELETE /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 204 len: 0 microversion: 2.1 time: 0.341362 Nov 02 12:45:41.093243 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2446/4804] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:45:40 2022] DELETE /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:45:41.105115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:41.109482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:41.126449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:41.131059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:41.131891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:41.133439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:41.134150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:41.136445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:41.793121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:41.806937 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94efe695-989e-4ab0-9d3b-dae5bce05eee tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1503 microversion: 2.1 time: 0.705864 Nov 02 12:45:41.810101 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2447/4805] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:41 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1503 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:41.817372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:41.822287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:41.849090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:41.850905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:41.851349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:41.856896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:41.859726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:41.861728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:41.862527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:41.932232 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db8afb3d-432b-443e-a0b6-cbf06d8997bd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.133407 Nov 02 12:45:41.935625 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2359/4806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:40 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:42.007235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:42.007235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:42.035731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:42.036565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:42.037575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:42.039111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:42.040275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:42.041241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:42.594927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17751538d574c96905bc8b1ba3fa22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3423858b363a4bc09372edbc984b6667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:42.623729 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4030ffd2-ec16-49f3-a48e-7caed4b04c39 tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 200 len: 1533 microversion: 2.1 time: 0.809814 Nov 02 12:45:42.627112 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2448/4807] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:41 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 1533 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:42.656110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1863376851", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "e03d8bfc-ad11-4dd1-8798-ac83dfe5c653"}, {"uuid": "d1e8064c-388c-4fa1-aca0-7f4bcf1c05c3"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:42.901689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] validate_networks() for [('e03d8bfc-ad11-4dd1-8798-ac83dfe5c653', None, None, None, None, None), ('d1e8064c-388c-4fa1-aca0-7f4bcf1c05c3', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:43.205337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:43.251567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f0bdb82-cb48-41b8-ae8e-608f5b27db6f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.261899 Nov 02 12:45:43.283493 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2360/4808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:41 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:43.283493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-12a888d6-c91a-49fe-a211-d1bcec2f7a61 req-ed8c0143-6f49-4e3f-871c-be2fcbffae7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63a4f4c-f12b-45a4-a311-7e908884aabc", "name": "network-vif-deleted", "tag": "4e115bbc-c984-4658-a0e1-4fa895d33b31"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:43.310554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-12a888d6-c91a-49fe-a211-d1bcec2f7a61 req-ed8c0143-6f49-4e3f-871c-be2fcbffae7d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:43.311064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-12a888d6-c91a-49fe-a211-d1bcec2f7a61 req-ed8c0143-6f49-4e3f-871c-be2fcbffae7d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:43.311586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-12a888d6-c91a-49fe-a211-d1bcec2f7a61 req-ed8c0143-6f49-4e3f-871c-be2fcbffae7d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:43.344047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-12a888d6-c91a-49fe-a211-d1bcec2f7a61 req-ed8c0143-6f49-4e3f-871c-be2fcbffae7d service nova] Creating event network-vif-deleted:4e115bbc-c984-4658-a0e1-4fa895d33b31 for instance a63a4f4c-f12b-45a4-a311-7e908884aabc on n-h1-855650-5 Nov 02 12:45:43.353400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-12a888d6-c91a-49fe-a211-d1bcec2f7a61 req-ed8c0143-6f49-4e3f-871c-be2fcbffae7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087721 Nov 02 12:45:43.358572 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2361/4809] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:43.366360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:43.370209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:43.393272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:43.394144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:43.394853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:43.397122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:43.397907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:43.402369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:44.053089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:44.075583 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18ff4c0c-70e4-4521-8fd6-450c1deaec5f tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1503 microversion: 2.1 time: 0.712355 Nov 02 12:45:44.078967 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2362/4810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:43 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1503 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:44.099989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:44.102425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] [instance: a63a4f4c-f12b-45a4-a311-7e908884aabc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:44.125123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:44.126036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:44.127000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:44.128064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:44.128863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:44.130000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:44.179349 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] HTTP exception thrown: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Request method failure captured: Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc HTTP/1.1 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmY7JmOdky6ntKI3OZ3tzcIzXPPjZm_4DOFHlPGXoHqOOd9Z8-KpywPgm9ZNbuS7Rrl5nui8A4LXM0lR1u0esy624WvR-7q8MT_ubslKh5AyEO5gYKEhEMyzx06pcZpSriaUoNDs8POv3hY_jm7fAHyJsl2h_shD6Hel8LtMQZsU3l8 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 3423858b363a4bc09372edbc984b6667 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2058663543 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3423858b363a4bc09372edbc984b6667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3423858b363a4bc09372edbc984b6667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3423858b363a4bc09372edbc984b6667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3423858b363a4bc09372edbc984b6667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2058663543 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 3423858b363a4bc09372edbc984b6667 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2058663543 Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2058663543-project Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b17751538d574c96905bc8b1ba3fa22f Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2058663543-project Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a63a4f4c-f12b-45a4-a311-7e908884aabc'} Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:44.187466 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:44.192382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] Returning 404 to user: Instance a63a4f4c-f12b-45a4-a311-7e908884aabc could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:44.198014 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62e303ea-0595-45a1-907f-84c751d9fa3c tempest-ServersNegativeTestMultiTenantJSON-2058663543 tempest-ServersNegativeTestMultiTenantJSON-2058663543-project] 10.222.0.45 "GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc" status: 404 len: 111 microversion: 2.1 time: 0.109028 Nov 02 12:45:44.200128 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2363/4811] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:44 2022] GET /compute/v2.1/servers/a63a4f4c-f12b-45a4-a311-7e908884aabc => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:45:45.101636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:45.105316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:45.123705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:45.125323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:45.126268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:45.132492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:45.134627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:45.135414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:45.158635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:45:45.160082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:45:45.160748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:45:45.161472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:45:45.162139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:45:45.180402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:45.181625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:45.183814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:45.184830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:45.189642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:45.190790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:45.229260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:45.229753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:45.233413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:45.234395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lazy-loading 'fault' on Instance uuid 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:45:45.251518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Getting quotas for project d0dcd863d02d453abfdff23c335b1d19. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:45:45.265326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Getting quotas for user f74d8e5e8ac74a3e99d602abe159308e and project d0dcd863d02d453abfdff23c335b1d19. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:45:45.287125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:45:45.291169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:45:45.352072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60fb27c5a05a4029b1241ef445ec14a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e1560d183e49dfb7a5ed28c7468264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:45.374733 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-962b02cf-e479-44df-aa51-75a401eabd27 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 200 len: 1303 microversion: 2.1 time: 0.276758 Nov 02 12:45:45.377012 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2364/4812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:45 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 1303 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:45.444623 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7582a4fa-fcf7-4065-8c29-45dd8ab5d7b8 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.815744 Nov 02 12:45:45.445833 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2449/4813] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:45:45.458194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-60429628-80da-44e1-9281-e3fd98e8b270 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:45.458875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-60429628-80da-44e1-9281-e3fd98e8b270 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:45.565073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6d39f1ab-1da2-468e-85b1-dfb6a03fecd2 req-5daf4c99-9e10-40cd-8a46-3a11a5af71d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bdc86e-6a17-4e74-a0bc-261ee60f6f66", "name": "network-vif-deleted", "tag": "331e5e84-84fd-4e9c-bc8b-44fefef6ccda"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:45.593259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d39f1ab-1da2-468e-85b1-dfb6a03fecd2 req-5daf4c99-9e10-40cd-8a46-3a11a5af71d9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:45.597952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d39f1ab-1da2-468e-85b1-dfb6a03fecd2 req-5daf4c99-9e10-40cd-8a46-3a11a5af71d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:45.599104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6d39f1ab-1da2-468e-85b1-dfb6a03fecd2 req-5daf4c99-9e10-40cd-8a46-3a11a5af71d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:45.632303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6d39f1ab-1da2-468e-85b1-dfb6a03fecd2 req-5daf4c99-9e10-40cd-8a46-3a11a5af71d9 service nova] Creating event network-vif-deleted:331e5e84-84fd-4e9c-bc8b-44fefef6ccda for instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 on n-h1-855650-5 Nov 02 12:45:45.645286 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6d39f1ab-1da2-468e-85b1-dfb6a03fecd2 req-5daf4c99-9e10-40cd-8a46-3a11a5af71d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083875 Nov 02 12:45:45.649132 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2450/4814] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:46.029672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-60429628-80da-44e1-9281-e3fd98e8b270 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:46.041217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-60429628-80da-44e1-9281-e3fd98e8b270 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1213 microversion: 2.1 time: 0.585496 Nov 02 12:45:46.044906 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2365/4815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:45 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1213 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:46.413605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:46.416406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] [instance: 27bdc86e-6a17-4e74-a0bc-261ee60f6f66] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:46.452607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:46.456313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:46.456925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:46.458749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cb1fa53-39dc-4e80-a956-e3991b41eb57 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298453570", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5a18a9e9-495a-4970-9f7b-124577e0709a", "destination_type": "local"}, {"source_type": "volume", "uuid": "718220f4-ec88-4571-88d3-86f430fbd983", "destination_type": "invalid"}], "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:46.460170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:46.460569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:46.466326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cb1fa53-39dc-4e80-a956-e3991b41eb57 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 494 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298453570", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5a18a9e9-495a-4970-9f7b-124577e0709a", "destination_type": "local"}, {"source_type": "volume", "uuid": "718220f4-ec88-4571-88d3-86f430fbd983", "destination_type": "invalid"}], "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-298453570', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '718220f4-ec88-4571-88d3-86f430fbd983', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:46.468612 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.472566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cb1fa53-39dc-4e80-a956-e3991b41eb57 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:46.478502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8cb1fa53-39dc-4e80-a956-e3991b41eb57 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018970 Nov 02 12:45:46.478502 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2366/4816] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:46 2022] POST /compute/v2.1/servers => generated 155 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:45:46.492421 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] HTTP exception thrown: Instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 could not be found. Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Request method failure captured: Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 HTTP/1.1 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYvHmxrAR4D-nesWGH8kAqu_3iDBdiUeffzxzakoVGzD1I5h3DtOnyaz_sFDYYLiulc1pKVSYHSw0I9ZsweWDe0vWO_K9gBOw1S-TAXObQ7PmA4S5sKRka-zM07f_mHG_oD4DeehNiFHVPW1uF9UWX7wwG1_7em_i0ZtzYMEMNrCzY Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 12e1560d183e49dfb7a5ed28c7468264 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-VolumesActionsTest-987131523 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12e1560d183e49dfb7a5ed28c7468264"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12e1560d183e49dfb7a5ed28c7468264"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12e1560d183e49dfb7a5ed28c7468264"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12e1560d183e49dfb7a5ed28c7468264"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-VolumesActionsTest-987131523 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 12e1560d183e49dfb7a5ed28c7468264 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-VolumesActionsTest-987131523 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-VolumesActionsTest-987131523-project Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 60fb27c5a05a4029b1241ef445ec14a4 Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-VolumesActionsTest-987131523-project Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 could not be found. Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '27bdc86e-6a17-4e74-a0bc-261ee60f6f66'} Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 could not be found. Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 could not be found. Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:46.501448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 could not be found. Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] Returning 404 to user: Instance 27bdc86e-6a17-4e74-a0bc-261ee60f6f66 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:46.506677 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c17d5c8b-faff-47bc-9e26-0e69e5ef1051 tempest-VolumesActionsTest-987131523 tempest-VolumesActionsTest-987131523-project] 10.222.0.45 "GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66" status: 404 len: 111 microversion: 2.1 time: 0.098349 Nov 02 12:45:46.515092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2451/4817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:46 2022] GET /compute/v2.1/servers/27bdc86e-6a17-4e74-a0bc-261ee60f6f66 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:45:46.522443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:46.528177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:46.553921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:46.558199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:46.558982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:46.559915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:46.562561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:46.563219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:47.071708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:47.072344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:47.083471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:47.083788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:47.084248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:47.084983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:47.085451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:47.085916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:47.505141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:47.538313 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e10d0e4-88c7-41d0-be72-18a74e8e0804 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1209 microversion: 2.1 time: 0.470484 Nov 02 12:45:47.538920 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2452/4818] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:47 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1209 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:47.811091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:47.835716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9907d482-a7bc-4baa-9d6e-f80787638f38 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.352166 Nov 02 12:45:47.841898 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2367/4819] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:46 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:47.886841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:47.897628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:47.910346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:47.911427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:47.912078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:47.913152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:47.914292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:47.914888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:48.579220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:48.580124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:48.607782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:48.610096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:48.610886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:48.611714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:48.612197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:48.612650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:48.743620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:48.759664 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-72b66d4e-a2bc-4733-872b-6bf7d2d35f81 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1271 microversion: 2.1 time: 0.190672 Nov 02 12:45:48.760607 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2368/4820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:48 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:49.025194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:49.053886 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f7dd91cf-cb3e-4f3a-b4d1-427a3e104963 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.190903 Nov 02 12:45:49.058272 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2453/4821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:47 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:49.229173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ad89d2a-9cc6-4ab0-a692-ce16b23e62a7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-508032810", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ad89d2a-9cc6-4ab0-a692-ce16b23e62a7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 491 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-508032810", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-508032810', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:49.238627 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 12:45:49.241951 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:49.247693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ad89d2a-9cc6-4ab0-a692-ce16b23e62a7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:49.248783 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ad89d2a-9cc6-4ab0-a692-ce16b23e62a7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.024751 Nov 02 12:45:49.259840 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2369/4822] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:49 2022] POST /compute/v2.1/servers => generated 624 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:45:49.271491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:49.272329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:49.313726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:49.316135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:49.317435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:49.319083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:49.323297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:49.325375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:49.793313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:49.798239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:49.810300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:49.811441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:49.812410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:49.816111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:49.816807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:49.817851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:50.184039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:50.204210 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df7647d0-e1f4-479e-99e4-9bb58d1d9e0c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1271 microversion: 2.1 time: 0.418712 Nov 02 12:45:50.207079 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2370/4823] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:49 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1271 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:50.546810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:50.575270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-729e6439-d832-470f-b032-56a256004536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.295201 Nov 02 12:45:50.594377 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2454/4824] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:49 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:50.608640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:50.611307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:50.634385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:50.637650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:50.638654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:50.645267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:50.646173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:50.648990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:51.240198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:51.240978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:51.254067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:51.254776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:51.255088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:51.256822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:51.257311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:51.257832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:51.329296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:51.338925 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-652c965d-fa8d-415b-b166-baae3c052aef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.738378 Nov 02 12:45:51.352303 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2371/4825] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:50 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:51.456890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82df7a1a-0e60-4f38-8383-d5431edb5fc4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82df7a1a-0e60-4f38-8383-d5431edb5fc4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 416 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:51.461370 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82df7a1a-0e60-4f38-8383-d5431edb5fc4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:51.468841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82df7a1a-0e60-4f38-8383-d5431edb5fc4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011605 Nov 02 12:45:51.475325 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2372/4826] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:51 2022] POST /compute/v2.1/servers => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:45:51.495402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:51.498827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:51.516087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:51.516590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:51.517038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:51.517753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:51.518241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:51.518686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:51.670862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:51.686154 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f01bbc5d-f957-49f6-b7b5-50cffa1de218 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1271 microversion: 2.1 time: 0.450037 Nov 02 12:45:51.691435 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2455/4827] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:51 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1271 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:52.262822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:52.282034 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d097cbe3-3267-4dd2-ad43-a8c8aa484c3f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.811600 Nov 02 12:45:52.285516 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2373/4828] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:51 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:52.315521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:52.316573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:52.325290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:52.326680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:52.327467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:52.328489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:52.329218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:52.330435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:52.603982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:52.614723 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e754d14-7cf5-41ed-adcb-364b7944a3fa tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.304304 Nov 02 12:45:52.620684 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2456/4829] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:52 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:52.710211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:52.711152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:52.729180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:52.730151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:52.737218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:52.738399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:52.740439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:52.741204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:52.774343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52c39265-11eb-4bf5-96e4-304b55c6f6ce tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1189647", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": -1, "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:52.874124 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-52c39265-11eb-4bf5-96e4-304b55c6f6ce tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Flavor -1 could not be found. Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52c39265-11eb-4bf5-96e4-304b55c6f6ce tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 203 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1189647", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": -1, "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: exception: Flavor -1 could not be found. Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1189647', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': -1, 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:52.889328 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Nov 02 12:45:52.893271 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:52.896663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52c39265-11eb-4bf5-96e4-304b55c6f6ce tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:52.899981 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52c39265-11eb-4bf5-96e4-304b55c6f6ce tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.133480 Nov 02 12:45:52.907384 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2457/4830] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:52 2022] POST /compute/v2.1/servers => generated 73 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:52.946300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:52.958765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:52.987522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:52.988863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:52.989758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:52.994336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:52.995348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:52.998509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:53.095270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:53.645527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:53.659630 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c463a2ab-7cb7-42e9-a64e-729a5d9e4739 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.746658 Nov 02 12:45:53.670491 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2458/4831] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:52 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:53.707926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:53.708900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:53.731100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:53.731882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:53.734859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:53.735928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:53.740449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:53.741158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:53.894561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:53.911925 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-45b526b2-cbaf-409a-a1db-eaa51cebd7b4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1313 microversion: 2.1 time: 1.206065 Nov 02 12:45:53.913477 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2374/4832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:52 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1313 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:54.000223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:54.000745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:54.015655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:54.023908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:54.024622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:54.025528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:54.026053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:54.026529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:54.153309 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d603e2a6-72a6-4232-aa21-4eefb5aa7291 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe/ips" status: 200 len: 150 microversion: 2.1 time: 0.155878 Nov 02 12:45:54.155747 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2375/4833] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:45:53 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe/ips => generated 150 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:45:54.241516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a226dd3-1368-468a-b1fa-de8059c89400"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:54.263405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:54.274643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:54.300706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:54.304505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:54.311268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:54.317364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:54.321170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:54.321461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e08ac773-de90-47b8-b295-7e5f50abde65 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.625800 Nov 02 12:45:54.340873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:54.341845 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2459/4834] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:53 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:54.412808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed19f41e-d2aa-4ce6-a8a2-b1cc69ca15d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-489133406", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed19f41e-d2aa-4ce6-a8a2-b1cc69ca15d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 172 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-489133406", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-489133406', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi -1 Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:45:54.472216 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 12:45:54.481743 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.502354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed19f41e-d2aa-4ce6-a8a2-b1cc69ca15d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:54.504509 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ed19f41e-d2aa-4ce6-a8a2-b1cc69ca15d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.099427 Nov 02 12:45:54.522497 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2460/4835] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:54 2022] POST /compute/v2.1/servers => generated 145 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:45:54.591314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:54.600840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:54.661205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:54.666224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:54.668588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:54.673287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:54.689253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:54.693118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:54.903478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:54.920040 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Invalid volume: volume 4a226dd3-1368-468a-b1fa-de8059c89400 is already attached to instances: 849b433f-9fa9-413b-8f1e-21a92e07c013 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe/os-volume_attachments HTTP/1.1 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 74 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: {"volumeAttachment": {"volumeId": "4a226dd3-1368-468a-b1fa-de8059c89400"}} Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid volume: volume 4a226dd3-1368-468a-b1fa-de8059c89400 is already attached to instances: 849b433f-9fa9-413b-8f1e-21a92e07c013 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': 'b3006885-3516-4839-9208-d9671c6626fe', 'body': {'volumeAttachment': {'volumeId': '4a226dd3-1368-468a-b1fa-de8059c89400'}}} Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4a226dd3-1368-468a-b1fa-de8059c89400 is already attached to instances: 849b433f-9fa9-413b-8f1e-21a92e07c013 Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.931756 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4a226dd3-1368-468a-b1fa-de8059c89400 is already attached to instances: 849b433f-9fa9-413b-8f1e-21a92e07c013 Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4a226dd3-1368-468a-b1fa-de8059c89400 is already attached to instances: 849b433f-9fa9-413b-8f1e-21a92e07c013 Nov 02 12:45:54.941949 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.950128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 400 to user: Invalid volume: volume 4a226dd3-1368-468a-b1fa-de8059c89400 is already attached to instances: 849b433f-9fa9-413b-8f1e-21a92e07c013 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:54.963200 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-239f15bc-2267-4cb1-81c4-5fd607812238 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.779233 Nov 02 12:45:54.964882 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2376/4836] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:45:54 2022] POST /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe/os-volume_attachments => generated 174 bytes in 794 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:45:54.975036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:54.999648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:55.056500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:55.059091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:55.071082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:55.072755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:55.074099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:55.079230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:55.211399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:55.281731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:56.037673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:56.640606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:56.666852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6ad56ccf-36a3-4586-b664-330d9cebce8a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 2.134541 Nov 02 12:45:56.688054 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2461/4837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:54 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:56.708360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.710656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:56.750293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:56.751384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:56.752171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:56.753430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:56.758885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:56.759709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:56.788785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:56.801607 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7bad07e-998a-4204-9126-b92292d28bb3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1313 microversion: 2.1 time: 1.833094 Nov 02 12:45:56.814187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2377/4838] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:54 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1313 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:56.833959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.837286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:56.847472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:45:56.850913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:56.854498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:56.858138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:56.858793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:56.862158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:56.865523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:56.866367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:57.170963 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4925b568-1e7d-43a0-90d8-a59645f1ab90 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 204 len: 0 microversion: 2.1 time: 0.480673 Nov 02 12:45:57.176673 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2462/4839] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:45:56 2022] DELETE /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:45:57.183790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:57.184521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:57.197010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:57.202818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:57.203398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:57.204263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:57.204744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:57.205333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:58.001714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:58.015567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d78cd1df-8072-49ec-9fac-ec1356569f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.200062 Nov 02 12:45:58.019226 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2378/4840] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:58.031531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:58.035309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:58.053235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:58.054955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:58.058775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:58.073563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:58.075316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:58.079740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:58.170616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:58.186477 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ddb1e806-3439-4c21-bc16-c91e3664db3f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1682 microversion: 2.1 time: 1.007890 Nov 02 12:45:58.201269 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2463/4841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:57 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1682 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:58.283808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-391cec6f-f4a5-4adf-bf65-b7c2fdb28aba tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1303678358", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:58.308645 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-391cec6f-f4a5-4adf-bf65-b7c2fdb28aba tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-391cec6f-f4a5-4adf-bf65-b7c2fdb28aba tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 216 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1303678358", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1303678358', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._validate_network_id( Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:58.312119 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:58.316349 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:58.316349 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:58.316349 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:58.316349 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:58.316349 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:58.316349 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:58.316349 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 12:45:58.316349 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:45:58.329614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-391cec6f-f4a5-4adf-bf65-b7c2fdb28aba tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:58.332973 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-391cec6f-f4a5-4adf-bf65-b7c2fdb28aba tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.056318 Nov 02 12:45:58.353901 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2464/4842] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:58 2022] POST /compute/v2.1/servers => generated 123 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:45:58.386089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:58.387317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:58.437744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:58.438069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:58.438543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:58.439325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:58.444228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:58.444941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:59.129904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:59.145088 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd40be76-9d73-4d6f-9954-fb8ad82195f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 1.123379 Nov 02 12:45:59.158947 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2379/4843] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:58 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:59.174628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:59.194548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d3a516fb-0c80-486d-9d36-70dbe71b645f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.835659 Nov 02 12:45:59.198071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2465/4844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:58 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:59.228490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:59.228884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:59.229747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:59.229932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:59.238162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:59.240630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:59.241584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:59.242906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:59.244104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:59.244809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:59.245272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:59.245478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:59.246628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:59.248503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:59.250050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:59.263737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:59.264312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:59.740357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:59.761157 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1275f3f2-b997-4bed-a068-97d49a53d0b7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1682 microversion: 2.1 time: 0.537605 Nov 02 12:45:59.766218 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2466/4845] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:59 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1682 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:00.061151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:00.085103 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-092b7bec-42cd-4ab6-bad8-7ef423df9f77 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.861525 Nov 02 12:46:00.099131 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2380/4846] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:59 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:00.174599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:00.176317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:00.194940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:00.197003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:00.198810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:00.201756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:00.204606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:00.211251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:00.246367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca3cc3ea-ad57-457b-aeb8-07e7253c0114 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1197475999", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-key-1034513685", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:01.009434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-ca3cc3ea-ad57-457b-aeb8-07e7253c0114 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] validate_networks() for [('c8f61405-3ba0-4101-8580-7b227f748cee', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:46:01.284240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:01.302844 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65641f1c-be0e-4d30-ad87-4e21e670e6a1 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 1.133766 Nov 02 12:46:01.318063 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2467/4847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:00 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:01.318063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:01.318063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:01.338113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:01.338986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:01.339494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:01.340578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:01.341037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:01.354260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:01.945857 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-ca3cc3ea-ad57-457b-aeb8-07e7253c0114 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Invalid key_name provided. Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca3cc3ea-ad57-457b-aeb8-07e7253c0114 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 247 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1197475999", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-key-1034513685", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid key_name provided. Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1197475999', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'key_name': 'tempest-key-1034513685', 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1034513685 not found for user d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:01.951219 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Nov 02 12:46:01.955491 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:01.959591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca3cc3ea-ad57-457b-aeb8-07e7253c0114 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid key_name provided. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:01.965644 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca3cc3ea-ad57-457b-aeb8-07e7253c0114 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.726233 Nov 02 12:46:01.967945 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2381/4848] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:00 2022] POST /compute/v2.1/servers => generated 70 bytes in 1730 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:01.982089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:01.987591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:01.989744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:01.996436 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8bab0de6-e346-408b-811d-3e6bcf9d56ea tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1682 microversion: 2.1 time: 0.690614 Nov 02 12:46:02.019109 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2468/4849] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:01 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1682 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:02.032344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:02.036342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:02.037549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:02.043285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:02.046830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:02.047783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:02.332192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:02.332823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:02.354154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:02.356178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:02.359602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:02.360716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:02.361389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:02.362169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:02.549938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:02.562975 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46725321-243a-4f31-9ce5-2527aa20f2cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.590477 Nov 02 12:46:02.567066 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2382/4850] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:01 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:02.600913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:02.603538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:02.628711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:02.632448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:02.633785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:02.635871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:02.645027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:02.646621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:03.189449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:03.203341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97b1aeb6-fde4-4bd9-a36f-4f0c64f4c2f3 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 0.878653 Nov 02 12:46:03.207076 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2469/4851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:02 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:03.223871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:03.228955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:03.231453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:03.251608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:03.252548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:03.253388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:03.258993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:03.263886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:03.269636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:03.275928 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88e1b152-f10c-46ea-a524-534d92b5b111 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.680529 Nov 02 12:46:03.306665 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2383/4852] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:02 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:03.440871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b634ea15-0162-4716-acd3-1a82305674a5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290936044", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:03.940594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:03.985229 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cfde8696-78b4-437c-8b84-6821d33a4e0e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1614 microversion: 2.1 time: 0.774741 Nov 02 12:46:04.034457 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2470/4853] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:03 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1614 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:04.230043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:04.230749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:04.248483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.249135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.249588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.250492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.250968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.251399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.544883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.security_group_api [None req-b634ea15-0162-4716-acd3-1a82305674a5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Neutron security group does_not_exist not found {{(pid=120722) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 02 12:46:04.545585 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-b634ea15-0162-4716-acd3-1a82305674a5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b634ea15-0162-4716-acd3-1a82305674a5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 257 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290936044", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: exception: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-290936044', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 02 12:46:04.559615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:04.564293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b634ea15-0162-4716-acd3-1a82305674a5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:04.568359 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b634ea15-0162-4716-acd3-1a82305674a5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.126138 Nov 02 12:46:04.568359 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2384/4854] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:03 2022] POST /compute/v2.1/servers => generated 106 bytes in 1128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:46:04.568359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-70abbb72-9eda-4ac0-bbf2-0ad417dd8771 req-bc5756f2-551d-4ff2-be48-e6b521970a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82a4748-5420-4164-bc86-ea51a9d04917", "tag": "8d3f55dd-bb71-4f16-b9e5-982bec74dc8a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:04.612684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-70abbb72-9eda-4ac0-bbf2-0ad417dd8771 req-bc5756f2-551d-4ff2-be48-e6b521970a29 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.614791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-70abbb72-9eda-4ac0-bbf2-0ad417dd8771 req-bc5756f2-551d-4ff2-be48-e6b521970a29 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.615788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-70abbb72-9eda-4ac0-bbf2-0ad417dd8771 req-bc5756f2-551d-4ff2-be48-e6b521970a29 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.642019 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-70abbb72-9eda-4ac0-bbf2-0ad417dd8771 req-bc5756f2-551d-4ff2-be48-e6b521970a29 service nova] Creating event network-changed:8d3f55dd-bb71-4f16-b9e5-982bec74dc8a for instance f82a4748-5420-4164-bc86-ea51a9d04917 on n-h2-855650-5 Nov 02 12:46:04.672181 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-70abbb72-9eda-4ac0-bbf2-0ad417dd8771 req-bc5756f2-551d-4ff2-be48-e6b521970a29 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103192 Nov 02 12:46:04.674067 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2385/4855] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:04.685548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:04.686869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:04.699992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.700947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.701742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.703175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.704001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.704750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:05.563040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:05.613993 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3308f20f-f071-47f4-9e42-bdcf7004527f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 1.386668 Nov 02 12:46:05.629055 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2471/4856] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:04 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:05.642550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:05.643279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:05.659762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:05.660574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:05.661248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:05.662000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:05.664450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:05.665230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:05.913881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:05.926892 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-15cbc221-c3e6-4da4-90fe-a8fa28064a54 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 200 len: 1614 microversion: 2.1 time: 0.296593 Nov 02 12:46:05.933228 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2472/4857] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:05 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 1614 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:06.394203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:06.408956 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ed0ba64-2a81-4690-b78d-2ef0c1b9e434 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.728183 Nov 02 12:46:06.410705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2386/4858] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:04 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:06.449076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:06.449760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:06.465100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:06.481665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:06.495436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:06.504525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:06.508289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:06.509987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:06.638736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:06.639805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:06.652066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:06.652996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:06.655589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:06.656705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:06.657747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:06.659722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.677019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:07.687934 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2ab0666b-1e5e-4b0a-a4a5-c31914cf456e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 1.053305 Nov 02 12:46:07.689227 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2387/4859] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:06 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:07.699974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0a80b3b3-0989-482c-8d84-6c5fc36d3986 req-f0a1940a-553f-457b-974f-cf3e8b8105f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3006885-3516-4839-9208-d9671c6626fe", "name": "network-vif-deleted", "tag": "58ddbc96-c2f5-491d-bf23-63e798b424f7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:07.730599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0a80b3b3-0989-482c-8d84-6c5fc36d3986 req-f0a1940a-553f-457b-974f-cf3e8b8105f7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:07.732634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0a80b3b3-0989-482c-8d84-6c5fc36d3986 req-f0a1940a-553f-457b-974f-cf3e8b8105f7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:07.733390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0a80b3b3-0989-482c-8d84-6c5fc36d3986 req-f0a1940a-553f-457b-974f-cf3e8b8105f7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.739531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:07.753674 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-521314a3-120e-4876-866a-10197914fe6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.315644 Nov 02 12:46:07.761094 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2473/4860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:06 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:07.784200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:07.787931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0a80b3b3-0989-482c-8d84-6c5fc36d3986 req-f0a1940a-553f-457b-974f-cf3e8b8105f7 service nova] Creating event network-vif-deleted:58ddbc96-c2f5-491d-bf23-63e798b424f7 for instance b3006885-3516-4839-9208-d9671c6626fe on n-h2-855650-5 Nov 02 12:46:07.791967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:07.810942 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0a80b3b3-0989-482c-8d84-6c5fc36d3986 req-f0a1940a-553f-457b-974f-cf3e8b8105f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120107 Nov 02 12:46:07.815805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:07.816320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:07.816759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.816970 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2388/4861] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:07.820911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:07.821716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:07.823263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7f29563-90d7-46c6-b0ce-a699d4425e50 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:07.824141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d7f29563-90d7-46c6-b0ce-a699d4425e50 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 940888f6-26e6-487d-b677-0aca9222148d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:07.827461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.830861 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d7f29563-90d7-46c6-b0ce-a699d4425e50 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 940888f6-26e6-487d-b677-0aca9222148d could not be found. Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7f29563-90d7-46c6-b0ce-a699d4425e50 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/940888f6-26e6-487d-b677-0aca9222148d HTTP/1.1 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 940888f6-26e6-487d-b677-0aca9222148d could not be found. Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '940888f6-26e6-487d-b677-0aca9222148d'} Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940888f6-26e6-487d-b677-0aca9222148d could not be found. Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940888f6-26e6-487d-b677-0aca9222148d could not be found. Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.832945 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:07.837714 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.837714 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:07.837714 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:07.837714 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:07.837714 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:07.837714 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:07.837714 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940888f6-26e6-487d-b677-0aca9222148d could not be found. Nov 02 12:46:07.837714 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.842338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7f29563-90d7-46c6-b0ce-a699d4425e50 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 940888f6-26e6-487d-b677-0aca9222148d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:07.843700 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d7f29563-90d7-46c6-b0ce-a699d4425e50 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "DELETE /compute/v2.1/servers/940888f6-26e6-487d-b677-0aca9222148d" status: 404 len: 111 microversion: 2.1 time: 0.025097 Nov 02 12:46:07.844487 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2389/4862] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:46:07 2022] DELETE /compute/v2.1/servers/940888f6-26e6-487d-b677-0aca9222148d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:07.854439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:07.855577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:07.863628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:07.864545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:07.865553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.866694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:07.866928 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:46:07.868357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:07.869144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe HTTP/1.1 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b3006885-3516-4839-9208-d9671c6626fe'} Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:07.869940 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.877701 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:07.877701 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:07.877701 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:07.877701 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:07.877701 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:07.877701 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:46:07.877701 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:07.894950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:07.903201 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b5ea23ae-febb-4708-a460-224575a3f3ad tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 404 len: 111 microversion: 2.1 time: 0.137619 Nov 02 12:46:07.907829 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2474/4863] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:07 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:07.916855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-168a9246-c747-4758-a14a-4c72bdb7cc94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '.version_select at 0x7f228edd65e0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:08.001654 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-168a9246-c747-4758-a14a-4c72bdb7cc94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330897564" status: 202 len: 0 microversion: 2.1 time: 0.087700 Nov 02 12:46:08.008647 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2475/4864] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:46:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330897564 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:46:08.329452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:08.345828 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1695a0d3-ac4b-4380-8308-ce77728b797f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.492189 Nov 02 12:46:08.385353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:08.387197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:08.392371 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2390/4865] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:07 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:08.424330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:08.425194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:08.425769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:08.429831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:08.430608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:08.434768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:08.717342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:08.723093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:08.765879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:08.770614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:08.772147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:08.779982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:08.781101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:08.784219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:09.545392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:09.558021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:09.567626 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98d9fbb6-8f64-4639-a93a-f1b489ec5f2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.194749 Nov 02 12:46:09.587717 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2476/4866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:08 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:09.620419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f527df06-6974-4656-8298-62e93623ba52 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:09.622193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f527df06-6974-4656-8298-62e93623ba52 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:46:09.624043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:09.626255 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f527df06-6974-4656-8298-62e93623ba52 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f527df06-6974-4656-8298-62e93623ba52 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 9223372036854775808 could not be found. Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '9223372036854775808'} Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:09.630832 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:09.635459 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:09.635459 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:09.635459 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:09.635459 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Nov 02 12:46:09.635459 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:09.638710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7681ae3d-f7a5-4e0f-a07e-9fdd199180b9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 0.925415 Nov 02 12:46:09.640998 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2391/4867] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:08 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:09.643535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f527df06-6974-4656-8298-62e93623ba52 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:09.647442 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f527df06-6974-4656-8298-62e93623ba52 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.038651 Nov 02 12:46:09.652377 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2477/4868] 10.222.0.45 () {58 vars in 1188 bytes} [Wed Nov 2 12:46:09 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:46:09.662461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:09.662837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:09.677397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:09.677931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:09.678588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:09.696602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:09.697732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:09.698454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:10.218778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-558efd2d-9600-4ae8-a297-4affa0d0f9cc req-ee37780e-af48-460b-bcd4-9db0fdf4216d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82a4748-5420-4164-bc86-ea51a9d04917", "tag": "90a952b9-4f8e-410e-a930-7cbc108322fa"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:10.292664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-558efd2d-9600-4ae8-a297-4affa0d0f9cc req-ee37780e-af48-460b-bcd4-9db0fdf4216d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:10.293147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-558efd2d-9600-4ae8-a297-4affa0d0f9cc req-ee37780e-af48-460b-bcd4-9db0fdf4216d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:10.293582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-558efd2d-9600-4ae8-a297-4affa0d0f9cc req-ee37780e-af48-460b-bcd4-9db0fdf4216d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:10.354774 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-558efd2d-9600-4ae8-a297-4affa0d0f9cc req-ee37780e-af48-460b-bcd4-9db0fdf4216d service nova] Creating event network-changed:90a952b9-4f8e-410e-a930-7cbc108322fa for instance f82a4748-5420-4164-bc86-ea51a9d04917 on n-h2-855650-5 Nov 02 12:46:10.362256 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-558efd2d-9600-4ae8-a297-4affa0d0f9cc req-ee37780e-af48-460b-bcd4-9db0fdf4216d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150381 Nov 02 12:46:10.363529 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2478/4869] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:10.690814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:10.697902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:10.728815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:10.731440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:10.732426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:10.734872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:10.739150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:10.739711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:10.960228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:10.978491 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2445edd0-5a44-4f23-a0e1-d09e9694519b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.320240 Nov 02 12:46:10.999950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2392/4870] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:09 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:11.014862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:11.020176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:11.030790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:11.031420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:11.032023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:11.032907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:11.034315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:11.034872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:11.253806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:11.272820 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-279639d6-09f7-4f42-832c-fd4a8a5a8392 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 0.608581 Nov 02 12:46:11.279539 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2479/4871] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:10 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:11.825075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:11.834370 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91436e6b-4620-47f7-bf61-06aadacbd2b8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.828744 Nov 02 12:46:11.841264 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2393/4872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:11 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:11.859533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe5acebe-33da-42c0-b9c9-aa40f71ef8e1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:11.860766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe5acebe-33da-42c0-b9c9-aa40f71ef8e1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Failed to fetch instance by id -1 {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:46:11.861452 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-fe5acebe-33da-42c0-b9c9-aa40f71ef8e1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance -1 could not be found. Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe5acebe-33da-42c0-b9c9-aa40f71ef8e1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance -1 could not be found. Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '-1'} Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:11.865204 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:11.869620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:11.869620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:11.869620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Nov 02 12:46:11.869620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.872987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe5acebe-33da-42c0-b9c9-aa40f71ef8e1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:11.875106 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe5acebe-33da-42c0-b9c9-aa40f71ef8e1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018543 Nov 02 12:46:11.876650 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2480/4873] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 12:46:11 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:46:11.885312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:11.885940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:11.908136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:11.908644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:11.909096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:11.909824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:11.912087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:11.915217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.315568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:12.316251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:12.345529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.349374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.355268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.359904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.368320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.370263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.422782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:12.437948 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb1fde0b-e22d-4e88-b98c-2f88dbfab536 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.555826 Nov 02 12:46:12.440155 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2394/4874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:11 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:12.468859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:12.469945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:12.483154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.486180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.486917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.490082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.490854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.493955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:13.030443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:13.044966 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-85dc7427-8d7a-4102-b482-f23c10307da2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 0.733549 Nov 02 12:46:13.046726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2481/4875] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:12 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:13.408883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:13.409530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:13.423588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:13.431576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:13.432394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:13.433266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:13.433851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:13.436869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:13.686318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lazy-loading 'services' on Instance uuid 849b433f-9fa9-413b-8f1e-21a92e07c013 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:46:13.845362 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-edb12163-76f5-495a-85be-d8e282d00353 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments/4a226dd3-1368-468a-b1fa-de8059c89400" status: 202 len: 0 microversion: 2.1 time: 0.439809 Nov 02 12:46:13.846374 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2482/4876] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:46:13 2022] DELETE /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments/4a226dd3-1368-468a-b1fa-de8059c89400 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:46:13.876463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:13.889480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:13.911299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:13.913033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:13.916936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:13.918369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:13.918369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:13.925044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:14.014411 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1bfa416f-d3d7-4f24-b026-1792fab56630 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155621 Nov 02 12:46:14.019818 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2483/4877] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:13 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:14.073906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:14.074636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:14.088347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:14.088890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:14.089448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:14.090424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:14.090940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:14.091425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:14.714709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:14.727367 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-69992dab-2f52-4554-a343-89507a6c6549 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 2.263585 Nov 02 12:46:14.732305 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2395/4878] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:12 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:14.759534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7b776a1-dff8-4f3b-be20-cae738c84adb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:14.763435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f7b776a1-dff8-4f3b-be20-cae738c84adb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 6a50a711-5b88-411d-b8d1-ed798b98edb7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:14.782636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f7b776a1-dff8-4f3b-be20-cae738c84adb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 6a50a711-5b88-411d-b8d1-ed798b98edb7 could not be found. Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7b776a1-dff8-4f3b-be20-cae738c84adb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/6a50a711-5b88-411d-b8d1-ed798b98edb7/action HTTP/1.1 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 19 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: {"forceDelete": {}} Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6a50a711-5b88-411d-b8d1-ed798b98edb7 could not be found. Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6a50a711-5b88-411d-b8d1-ed798b98edb7', 'body': {'forceDelete': {}}} Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a50a711-5b88-411d-b8d1-ed798b98edb7 could not be found. Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a50a711-5b88-411d-b8d1-ed798b98edb7 could not be found. Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:14.799509 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:14.804224 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:14.804224 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:14.804224 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a50a711-5b88-411d-b8d1-ed798b98edb7 could not be found. Nov 02 12:46:14.804224 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:14.806265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7b776a1-dff8-4f3b-be20-cae738c84adb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 6a50a711-5b88-411d-b8d1-ed798b98edb7 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:14.807422 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f7b776a1-dff8-4f3b-be20-cae738c84adb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/6a50a711-5b88-411d-b8d1-ed798b98edb7/action" status: 404 len: 111 microversion: 2.1 time: 0.053486 Nov 02 12:46:14.808655 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2396/4879] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:14 2022] POST /compute/v2.1/servers/6a50a711-5b88-411d-b8d1-ed798b98edb7/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:46:14.822328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:14.826608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:14.841741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:14.844974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:14.845681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:14.847300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:14.849543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:14.850933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:15.726438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:15.742685 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-92c7784b-2fe3-4e29-9bc7-074c63570b5f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 1.668228 Nov 02 12:46:15.746616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2484/4880] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:14 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:15.773107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-75a3a5be-8be9-4f56-833c-6cf29faa50d5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Action: 'create', calling method: .version_select at 0x7f228dcacdc0>, body: {"keypair": {"name": "tempest-keypair-811820979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRk4ZWIL7xDaL/bwhCAX3f7qAO8TiscLOzS4ZambQSBzVpUbMJd87N1DsGtTkwIvfX77+5jURvYxKyYlUMRT5LGBV/3rZsc9+q61fEIr6WtRGR6x8oerpUqv+oZBV0ewA=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:15.812924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-75a3a5be-8be9-4f56-833c-6cf29faa50d5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Getting quotas for project 72292c4dd7214be4a630e6c175b8453e. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:15.825821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-75a3a5be-8be9-4f56-833c-6cf29faa50d5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Getting quotas for user 04c1e4d0344f444db533d8b419cee797 and project 72292c4dd7214be4a630e6c175b8453e. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:15.892476 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-75a3a5be-8be9-4f56-833c-6cf29faa50d5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.141096 Nov 02 12:46:15.893873 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2485/4881] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 12:46:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:46:15.895705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:15.901019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:15.904264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:15.915768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:15.916605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:15.918201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:15.918616 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37552f5a-b8d5-406c-8184-0ee686587796 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.095238 Nov 02 12:46:15.919247 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2397/4882] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:14 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:15.920693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:15.921567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:15.922281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:15.950479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:15.951753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:15.965499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:15.966326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:15.967586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:15.968756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:15.969592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:15.970431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:15.972579 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-521e54ee-422f-4621-a2e8-90e2fa002aa5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077293 Nov 02 12:46:15.973381 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2486/4883] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:15 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:16.777339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:16.779465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:16.796064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:16.805642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:16.807430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:16.808642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:16.809371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:16.810078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:16.893102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:16.897716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:16.910945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82c0b70c-c550-4793-a815-1bcbb0d290c7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.966903 Nov 02 12:46:16.911549 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2398/4884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:15 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:16.944181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf20dede-7aef-4b06-b761-7cce27a05371 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:16.951289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bf20dede-7aef-4b06-b761-7cce27a05371 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: d4bf01d7-8ac8-493f-b00d-7ca99a5921db] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:16.974974 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-bf20dede-7aef-4b06-b761-7cce27a05371 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance d4bf01d7-8ac8-493f-b00d-7ca99a5921db could not be found. Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf20dede-7aef-4b06-b761-7cce27a05371 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/d4bf01d7-8ac8-493f-b00d-7ca99a5921db/action HTTP/1.1 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 39 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: {"os-getConsoleOutput": {"length": 10}} Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance d4bf01d7-8ac8-493f-b00d-7ca99a5921db could not be found. Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'd4bf01d7-8ac8-493f-b00d-7ca99a5921db', 'body': {'os-getConsoleOutput': {'length': 10}}} Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bf01d7-8ac8-493f-b00d-7ca99a5921db could not be found. Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bf01d7-8ac8-493f-b00d-7ca99a5921db could not be found. Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:16.988771 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:16.994148 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:16.994148 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:16.994148 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:16.994148 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:16.994148 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bf01d7-8ac8-493f-b00d-7ca99a5921db could not be found. Nov 02 12:46:16.994148 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:16.997277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf20dede-7aef-4b06-b761-7cce27a05371 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance d4bf01d7-8ac8-493f-b00d-7ca99a5921db could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:16.997277 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bf20dede-7aef-4b06-b761-7cce27a05371 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/d4bf01d7-8ac8-493f-b00d-7ca99a5921db/action" status: 404 len: 111 microversion: 2.1 time: 0.062318 Nov 02 12:46:16.998344 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2399/4885] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:16 2022] POST /compute/v2.1/servers/d4bf01d7-8ac8-493f-b00d-7ca99a5921db/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:17.007196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:17.013555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:17.034399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:17.039253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:17.039996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:17.041623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:17.043569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:17.045655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:17.124910 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-453c841c-bf61-4574-941e-e2f8dbff58c0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124272 Nov 02 12:46:17.125847 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2400/4886] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:16 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:17.137529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:17.139069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:17.165419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:17.165950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:17.167678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:17.168527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:17.173840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:17.174503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:17.506265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:17.532115 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8457d311-c011-4a7d-ae33-72e0a513c98e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 0.758460 Nov 02 12:46:17.533380 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2487/4887] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:16 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:17.925448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:17.955183 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ecd41269-4cb4-4043-b09e-52d693fed5cd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.815320 Nov 02 12:46:17.967640 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2401/4888] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:17 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:17.990937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:17.992688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:18.011159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.016948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.017575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:18.022229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.023810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.024071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:18.140989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:18.143601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:18.177443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.178493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.179259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:18.183409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.184611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.185308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:18.284469 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65eee157-9dec-48dd-9135-66b08a25bea5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147838 Nov 02 12:46:18.313179 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2402/4889] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:18 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:18.545855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:18.555691 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c33987af-5ca9-402b-8b5b-60816f47664b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.570378 Nov 02 12:46:18.561383 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2488/4890] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:17 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:18.582097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:18.582887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:18.585290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be75a819-f830-4ce3-93c9-0aceda948e8d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:18.586710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be75a819-f830-4ce3-93c9-0aceda948e8d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 228b18d4-6003-4248-aefe-0b9b96829299] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:18.597587 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-be75a819-f830-4ce3-93c9-0aceda948e8d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 228b18d4-6003-4248-aefe-0b9b96829299 could not be found. Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be75a819-f830-4ce3-93c9-0aceda948e8d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/228b18d4-6003-4248-aefe-0b9b96829299 HTTP/1.1 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 228b18d4-6003-4248-aefe-0b9b96829299 could not be found. Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '228b18d4-6003-4248-aefe-0b9b96829299'} Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228b18d4-6003-4248-aefe-0b9b96829299 could not be found. Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228b18d4-6003-4248-aefe-0b9b96829299 could not be found. Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:18.599670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:18.604221 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:18.604221 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:18.604221 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:18.604221 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228b18d4-6003-4248-aefe-0b9b96829299 could not be found. Nov 02 12:46:18.604221 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:18.607229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be75a819-f830-4ce3-93c9-0aceda948e8d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 228b18d4-6003-4248-aefe-0b9b96829299 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:18.607380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.607760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.611518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:18.614184 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be75a819-f830-4ce3-93c9-0aceda948e8d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/228b18d4-6003-4248-aefe-0b9b96829299" status: 404 len: 111 microversion: 2.1 time: 0.025065 Nov 02 12:46:18.614842 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2489/4891] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:18 2022] GET /compute/v2.1/servers/228b18d4-6003-4248-aefe-0b9b96829299 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:46:18.618189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.620146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.621510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:18.626536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:18.627162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:18.655623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.656151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.656605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:18.658735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.659259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.662986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:19.041028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:19.063178 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2dfbe867-3825-40f2-9c33-d65434fb8aa9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 0.482915 Nov 02 12:46:19.064348 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2403/4892] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:18 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:19.268621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:19.286612 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5bb82c12-de49-4eb5-8a12-fa0437ae6cc6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.663368 Nov 02 12:46:19.290110 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2490/4893] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:18 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:19.305174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:19.307931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:19.337126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:19.338948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:19.347140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:19.350152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:19.350646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:19.351961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:19.352445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:19.352880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:19.359541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:19.363125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:19.363818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:19.364740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:19.365359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:19.366433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:19.442780 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea4f83f8-2b02-4457-8163-4502b2496b68 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143097 Nov 02 12:46:19.445480 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2404/4894] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:19 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:19.646856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:19.671724 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7ac686d1-d6eb-4419-bc45-edc579a54f39 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.344021 Nov 02 12:46:19.678548 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2491/4895] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:19 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:19.785894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f02057d4-3c03-4b08-9ddb-b0d79f7aa555 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-71027155", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f02057d4-3c03-4b08-9ddb-b0d79f7aa555 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 236 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-71027155", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-71027155', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.807858 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f02057d4-3c03-4b08-9ddb-b0d79f7aa555 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f02057d4-3c03-4b08-9ddb-b0d79f7aa555 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028072 Nov 02 12:46:19.816867 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2405/4896] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:46:19.823167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:19.824152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:19.837110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:19.837620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:19.838097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:19.846169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:19.850062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:19.850773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.108260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:20.109085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:20.148927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:20.153355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:20.154457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.163459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:20.166105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:20.168194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.316984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:20.367694 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8de1ae10-483e-4d62-96b0-5d3810d55387 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.546644 Nov 02 12:46:20.368394 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2492/4897] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:19 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:20.399418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:20.400604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:20.421171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:20.422333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:20.424678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.425656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:20.428277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:20.429075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.715265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:20.735481 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-69c68fca-f9c5-4adb-b249-d0413a4cf4b2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 0.622987 Nov 02 12:46:20.740354 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2406/4898] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:20 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:20.770759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:20.779379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:20.800489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:20.820886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:20.821669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.822874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:20.823616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:20.824306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.932004 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d165e3f-29cd-4d19-984c-94fae0844c83 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172813 Nov 02 12:46:20.949897 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2407/4899] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:20 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:20.998216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:21.031051 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ed9c7d0d-d792-4701-8cee-eccf1a228e2d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.613430 Nov 02 12:46:21.034988 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2493/4900] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:20 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:21.261823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45f05873-3490-40d2-9d66-9a1fd6b34d9b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1464867932", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45f05873-3490-40d2-9d66-9a1fd6b34d9b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 235 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1464867932", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1464867932', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'notvalid' Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.266322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 12:46:21.272285 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:21.281699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45f05873-3490-40d2-9d66-9a1fd6b34d9b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:21.282945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-45f05873-3490-40d2-9d66-9a1fd6b34d9b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025759 Nov 02 12:46:21.285890 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2408/4901] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:21 2022] POST /compute/v2.1/servers => generated 133 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:46:21.295573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:21.296745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:21.314449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:21.320363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:21.321796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:21.323536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:21.324488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:21.353340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:21.775732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:21.777034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:21.801776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:21.803251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:21.809241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:21.810795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:21.812561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:21.814425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:22.662627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:22.681923 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-623ea383-bf85-41ca-a1c8-80e6f4b6fb55 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.381865 Nov 02 12:46:22.698892 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2494/4902] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:21 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:22.714352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:22.729417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:22.769741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:22.770745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:22.773444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:22.796835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:22.802357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:22.802985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:22.986428 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f47b5909-541e-46f7-bcac-e15161af9149 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.297456 Nov 02 12:46:22.996126 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2495/4903] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:22 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 197 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:23.004652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:23.005299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:23.023795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:23.026726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:23.028731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:23.029539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:23.031849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:23.032326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:23.292210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:23.306345 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b1f7532-3095-49ca-9327-3ee8424d4ff4 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 1.534104 Nov 02 12:46:23.308585 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2409/4904] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:21 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:24.018773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:24.036527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:24.086862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:24.092991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:24.100732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:24.103594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:24.104786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:24.105265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:24.244366 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56b9940a-f947-4fa2-b868-a16f70d45ad2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.239100 Nov 02 12:46:24.245088 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2410/4905] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:23 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:46:24.284702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:24.302662 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5f1a3b8c-be24-4a31-b09f-3eb71c2065b5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.308891 Nov 02 12:46:24.331622 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2496/4906] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:22 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:24.340954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:24.344383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:24.353763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96e12252-c1bd-40d2-94ae-ff96238b528e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:24.354960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96e12252-c1bd-40d2-94ae-ff96238b528e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 226ccdbf-5d41-4f2c-b50c-9da86db1a8b0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:24.360328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:24.361190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:24.361880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:24.362893 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-96e12252-c1bd-40d2-94ae-ff96238b528e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 226ccdbf-5d41-4f2c-b50c-9da86db1a8b0 could not be found. Nov 02 12:46:24.363037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:24.363769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:24.364448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96e12252-c1bd-40d2-94ae-ff96238b528e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/226ccdbf-5d41-4f2c-b50c-9da86db1a8b0/action HTTP/1.1 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 13 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: {"pause": {}} Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 226ccdbf-5d41-4f2c-b50c-9da86db1a8b0 could not be found. Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '226ccdbf-5d41-4f2c-b50c-9da86db1a8b0', 'body': {'pause': {}}} Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226ccdbf-5d41-4f2c-b50c-9da86db1a8b0 could not be found. Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226ccdbf-5d41-4f2c-b50c-9da86db1a8b0 could not be found. Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:24.376730 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:24.385523 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:24.385523 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:24.385523 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226ccdbf-5d41-4f2c-b50c-9da86db1a8b0 could not be found. Nov 02 12:46:24.385523 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:24.385523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96e12252-c1bd-40d2-94ae-ff96238b528e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 226ccdbf-5d41-4f2c-b50c-9da86db1a8b0 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:24.385523 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96e12252-c1bd-40d2-94ae-ff96238b528e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/226ccdbf-5d41-4f2c-b50c-9da86db1a8b0/action" status: 404 len: 111 microversion: 2.1 time: 0.031682 Nov 02 12:46:24.385523 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2411/4907] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:24 2022] POST /compute/v2.1/servers/226ccdbf-5d41-4f2c-b50c-9da86db1a8b0/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:24.403851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:24.405695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:24.423434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:24.435971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:24.436522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:24.442212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:24.447761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:24.449700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:24.450390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:25.769472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:25.783827 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf496d12-1cb9-4a4b-9676-8a04dc53062b tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 1.449722 Nov 02 12:46:25.799480 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2497/4908] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:24 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:25.809746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1025285", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a08d8f30-672e-4cfb-9cf6-4586fabc8264"}, {"port": "08d946d8-b737-4d8f-a0f8-2a4f7e6c893b", "tag": "port-1"}, {"port": "1b72dfc0-e39d-4182-b6fb-9a2ef7753062", "tag": "port-2"}, {"uuid": "f78366fb-4e91-416e-a1ba-0c1afe2db42e", "tag": "net-1"}, {"uuid": "f78366fb-4e91-416e-a1ba-0c1afe2db42e"}, {"uuid": "18d5f6ee-6d20-4832-8144-f3e3d120de5c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "18d5f6ee-6d20-4832-8144-f3e3d120de5c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7da759f2-a269-454d-94ce-2c1c3320612b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "bea58faf-5a27-4c20-ae7e-8e3a51ed5874", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "06e7aa0d-0b3c-4f94-8a03-630ec866002e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1266135312"}], "key_name": "tempest-keypair-811820979", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:25.859329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:26.197234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:26.233413 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25fd5a54-1792-4e10-a8aa-9374c79b46c8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.845878 Nov 02 12:46:26.246625 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2412/4909] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:24 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:26.263464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-410e557d-06bb-4301-b8ee-ec78279c9cc3 req-ef84348d-3dda-467a-ba93-7698759f3561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82a4748-5420-4164-bc86-ea51a9d04917", "name": "network-vif-plugged", "status": "completed", "tag": "90a952b9-4f8e-410e-a930-7cbc108322fa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:26.327665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] validate_networks() for [('a08d8f30-672e-4cfb-9cf6-4586fabc8264', None, None, None, None, None), (None, None, '08d946d8-b737-4d8f-a0f8-2a4f7e6c893b', None, None, None), (None, None, '1b72dfc0-e39d-4182-b6fb-9a2ef7753062', None, None, None), ('f78366fb-4e91-416e-a1ba-0c1afe2db42e', None, None, None, None, None), ('f78366fb-4e91-416e-a1ba-0c1afe2db42e', None, None, None, None, None), ('18d5f6ee-6d20-4832-8144-f3e3d120de5c', '10.2.2.100', None, None, None, None), ('18d5f6ee-6d20-4832-8144-f3e3d120de5c', '10.2.2.200', None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:46:26.360914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-410e557d-06bb-4301-b8ee-ec78279c9cc3 req-ef84348d-3dda-467a-ba93-7698759f3561 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:26.362977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-410e557d-06bb-4301-b8ee-ec78279c9cc3 req-ef84348d-3dda-467a-ba93-7698759f3561 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:26.363261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-410e557d-06bb-4301-b8ee-ec78279c9cc3 req-ef84348d-3dda-467a-ba93-7698759f3561 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:26.388255 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-410e557d-06bb-4301-b8ee-ec78279c9cc3 req-ef84348d-3dda-467a-ba93-7698759f3561 service nova] Creating event network-vif-plugged:90a952b9-4f8e-410e-a930-7cbc108322fa for instance f82a4748-5420-4164-bc86-ea51a9d04917 on n-h2-855650-5 Nov 02 12:46:26.398440 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-410e557d-06bb-4301-b8ee-ec78279c9cc3 req-ef84348d-3dda-467a-ba93-7698759f3561 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147983 Nov 02 12:46:26.399263 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2413/4910] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:26.900450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:26.904222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:26.933587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=70 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:26.954014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:26.957941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:26.963716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:26.964943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:26.972495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:26.974295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:27.115566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-27aea93b-84e9-48f0-a606-7ec37c213ca6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.714767 Nov 02 12:46:27.121915 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2414/4911] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:46:26 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013/os-volume_attachments => generated 25 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:46:27.136783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:27.139905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:27.170878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:27.171643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:27.173221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:27.174124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:27.176440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:27.177033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:27.790906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:27.800729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de43cf64-711b-4cbe-bcf9-65fb85bc5af1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.676742 Nov 02 12:46:27.801777 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2415/4912] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:27 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:27.808140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:27.809083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:27.832781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:27.837266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:27.838578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:27.843501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:27.849106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:27.849521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:28.758706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:28.768079 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f688959-ce15-41b1-8167-9b58e6ecd2f9 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 0.965073 Nov 02 12:46:28.775534 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2416/4913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:27 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:28.798205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:28.801854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:28.831011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:28.832006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:28.835391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:28.840573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:28.844180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:28.845393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:28.916616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:46:29.144734 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-76192cdd-7cfa-4116-8781-f562922ec188 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 204 len: 0 microversion: 2.1 time: 0.366037 Nov 02 12:46:29.145474 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2417/4914] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:46:28 2022] DELETE /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:29.155771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:29.159946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:29.176277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.176854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.177413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:29.178273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.179855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.183012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:29.241130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:29.415203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-abda23a9-355c-48f8-9f78-0f35a770f490 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 202 len: 0 microversion: 2.1 time: 0.266622 Nov 02 12:46:29.422639 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2418/4915] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:29 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:46:29.436758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c52d24e4-370d-4418-abbd-1b38a8a34853 req-77756e6b-0b61-4416-8d3b-05c2401008e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82a4748-5420-4164-bc86-ea51a9d04917", "name": "network-vif-plugged", "status": "completed", "tag": "8d3f55dd-bb71-4f16-b9e5-982bec74dc8a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:29.461652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c52d24e4-370d-4418-abbd-1b38a8a34853 req-77756e6b-0b61-4416-8d3b-05c2401008e8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.463707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c52d24e4-370d-4418-abbd-1b38a8a34853 req-77756e6b-0b61-4416-8d3b-05c2401008e8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.465060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c52d24e4-370d-4418-abbd-1b38a8a34853 req-77756e6b-0b61-4416-8d3b-05c2401008e8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:29.482636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c52d24e4-370d-4418-abbd-1b38a8a34853 req-77756e6b-0b61-4416-8d3b-05c2401008e8 service nova] Creating event network-vif-plugged:8d3f55dd-bb71-4f16-b9e5-982bec74dc8a for instance f82a4748-5420-4164-bc86-ea51a9d04917 on n-h2-855650-5 Nov 02 12:46:29.490020 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c52d24e4-370d-4418-abbd-1b38a8a34853 req-77756e6b-0b61-4416-8d3b-05c2401008e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063937 Nov 02 12:46:29.491853 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2419/4916] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:29.499512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:29.500559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:29.509473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.510481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.511173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:29.512711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.514302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.515226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:29.854396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:29.868322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd772496-d04e-4897-a304-cc78088ad6d5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1682 microversion: 2.1 time: 0.371840 Nov 02 12:46:29.869582 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2420/4917] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:29 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1682 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:29.884562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:29.885580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:29.905585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.910698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.916328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:29.917632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.918334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.918833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:30.231639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:30.240314 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b775637-cd64-4766-95d2-40fc31f55363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1510 microversion: 2.1 time: 0.369167 Nov 02 12:46:30.254234 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2421/4918] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:29 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:30.255195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:30.255826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:30.271885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:30.272399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:30.272886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:30.273612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:30.274108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:30.274543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:31.424423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:31.437463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bfdc25e3-f803-42bd-a5a7-c26caada3033 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1334 microversion: 2.1 time: 1.189813 Nov 02 12:46:31.450392 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2422/4919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:30 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1334 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:31.463616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:31.464840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:31.487160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:31.489514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:31.492755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:31.494187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:31.499812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:31.502833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:31.909750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:31.931760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d27570db-31db-4a59-9256-9d8ee2de4d1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1682 microversion: 2.1 time: 0.479715 Nov 02 12:46:31.932380 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2423/4920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:31 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1682 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:31.965139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:31.965776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:31.996899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:31.997409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:32.006466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:32.007306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:32.010998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:32.011588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:32.522413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:32.531017 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e37b8434-084f-42b1-b588-e15c693d102a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1490 microversion: 2.1 time: 0.597594 Nov 02 12:46:32.538048 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2424/4921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:31 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1490 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:32.549103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:32.549730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:32.616056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:32.616563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:32.617019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:32.617843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:32.618455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:32.618897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:33.472435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:33.481053 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3fd3d2ec-b2f3-455c-9fd4-9752fb08e54c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1669 microversion: 2.1 time: 0.941305 Nov 02 12:46:33.481643 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2425/4922] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:32 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1669 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:33.514780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:33.520243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:33.550732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:33.551424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:33.552874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:33.555993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:33.556778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:33.557448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:33.620514 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Cannot 'pause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state paused Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action HTTP/1.1 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 13 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: {"pause": {}} Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'pause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state paused Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'pause': {}}} Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b in vm_state paused. Cannot pause while the instance is in this state. Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state paused Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:33.623716 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:33.628794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:33.628794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:33.628794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:33.628794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state paused Nov 02 12:46:33.628794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:33.630067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 409 to user: Cannot 'pause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state paused {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:33.631177 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f41315f-b845-4cec-a51c-4ee41f49c48f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 409 len: 143 microversion: 2.1 time: 0.140862 Nov 02 12:46:33.632599 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2426/4923] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:33 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 143 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:46:33.638111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:33.639380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:33.648571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:33.649385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:33.650018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:33.651171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:33.653490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:33.664922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.338994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:34.395731 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8c06191-d53d-4878-963d-059d6e416c41 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 200 len: 1682 microversion: 2.1 time: 0.761805 Nov 02 12:46:34.400683 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2427/4924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:33 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 1682 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:34.420336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:34.420860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:34.446759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.452635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.453475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.462582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.463354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.464496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.509809 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17557753-ba41-4115-a8f6-a37d017bde7f tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917/ips" status: 200 len: 179 microversion: 2.1 time: 0.102938 Nov 02 12:46:34.511704 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2428/4925] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:46:34 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917/ips => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:34.526228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:34.529255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:34.547832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.550898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.552689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.557435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.558416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.559107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.801097 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26f12ae6-4929-441c-9119-3a77520444ff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 202 len: 0 microversion: 2.1 time: 0.284156 Nov 02 12:46:34.815647 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2429/4926] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:34 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:46:34.841294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:34.842350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:34.873987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.875980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.876743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.878144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.879022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.879714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.946885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:46:35.217571 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab4883ec-8fc5-4638-a2ce-452affdb1a14 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 204 len: 0 microversion: 2.1 time: 0.399594 Nov 02 12:46:35.218871 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2430/4927] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:46:34 2022] DELETE /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:35.224179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:46:35.224906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:46:35.225606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:46:35.226267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:46:35.226894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:46:35.228365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:35.229244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:35.237077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:35.237720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:35.238391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:35.238915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:35.239953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:35.240811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:35.241357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:35.283436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:35.287508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:35.288080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:35.289067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:35.292292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:35.293000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:35.372080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Getting quotas for project 72292c4dd7214be4a630e6c175b8453e. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:35.389004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Getting quotas for user 04c1e4d0344f444db533d8b419cee797 and project 72292c4dd7214be4a630e6c175b8453e. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:35.725337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:46:35.728596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7da759f2-a269-454d-94ce-2c1c3320612b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='bea58faf-5a27-4c20-ae7e-8e3a51ed5874',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06e7aa0d-0b3c-4f94-8a03-630ec866002e',volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:46:36.426427 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-879f6826-9b3b-4cdb-bf2f-49a0279267ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 10.625060 Nov 02 12:46:36.427073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2498/4928] 10.222.0.45 () {62 vars in 1189 bytes} [Wed Nov 2 12:46:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 10627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:46:36.692096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:36.711179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ea64bb6-9313-446a-bc50-943076c36136 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1497 microversion: 2.1 time: 1.490110 Nov 02 12:46:36.711955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2431/4929] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:35 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1497 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:36.716481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:36.717094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:36.740520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.750767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.753334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.754130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.754640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.755100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.784863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Calling method '.version_select at 0x7f228dcac790>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:36.791719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.792664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.793353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.812433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.813387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.814020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.826540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.827298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.827963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.835026 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09f91320-c31e-40e6-aa6d-44283afbbd49 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404 tempest-PortsAdminExtendedAttrsIpV6TestJSON-920060404-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.406790 Nov 02 12:46:36.836444 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2499/4930] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:46:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:36.842264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:36.843147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:36.850732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.854939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.855462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.856356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.857042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.857512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.915532 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 HTTP/1.1 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '849b433f-9fa9-413b-8f1e-21a92e07c013'} Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:36.917593 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3a4eebbc-6fef-47a6-a30d-ef0c93554ec6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 404 len: 111 microversion: 2.1 time: 0.081688 Nov 02 12:46:36.924055 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2500/4931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:36 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:36.932483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b1ca221a-35f2-4a44-b017-bd202695a4e6 req-2691acfd-8058-4b89-bbbf-d18b7449607d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849b433f-9fa9-413b-8f1e-21a92e07c013", "name": "network-vif-deleted", "tag": "5931d485-b7de-4d4b-b0fd-bbc183e4d3ac"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:36.965878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b1ca221a-35f2-4a44-b017-bd202695a4e6 req-2691acfd-8058-4b89-bbbf-d18b7449607d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.966866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b1ca221a-35f2-4a44-b017-bd202695a4e6 req-2691acfd-8058-4b89-bbbf-d18b7449607d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.967973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b1ca221a-35f2-4a44-b017-bd202695a4e6 req-2691acfd-8058-4b89-bbbf-d18b7449607d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.990005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b1ca221a-35f2-4a44-b017-bd202695a4e6 req-2691acfd-8058-4b89-bbbf-d18b7449607d service nova] Creating event network-vif-deleted:5931d485-b7de-4d4b-b0fd-bbc183e4d3ac for instance 849b433f-9fa9-413b-8f1e-21a92e07c013 on n-h1-855650-5 Nov 02 12:46:37.002493 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b1ca221a-35f2-4a44-b017-bd202695a4e6 req-2691acfd-8058-4b89-bbbf-d18b7449607d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075845 Nov 02 12:46:37.003139 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2501/4932] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:37.021432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e835c4c7-b7f2-4cb9-8f7f-29fe96d7453b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:37.022179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e835c4c7-b7f2-4cb9-8f7f-29fe96d7453b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:37.200762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e835c4c7-b7f2-4cb9-8f7f-29fe96d7453b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:37.215950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:37.219202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e835c4c7-b7f2-4cb9-8f7f-29fe96d7453b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:37.220784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e835c4c7-b7f2-4cb9-8f7f-29fe96d7453b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:37.221995 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e835c4c7-b7f2-4cb9-8f7f-29fe96d7453b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1282 microversion: 2.42 time: 0.216733 Nov 02 12:46:37.222494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:37.225071 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11d1f4f3-017e-49a7-9990-1c5eca99d768 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1675 microversion: 2.1 time: 0.512306 Nov 02 12:46:37.230774 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2502/4933] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:37 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:37.246041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1d2e18f-70b2-4920-a8d6-a7031393038d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '.version_select at 0x7f228dcd78b0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:37.250984 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2432/4934] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:36 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1675 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:37.313656 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b1d2e18f-70b2-4920-a8d6-a7031393038d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843935171" status: 202 len: 0 microversion: 2.1 time: 0.081258 Nov 02 12:46:37.314446 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2503/4935] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843935171 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:46:37.746049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:37.751323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:37.766254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:37.773894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:37.774660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:37.780069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:37.780954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:37.781649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.258555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:38.259194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:38.275329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.275900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.278100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.280829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.283706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.288917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:38.293933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.304886 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9b42a96-e052-4443-bb00-dc2520bbc4cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.564080 Nov 02 12:46:38.318543 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2433/4936] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:37 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:38.341242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:38.343677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:38.359677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.362786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.363574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.366111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.367155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.367831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.541252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:38.585985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:38.588426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:38.597619 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb55ac92-7115-48b9-9ae4-4ea312881b14 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1516 microversion: 2.42 time: 0.273204 Nov 02 12:46:38.598398 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2434/4937] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:38 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:38.633706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:38.634787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:38.644919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.646162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.646848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.649004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.650794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.651519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.852180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:38.876561 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-56ba5e1f-6d53-44e0-906b-ec3347e644cd tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1654 microversion: 2.1 time: 0.607394 Nov 02 12:46:38.877614 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2504/4938] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:38 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1654 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:39.120474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f0be5c71-ee59-42b1-b6ca-a33babb01935 req-2986cc4e-ed82-47cf-9a6a-e6de404c598f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82a4748-5420-4164-bc86-ea51a9d04917", "name": "network-vif-deleted", "tag": "8d3f55dd-bb71-4f16-b9e5-982bec74dc8a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:39.154506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f0be5c71-ee59-42b1-b6ca-a33babb01935 req-2986cc4e-ed82-47cf-9a6a-e6de404c598f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:39.156194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f0be5c71-ee59-42b1-b6ca-a33babb01935 req-2986cc4e-ed82-47cf-9a6a-e6de404c598f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:39.157385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f0be5c71-ee59-42b1-b6ca-a33babb01935 req-2986cc4e-ed82-47cf-9a6a-e6de404c598f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:39.161578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:39.171515 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d7ca692-0737-48ce-8106-ed8e49da5d83 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.556107 Nov 02 12:46:39.192638 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2435/4939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:38 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:39.200747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:39.201119 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f0be5c71-ee59-42b1-b6ca-a33babb01935 req-2986cc4e-ed82-47cf-9a6a-e6de404c598f service nova] Creating event network-vif-deleted:8d3f55dd-bb71-4f16-b9e5-982bec74dc8a for instance f82a4748-5420-4164-bc86-ea51a9d04917 on n-h2-855650-5 Nov 02 12:46:39.204747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:39.219388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:39.220947 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f0be5c71-ee59-42b1-b6ca-a33babb01935 req-2986cc4e-ed82-47cf-9a6a-e6de404c598f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105041 Nov 02 12:46:39.226494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:39.227943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:39.229121 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2505/4940] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:46:39.230938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:39.233072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:39.237949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:39.263918 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1/action HTTP/1.1 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 28 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: {"reboot": {"type": "SOFT"}} Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '438595d5-1ffa-4c37-a45a-86ee201a1db1', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:39.269414 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:39.273610 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:39.280557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:39.282153 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-951f1c98-3392-4c7a-ac9d-fb32934bafcb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1/action" status: 404 len: 111 microversion: 2.1 time: 0.088063 Nov 02 12:46:39.284040 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2436/4941] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:39 2022] POST /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:39.301630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:39.302480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:39.318753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:39.319520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:39.320371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:39.329519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:39.330252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:39.348562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:39.627963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:39.628594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:39.646199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:39.646693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:39.647315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:39.648241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:39.648856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:39.656822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:39.977811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:39.989132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:39.990609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:39.991832 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99346c40-bf4b-44a6-8a33-788023c56fac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1590 microversion: 2.42 time: 0.367848 Nov 02 12:46:39.992404 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2437/4942] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:39 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1590 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:40.033420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:40.035638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:40.066398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.067046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.067482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.068341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.068680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.069114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.103186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:40.112843 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b087bc8-367d-4611-bcaa-85b01c5f4005 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.823458 Nov 02 12:46:40.118000 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2506/4943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:39 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:40.146290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:40.147291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:40.158589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.159379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.159982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.160910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.161531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.162153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.533075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:40.550814 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec062afe-faa1-47b0-91b6-29c1e888b806 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1495 microversion: 2.1 time: 0.544846 Nov 02 12:46:40.552958 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2438/4944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:39 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1495 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:40.761825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:40.762912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-32d39dfb-050b-4314-ab95-42f281818c9a req-0b2997b7-88a8-43b7-a8ae-cf96f0222d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82a4748-5420-4164-bc86-ea51a9d04917", "name": "network-vif-unplugged", "status": "completed", "tag": "90a952b9-4f8e-410e-a930-7cbc108322fa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:40.770811 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d63750f-c32a-49a9-bf26-cc044b0a67f2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.631064 Nov 02 12:46:40.783213 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2507/4945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:40 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:40.801678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fed6e7c2-ecde-48e7-a022-0975e9c5767a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:40.806461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fed6e7c2-ecde-48e7-a022-0975e9c5767a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 91528e45-fcc8-4dfe-b6bc-1c39082ec345] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:40.807731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32d39dfb-050b-4314-ab95-42f281818c9a req-0b2997b7-88a8-43b7-a8ae-cf96f0222d28 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.808107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32d39dfb-050b-4314-ab95-42f281818c9a req-0b2997b7-88a8-43b7-a8ae-cf96f0222d28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.809767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32d39dfb-050b-4314-ab95-42f281818c9a req-0b2997b7-88a8-43b7-a8ae-cf96f0222d28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.829716 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-fed6e7c2-ecde-48e7-a022-0975e9c5767a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 91528e45-fcc8-4dfe-b6bc-1c39082ec345 could not be found. Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fed6e7c2-ecde-48e7-a022-0975e9c5767a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/91528e45-fcc8-4dfe-b6bc-1c39082ec345/action HTTP/1.1 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 28 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: {"reboot": {"type": "SOFT"}} Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 91528e45-fcc8-4dfe-b6bc-1c39082ec345 could not be found. Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '91528e45-fcc8-4dfe-b6bc-1c39082ec345', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91528e45-fcc8-4dfe-b6bc-1c39082ec345 could not be found. Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91528e45-fcc8-4dfe-b6bc-1c39082ec345 could not be found. Nov 02 12:46:40.831629 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91528e45-fcc8-4dfe-b6bc-1c39082ec345 could not be found. Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fed6e7c2-ecde-48e7-a022-0975e9c5767a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 91528e45-fcc8-4dfe-b6bc-1c39082ec345 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fed6e7c2-ecde-48e7-a022-0975e9c5767a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/91528e45-fcc8-4dfe-b6bc-1c39082ec345/action" status: 404 len: 111 microversion: 2.1 time: 0.035723 Nov 02 12:46:40.839816 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2508/4946] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:40 2022] POST /compute/v2.1/servers/91528e45-fcc8-4dfe-b6bc-1c39082ec345/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:46:40.858857 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-32d39dfb-050b-4314-ab95-42f281818c9a req-0b2997b7-88a8-43b7-a8ae-cf96f0222d28 service nova] Creating event network-vif-unplugged:90a952b9-4f8e-410e-a930-7cbc108322fa for instance f82a4748-5420-4164-bc86-ea51a9d04917 on n-h2-855650-5 Nov 02 12:46:40.872309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:40.873136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:40.876084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-32d39dfb-050b-4314-ab95-42f281818c9a req-0b2997b7-88a8-43b7-a8ae-cf96f0222d28 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116733 Nov 02 12:46:40.879326 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2439/4947] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:46:40.913064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.940356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.943726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.944775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.945430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.946096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.022800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:41.024087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:41.035601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.036032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:41.036482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.037201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.046350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:41.046831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.499376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.518538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.520065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.521292 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-63bd1410-e693-46f0-a06a-a287b941929a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1590 microversion: 2.42 time: 0.503142 Nov 02 12:46:41.521873 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2440/4948] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:41 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1590 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:41.579056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:41.581775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:41.591358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.591872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:41.592329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.593062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.598787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:41.599313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.951772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.954370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74d8e5e8ac74a3e99d602abe159308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dcd863d02d453abfdff23c335b1d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.960045 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4b0866e0-2e99-482f-82a5-0af88a197fbf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.107416 Nov 02 12:46:41.972182 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2509/4949] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:40 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:41.977644 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d4a7179-4864-4d9f-bf94-71640084e7e2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 200 len: 1453 microversion: 2.1 time: 0.402339 Nov 02 12:46:41.978593 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2441/4950] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:41 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 1453 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:41.987738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:41.989471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:41.993157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b5fd6d2f-c53f-43b2-a146-f3bced6ee87d req-b72d3624-bb7b-4dbb-9acb-5031ef42c005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82a4748-5420-4164-bc86-ea51a9d04917", "name": "network-vif-deleted", "tag": "90a952b9-4f8e-410e-a930-7cbc108322fa"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:41.998806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.999564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.000190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.001068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.001689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.002461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.010390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b5fd6d2f-c53f-43b2-a146-f3bced6ee87d req-b72d3624-bb7b-4dbb-9acb-5031ef42c005 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.026802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b5fd6d2f-c53f-43b2-a146-f3bced6ee87d req-b72d3624-bb7b-4dbb-9acb-5031ef42c005 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.027603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b5fd6d2f-c53f-43b2-a146-f3bced6ee87d req-b72d3624-bb7b-4dbb-9acb-5031ef42c005 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.050967 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b5fd6d2f-c53f-43b2-a146-f3bced6ee87d req-b72d3624-bb7b-4dbb-9acb-5031ef42c005 service nova] Creating event network-vif-deleted:90a952b9-4f8e-410e-a930-7cbc108322fa for instance f82a4748-5420-4164-bc86-ea51a9d04917 on n-h2-855650-5 Nov 02 12:46:42.073043 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b5fd6d2f-c53f-43b2-a146-f3bced6ee87d req-b72d3624-bb7b-4dbb-9acb-5031ef42c005 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099161 Nov 02 12:46:42.073840 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2510/4951] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:42.358427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c25e2108-1c38-462c-8407-a2dde8720468 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: .version_select at 0x7f228dc223a0>, body: {"keypair": {"name": "tempest-keypair-2129407573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxDTXulV6DlRQEKd7MMMUsh0Hc3HchwaXgHIsKr+TLEgQxggCcL551NUOfPjn3x4f+J6bDrufETb5Z3HbDYHOgrGrQWTgIDcMe59FhlBdsdJFu2cygkp7FO8QTkPFKReg=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:42.410490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c25e2108-1c38-462c-8407-a2dde8720468 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:42.424029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c25e2108-1c38-462c-8407-a2dde8720468 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for user be15916efb09427eb892d0104e3db5ff and project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:42.546232 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c25e2108-1c38-462c-8407-a2dde8720468 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192904 Nov 02 12:46:42.549948 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2511/4952] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:46:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:46:42.557869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:42.560866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:42.578739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.582752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.583503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.586191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.587134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.590089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.617110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:42.648386 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f604a95-0ded-4abb-9d65-78c63d75b166 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.665241 Nov 02 12:46:42.649851 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2442/4953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:41 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:42.672883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:42.687549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:42.703901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.704697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.705315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.706304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.707214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.707837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.724265 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1/action HTTP/1.1 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 65 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '438595d5-1ffa-4c37-a45a-86ee201a1db1', 'body': {'rebuild': {'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a'}}} Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 12:46:42.727159 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:46:42.731706 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:42.733722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:42.735431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab5f434a-aae8-4508-bf5a-d9691dcf2802 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1/action" status: 404 len: 111 microversion: 2.1 time: 0.066881 Nov 02 12:46:42.736876 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2443/4954] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:42 2022] POST /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:46:42.745746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:42.746506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:42.757901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.758545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.759085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.759964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.761026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.761542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.775340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:42.806234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:42.814759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:42.816300 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2df4b73-d13e-4b0c-b2f7-c642d698a99c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1590 microversion: 2.42 time: 0.264652 Nov 02 12:46:42.817110 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2512/4955] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:42 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1590 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:43.012548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:43.014414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:43.025264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.026248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.032732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.033934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.035024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.035773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.076785 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] HTTP exception thrown: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:43.078828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Request method failure captured: Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 HTTP/1.1 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYOM-DNWwCzrjfeQ_XlzIDVNfbVqLkBVnGxfCJCi59oofIzXiOrERcVf8fPN2lXjHFeR4Luv0ehHNtZ13XWYjwn0VMBNL4Ouv7B1IduS9tiyoRGPkxEgWvuZphD1DvW_q6oDKzkaH_vA7Kc7nKpOFuul2fzbiTOm63UB9bzrQSyw08 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f74d8e5e8ac74a3e99d602abe159308e Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f82a4748-5420-4164-bc86-ea51a9d04917'} Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:43.081342 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:43.086100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:43.086100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:43.086100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:43.086100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:43.086100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:43.086100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:43.086100 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:43.087259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Returning 404 to user: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:43.087959 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5a19bfa9-a971-467a-bfa7-c426d98edaaa tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 404 len: 111 microversion: 2.1 time: 0.085254 Nov 02 12:46:43.089503 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2513/4956] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:43 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:46:43.097321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19313e2e-9177-48b7-aa2c-d59fb754644f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.352486 Nov 02 12:46:43.111123 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2444/4957] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:42 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:43.127041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:43.127828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:43.138996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.142145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.143953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.145791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.147444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.150867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.846865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:43.848269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:43.872442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.873952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.876617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.878130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.879748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.882566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.940000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:43.949574 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e0193724-0425-4358-9be7-f369d6687529 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.827214 Nov 02 12:46:43.954671 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2514/4958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:43 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:43.990900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49bd2e1a-4a79-4ab4-a92b-4b5a8b5c7c4d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:43.995943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-49bd2e1a-4a79-4ab4-a92b-4b5a8b5c7c4d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 4e545c6e-30fe-4aae-97cc-9191db110284] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:44.024019 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-49bd2e1a-4a79-4ab4-a92b-4b5a8b5c7c4d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 4e545c6e-30fe-4aae-97cc-9191db110284 could not be found. Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49bd2e1a-4a79-4ab4-a92b-4b5a8b5c7c4d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/4e545c6e-30fe-4aae-97cc-9191db110284/action HTTP/1.1 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 65 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 4e545c6e-30fe-4aae-97cc-9191db110284 could not be found. Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '4e545c6e-30fe-4aae-97cc-9191db110284', 'body': {'rebuild': {'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a'}}} Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e545c6e-30fe-4aae-97cc-9191db110284 could not be found. Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:46:44.026872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e545c6e-30fe-4aae-97cc-9191db110284 could not be found. Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e545c6e-30fe-4aae-97cc-9191db110284 could not be found. Nov 02 12:46:44.032048 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:44.034500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49bd2e1a-4a79-4ab4-a92b-4b5a8b5c7c4d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 4e545c6e-30fe-4aae-97cc-9191db110284 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:44.035610 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49bd2e1a-4a79-4ab4-a92b-4b5a8b5c7c4d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/4e545c6e-30fe-4aae-97cc-9191db110284/action" status: 404 len: 111 microversion: 2.1 time: 0.055901 Nov 02 12:46:44.036508 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2515/4959] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:43 2022] POST /compute/v2.1/servers/4e545c6e-30fe-4aae-97cc-9191db110284/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:44.051071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:44.066004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:44.089071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:44.093399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:44.096351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:44.098925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:44.100329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:44.102523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:44.405608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:44.419804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:44.423080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:44.425758 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b205d011-47e2-4675-a35b-aa670e4eec1a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1590 microversion: 2.42 time: 0.583677 Nov 02 12:46:44.427634 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2445/4960] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:43 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1590 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:44.918582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:44.930249 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9182e895-c738-4d26-a4d2-f5aeb897d808 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.883174 Nov 02 12:46:44.930839 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2516/4961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:44 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:44.961916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:44.962649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:44.984120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:44.985462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:44.988441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:44.989812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:44.991431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:44.991887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:45.455895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:45.456600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:45.459198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:45.476237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:45.481764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:45.484524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:45.485578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:45.488080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:45.488791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:45.608329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:45.634722 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8dc0735c-a7bc-4627-a05d-b9fe9cfe18f4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.678938 Nov 02 12:46:45.636976 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2446/4962] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:44 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:45.668572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93fe6495-e96b-44f4-a1b9-9ec8b99417f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:45.676675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-93fe6495-e96b-44f4-a1b9-9ec8b99417f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:45.711888 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-93fe6495-e96b-44f4-a1b9-9ec8b99417f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f could not be found. Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93fe6495-e96b-44f4-a1b9-9ec8b99417f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f/action HTTP/1.1 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 15 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: {"restore": {}} Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f could not be found. Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f', 'body': {'restore': {}}} Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f could not be found. Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f could not be found. Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:45.718464 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:45.723518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:45.723518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:45.723518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f could not be found. Nov 02 12:46:45.723518 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:45.729258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93fe6495-e96b-44f4-a1b9-9ec8b99417f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:45.730975 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-93fe6495-e96b-44f4-a1b9-9ec8b99417f8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f/action" status: 404 len: 111 microversion: 2.1 time: 0.071635 Nov 02 12:46:45.734197 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2447/4963] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:45 2022] POST /compute/v2.1/servers/7ca5b30b-dc1f-4cc7-8cb6-32f3b173e79f/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:45.743781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:45.747044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:45.766246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:45.767241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:45.769424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:45.770590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:45.771270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:45.772669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:46.725206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:46.745010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:46.747645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:46.756121 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb584289-8913-49f0-a818-72ab6d0b795f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1658 microversion: 2.42 time: 1.303794 Nov 02 12:46:46.757043 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2517/4964] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:45 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1658 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:47.100562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:47.112489 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-166b5e68-4735-494b-bb8a-d767d425c152 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.375204 Nov 02 12:46:47.133535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2448/4965] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:45 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:47.154993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:47.155872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:47.171840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.175146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.176244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:47.183225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.184263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.185792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:47.783435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:47.784067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:47.795631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.796179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.796639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:47.797522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.797855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.798433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:48.744494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:48.759778 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1adc155-4c7c-4534-9890-80b2322152e2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.609254 Nov 02 12:46:48.763110 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2518/4966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:47 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:48.789735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:48.790522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:48.802358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:48.803020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:48.803619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:48.807041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:48.807733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:48.810617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:48.861529 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Cannot 'restore' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action HTTP/1.1 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 15 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: {"restore": {}} Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: exception: Cannot 'restore' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'restore': {}}} Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b in vm_state active. Cannot restore while the instance is in this state. Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:48.869126 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:48.879858 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:48.879858 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:48.879858 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:48.879858 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:46:48.879858 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:48.879858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 409 to user: Cannot 'restore' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:48.879858 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cfc9e352-5d17-43b1-9a20-53ff527fa637 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 409 len: 145 microversion: 2.1 time: 0.085966 Nov 02 12:46:48.879858 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2519/4967] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:48 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:46:48.894073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:48.894700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:48.914082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:48.914453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:48.915068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:48.916154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:48.916775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:48.918489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:49.743534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:49.763729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:49.770777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:49.797375 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e6ce312-bf8c-488b-a06b-a4a91aa26974 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1705 microversion: 2.42 time: 1.993005 Nov 02 12:46:49.806333 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2449/4968] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:47 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1705 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:50.398784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:50.409405 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6dc22d8c-011a-4d7f-ad79-296a3928cbc9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.530806 Nov 02 12:46:50.421992 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2520/4969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:48 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:50.441345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:50.442116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:50.464614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:50.465222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:50.465830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:50.471471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:50.472166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:50.473744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:50.833853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:50.835172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:50.844407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:50.844894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:50.850360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:50.853851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:50.854538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:50.856035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:51.245328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:51.265278 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e54d68e4-5c5f-443e-8982-bf0ee79f3479 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.827946 Nov 02 12:46:51.268891 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2450/4970] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:50 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:51.311000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94ff6358-4f12-417e-a6a4-0c3866f6ed69 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:51.311896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94ff6358-4f12-417e-a6a4-0c3866f6ed69 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: f88b7cd4-2202-4144-9a62-5fb03a3daca2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:51.342245 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-94ff6358-4f12-417e-a6a4-0c3866f6ed69 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance f88b7cd4-2202-4144-9a62-5fb03a3daca2 could not be found. Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94ff6358-4f12-417e-a6a4-0c3866f6ed69 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/f88b7cd4-2202-4144-9a62-5fb03a3daca2/action HTTP/1.1 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 14 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: {"resume": {}} Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance f88b7cd4-2202-4144-9a62-5fb03a3daca2 could not be found. Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'f88b7cd4-2202-4144-9a62-5fb03a3daca2', 'body': {'resume': {}}} Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f88b7cd4-2202-4144-9a62-5fb03a3daca2 could not be found. Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f88b7cd4-2202-4144-9a62-5fb03a3daca2 could not be found. Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:51.351847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:51.358845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:51.358845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:51.358845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f88b7cd4-2202-4144-9a62-5fb03a3daca2 could not be found. Nov 02 12:46:51.358845 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:51.362900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94ff6358-4f12-417e-a6a4-0c3866f6ed69 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance f88b7cd4-2202-4144-9a62-5fb03a3daca2 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:51.364188 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94ff6358-4f12-417e-a6a4-0c3866f6ed69 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/f88b7cd4-2202-4144-9a62-5fb03a3daca2/action" status: 404 len: 111 microversion: 2.1 time: 0.071429 Nov 02 12:46:51.365135 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2451/4971] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:51 2022] POST /compute/v2.1/servers/f88b7cd4-2202-4144-9a62-5fb03a3daca2/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:51.385501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:51.388572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:51.403389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:51.406723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:51.409664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:51.410704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:51.411762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:51.414340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:51.718062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:51.748030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:51.767843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:51.769162 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf220e03-e6ad-41a2-b897-89095706b248 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1705 microversion: 2.42 time: 0.940497 Nov 02 12:46:51.772391 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2521/4972] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:50 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1705 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:52.283229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.284000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:52.296236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.296966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.299693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.301381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.305044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.305911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.386254 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] HTTP exception thrown: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Request method failure captured: Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 HTTP/1.1 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYOM-DNWwCzrjfeQ_XlzIDVNfbVqLkBVnGxfCJCi59oofIzXiOrERcVf8fPN2lXjHFeR4Luv0ehHNtZ13XWYjwn0VMBNL4Ouv7B1IduS9tiyoRGPkxEgWvuZphD1DvW_q6oDKzkaH_vA7Kc7nKpOFuul2fzbiTOm63UB9bzrQSyw08 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f74d8e5e8ac74a3e99d602abe159308e Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f82a4748-5420-4164-bc86-ea51a9d04917'} Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:52.388405 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.392688 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.393860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Returning 404 to user: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:52.395925 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c77c6f71-2bef-4db4-8f67-8bd33f50c8f2 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 404 len: 111 microversion: 2.1 time: 0.120404 Nov 02 12:46:52.403309 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2522/4973] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:46:52 2022] DELETE /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:52.415802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.416470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: f82a4748-5420-4164-bc86-ea51a9d04917] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:52.424514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.425015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.425458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.426203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.426660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.427119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.448004 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] HTTP exception thrown: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Request method failure captured: Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 HTTP/1.1 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYOM-DNWwCzrjfeQ_XlzIDVNfbVqLkBVnGxfCJCi59oofIzXiOrERcVf8fPN2lXjHFeR4Luv0ehHNtZ13XWYjwn0VMBNL4Ouv7B1IduS9tiyoRGPkxEgWvuZphD1DvW_q6oDKzkaH_vA7Kc7nKpOFuul2fzbiTOm63UB9bzrQSyw08 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f74d8e5e8ac74a3e99d602abe159308e Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f82a4748-5420-4164-bc86-ea51a9d04917'} Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:52.449572 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Returning 404 to user: Instance f82a4748-5420-4164-bc86-ea51a9d04917 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:52.453646 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4648f0be-2b6f-47df-988d-074b76fc6e68 tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917" status: 404 len: 111 microversion: 2.1 time: 0.047107 Nov 02 12:46:52.455538 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2523/4974] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/servers/f82a4748-5420-4164-bc86-ea51a9d04917 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:52.467409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.468052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:52.483940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:52.488158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.488647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.496109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.500454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.500958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.501397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.555577 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] HTTP exception thrown: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Request method failure captured: Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 HTTP/1.1 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYOM-DNWwCzrjfeQ_XlzIDVNfbVqLkBVnGxfCJCi59oofIzXiOrERcVf8fPN2lXjHFeR4Luv0ehHNtZ13XWYjwn0VMBNL4Ouv7B1IduS9tiyoRGPkxEgWvuZphD1DvW_q6oDKzkaH_vA7Kc7nKpOFuul2fzbiTOm63UB9bzrQSyw08 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f74d8e5e8ac74a3e99d602abe159308e Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b190e70d-986d-4bf4-8df7-06b56e79b789'} Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:52.565377 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.571321 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.573854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Returning 404 to user: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:52.577501 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-40740786-a8f7-4858-ba11-9dbeaf52b22e tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 404 len: 111 microversion: 2.1 time: 0.120537 Nov 02 12:46:52.578317 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2524/4975] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:46:52 2022] DELETE /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:52.608106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.620221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] [instance: b190e70d-986d-4bf4-8df7-06b56e79b789] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:52.627541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.629179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.629809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.630857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.632330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.632999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.657254 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] HTTP exception thrown: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Request method failure captured: Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 HTTP/1.1 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYOM-DNWwCzrjfeQ_XlzIDVNfbVqLkBVnGxfCJCi59oofIzXiOrERcVf8fPN2lXjHFeR4Luv0ehHNtZ13XWYjwn0VMBNL4Ouv7B1IduS9tiyoRGPkxEgWvuZphD1DvW_q6oDKzkaH_vA7Kc7nKpOFuul2fzbiTOm63UB9bzrQSyw08 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d0dcd863d02d453abfdff23c335b1d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d0dcd863d02d453abfdff23c335b1d19 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersTestMultiNic-2046179309 Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: f74d8e5e8ac74a3e99d602abe159308e Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersTestMultiNic-2046179309-project Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b190e70d-986d-4bf4-8df7-06b56e79b789'} Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:52.659448 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.665268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:52.665268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:52.665268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:52.665268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:52.665268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:52.665268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. Nov 02 12:46:52.665268 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:52.673020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] Returning 404 to user: Instance b190e70d-986d-4bf4-8df7-06b56e79b789 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:52.674448 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-88906668-518d-4af7-97d1-59212ab86d1c tempest-ServersTestMultiNic-2046179309 tempest-ServersTestMultiNic-2046179309-project] 10.222.0.45 "GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789" status: 404 len: 111 microversion: 2.1 time: 0.089292 Nov 02 12:46:52.681653 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2525/4976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/servers/b190e70d-986d-4bf4-8df7-06b56e79b789 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:52.805160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.807048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:52.817547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.820546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.825947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.826989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.827614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.828479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.832247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:53.455944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:53.555285 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43251ebb-f10e-4824-8020-cb3446c65afe tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 2.184103 Nov 02 12:46:53.557264 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2452/4977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:51 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:53.631298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:53.634054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:53.671964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:53.677626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:53.680517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:53.687318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:53.690356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:53.692903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:53.779248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:54.285624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:54.307134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:54.314533 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-642abcf6-d383-4b2f-843a-168f87bf4467 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.716644 Nov 02 12:46:54.315545 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2453/4978] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:53 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:54.337684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:54.344298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:54.345405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:54.346314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:54.355683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52b22fec-0bc1-4b59-abc6-aa5846aaab28 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1752 microversion: 2.42 time: 1.553056 Nov 02 12:46:54.371915 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2526/4979] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1752 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:54.373793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:54.374795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:54.375724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:54.384615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:54.386398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:54.388015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:54.459701 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Cannot 'resume' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action HTTP/1.1 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 14 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: {"resume": {}} Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'resume' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'resume': {}}} Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b in vm_state active. Cannot resume while the instance is in this state. Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:54.465685 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:54.472031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:54.472031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:54.472031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:54.472031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:54.472031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:54.472031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:46:54.472031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:46:54.474371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 409 to user: Cannot 'resume' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:54.476011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a0e11e0e-77e4-445a-8557-a4ade49033a2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 409 len: 144 microversion: 2.1 time: 0.136619 Nov 02 12:46:54.477208 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2454/4980] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:46:54 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 144 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:46:54.485539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:54.486204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:54.501765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:54.507678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:54.509447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:54.528889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:54.530909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:54.535287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:54.956408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1332576054", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92a568cc-930f-412f-9bc6-cc5b26f3a471"}], "security_groups": [{"name": "tempest-securitygroup--846818187"}], "key_name": "tempest-keypair-2129407573", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:55.006101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:55.026217 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-519460fe-667c-4bd4-ac0a-cf3c979322fd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.538733 Nov 02 12:46:55.040858 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2527/4981] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:54 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:55.064874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:55.065544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:55.075803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:55.078171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:55.078707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:55.079490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:55.079976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:55.080420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:55.402234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] validate_networks() for [('92a568cc-930f-412f-9bc6-cc5b26f3a471', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:46:55.968791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:55.980161 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0e6b97bd-7f01-4c9b-88bc-97ba2c574a4a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.921388 Nov 02 12:46:55.983324 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2528/4982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:55 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:56.012671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:56.015819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:56.036170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:56.037066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:56.040510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:56.047000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:56.047755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:56.051387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:56.727472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:56.751969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:56.761561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:56.763303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-43fe5714-4b1f-415f-8876-7b4d2cb8b4d3 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1799 microversion: 2.42 time: 0.778267 Nov 02 12:46:56.783327 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2529/4983] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:55 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1799 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:56.811500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3cde926b-a4da-49d5-9aa0-da256a74fa88 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3cde926b-a4da-49d5-9aa0-da256a74fa88 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 160 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "c8f61405-3ba0-4101-8580-7b227f748cee"}]}} Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': '', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'networks': [{'uuid': 'c8f61405-3ba0-4101-8580-7b227f748cee'}]}}} Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi '' Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:46:56.817196 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.824292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3cde926b-a4da-49d5-9aa0-da256a74fa88 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:56.827047 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3cde926b-a4da-49d5-9aa0-da256a74fa88 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.028368 Nov 02 12:46:56.830031 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2530/4984] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:56 2022] POST /compute/v2.1/servers => generated 108 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:46:56.833950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3cde926b-a4da-49d5-9aa0-da256a74fa88 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:56.836222 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3cde926b-a4da-49d5-9aa0-da256a74fa88 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005110 Nov 02 12:46:56.836684 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2531/4985] 10.222.0.45 () {56 vars in 886 bytes} [Wed Nov 2 12:46:56 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:46:56.847727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:56.848358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:56.864934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:56.865490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:56.865942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:56.867907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:56.868628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:56.869227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:57.512329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:46:57.513702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:46:57.514351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:46:57.516425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:46:57.517794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:46:57.520105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:57.552869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:57.560244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:57.561722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:57.563664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:57.564156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:57.564599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:57.655383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:57.674073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for user be15916efb09427eb892d0104e3db5ff and project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:57.716521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:46:57.722173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:46:57.815234 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-183e8374-e9ac-47e4-8c2e-8eb89720a30f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.863541 Nov 02 12:46:57.825012 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2455/4986] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 2874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:46:57.831446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:57.832742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:57.840480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:57.841219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:57.842110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:57.843007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:57.847701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:57.848346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:58.165569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:58.175847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3b655553-e03a-4a2a-853e-c534917c28b6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 1.337337 Nov 02 12:46:58.184715 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2532/4987] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:56 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:58.223951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d17d2e8e-bf9c-4057-b9c7-98a03eae820c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:58.225212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d17d2e8e-bf9c-4057-b9c7-98a03eae820c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:59.277261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d17d2e8e-bf9c-4057-b9c7-98a03eae820c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:59.285702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:59.289287 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d17d2e8e-bf9c-4057-b9c7-98a03eae820c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1242 microversion: 2.1 time: 1.081339 Nov 02 12:46:59.294781 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2533/4988] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:58 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1242 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:59.317685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:59.320340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:59.324789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:59.326834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:59.332962 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9867ba30-bff1-40a4-811c-f6a78fc29f33 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1799 microversion: 2.42 time: 1.506204 Nov 02 12:46:59.353557 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2456/4989] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:57 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1799 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:59.355309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:59.356039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:59.357014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:59.364062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:59.368362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:59.369035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:00.009347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:00.021448 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2369e0e9-7ad1-4068-b63d-f65301fbd0f7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.724207 Nov 02 12:47:00.024702 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2534/4990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:59 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:00.051827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94622674-52e7-4276-ad3f-f33547f37605 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:00.052688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94622674-52e7-4276-ad3f-f33547f37605 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 11d1bd29-f8e9-41df-8c81-7ab04414388c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:00.067496 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-94622674-52e7-4276-ad3f-f33547f37605 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 11d1bd29-f8e9-41df-8c81-7ab04414388c could not be found. Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94622674-52e7-4276-ad3f-f33547f37605 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/11d1bd29-f8e9-41df-8c81-7ab04414388c/action HTTP/1.1 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 14 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: {"shelve": {}} Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 11d1bd29-f8e9-41df-8c81-7ab04414388c could not be found. Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '11d1bd29-f8e9-41df-8c81-7ab04414388c', 'body': {'shelve': {}}} Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d1bd29-f8e9-41df-8c81-7ab04414388c could not be found. Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d1bd29-f8e9-41df-8c81-7ab04414388c could not be found. Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:00.080615 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:00.085625 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:47:00.085625 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:47:00.085625 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d1bd29-f8e9-41df-8c81-7ab04414388c could not be found. Nov 02 12:47:00.085625 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:47:00.085625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94622674-52e7-4276-ad3f-f33547f37605 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 11d1bd29-f8e9-41df-8c81-7ab04414388c could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:47:00.085625 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94622674-52e7-4276-ad3f-f33547f37605 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/11d1bd29-f8e9-41df-8c81-7ab04414388c/action" status: 404 len: 111 microversion: 2.1 time: 0.036252 Nov 02 12:47:00.088245 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2457/4991] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:47:00 2022] POST /compute/v2.1/servers/11d1bd29-f8e9-41df-8c81-7ab04414388c/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:47:00.092910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:00.093724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:00.103176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:00.107263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:00.109421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:00.113913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:00.115142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:00.117093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:00.117797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:00.324725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:00.325407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:00.343612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:00.345689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:00.350026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:00.361071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:00.365016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:00.365489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:00.747915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:00.770608 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7156aa12-f6c5-4eb6-ba1e-7bb562fbe6da tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.674556 Nov 02 12:47:00.772935 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2535/4992] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:00 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:00.785755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:00.788951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:00.822106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:00.824379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:00.826793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:00.830569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:00.831446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:00.833303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:00.915340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:00.929245 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6c82fabf-afe1-4a48-be13-c90db932f2b2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1312 microversion: 2.1 time: 0.610423 Nov 02 12:47:00.931867 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2458/4993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:00 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1312 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:00.942077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:00.947479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:00.962788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:00.969096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:00.969759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:00.973679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:00.976737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:00.977228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:01.642646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:01.661194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:01.665690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:01.666989 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ddefe0b-1eea-40e2-a4b7-1b3b3f654936 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1846 microversion: 2.42 time: 0.891877 Nov 02 12:47:01.667586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2536/4994] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:00 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1846 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:01.760965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:01.776738 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67366f61-622a-418d-82a3-a48520a6d73e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.838446 Nov 02 12:47:01.777359 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2459/4995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:00 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:01.800974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:01.803124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:01.827854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:01.828937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:01.831274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:01.832835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:01.833711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:01.835713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:01.890761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lazy-loading 'flavor' on Instance uuid 38f9ad93-6e10-49ae-86ca-8dc87c6b301b {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:47:01.961300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:01.962184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:01.979517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:01.980065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:01.983386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:01.985842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:01.986400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:01.986860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:02.220943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:02.245255 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d10e880f-56c3-484b-8fd6-aaed927abcbb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1300 microversion: 2.1 time: 0.287788 Nov 02 12:47:02.247193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2460/4996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:01 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1300 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:02.398663 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0766fa7c-48b5-4c2c-8a35-476e505017cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 202 len: 0 microversion: 2.1 time: 0.602268 Nov 02 12:47:02.404072 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2537/4997] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:47:01 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:47:02.414317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:02.415342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:02.435652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:02.436669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:02.437390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:02.438506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:02.441348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:02.465136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:02.699865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:02.700577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:02.716125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:02.716647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:02.719417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:02.721236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:02.723413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:02.724929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:03.842701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:03.853141 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea3a9c43-d11a-452f-a416-dcbe4a11f6ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 1.447798 Nov 02 12:47:03.862747 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2461/4998] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:02 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:03.873819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:03.875005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:03.885915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:03.893479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:03.894479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:03.902724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:03.903902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:03.904617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:03.905285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:03.910157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:03.912186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:03.920603 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-177fe2db-971e-498e-8753-add0241d64ac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1846 microversion: 2.42 time: 1.225384 Nov 02 12:47:03.925788 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2538/4999] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:02 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1846 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:04.885542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:04.886264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:04.895991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:04.896486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:04.896926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:04.897706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:04.898189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:04.904747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:05.065841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:05.084139 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-013cc518-3900-44b4-b627-86a79fec5a6a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1367 microversion: 2.1 time: 1.211630 Nov 02 12:47:05.085200 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2462/5000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:03 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1367 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:05.091242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:05.097197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:05.119278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:05.119980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:05.120442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:05.121215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:05.121654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:05.122132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:05.901581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:05.914471 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36424bc3-dfdb-436b-8de3-ddc6cc87fcdc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 1.028391 Nov 02 12:47:05.915480 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2539/5001] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:04 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:06.112328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:06.113239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:06.129408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:06.130163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:06.130620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:06.133619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:06.134168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:06.134620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:06.146273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:06.166643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:06.172522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:06.177138 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b719c1ed-cd98-479c-9b52-ed1abb2f19d6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1846 microversion: 2.42 time: 1.090370 Nov 02 12:47:06.179248 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2463/5002] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:05 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1846 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:06.192843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-90779d31-5659-4cb1-b176-084e4ab53908 req-e5e26564-7e6c-4858-b27d-4c3a792da99c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "tag": "cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:06.221211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-90779d31-5659-4cb1-b176-084e4ab53908 req-e5e26564-7e6c-4858-b27d-4c3a792da99c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:06.227568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-90779d31-5659-4cb1-b176-084e4ab53908 req-e5e26564-7e6c-4858-b27d-4c3a792da99c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:06.228268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-90779d31-5659-4cb1-b176-084e4ab53908 req-e5e26564-7e6c-4858-b27d-4c3a792da99c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:06.255100 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-90779d31-5659-4cb1-b176-084e4ab53908 req-e5e26564-7e6c-4858-b27d-4c3a792da99c service nova] Creating event network-changed:cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:47:06.267367 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-90779d31-5659-4cb1-b176-084e4ab53908 req-e5e26564-7e6c-4858-b27d-4c3a792da99c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086506 Nov 02 12:47:06.268009 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2464/5003] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:06.939402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:06.940714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:06.949997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:06.959233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:06.962168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:06.962880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:06.964018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:06.969307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:06.970041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:06.972316 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-38e7253a-a5f5-49bb-98a9-cab5a85dff85 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1367 microversion: 2.1 time: 0.866954 Nov 02 12:47:06.979269 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2540/5004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:06 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1367 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:07.206079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:07.207397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:07.226929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:07.227943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:07.234461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:07.235731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:07.236390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:07.237003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:07.633022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:07.696701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:08.019372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:08.030457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:08.039164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:08.044683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1109547f-4663-4637-84a8-702641aec7aa tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1846 microversion: 2.42 time: 0.843781 Nov 02 12:47:08.080262 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2541/5005] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:07 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1846 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:08.104294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:08.105049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:08.156329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:08.156845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:08.157350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:08.174138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:08.190736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:08.191252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:08.199985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:08.264219 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43847270-69b8-42fd-949d-558b1be04130 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 1.315099 Nov 02 12:47:08.266862 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2465/5006] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:06 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:08.343410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-01dc1860-f62e-45dd-beab-5fcc6bb6de64 req-a40b7057-83bc-4e2d-80a9-2f9943dfbc1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69765fbb-916c-4ca2-81fd-8ceeccde7cb1", "tag": "d953cfbe-13b1-40ef-b3d8-ad291007d677"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:08.367378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-01dc1860-f62e-45dd-beab-5fcc6bb6de64 req-a40b7057-83bc-4e2d-80a9-2f9943dfbc1b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:08.367884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-01dc1860-f62e-45dd-beab-5fcc6bb6de64 req-a40b7057-83bc-4e2d-80a9-2f9943dfbc1b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:08.368329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-01dc1860-f62e-45dd-beab-5fcc6bb6de64 req-a40b7057-83bc-4e2d-80a9-2f9943dfbc1b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:08.396456 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-01dc1860-f62e-45dd-beab-5fcc6bb6de64 req-a40b7057-83bc-4e2d-80a9-2f9943dfbc1b service nova] Creating event network-changed:d953cfbe-13b1-40ef-b3d8-ad291007d677 for instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 on n-h2-855650-5 Nov 02 12:47:08.435783 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-01dc1860-f62e-45dd-beab-5fcc6bb6de64 req-a40b7057-83bc-4e2d-80a9-2f9943dfbc1b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095418 Nov 02 12:47:08.437934 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2466/5007] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:08.834616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:08.847622 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-802fd0b7-a69e-450f-83af-0a080a0e4264 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1367 microversion: 2.1 time: 0.765192 Nov 02 12:47:08.856612 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2542/5008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:08 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1367 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:09.082080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:09.084064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:09.113231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:09.117672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:09.120013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:09.121042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:09.121707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:09.124840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:09.293924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:09.294690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:09.298030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:09.321857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:09.335050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:09.336065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:09.337213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:09.338167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:09.338874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:10.977866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:10.992876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:11.002600 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac6b118b-6fd0-41cc-b4dd-a66c73f22f06 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 1.712552 Nov 02 12:47:11.019207 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2543/5009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:09 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:11.027481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:11.028398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:11.044394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:11.045330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:11.046336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:11.047396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:11.048130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:11.048788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:11.216941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:11.240583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:11.249509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:11.254213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-335d6b7e-382e-4a2d-876a-c845570df8b9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1867 microversion: 2.42 time: 2.176992 Nov 02 12:47:11.255734 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2467/5010] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:09 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1867 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:11.287240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6e59182f-2729-4aa0-8010-d5fff69af054 req-5ed46682-575e-4f12-960c-aade2e89169a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "tag": "08d946d8-b737-4d8f-a0f8-2a4f7e6c893b"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:11.342804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e59182f-2729-4aa0-8010-d5fff69af054 req-5ed46682-575e-4f12-960c-aade2e89169a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:11.343697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e59182f-2729-4aa0-8010-d5fff69af054 req-5ed46682-575e-4f12-960c-aade2e89169a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:11.344388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e59182f-2729-4aa0-8010-d5fff69af054 req-5ed46682-575e-4f12-960c-aade2e89169a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:11.384049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6e59182f-2729-4aa0-8010-d5fff69af054 req-5ed46682-575e-4f12-960c-aade2e89169a service nova] Creating event network-changed:08d946d8-b737-4d8f-a0f8-2a4f7e6c893b for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:47:11.397669 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6e59182f-2729-4aa0-8010-d5fff69af054 req-5ed46682-575e-4f12-960c-aade2e89169a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124800 Nov 02 12:47:11.398756 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2468/5011] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:11.666780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:11.690418 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c9203cad-87e9-4b7c-a037-1368cd10955a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1367 microversion: 2.1 time: 0.668545 Nov 02 12:47:11.692443 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2544/5012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:11 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1367 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:12.033106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:12.033834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:12.044438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:12.044983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:12.045486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:12.046601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:12.047078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:12.047519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:12.286013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:12.290466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:12.300626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:12.305686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:12.306628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:12.307543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:12.308176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:12.308861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:12.654116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:12.665176 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8a25eab-af44-4815-b9fc-96a7a83b146c tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 0.636517 Nov 02 12:47:12.674307 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2469/5013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:12 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:12.721113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:12.722064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:12.734338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:12.735164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:12.735890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:12.738699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:12.739376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:12.742712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:12.785230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:12.797873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:12.812388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:12.813499 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-363f2d14-28f4-4edc-9608-716f925d7dae tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1867 microversion: 2.42 time: 0.531131 Nov 02 12:47:12.818032 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2545/5014] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:12 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1867 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:13.705441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:13.706124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:13.715499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:13.727277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:13.727943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:13.728771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:13.729315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:13.729851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:13.731869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:13.743276 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85888210-dc1d-4408-a983-9eed87d4b6de tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1367 microversion: 2.1 time: 1.023623 Nov 02 12:47:13.744496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2470/5015] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:12 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1367 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:13.850821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:13.853213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:13.869610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:13.870522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:13.871356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:13.872607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:13.874077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:13.874798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:14.243548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:14.259292 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe317c41-e512-4392-8b38-af1d8ac30332 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 0.559814 Nov 02 12:47:14.260632 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2546/5016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:13 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:14.398821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:14.422736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:14.425565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:14.427767 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb8a23ed-3c01-4d8d-9de6-637e28416774 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.582487 Nov 02 12:47:14.441297 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2471/5017] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:13 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:14.466758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a4f6af29-5f08-4ac9-adbe-837dd6703d9a req-dee2c1b6-1dc5-4bda-a760-b730cb689111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "tag": "1b72dfc0-e39d-4182-b6fb-9a2ef7753062"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:14.495506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a4f6af29-5f08-4ac9-adbe-837dd6703d9a req-dee2c1b6-1dc5-4bda-a760-b730cb689111 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:14.495995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a4f6af29-5f08-4ac9-adbe-837dd6703d9a req-dee2c1b6-1dc5-4bda-a760-b730cb689111 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:14.496425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a4f6af29-5f08-4ac9-adbe-837dd6703d9a req-dee2c1b6-1dc5-4bda-a760-b730cb689111 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:14.533697 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a4f6af29-5f08-4ac9-adbe-837dd6703d9a req-dee2c1b6-1dc5-4bda-a760-b730cb689111 service nova] Creating event network-changed:1b72dfc0-e39d-4182-b6fb-9a2ef7753062 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:47:14.542302 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a4f6af29-5f08-4ac9-adbe-837dd6703d9a req-dee2c1b6-1dc5-4bda-a760-b730cb689111 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079006 Nov 02 12:47:14.547944 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2547/5018] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:14.776592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:14.781475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:14.801391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:14.802296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:14.803173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:14.806228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:14.807045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:14.810130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:15.286544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:15.287343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:15.301926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:15.305895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:15.307195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:15.308948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:15.313794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:15.314810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:16.260603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:16.290917 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-63d63cc1-1442-4e01-80cb-129cba27c750 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1367 microversion: 2.1 time: 1.523292 Nov 02 12:47:16.291565 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2472/5019] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:14 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1367 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:16.353109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:16.354325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:16.372934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:16.376866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:16.378103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:16.382568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:16.383483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:16.385781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:17.125738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:17.138344 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f9f94d89-dd0b-4daa-a467-ace955f531b1 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 1.856678 Nov 02 12:47:17.141159 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2548/5020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:15 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:17.163073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3c1deff4-05d0-4e63-93c3-b8a2ffdaedfc req-b047e63b-82c2-4eca-ad11-31b3e59a77c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "tag": "880ff257-ea6b-45a9-abe1-67bba3951184"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:17.196382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3c1deff4-05d0-4e63-93c3-b8a2ffdaedfc req-b047e63b-82c2-4eca-ad11-31b3e59a77c9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:17.196933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3c1deff4-05d0-4e63-93c3-b8a2ffdaedfc req-b047e63b-82c2-4eca-ad11-31b3e59a77c9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:17.197380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3c1deff4-05d0-4e63-93c3-b8a2ffdaedfc req-b047e63b-82c2-4eca-ad11-31b3e59a77c9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:17.261053 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3c1deff4-05d0-4e63-93c3-b8a2ffdaedfc req-b047e63b-82c2-4eca-ad11-31b3e59a77c9 service nova] Creating event network-changed:880ff257-ea6b-45a9-abe1-67bba3951184 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:47:17.286434 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3c1deff4-05d0-4e63-93c3-b8a2ffdaedfc req-b047e63b-82c2-4eca-ad11-31b3e59a77c9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135024 Nov 02 12:47:17.290084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2549/5021] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:17.323666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:17.324485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:17.352113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:17.359799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:17.361385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:17.363715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:17.373680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:17.376299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:18.045862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:18.065452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:18.075777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:18.079556 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7e1a0835-3aa8-4b05-88b4-46416f77fe89 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.782619 Nov 02 12:47:18.080470 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2473/5022] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:16 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:18.098604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7a3df63f-5f71-4a3d-834e-f3398819e957 req-0a2ed7a8-6075-44c6-b171-c95782e3a599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69765fbb-916c-4ca2-81fd-8ceeccde7cb1", "name": "network-vif-plugged", "status": "completed", "tag": "d953cfbe-13b1-40ef-b3d8-ad291007d677"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:18.120621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7a3df63f-5f71-4a3d-834e-f3398819e957 req-0a2ed7a8-6075-44c6-b171-c95782e3a599 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:18.121734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7a3df63f-5f71-4a3d-834e-f3398819e957 req-0a2ed7a8-6075-44c6-b171-c95782e3a599 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:18.122486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7a3df63f-5f71-4a3d-834e-f3398819e957 req-0a2ed7a8-6075-44c6-b171-c95782e3a599 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:18.144353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:18.149208 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7a3df63f-5f71-4a3d-834e-f3398819e957 req-0a2ed7a8-6075-44c6-b171-c95782e3a599 service nova] Creating event network-vif-plugged:d953cfbe-13b1-40ef-b3d8-ad291007d677 for instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 on n-h2-855650-5 Nov 02 12:47:18.156795 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7a3df63f-5f71-4a3d-834e-f3398819e957 req-0a2ed7a8-6075-44c6-b171-c95782e3a599 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073247 Nov 02 12:47:18.158459 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2474/5023] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:18.166601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:18.168169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:18.177331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:18.178811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:18.179547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:18.180562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:18.181141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:18.181682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:18.559635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:18.575362 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59ba160e-3424-4c7d-8771-d100928b8081 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1367 microversion: 2.1 time: 1.260157 Nov 02 12:47:18.576348 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2550/5024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:17 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1367 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:18.783719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:18.799928 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8767fabf-14c2-4fd5-b56b-bf8fedbd0543 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 0.636001 Nov 02 12:47:18.804407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2475/5025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:18 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:19.108377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:19.109353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:19.118720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.127231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.131796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.132825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.133468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.134123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.338839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-25a3c587-1932-491b-a7c2-7cc1959b3e5f req-f2363b06-062c-416b-b8a8-911597283e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "tag": "3fcc22ed-2130-410f-b618-7d1d71081222"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:19.427570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-25a3c587-1932-491b-a7c2-7cc1959b3e5f req-f2363b06-062c-416b-b8a8-911597283e0f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.430655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-25a3c587-1932-491b-a7c2-7cc1959b3e5f req-f2363b06-062c-416b-b8a8-911597283e0f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.452302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-25a3c587-1932-491b-a7c2-7cc1959b3e5f req-f2363b06-062c-416b-b8a8-911597283e0f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.501880 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-25a3c587-1932-491b-a7c2-7cc1959b3e5f req-f2363b06-062c-416b-b8a8-911597283e0f service nova] Creating event network-changed:3fcc22ed-2130-410f-b618-7d1d71081222 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:47:19.512891 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-25a3c587-1932-491b-a7c2-7cc1959b3e5f req-f2363b06-062c-416b-b8a8-911597283e0f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183408 Nov 02 12:47:19.516591 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2476/5026] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:47:19.609269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:19.610625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:19.626951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.628216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.629893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.630695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.631177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.631665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.719307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:19.743970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:19.747889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:19.755108 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7bc9877e-0dbc-4cb5-9b8a-7a4214253afc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.650762 Nov 02 12:47:19.765497 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2551/5027] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:19 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:19.827099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:19.828577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:19.848051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.848840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.849465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.850427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.851058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.851657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.348001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:20.362830 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4a36fb1-b428-4f2e-8f9f-3a878553d548 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1367 microversion: 2.1 time: 0.755560 Nov 02 12:47:20.366571 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2477/5028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:19 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1367 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:20.794070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:20.794695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:20.799313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:20.808786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.811351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.816172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.819705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.820513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.822365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.826178 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b0ac836-9639-4f29-b6d5-e289373eec45 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1532 microversion: 2.1 time: 0.995031 Nov 02 12:47:20.839367 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2552/5029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:19 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1532 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:21.397564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:21.399587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:21.433553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:21.436264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:21.441606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:21.443445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:21.444880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:21.445958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:22.325836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:22.353662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:22.357878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:22.359786 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ac8118a-ac0d-417a-a52f-8061fdfedb58 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.570584 Nov 02 12:47:22.360958 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2478/5030] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:20 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:22.366546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0e9ad158-75f2-42e6-9ea9-31090681cbca req-67e1e152-3041-47a9-b76f-1bc731011680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "tag": "e7168472-9de7-4506-b496-895fda51cfd5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:22.388747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0e9ad158-75f2-42e6-9ea9-31090681cbca req-67e1e152-3041-47a9-b76f-1bc731011680 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:22.389677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0e9ad158-75f2-42e6-9ea9-31090681cbca req-67e1e152-3041-47a9-b76f-1bc731011680 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:22.390365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0e9ad158-75f2-42e6-9ea9-31090681cbca req-67e1e152-3041-47a9-b76f-1bc731011680 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:22.406057 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0e9ad158-75f2-42e6-9ea9-31090681cbca req-67e1e152-3041-47a9-b76f-1bc731011680 service nova] Creating event network-changed:e7168472-9de7-4506-b496-895fda51cfd5 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:47:22.412965 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0e9ad158-75f2-42e6-9ea9-31090681cbca req-67e1e152-3041-47a9-b76f-1bc731011680 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050255 Nov 02 12:47:22.414618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2479/5031] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:22.422332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:22.423365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:22.437514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:22.438389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:22.439411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:22.440862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:22.441731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:22.442653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:23.273100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:23.297953 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a0cdc4a-9895-4997-8a5a-69ee8d3fff43 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1558 microversion: 2.1 time: 1.909890 Nov 02 12:47:23.298424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:23.316481 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19f6f785-75ee-42b1-9c4a-19692172f962 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1532 microversion: 2.1 time: 0.896124 Nov 02 12:47:23.316481 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2480/5032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:22 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1532 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:23.316653 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2553/5033] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:21 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1558 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:23.339001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-00662769-fe39-4017-abae-2000c5605afd req-681ad3bd-83f5-44cc-b5fb-b0d43ca480c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f9ad93-6e10-49ae-86ca-8dc87c6b301b", "name": "network-vif-plugged", "status": "completed", "tag": "75616d16-546a-49d9-aa00-26848131158f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:23.391403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00662769-fe39-4017-abae-2000c5605afd req-681ad3bd-83f5-44cc-b5fb-b0d43ca480c1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:23.394537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00662769-fe39-4017-abae-2000c5605afd req-681ad3bd-83f5-44cc-b5fb-b0d43ca480c1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:23.399043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-00662769-fe39-4017-abae-2000c5605afd req-681ad3bd-83f5-44cc-b5fb-b0d43ca480c1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:23.432273 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-00662769-fe39-4017-abae-2000c5605afd req-681ad3bd-83f5-44cc-b5fb-b0d43ca480c1 service nova] Creating event network-vif-plugged:75616d16-546a-49d9-aa00-26848131158f for instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b on n-h1-855650-5 Nov 02 12:47:23.460552 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-00662769-fe39-4017-abae-2000c5605afd req-681ad3bd-83f5-44cc-b5fb-b0d43ca480c1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144046 Nov 02 12:47:23.462995 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2481/5034] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:23.476198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:23.476798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:23.494334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:23.494843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:23.495297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:23.496018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:23.496488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:23.496907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:23.637050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-77024033-eb57-4664-a999-a6d6d05a74b2 tempest-ComputeTenantNetworksTest-1951916413 tempest-ComputeTenantNetworksTest-1951916413-project] Calling method '.version_select at 0x7f228dc71430>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:24.038504 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f84d60c6-5abf-4253-b525-5a138bc450e6 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.574062 Nov 02 12:47:24.039118 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2482/5035] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:47:23 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-interface => generated 285 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:24.050505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:24.051342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:24.058702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.059207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.059662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.060386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.060851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.070762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.411039 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-77024033-eb57-4664-a999-a6d6d05a74b2 tempest-ComputeTenantNetworksTest-1951916413 tempest-ComputeTenantNetworksTest-1951916413-project] 10.222.0.45 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.093650 Nov 02 12:47:24.411630 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2554/5036] 10.222.0.45 () {58 vars in 1158 bytes} [Wed Nov 2 12:47:23 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:24.419914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:24.420547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:24.440531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.441499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.442133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.443013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.443640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.445983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.825524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:24.840664 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f7f157aa-74c2-4283-8924-b4e4f0e55ce2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1532 microversion: 2.1 time: 0.425305 Nov 02 12:47:24.842122 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2555/5037] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:24 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1532 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:24.854994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f1d3eaf-3e78-4a28-b91e-f255ef7da402 tempest-ComputeTenantNetworksTest-1951916413 tempest-ComputeTenantNetworksTest-1951916413-project] Calling method '.version_select at 0x7f228e978d30>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:24.868827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:24.892106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:24.893620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:24.896757 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dffb8cdc-a268-4d96-a20e-4251d9f14a83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.856545 Nov 02 12:47:24.898201 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2483/5038] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:24 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:24.908616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d6061974-e4dd-4cd8-bcd0-69cf4e7a874c req-563692a6-a297-4d06-9c87-24ead0369d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "tag": "8007eff5-a08a-4593-94af-120b1b805694"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:24.948199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d6061974-e4dd-4cd8-bcd0-69cf4e7a874c req-563692a6-a297-4d06-9c87-24ead0369d22 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.948749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d6061974-e4dd-4cd8-bcd0-69cf4e7a874c req-563692a6-a297-4d06-9c87-24ead0369d22 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.949196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d6061974-e4dd-4cd8-bcd0-69cf4e7a874c req-563692a6-a297-4d06-9c87-24ead0369d22 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.967597 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d6061974-e4dd-4cd8-bcd0-69cf4e7a874c req-563692a6-a297-4d06-9c87-24ead0369d22 service nova] Creating event network-changed:8007eff5-a08a-4593-94af-120b1b805694 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:47:24.988454 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d6061974-e4dd-4cd8-bcd0-69cf4e7a874c req-563692a6-a297-4d06-9c87-24ead0369d22 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086515 Nov 02 12:47:24.990421 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2484/5039] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:25.146758 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f1d3eaf-3e78-4a28-b91e-f255ef7da402 tempest-ComputeTenantNetworksTest-1951916413 tempest-ComputeTenantNetworksTest-1951916413-project] 10.222.0.45 "GET /compute/v2.1/os-tenant-networks/0809d7ce-49a4-4e1a-8efd-c1af96d4a31c" status: 200 len: 139 microversion: 2.1 time: 0.302640 Nov 02 12:47:25.148156 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2556/5040] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 12:47:24 2022] GET /compute/v2.1/os-tenant-networks/0809d7ce-49a4-4e1a-8efd-c1af96d4a31c => generated 139 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:25.869097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:25.870198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:25.887385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:25.888763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:25.889828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:25.896958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:25.897570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:25.898258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:25.936412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:25.938389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:25.958352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:25.960482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:25.970675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:25.971702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:25.972478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:25.973061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:27.620773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:27.637509 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3df374a2-7522-499a-8efc-78240fc9dc36 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 1.773820 Nov 02 12:47:27.638181 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2485/5041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:25 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:27.814049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:27.845077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:27.849388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:27.856195 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f29e8be-c27a-40c1-b0d1-0cde1b74630a tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.927555 Nov 02 12:47:27.883555 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2557/5042] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:25 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:28.664323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:28.665142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:28.667647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:28.692344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:28.700990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:28.705924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:28.710424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:28.714905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:28.717274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:28.891030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:28.893059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:28.909481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:28.919087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:28.920838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:28.926978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:28.928001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:28.934765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:29.918967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:29.931953 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c003fbb8-6d59-4ec4-b5cb-6b77a5b5eb01 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 1.273316 Nov 02 12:47:29.945302 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2486/5043] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:28 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:30.032144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1e4c0c80-334b-4ba6-8b3e-ea2d09bb2574 req-0d824e51-8229-483b-83eb-028e8bcc3987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69765fbb-916c-4ca2-81fd-8ceeccde7cb1", "tag": "d953cfbe-13b1-40ef-b3d8-ad291007d677"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:30.060344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1e4c0c80-334b-4ba6-8b3e-ea2d09bb2574 req-0d824e51-8229-483b-83eb-028e8bcc3987 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:30.061074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1e4c0c80-334b-4ba6-8b3e-ea2d09bb2574 req-0d824e51-8229-483b-83eb-028e8bcc3987 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:30.062533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1e4c0c80-334b-4ba6-8b3e-ea2d09bb2574 req-0d824e51-8229-483b-83eb-028e8bcc3987 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:30.096205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:30.106872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:30.114705 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1e4c0c80-334b-4ba6-8b3e-ea2d09bb2574 req-0d824e51-8229-483b-83eb-028e8bcc3987 service nova] Creating event network-changed:d953cfbe-13b1-40ef-b3d8-ad291007d677 for instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 on n-h2-855650-5 Nov 02 12:47:30.133790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:30.135671 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c9b3e453-82db-4dc7-aaf9-45afce6f345b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.248595 Nov 02 12:47:30.142780 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1e4c0c80-334b-4ba6-8b3e-ea2d09bb2574 req-0d824e51-8229-483b-83eb-028e8bcc3987 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116422 Nov 02 12:47:30.149555 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2487/5044] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:47:30.155191 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2558/5045] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:28 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:30.988525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:31.000321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:31.010219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:31.011193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:31.011888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:31.014231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:31.015031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:31.015810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:31.170403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:31.171871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:31.187901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=44 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:31.194022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:31.203306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:31.204176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:31.205234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:31.205853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:31.207028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:31.518933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:31.528305 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-69545182-3b43-4c79-983d-765a008d0849 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 0.550087 Nov 02 12:47:31.528905 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2488/5046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:30 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:32.233534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:32.275814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:32.283623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:32.293051 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8d9cbabb-7880-4fb3-8964-d6bf2ff964fb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.126479 Nov 02 12:47:32.305994 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2559/5047] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:31 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:32.567803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:32.569505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:32.593312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:32.594161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:32.594817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:32.595854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:32.596621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:32.597308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:33.324096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:33.324915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:33.374847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:33.375366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:33.375800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:33.376534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:33.376989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:33.393131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:33.730579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:33.751543 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44c09ba1-c3f0-4463-843b-9bce018e37cf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 1.194333 Nov 02 12:47:33.752952 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2489/5048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:32 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:34.783342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:34.785056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:34.796661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:34.797539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:34.798193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:34.801314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:34.802270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:34.804642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:35.277729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:35.287907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:35.289358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:35.290597 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac1192f2-eb8c-4efc-91f5-c3dc7c8f5787 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.971224 Nov 02 12:47:35.331273 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2560/5049] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:33 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:36.148819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:36.166686 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7729a7af-cc9f-47af-883d-43deb9b52ed8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 1.389824 Nov 02 12:47:36.179899 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2490/5050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:34 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:36.358386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:36.359042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:36.385068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:36.385621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:36.386249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:36.387975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:36.388305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:36.388661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:37.200122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:37.201772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:37.227949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:37.228451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:37.228917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:37.229650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:37.234090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:37.234090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:37.913635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:37.927792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-503b1350-3aa6-47dc-a5c3-93fde0f77478 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 0.731961 Nov 02 12:47:37.932552 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2491/5051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:37 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:38.108405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:38.123735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:38.127718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:38.132010 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b8861570-e0c7-4566-b0e5-be7b8fa280cf tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.791856 Nov 02 12:47:38.135247 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2561/5052] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:36 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:38.979783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:38.985594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:39.024309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:39.024906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:39.027694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:39.035374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:39.037044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:39.044513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:39.184017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:39.184785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:39.225348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:39.225875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:39.226367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:39.227111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:39.227677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:39.228277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:41.111002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:41.114526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=94 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:41.152346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:41.169213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:41.174137 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-31d3ef27-35b5-4880-ad8f-a22bc7e647e0 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 2.005550 Nov 02 12:47:41.192566 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2562/5053] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:39 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:41.226180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:41.274242 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-efb4682a-052e-4751-b764-e046f41c3d97 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 2.310080 Nov 02 12:47:41.277100 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2492/5054] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:38 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:42.209501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:42.210738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:42.223487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.224386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.225104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:42.227532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.246546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.247836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:42.300076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:42.301415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:42.326158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.327094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.328874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:42.329879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.330542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.331132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:43.144232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:43.160428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:43.163677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:43.174945 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-015bf987-97cd-4711-9e4a-a3dd9f28c086 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.969454 Nov 02 12:47:43.192776 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2563/5055] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:42 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:43.225806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:43.238169 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba075631-599e-4a9b-8f79-10e0d8cbceeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 0.940576 Nov 02 12:47:43.239157 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2493/5056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:42 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:44.209043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:44.209881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:44.224050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:44.228162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:44.230191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:44.231359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:44.245515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:44.247140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:44.267609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:44.269034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:44.289536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:44.297694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:44.307268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:44.309525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:44.311562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:44.312316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:45.044579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:45.068250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:45.072702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:45.074259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:45.075459 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e9313db2-f545-403e-b790-731d9df03eec tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.870740 Nov 02 12:47:45.080375 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2564/5057] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:44 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:45.091983 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4bebe399-dc66-4aa8-bbb0-8e84a8e4a96b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 0.813305 Nov 02 12:47:45.103684 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2494/5058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:44 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:45.922116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60feb446-9fc7-494f-8059-50d2279c6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'create', calling method: .version_select at 0x7f228dccc550>, body: {"keypair": {"name": "tempest-keypair-1630767197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzEiIj4CrvJLOuSPC0201ixB2DfZ1BL1Ic0OLCx1nb1HUMGd/zBVmdmKlzDU+Xelvw/al0Si9PVWHGpkU0/vkNJ6YgMdDYwXKMDVONsiIrJBZEH0NpJcHrO/0aTK0IdMw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:45.971520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-60feb446-9fc7-494f-8059-50d2279c6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:47:45.988143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-60feb446-9fc7-494f-8059-50d2279c6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for user 856c99b2530442b9bfb9d795a2d1d079 and project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:47:46.071168 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60feb446-9fc7-494f-8059-50d2279c6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.883475 Nov 02 12:47:46.082816 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2565/5059] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:47:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:46.110583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:46.112158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:46.130595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:46.131254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:46.137150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.138200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.140495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.141008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.141452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.142098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.145993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.147654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.148417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.150027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.152377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.152887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.159851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:47.197406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:47.208505 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b33dc9b4-1cd7-4334-b394-f665db32d5c5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 1.082149 Nov 02 12:47:47.235433 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2566/5060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:46 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:47.384794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:47.398077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:47.408792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:47.410179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e452877a-b206-4e2b-9107-f3b45dd81dac tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.305968 Nov 02 12:47:47.413932 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2495/5061] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:46 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:48.239735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:48.240919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:48.261440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:48.261959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:48.262441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:48.263185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:48.263648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:48.264086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:48.440901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:48.442193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:48.460165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:48.461282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:48.461911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:48.462852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:48.463473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:48.464125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:48.653556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:48.663247 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c8c926f-7d6b-4b58-b517-01a2eb57c1be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 0.427800 Nov 02 12:47:48.686314 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2567/5062] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:48 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:49.653102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:49.663073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:49.664635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:49.679111 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9c6dd65-b57b-4101-82f0-36741f67242c tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.242589 Nov 02 12:47:49.680463 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2496/5063] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:48 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:49.688536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:49.689759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:49.703046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:49.706498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:49.707168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:49.708449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:49.711014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:49.711690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:50.073876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:50.086816 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9ca783d0-0abd-4e93-802f-559db78395ec tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 0.401920 Nov 02 12:47:50.092949 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2568/5064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:49 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:50.711052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:50.712255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:50.736911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:50.741682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:50.747590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:50.751335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:50.757586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:50.771214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:51.115668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:51.116502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:51.130453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:51.139699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:51.140418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:51.141388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:51.144375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:51.146017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:52.268991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:52.284623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:52.286179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:52.287648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-399f8674-a6c4-4482-a9df-95220a102f15 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.581333 Nov 02 12:47:52.288208 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2497/5065] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:50 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:52.503796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:52.513603 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-440dee22-68b3-484b-9527-d5aac5baaca7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 1.401891 Nov 02 12:47:52.526281 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2569/5066] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:51 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:53.317882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:53.319326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:53.366314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.366845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.367287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:53.368043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.368507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.368945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:53.586188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:53.588248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:53.641956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.650939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.652347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:53.653678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.655127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.655965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:54.714481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:54.752390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:54.758719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:54.760431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3e15ad4-594a-4cbc-b716-8731cf07a237 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.446934 Nov 02 12:47:54.764874 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2498/5067] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:53 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:54.840220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:54.873439 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa8316dd-e66a-4f05-b638-5cb17f9bab1f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 1.332399 Nov 02 12:47:54.879064 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2570/5068] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:53 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:55.119217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2123697806", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27a2ec76-336c-4d46-b2bd-166a4b3d0fe4"}], "security_groups": [{"name": "tempest-securitygroup--266288308"}], "key_name": "tempest-keypair-1630767197", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:55.421482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] validate_networks() for [('27a2ec76-336c-4d46-b2bd-166a4b3d0fe4', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:47:55.793707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:55.794560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:55.806977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:55.813023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:55.817577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:55.825026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:55.829301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:55.835405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:56.009058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:56.874965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:56.905596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:56.909943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:56.911426 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b183860-9a49-4bb3-996e-bc8fa7e30f27 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.121850 Nov 02 12:47:56.940515 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2571/5069] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:55 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:56.950162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:56.955753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:56.971006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:56.973078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:56.981353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:56.987660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:56.988528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:56.989261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:57.398749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:47:57.399748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:47:57.400495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:47:57.401080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:47:57.401669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:47:57.418160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:57.424691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:57.425413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:57.426433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:57.427073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:57.428264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:57.472586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:47:57.486317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for user 856c99b2530442b9bfb9d795a2d1d079 and project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:47:57.506886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:57.517382 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac5217fe-bf0b-4c64-9981-263a86364ea7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 0.590076 Nov 02 12:47:57.526902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:47:57.530014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:47:57.542712 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2572/5070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:56 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:57.666872 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-080eedd7-af29-43df-b765-83240b94d165 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.563089 Nov 02 12:47:57.679298 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2499/5071] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:47:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:47:57.689038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-11cb754c-9fc5-4246-9273-95f6bce07277 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:57.689854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-11cb754c-9fc5-4246-9273-95f6bce07277 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:57.887916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-11cb754c-9fc5-4246-9273-95f6bce07277 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:57.904815 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-11cb754c-9fc5-4246-9273-95f6bce07277 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1239 microversion: 2.1 time: 0.222948 Nov 02 12:47:57.910431 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2573/5072] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:57 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1239 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:57.953505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:57.954544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:57.983510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:57.987408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:57.990460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:58.002493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:58.007754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:58.009608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:58.567940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:58.569137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:58.602960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:58.603465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:58.610654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:58.617947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:58.620373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:58.621099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:58.979536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:59.025225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:59.030947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:59.034255 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80fbe4c3-7c37-404a-8ce9-49ffde046661 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.088298 Nov 02 12:47:59.039996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2500/5073] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:57 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:59.056237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a41b0cc9-0d93-4092-8a81-28c4727d747b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:59.060049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a41b0cc9-0d93-4092-8a81-28c4727d747b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:59.080237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:59.422430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a41b0cc9-0d93-4092-8a81-28c4727d747b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:59.432115 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a41b0cc9-0d93-4092-8a81-28c4727d747b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1239 microversion: 2.1 time: 0.388493 Nov 02 12:47:59.432709 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2501/5074] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:59 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1239 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:59.642094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:59.642094 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39080ed9-7425-4619-816c-472f7b2be5d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1527 microversion: 2.1 time: 1.086774 Nov 02 12:47:59.642094 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2574/5075] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:58 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1527 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:00.070454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:00.071093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:00.080801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:00.082823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:00.083290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:00.084100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:00.084575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:00.085022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:00.457585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:00.458552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:00.470724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:00.471557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:00.472332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:00.473552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:00.474243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:00.477180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:00.681587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:00.715435 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65a29aaa-c544-47d8-b07b-31e524c8d001 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1299 microversion: 2.1 time: 0.256992 Nov 02 12:48:00.716181 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2575/5076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:00 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1299 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:00.742116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:00.742951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:00.767993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:00.772685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:00.773277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:00.774369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:00.774963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:00.775712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:00.854622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:00.872717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:00.876768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:00.880405 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6a99c02-9b12-44c0-a99b-31c6e2497bd2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.814744 Nov 02 12:48:00.884786 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2502/5077] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:00 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:01.085140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:01.100768 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69507649-50a9-42bd-b9a2-219a3d6584cb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1509 microversion: 2.1 time: 0.381739 Nov 02 12:48:01.121495 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2576/5078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:00 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1509 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:01.739305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:01.740582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:01.755097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:01.756286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:01.756811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:01.757616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:01.758185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:01.759988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:01.911642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:01.912845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:01.920010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:01.937369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:01.940416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:01.945948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:01.950046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:01.950798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:01.954062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:02.023150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:02.035362 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ffb29c97-fd90-4858-bb7a-5b78ab74c143 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1297 microversion: 2.1 time: 0.299921 Nov 02 12:48:02.045806 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2503/5079] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:01 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1297 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:02.130085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:02.131033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:02.142105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:02.147852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:02.148533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:02.149512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:02.150589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:02.151315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:02.734763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:02.772380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:02.782559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:02.784309 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0444b04e-bde0-43c4-922e-ff300ddcda83 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.877670 Nov 02 12:48:02.789539 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2577/5080] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:01 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:48:02.915770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:02.942606 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4373d01b-89e3-42b9-9c53-2391dcb32e71 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1509 microversion: 2.1 time: 0.808336 Nov 02 12:48:02.956992 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2504/5081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:02 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1509 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:03.060600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:03.064802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:03.095569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:03.098023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:03.102735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:03.106501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:03.107109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:03.107515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:03.259731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:03.267957 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5bbea7c-5418-4e1e-bee2-6417af37d3f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1297 microversion: 2.1 time: 0.212589 Nov 02 12:48:03.268559 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2578/5082] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:03 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1297 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:03.817855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:03.820339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:03.839137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:03.839714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:03.840391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:03.841413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:03.842157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:03.842770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:03.976869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:03.977559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:04.002584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:04.005209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:04.006820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:04.010609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:04.012400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:04.013074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:04.457648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:04.471477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:04.480102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:04.483956 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f1e84b11-aeee-4da1-a5ba-bf8e54088a3f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.668367 Nov 02 12:48:04.522229 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2505/5083] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:03 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:04.534839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:04.537908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:04.571523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:04.578003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:04.578837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:04.583372 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b73ee0ee-df77-403b-8d6f-4cd4179b04b4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1509 microversion: 2.1 time: 0.614634 Nov 02 12:48:04.584905 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2579/5084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:03 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1509 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:04.586385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:04.588912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:04.590882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:04.592436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:05.223096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:05.243952 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a832b3e5-7688-4ff7-a9bd-0302d5d16851 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1364 microversion: 2.1 time: 0.718556 Nov 02 12:48:05.250557 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2506/5085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:04 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1364 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:05.519037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:05.520229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:05.544696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:05.545592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:05.547632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:05.550347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:05.551045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:05.553658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:05.621383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:05.623365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:05.639874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:05.644065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:05.644532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:05.646499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:05.646972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:05.647411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:06.273849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:06.276537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:06.291811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:06.297332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:06.309305 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f12c795f-2798-4ed6-b26c-cd1294b02961 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.793905 Nov 02 12:48:06.310370 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2580/5086] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:05 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:06.331398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d4b067d1-a45d-4993-9441-99501d6dd9b0 req-479ba91a-85dd-4353-b78d-8410ceb95151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f9ad93-6e10-49ae-86ca-8dc87c6b301b", "name": "network-vif-unplugged", "status": "completed", "tag": "75616d16-546a-49d9-aa00-26848131158f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:06.360465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4b067d1-a45d-4993-9441-99501d6dd9b0 req-479ba91a-85dd-4353-b78d-8410ceb95151 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:06.364376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4b067d1-a45d-4993-9441-99501d6dd9b0 req-479ba91a-85dd-4353-b78d-8410ceb95151 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:06.366572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4b067d1-a45d-4993-9441-99501d6dd9b0 req-479ba91a-85dd-4353-b78d-8410ceb95151 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:06.372929 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-205b65ad-2a1d-45af-b981-88201afbbc40 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1509 microversion: 2.1 time: 0.757352 Nov 02 12:48:06.373815 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2507/5087] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:05 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1509 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:06.395200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:06.406629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:06.419117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:06.419856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:06.420671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:06.421441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:06.422166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:06.425746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:06.433011 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d4b067d1-a45d-4993-9441-99501d6dd9b0 req-479ba91a-85dd-4353-b78d-8410ceb95151 service nova] Creating event network-vif-unplugged:75616d16-546a-49d9-aa00-26848131158f for instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b on n-h1-855650-5 Nov 02 12:48:06.440431 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d4b067d1-a45d-4993-9441-99501d6dd9b0 req-479ba91a-85dd-4353-b78d-8410ceb95151 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128357 Nov 02 12:48:06.441778 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2581/5088] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:06.581792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-33ccf10e-7118-4806-962b-326cff936282 req-f5f4e9af-bf3f-4921-adbd-c7e53d2fb04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:06.626837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-33ccf10e-7118-4806-962b-326cff936282 req-f5f4e9af-bf3f-4921-adbd-c7e53d2fb04c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:06.627009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-33ccf10e-7118-4806-962b-326cff936282 req-f5f4e9af-bf3f-4921-adbd-c7e53d2fb04c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:06.630024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-33ccf10e-7118-4806-962b-326cff936282 req-f5f4e9af-bf3f-4921-adbd-c7e53d2fb04c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:06.661633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:06.709920 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-33ccf10e-7118-4806-962b-326cff936282 req-f5f4e9af-bf3f-4921-adbd-c7e53d2fb04c service nova] Creating event network-changed:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:48:06.723629 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-33ccf10e-7118-4806-962b-326cff936282 req-f5f4e9af-bf3f-4921-adbd-c7e53d2fb04c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146410 Nov 02 12:48:06.729260 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2582/5089] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:07.049055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:07.057874 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d7f23b63-5dda-4170-94aa-3272a043a004 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1364 microversion: 2.1 time: 0.666497 Nov 02 12:48:07.058531 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2508/5090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:06 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1364 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:07.342424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:07.343156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:07.361822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:07.362358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:07.362826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:07.363533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:07.364520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:07.364520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:07.416732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:07.417315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:07.431253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:07.431757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:07.442644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:07.443473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:07.443959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:07.444399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:07.458516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:07.903040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:08.046697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:08.065764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:08.066046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:08.070386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:08.072721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a3963d2-9a7c-463c-86fe-d31b3048bb9d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.734766 Nov 02 12:48:08.091775 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2583/5091] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:07 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:08.097562 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40df7535-f0cc-4eaa-b951-5ed24b4408d6 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1512 microversion: 2.1 time: 0.687646 Nov 02 12:48:08.106220 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2509/5092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:07 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1512 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:08.111853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:08.113999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:08.122298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:08.122937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:08.129671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:08.131145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:08.131929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:08.132895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:08.133509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:08.134146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:08.140356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:08.145408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:08.146961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:08.150228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:08.150805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:08.152220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:08.947263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:08.957953 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a7424fa-d8b4-4bd7-bf85-ddea9cc4e975 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1364 microversion: 2.1 time: 0.855683 Nov 02 12:48:08.961181 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2584/5093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:08 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1364 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:09.054731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:09.069222 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-766e1754-fe29-4131-9017-b16cc4224704 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1452 microversion: 2.1 time: 0.951530 Nov 02 12:48:09.071400 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2510/5094] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:08 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1452 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:09.103952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:09.104766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:09.138476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.141313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.141706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.149750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.149938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.150424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.274669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:09.275338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:09.286179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.286882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.290710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.294350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.294350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.294350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.367056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lazy-loading 'flavor' on Instance uuid 38f9ad93-6e10-49ae-86ca-8dc87c6b301b {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:48:09.402227 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Cannot 'shelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state shelved_offloaded Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action HTTP/1.1 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 14 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: {"shelve": {}} Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'shelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state shelved_offloaded Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'shelve': {}}} Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:48:09.404303 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state shelved_offloaded Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state shelved_offloaded Nov 02 12:48:09.408991 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:09.413460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 409 to user: Cannot 'shelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state shelved_offloaded {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:09.415357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-861afadc-67c4-42fd-b6a9-6aa78ca6805d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 409 len: 155 microversion: 2.1 time: 0.145787 Nov 02 12:48:09.418596 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2511/5095] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:48:09 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 155 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:48:09.435094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:09.437695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:09.443963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:09.457612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.458619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.460426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.464901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.467971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.468718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.629684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:48:09.804381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:09.811567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:09.817372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:09.820284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:09.838894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7f5378e9-57b0-47c3-8510-64dfb6e8ad35 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.725938 Nov 02 12:48:09.842081 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2585/5096] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:09 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:09.854268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f01b5e37-d374-43bd-b274-4909ca561f05 req-d9cb3952-1353-436f-9ae2-9c860c8e83ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-plugged", "status": "completed", "tag": "cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:09.878052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f01b5e37-d374-43bd-b274-4909ca561f05 req-d9cb3952-1353-436f-9ae2-9c860c8e83ca service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.881488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f01b5e37-d374-43bd-b274-4909ca561f05 req-d9cb3952-1353-436f-9ae2-9c860c8e83ca service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.883882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f01b5e37-d374-43bd-b274-4909ca561f05 req-d9cb3952-1353-436f-9ae2-9c860c8e83ca service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.913441 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f01b5e37-d374-43bd-b274-4909ca561f05 req-d9cb3952-1353-436f-9ae2-9c860c8e83ca service nova] Creating event network-vif-plugged:cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:48:09.920717 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-863a796d-2b76-444a-921f-cd7ef9cc072d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 202 len: 0 microversion: 2.1 time: 0.493564 Nov 02 12:48:09.926289 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2512/5097] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:48:09 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:48:09.936050 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f01b5e37-d374-43bd-b274-4909ca561f05 req-d9cb3952-1353-436f-9ae2-9c860c8e83ca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092303 Nov 02 12:48:09.937243 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2586/5098] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:09.966537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:09.971505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:09.991484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.991997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.992968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:09.993950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.994645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:09.996561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:09.997320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:09.999588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:10.008149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:10.011157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:10.029764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:10.033722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:10.038464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:10.039574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:10.666161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:10.689599 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f83e04a4-da5c-4335-850e-d7b63453a55e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1460 microversion: 2.1 time: 0.759782 Nov 02 12:48:10.722216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2513/5099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:09 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1460 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:10.726303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:10.738632 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d345b35b-f3dd-4482-8b6f-87e8bd6ee009 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1364 microversion: 2.1 time: 0.751836 Nov 02 12:48:10.739234 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2587/5100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:09 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1364 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:10.875829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:10.876631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:10.897171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:10.899672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:10.900932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:10.903167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:10.906952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:10.908607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:11.663767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:11.681173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:11.697350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:11.699897 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6cb475ac-8b30-4601-a09a-ff080ff7b8bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.834640 Nov 02 12:48:11.701036 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2514/5101] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:10 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:11.718963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:11.721864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:11.738875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:11.739783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:11.740482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:11.742903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:11.743679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:11.745458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:11.767689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:11.768322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:11.786517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:11.794869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:11.798045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:11.798881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:11.799378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:11.799825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:12.721758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:12.732055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:12.745460 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ccaa9f04-33f8-49db-96d7-e246fdd8b30d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1364 microversion: 2.1 time: 0.979289 Nov 02 12:48:12.746449 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2515/5102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:11 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1364 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:12.756578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:12.757199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:12.763724 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9234d8a9-9276-42c3-a969-24741c3e2a64 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1460 microversion: 2.1 time: 1.046671 Nov 02 12:48:12.764341 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2588/5103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:11 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1460 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:12.789195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:12.790011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:12.790674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:12.791575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:12.792203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:12.792801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:13.415047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:13.431307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:13.440031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:13.444627 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e19c1fa1-6c31-4948-ac8b-6669973ed166 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.697108 Nov 02 12:48:13.446848 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2516/5104] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:12 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:13.780334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:13.789066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:13.796649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:13.798233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:13.807515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:13.810887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:13.812714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:13.813739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:13.815320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:13.815808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:13.816516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:13.817414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:13.819445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:13.821567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:13.822118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:13.822581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:14.551630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:14.561698 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-053a30e1-cc54-481e-b657-fdc39fc1c2db tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.771193 Nov 02 12:48:14.566584 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2517/5105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:13 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:14.576872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:14.582619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:14.602046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:14.603281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:14.603958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:14.604790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:14.608991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:14.610561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:14.855549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:14.866522 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e463602a-5159-465e-8416-0a6c6587f9bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1364 microversion: 2.1 time: 1.101435 Nov 02 12:48:14.871155 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2589/5106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:13 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1364 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:14.967186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:14.984115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:14.990629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:14.992303 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-73b8aa14-3a14-40db-9a4e-a493ee87a8e2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.422357 Nov 02 12:48:14.995707 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2518/5107] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:14 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:15.595340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:15.595962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:15.608083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:15.608584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:15.609034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:15.609764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:15.610228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:15.614692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:15.900161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:15.908341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:15.930068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:15.932236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:15.933883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:15.937849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:15.939915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:15.940597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:16.240471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:16.250997 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c55d3d59-5b5f-4da1-a30f-3ccd74eb4089 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.659619 Nov 02 12:48:16.276101 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2590/5108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:15 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:16.283235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:16.292447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:16.304722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:16.306155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:16.306870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:16.307937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:16.308722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:16.309319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:16.428957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:16.438994 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d7f22e9-d7f6-4199-9cd4-de14d1eea09b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1364 microversion: 2.1 time: 0.548974 Nov 02 12:48:16.450577 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2519/5109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:15 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:16.668807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-63afc5f7-ee15-4055-9a1e-59f41c8c9180 req-3e804edf-3833-491c-9b7e-0f24fd2ea95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "name": "network-vif-plugged", "status": "completed", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:16.714693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-63afc5f7-ee15-4055-9a1e-59f41c8c9180 req-3e804edf-3833-491c-9b7e-0f24fd2ea95c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:16.716252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-63afc5f7-ee15-4055-9a1e-59f41c8c9180 req-3e804edf-3833-491c-9b7e-0f24fd2ea95c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:16.721404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-63afc5f7-ee15-4055-9a1e-59f41c8c9180 req-3e804edf-3833-491c-9b7e-0f24fd2ea95c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:16.767158 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-63afc5f7-ee15-4055-9a1e-59f41c8c9180 req-3e804edf-3833-491c-9b7e-0f24fd2ea95c service nova] Creating event network-vif-plugged:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:48:16.778822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-63afc5f7-ee15-4055-9a1e-59f41c8c9180 req-3e804edf-3833-491c-9b7e-0f24fd2ea95c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114915 Nov 02 12:48:16.784103 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2520/5110] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:17.033205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:17.049477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:17.061015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:17.062725 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-51444380-74fb-4107-a1aa-010db0720352 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.783397 Nov 02 12:48:17.063460 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2591/5111] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:16 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:17.283797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:17.284864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:17.306809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:17.307706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:17.310099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:17.319770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:17.320749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:17.322702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:17.474519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:17.475184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:17.483896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:17.484742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:17.485632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:17.486781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:17.487678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:17.488310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:18.208613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:18.239131 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52e8db38-1d6e-424d-93c3-c8e6475fcf44 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1364 microversion: 2.1 time: 0.758650 Nov 02 12:48:18.242474 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2592/5112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:17 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1364 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:18.277177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:18.278240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:18.288409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:18.289237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:18.290177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:18.291307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:18.291949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:18.292545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:18.558709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:18.579864 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-041af2fe-a9bb-49fa-8eb0-62de63d0452d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 1.293209 Nov 02 12:48:18.580535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2521/5113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:17 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:19.049895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:19.072979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:19.074542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:19.075788 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4cedc04e-d457-4243-9a5d-93e6a0cfecdb tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.806366 Nov 02 12:48:19.076487 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2593/5114] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:18 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:19.265422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:19.266075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:19.284323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:19.286611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:19.287068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:19.287810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:19.288272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:19.288713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:19.609888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:19.611088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:19.652115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:19.653232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:19.653878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:19.655322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:19.658102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:19.658972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:20.347151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:20.362275 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5c1469dd-f122-402d-8489-db72bb31678e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1552 microversion: 2.1 time: 1.100240 Nov 02 12:48:20.371211 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2522/5115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:19 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1552 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:20.400831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:20.401461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:20.421819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:20.422637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:20.423111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:20.423841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:20.424303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:20.424776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:20.994792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:21.007498 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2211c595-cebe-4d0f-b62d-1747f5c89ba9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 1.401789 Nov 02 12:48:21.021430 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2594/5116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:19 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:21.043720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:21.044249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:21.075382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:21.075890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:21.076340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:21.092909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:21.093444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:21.102706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:21.145245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:21.170439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:21.183860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:21.195001 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a8ad5288-1a08-44a8-9c0d-9ec0bc2c3249 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.816181 Nov 02 12:48:21.196106 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2523/5117] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:20 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:21.872686 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-743319df-e1e5-434b-be5b-3490cfb286eb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.849705 Nov 02 12:48:21.874240 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2595/5118] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:48:21 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/os-interface => generated 285 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:22.048712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:22.054018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:22.106441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:22.113776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:22.114631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:22.116594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:22.117477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:22.118423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:22.231852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:22.232489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:22.250019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:22.252269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:22.252740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:22.256104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:22.257204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:22.258172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:24.223060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:24.248429 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e69aa01-9f2a-4f3a-8ccd-2c6a195e54ab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 2.211769 Nov 02 12:48:24.249773 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2524/5119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:22 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:24.403952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:24.427298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:24.429374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:24.431124 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f604f35d-c3bf-4069-9ace-e0f3d94636a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 2.209298 Nov 02 12:48:24.451891 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2596/5120] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:22 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:25.276769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:25.277514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:25.291694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:25.294644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:25.295233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:25.296173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:25.297534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:25.299977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:25.461058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:25.461664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:25.479970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:25.480484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:25.480940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:25.481685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:25.482296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:25.482788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:26.001179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:26.023570 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5c55f696-ed2e-481c-8e4c-8e7041fd0550 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.751468 Nov 02 12:48:26.047620 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2525/5121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:25 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:26.596514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9d45ae22-d235-4189-85e3-392d1d49be66 req-117e4429-b9cb-4508-a724-5effe1f84ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-plugged", "status": "completed", "tag": "1b72dfc0-e39d-4182-b6fb-9a2ef7753062"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:26.633554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9d45ae22-d235-4189-85e3-392d1d49be66 req-117e4429-b9cb-4508-a724-5effe1f84ebb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:26.637786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9d45ae22-d235-4189-85e3-392d1d49be66 req-117e4429-b9cb-4508-a724-5effe1f84ebb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:26.638338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9d45ae22-d235-4189-85e3-392d1d49be66 req-117e4429-b9cb-4508-a724-5effe1f84ebb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:26.697857 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9d45ae22-d235-4189-85e3-392d1d49be66 req-117e4429-b9cb-4508-a724-5effe1f84ebb service nova] Creating event network-vif-plugged:1b72dfc0-e39d-4182-b6fb-9a2ef7753062 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:48:26.717103 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9d45ae22-d235-4189-85e3-392d1d49be66 req-117e4429-b9cb-4508-a724-5effe1f84ebb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123374 Nov 02 12:48:26.718437 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2526/5122] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 12:48:27.031303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:27.053734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:27.054985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:27.056583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:27.060187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:27.063426 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3b357f1-4e56-426e-84f5-93c991310814 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.608296 Nov 02 12:48:27.067875 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2597/5123] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:25 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:48:27.077879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:27.080874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:27.081568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:27.088451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:27.089495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:27.089989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:27.796033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:27.815420 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05e48928-b505-4396-8b5e-40fa01b65724 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.766395 Nov 02 12:48:27.817841 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2527/5124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:27 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:28.096860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:28.102422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:28.162983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.167625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.170569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.172673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.181418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.182798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.586009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b6f2c188-1ec6-4931-a159-63bef74d1b94 req-0fb964eb-d037-4553-bc80-8611f1c877de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:28.636343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b6f2c188-1ec6-4931-a159-63bef74d1b94 req-0fb964eb-d037-4553-bc80-8611f1c877de service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.646258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b6f2c188-1ec6-4931-a159-63bef74d1b94 req-0fb964eb-d037-4553-bc80-8611f1c877de service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.647156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b6f2c188-1ec6-4931-a159-63bef74d1b94 req-0fb964eb-d037-4553-bc80-8611f1c877de service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.731290 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b6f2c188-1ec6-4931-a159-63bef74d1b94 req-0fb964eb-d037-4553-bc80-8611f1c877de service nova] Creating event network-changed:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:48:28.751725 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b6f2c188-1ec6-4931-a159-63bef74d1b94 req-0fb964eb-d037-4553-bc80-8611f1c877de service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.683724 Nov 02 12:48:28.757687 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2598/5125] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:28.843641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:28.844669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:28.855965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.865433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.866267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.870932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.871761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.879290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:29.923282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:29.944506 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6a7596d-4d9e-48e9-98fd-a50cdb4acdeb tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 1.105521 Nov 02 12:48:29.946711 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2599/5126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:28 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:29.953903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3897328a-1c6a-4891-a9a4-b703302879ae req-5843d173-5548-4391-a3e6-db76e413f6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-plugged", "status": "completed", "tag": "08d946d8-b737-4d8f-a0f8-2a4f7e6c893b"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-plugged", "status": "completed", "tag": "e7168472-9de7-4506-b496-895fda51cfd5"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:29.961349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:29.977227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3897328a-1c6a-4891-a9a4-b703302879ae req-5843d173-5548-4391-a3e6-db76e413f6b0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:29.978047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3897328a-1c6a-4891-a9a4-b703302879ae req-5843d173-5548-4391-a3e6-db76e413f6b0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:29.978711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3897328a-1c6a-4891-a9a4-b703302879ae req-5843d173-5548-4391-a3e6-db76e413f6b0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:29.989193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:29.995857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:29.997344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8efda089-1f8c-4ae1-86ee-ce8d5bc81165 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.906446 Nov 02 12:48:30.003060 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3897328a-1c6a-4891-a9a4-b703302879ae req-5843d173-5548-4391-a3e6-db76e413f6b0 service nova] Creating event network-vif-plugged:08d946d8-b737-4d8f-a0f8-2a4f7e6c893b for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:48:30.004956 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3897328a-1c6a-4891-a9a4-b703302879ae req-5843d173-5548-4391-a3e6-db76e413f6b0 service nova] Creating event network-vif-plugged:e7168472-9de7-4506-b496-895fda51cfd5 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:48:30.015187 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3897328a-1c6a-4891-a9a4-b703302879ae req-5843d173-5548-4391-a3e6-db76e413f6b0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065771 Nov 02 12:48:30.016095 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2600/5127] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:30.028203 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2528/5128] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:28 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:30.977477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:30.978282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:31.003389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:31.003893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:31.004341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:31.005208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:31.005592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:31.006044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:31.029814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:31.032163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:31.054149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:31.064372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:31.070605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:31.071391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:31.076295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:31.082484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:31.083106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:31.912534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:31.915819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:31.923937 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5976fd11-d6c0-42ee-aa42-6a45f631ee21 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.951342 Nov 02 12:48:31.934510 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2601/5129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:30 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:32.043287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-bb07adc1-1980-4767-8e27-fdee89f456d4 req-67bf483b-33a7-46aa-9528-50db0e1e2222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-plugged", "status": "completed", "tag": "3fcc22ed-2130-410f-b618-7d1d71081222"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-plugged", "status": "completed", "tag": "8007eff5-a08a-4593-94af-120b1b805694"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-plugged", "status": "completed", "tag": "880ff257-ea6b-45a9-abe1-67bba3951184"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:32.075445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=50 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:32.077693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bb07adc1-1980-4767-8e27-fdee89f456d4 req-67bf483b-33a7-46aa-9528-50db0e1e2222 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:32.085190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bb07adc1-1980-4767-8e27-fdee89f456d4 req-67bf483b-33a7-46aa-9528-50db0e1e2222 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:32.085849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bb07adc1-1980-4767-8e27-fdee89f456d4 req-67bf483b-33a7-46aa-9528-50db0e1e2222 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:32.105610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:32.113601 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-bb07adc1-1980-4767-8e27-fdee89f456d4 req-67bf483b-33a7-46aa-9528-50db0e1e2222 service nova] Creating event network-vif-plugged:3fcc22ed-2130-410f-b618-7d1d71081222 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:48:32.116184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:32.127847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-bb07adc1-1980-4767-8e27-fdee89f456d4 req-67bf483b-33a7-46aa-9528-50db0e1e2222 service nova] Creating event network-vif-plugged:8007eff5-a08a-4593-94af-120b1b805694 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:48:32.128440 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-bb07adc1-1980-4767-8e27-fdee89f456d4 req-67bf483b-33a7-46aa-9528-50db0e1e2222 service nova] Creating event network-vif-plugged:880ff257-ea6b-45a9-abe1-67bba3951184 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:48:32.137091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:32.141484 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e5641a5-658e-4344-b3b3-a4cb46916863 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 1.120329 Nov 02 12:48:32.142380 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2529/5130] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:31 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:32.157486 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-bb07adc1-1980-4767-8e27-fdee89f456d4 req-67bf483b-33a7-46aa-9528-50db0e1e2222 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.118009 Nov 02 12:48:32.171869 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2602/5131] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:32.963596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:32.964412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:32.982628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:32.985266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:32.986376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:32.987356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:32.987897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:32.988648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:33.034344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:33.175836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:33.177383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:33.199491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:33.200077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:33.201175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:33.202023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:33.206606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:33.207012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:33.243807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:33.260482 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e16ca437-7c2c-402e-8d78-3342d349efff tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.298250 Nov 02 12:48:33.261885 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2530/5132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:32 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:33.704816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:33.725525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:33.734832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:33.740192 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f53244d2-b4c5-453c-8c19-e7d0e5ddedc9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.566461 Nov 02 12:48:33.753998 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2603/5133] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:33 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:34.289174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:34.290592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:34.305826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:34.309495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:34.310284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:34.311781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:34.312554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:34.319398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:34.539224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:34.555876 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aecdd7d2-500c-4ab0-9dc6-fe5e62035d9f tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.271594 Nov 02 12:48:34.556981 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2531/5134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:34 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:34.770839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:34.772206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:34.789878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:34.791361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:34.792062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:34.793042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:34.793503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:34.793939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:35.194424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:35.219236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:35.224694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:35.234379 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8fbaad07-0173-4144-bf9d-ecaecd940146 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.461045 Nov 02 12:48:35.235829 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2604/5135] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:34 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:35.587608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:35.588229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:35.603441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:35.604601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:35.605063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:35.605804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:35.606304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:35.606740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:35.843064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:35.852366 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6a49cc73-3288-4c74-8126-250eb728291d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.269984 Nov 02 12:48:35.853822 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2532/5136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:35 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:36.295589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:36.296177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:36.343497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:36.354523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:36.355288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:36.356270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:36.358598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:36.359923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:36.778930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:36.794033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:36.796908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:36.799136 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-43280b74-c707-4d57-8fc2-c8562e8517bc tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.523376 Nov 02 12:48:36.799693 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2605/5137] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:36 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:36.878074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:36.878712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:36.902648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:36.907131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:36.908379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:36.909547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:36.910266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:36.911007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:37.291310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:37.301041 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef8d464e-bd7b-4feb-94f2-9580bd6dd4ee tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.427732 Nov 02 12:48:37.301899 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2533/5138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:36 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:37.830058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:37.830963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:37.844218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:37.844718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:37.845168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:37.851367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:37.851949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:37.852410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:38.327387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:38.328134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:38.337837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:38.346689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:38.347504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:38.348012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:38.348452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:38.348929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:38.743772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:38.755826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:38.757652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:38.758889 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-141a8caa-d25c-4c74-b078-680f04a5ad75 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1876 microversion: 2.42 time: 0.935387 Nov 02 12:48:38.759464 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2606/5139] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:37 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1876 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:38.830666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:38.842766 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4be85926-81aa-49d5-ac6b-aea09f99e400 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.519404 Nov 02 12:48:38.844206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2534/5140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:38 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:39.788672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:39.789318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:39.797860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:39.798741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:39.799433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:39.801104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:39.802403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:39.803228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:39.877262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:39.878025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:39.899542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:39.900095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:39.900562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:39.904229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:39.904743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:39.905203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:40.256408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:40.271922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:40.279948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:40.283860 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b190ca2d-3d24-43c4-8164-86fd8534dc61 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2834 microversion: 2.42 time: 0.500887 Nov 02 12:48:40.285289 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2607/5141] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:39 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2834 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:40.313544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:40.314132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:40.325173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:40.327490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:40.328488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:40.329565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:40.330737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:40.331181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:40.425310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:40.437355 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6991db6c-11f5-4236-84ae-b07051e38570 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.572820 Nov 02 12:48:40.438912 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2535/5142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:39 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:40.555034 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8d61b7ea-274a-40ff-ab17-e26756543cbd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.245340 Nov 02 12:48:40.556661 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2608/5143] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Nov 2 12:48:40 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819/os-interface => generated 1831 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:40.577389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:40.578249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:40.611203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:40.613266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:40.615251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:40.617866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:40.619512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:40.621429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:40.706859 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4b0ff7e9-942e-4f1a-80e0-9dc0bbc7cb1b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/ips" status: 200 len: 151 microversion: 2.1 time: 0.133513 Nov 02 12:48:40.707763 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2536/5144] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:48:40 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/ips => generated 151 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:41.463026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:41.464763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:41.484235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:41.487021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:41.488564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:41.491341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:41.497817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:41.499373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:42.118629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:42.144826 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df8ebd52-e409-435c-893d-086c412300b7 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.687404 Nov 02 12:48:42.151493 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2609/5145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:41 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:42.968855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c03ef335-9d90-4340-b07d-fce13495aadb req-fd5b9490-04fa-41ea-856f-873bcbbc625d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f9ad93-6e10-49ae-86ca-8dc87c6b301b", "name": "network-vif-plugged", "status": "completed", "tag": "75616d16-546a-49d9-aa00-26848131158f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:43.018221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c03ef335-9d90-4340-b07d-fce13495aadb req-fd5b9490-04fa-41ea-856f-873bcbbc625d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:43.033026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c03ef335-9d90-4340-b07d-fce13495aadb req-fd5b9490-04fa-41ea-856f-873bcbbc625d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:43.033633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c03ef335-9d90-4340-b07d-fce13495aadb req-fd5b9490-04fa-41ea-856f-873bcbbc625d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:43.084635 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c03ef335-9d90-4340-b07d-fce13495aadb req-fd5b9490-04fa-41ea-856f-873bcbbc625d service nova] Creating event network-vif-plugged:75616d16-546a-49d9-aa00-26848131158f for instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b on n-h1-855650-5 Nov 02 12:48:43.100227 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c03ef335-9d90-4340-b07d-fce13495aadb req-fd5b9490-04fa-41ea-856f-873bcbbc625d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133626 Nov 02 12:48:43.102299 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2537/5146] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:43.173886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:43.174568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:43.188680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:43.189479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:43.190166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:43.191074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:43.191814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:43.193344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:43.227186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8a9afe35-1d43-4164-9e16-173c46ab8891 req-1324867d-ac3e-4990-b138-f666364cb8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "tag": "cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:43.253620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8a9afe35-1d43-4164-9e16-173c46ab8891 req-1324867d-ac3e-4990-b138-f666364cb8d3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:43.255688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8a9afe35-1d43-4164-9e16-173c46ab8891 req-1324867d-ac3e-4990-b138-f666364cb8d3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:43.257794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8a9afe35-1d43-4164-9e16-173c46ab8891 req-1324867d-ac3e-4990-b138-f666364cb8d3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:43.289082 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8a9afe35-1d43-4164-9e16-173c46ab8891 req-1324867d-ac3e-4990-b138-f666364cb8d3 service nova] Creating event network-changed:cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:48:43.311447 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8a9afe35-1d43-4164-9e16-173c46ab8891 req-1324867d-ac3e-4990-b138-f666364cb8d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089990 Nov 02 12:48:43.314397 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2538/5147] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:43.436672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:43.450067 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-95c64d1d-7fa9-4826-ae4a-4017f698ed17 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.282801 Nov 02 12:48:43.452578 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2610/5148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:43 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:44.491293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:44.496650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:44.518599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:44.523439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:44.525626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:44.526781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:44.527753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:44.530927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:44.653988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32685d93-e15e-46e0-ac19-721eb10648df"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:44.665480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:44.700054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:44.702983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:44.703503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:44.704332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:44.704812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:44.705272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:45.264203 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cee94645-46d7-4466-9ccd-e627dd8a7ad9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614421 Nov 02 12:48:45.265613 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2611/5149] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:48:44 2022] POST /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:45.315952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:45.326183 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f74051dd-649f-410a-a97a-73248a5df17a tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.849047 Nov 02 12:48:45.334641 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2539/5150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:44 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:46.362861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:46.364240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:46.377508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:46.377945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:46.380837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:46.386941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:46.387908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:46.388520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:46.944604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:46.956392 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e33ee199-d5ff-4824-802f-914a27578547 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1518 microversion: 2.1 time: 0.599263 Nov 02 12:48:46.957261 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2612/5151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:46 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1518 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:47.979749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:47.980378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:47.992597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:47.993426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:47.994155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:47.995722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:47.996374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:47.996977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:48.323993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:48.342754 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb4237b3-59f9-4025-a0ff-5fc4c5c61e78 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.356351 Nov 02 12:48:48.342754 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2540/5152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:47 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:48.370225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:48.371091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:48.396482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:48.396904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:48.397355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:48.398390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:48.398854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:48.399293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:48.706980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:48.726227 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d4c23a2e-ed2b-48d2-a3c8-186aa217e96e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.358346 Nov 02 12:48:48.734243 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2613/5153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:48 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:48.769856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:48.771099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:48.778049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:48.778787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:48.779509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:48.780480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:48.781401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:48.782091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:49.046054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:49.062985 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-252507a0-3cca-428e-89d4-b80416c196a8 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.303181 Nov 02 12:48:49.063601 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2541/5154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:48 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:49.090623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ce428e2-2930-4e5e-8c44-f7823a225943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:49.098848 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3ce428e2-2930-4e5e-8c44-f7823a225943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance cf9981d7-6f9a-4594-aaa2-0b70954c978e has no mapping to a cell. Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ce428e2-2930-4e5e-8c44-f7823a225943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/cf9981d7-6f9a-4594-aaa2-0b70954c978e/action HTTP/1.1 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 15 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: {"os-stop": {}} Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance cf9981d7-6f9a-4594-aaa2-0b70954c978e has no mapping to a cell. Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'cf9981d7-6f9a-4594-aaa2-0b70954c978e', 'body': {'os-stop': {}}} Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance cf9981d7-6f9a-4594-aaa2-0b70954c978e has no mapping to a cell. Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:48:49.113704 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9981d7-6f9a-4594-aaa2-0b70954c978e has no mapping to a cell. Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9981d7-6f9a-4594-aaa2-0b70954c978e has no mapping to a cell. Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ce428e2-2930-4e5e-8c44-f7823a225943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance cf9981d7-6f9a-4594-aaa2-0b70954c978e has no mapping to a cell. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ce428e2-2930-4e5e-8c44-f7823a225943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/cf9981d7-6f9a-4594-aaa2-0b70954c978e/action" status: 404 len: 117 microversion: 2.1 time: 0.030099 Nov 02 12:48:49.119751 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2614/5155] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:48:49 2022] POST /compute/v2.1/servers/cf9981d7-6f9a-4594-aaa2-0b70954c978e/action => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:48:49.125141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:49.125769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:49.166358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:49.167059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:49.167537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:49.168316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:49.168784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:49.169222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:49.521391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:49.538606 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e94e59f-d1ad-44cd-a6b7-793f2a7190bc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.413052 Nov 02 12:48:49.539303 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2542/5156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:49 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:49.568302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:49.570128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:49.592022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:49.594093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:49.595278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:49.598613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:49.599782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:49.600463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:50.165450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:50.181682 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b64b0e7d-25a4-4689-b6f7-6d70ac530e6e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.618566 Nov 02 12:48:50.182363 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2615/5157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:49 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:50.207311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-621c42df-2a9b-4995-9494-bbe9bd2a0f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:50.208661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-621c42df-2a9b-4995-9494-bbe9bd2a0f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 4636275b-c25a-4366-83d5-9e79b2ff58e5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:50.222292 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-621c42df-2a9b-4995-9494-bbe9bd2a0f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 4636275b-c25a-4366-83d5-9e79b2ff58e5 could not be found. Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-621c42df-2a9b-4995-9494-bbe9bd2a0f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/4636275b-c25a-4366-83d5-9e79b2ff58e5/action HTTP/1.1 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 15 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: {"suspend": {}} Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 4636275b-c25a-4366-83d5-9e79b2ff58e5 could not be found. Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4636275b-c25a-4366-83d5-9e79b2ff58e5', 'body': {'suspend': {}}} Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4636275b-c25a-4366-83d5-9e79b2ff58e5 could not be found. Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4636275b-c25a-4366-83d5-9e79b2ff58e5 could not be found. Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:50.228451 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:50.233096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:50.233096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:50.233096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4636275b-c25a-4366-83d5-9e79b2ff58e5 could not be found. Nov 02 12:48:50.233096 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:50.235377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-621c42df-2a9b-4995-9494-bbe9bd2a0f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 4636275b-c25a-4366-83d5-9e79b2ff58e5 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:50.236541 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-621c42df-2a9b-4995-9494-bbe9bd2a0f33 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/4636275b-c25a-4366-83d5-9e79b2ff58e5/action" status: 404 len: 111 microversion: 2.1 time: 0.033415 Nov 02 12:48:50.242374 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2543/5158] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:48:50 2022] POST /compute/v2.1/servers/4636275b-c25a-4366-83d5-9e79b2ff58e5/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:48:50.251723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:50.252423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:50.268150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:50.268654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:50.269169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:50.269894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:50.270955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:50.271392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:50.658251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:50.673263 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-272981cb-742e-4366-98d7-9754fb490786 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.424203 Nov 02 12:48:50.675291 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2616/5159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:50 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:50.707097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:50.709154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:50.718817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:50.719823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:50.720919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:50.722329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:50.723100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:50.723842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:51.306693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:51.322336 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a147ac1f-dab8-4389-8eb4-3c8525d01a6b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.616465 Nov 02 12:48:51.324915 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2544/5160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:50 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:51.347019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:51.347560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:51.354716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:51.355428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:51.356065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:51.356951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:51.357766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:51.358384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:51.391033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lazy-loading 'flavor' on Instance uuid 38f9ad93-6e10-49ae-86ca-8dc87c6b301b {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:48:51.495203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:51.554809 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-00d8e79d-cfa3-42fe-b137-8b239984377b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 202 len: 0 microversion: 2.1 time: 0.208424 Nov 02 12:48:51.555936 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2617/5161] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:48:51 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:48:51.565101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:51.565722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:51.590841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:51.592730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:51.593311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:51.603214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:51.606205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:51.606712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:52.079122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:52.088480 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9bebf8f8-8290-4730-988c-e6e7e89509af tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1513 microversion: 2.1 time: 0.528258 Nov 02 12:48:52.094143 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2545/5162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:51 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1513 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:53.125278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:53.126168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:53.150607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.151124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.151573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:53.152299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.152755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.153182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:53.452041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:53.463365 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a669d616-8120-43b8-bb09-e28f619f7cb9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1496 microversion: 2.1 time: 0.344483 Nov 02 12:48:53.464478 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2618/5163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:53 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1496 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:53.492765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:53.493436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:53.510490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.522041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.522524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:53.523295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.523774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.524219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:53.585722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lazy-loading 'flavor' on Instance uuid 38f9ad93-6e10-49ae-86ca-8dc87c6b301b {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:48:53.625298 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Cannot 'suspend' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state suspended Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action HTTP/1.1 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 15 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: {"suspend": {}} Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'suspend' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state suspended Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'suspend': {}}} Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b in vm_state suspended. Cannot suspend while the instance is in this state. Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Nov 02 12:48:53.628751 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state suspended Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state suspended Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:48:53.634572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 409 to user: Cannot 'suspend' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state suspended {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:53.636353 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31b7117d-2393-4733-b456-86382dd25ebd tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 409 len: 148 microversion: 2.1 time: 0.148355 Nov 02 12:48:53.638080 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2546/5164] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:48:53 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 148 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:48:53.651168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:53.653054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:53.685664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.699777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.700764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:53.702128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.703009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.703832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:54.000933 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8dbb4a34-fe5d-4116-bc0f-9f90649a032b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 202 len: 0 microversion: 2.1 time: 0.357131 Nov 02 12:48:54.006649 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2619/5165] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:48:53 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:48:54.025551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:54.027811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:54.056903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:54.057946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:54.060274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:54.063061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:54.067146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:54.068322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:54.407450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:54.426184 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8927feb2-f82b-4daf-bf40-9a2dddf39262 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1502 microversion: 2.1 time: 0.413551 Nov 02 12:48:54.430648 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2547/5166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:54 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:55.481125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:55.482687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:55.500282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:55.502710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:55.503710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:55.505829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:55.508791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:55.509706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:56.828964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:56.844373 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eddfbf13-5f51-408f-9e88-99717a1be7c4 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1502 microversion: 2.1 time: 1.370235 Nov 02 12:48:56.846143 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2620/5167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:55 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1502 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:57.871889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:57.873513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:57.890923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:57.893393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:57.895769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:57.909644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:57.915591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:57.917016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:58.763113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:58.792835 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8eb28b0a-eb5b-4ee3-8fc8-75903dfe4474 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1502 microversion: 2.1 time: 0.925080 Nov 02 12:48:58.795728 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2548/5168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:57 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1502 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:59.818955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:59.819580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:59.835240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:59.836085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:59.836920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:59.838184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:59.838823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:59.839463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:00.192751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:00.201944 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a54488c-e9c9-4f33-a8ae-a84c49ff72e5 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.387233 Nov 02 12:49:00.218080 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2621/5169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:59 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:00.235110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:00.235905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:00.250998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:00.252530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:00.254925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:00.255829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:00.258660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:00.259336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:00.574049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:00.578205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:00.585691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33d56519-2d1f-48d6-bc4a-6fb573a85ab9 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.355226 Nov 02 12:49:00.591614 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2549/5170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:00 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:00.617157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8dda931-e340-46ab-9b89-0add6b53338e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:00.618102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b8dda931-e340-46ab-9b89-0add6b53338e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: a3e953dc-5615-4ee6-a781-812de0c13e60] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:00.631945 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-b8dda931-e340-46ab-9b89-0add6b53338e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance a3e953dc-5615-4ee6-a781-812de0c13e60 could not be found. Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8dda931-e340-46ab-9b89-0add6b53338e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/a3e953dc-5615-4ee6-a781-812de0c13e60/action HTTP/1.1 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 15 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: {"unpause": {}} Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance a3e953dc-5615-4ee6-a781-812de0c13e60 could not be found. Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'a3e953dc-5615-4ee6-a781-812de0c13e60', 'body': {'unpause': {}}} Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e953dc-5615-4ee6-a781-812de0c13e60 could not be found. Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e953dc-5615-4ee6-a781-812de0c13e60 could not be found. Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:00.637159 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:00.643792 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:00.643792 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:00.643792 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e953dc-5615-4ee6-a781-812de0c13e60 could not be found. Nov 02 12:49:00.643792 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.643792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8dda931-e340-46ab-9b89-0add6b53338e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance a3e953dc-5615-4ee6-a781-812de0c13e60 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:00.644643 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b8dda931-e340-46ab-9b89-0add6b53338e tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/a3e953dc-5615-4ee6-a781-812de0c13e60/action" status: 404 len: 111 microversion: 2.1 time: 0.025772 Nov 02 12:49:00.650976 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2622/5171] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:49:00 2022] POST /compute/v2.1/servers/a3e953dc-5615-4ee6-a781-812de0c13e60/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:49:00.659855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:00.660609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:00.675915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:00.679547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:00.683419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:00.690463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:00.690463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:00.690463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:01.260681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:01.279443 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8bb655d3-e1d7-4fe9-9005-51d51f53d789 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.623711 Nov 02 12:49:01.300328 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2550/5172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:00 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:01.313534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:01.314380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:01.346790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:01.346790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:01.346790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:01.346790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:01.346790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:01.346790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:01.954606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:01.969885 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63256d4b-410e-4be1-8f12-73038b08d4ef tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.656767 Nov 02 12:49:01.970609 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2623/5173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:01 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:01.998748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:01.999305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:02.006085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=44 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:02.008152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:02.008880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:02.009864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:02.010935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:02.011775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:02.012395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:02.069024 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Cannot 'unpause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action HTTP/1.1 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 15 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: {"unpause": {}} Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: exception: Cannot 'unpause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'unpause': {}}} Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b in vm_state active. Cannot unpause while the instance is in this state. Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:02.075581 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:02.082031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:02.082031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:02.082031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:02.082031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:49:02.082031 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.087150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 409 to user: Cannot 'unpause' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:02.089875 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7cabaa8-8b3d-4f26-86bb-d694e2d57c84 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 409 len: 145 microversion: 2.1 time: 0.095708 Nov 02 12:49:02.098503 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2551/5174] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:49:01 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 145 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:49:02.105844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:02.106998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:02.118725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=44 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:02.120969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:02.123082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:02.125338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:02.126796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:02.130719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:02.133034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:02.635526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:02.652438 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8834c591-a44f-4446-b76e-7260598814a3 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.552334 Nov 02 12:49:02.655730 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2624/5175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:02 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:02.683421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:02.685319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:02.695427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:02.695950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:02.697158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:02.698280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:02.699261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:02.699877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:02.990136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32685d93-e15e-46e0-ac19-721eb10648df"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:03.006240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:03.045819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.046380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.049576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.053441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.058845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.062372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.243871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Invalid volume: volume 32685d93-e15e-46e0-ac19-721eb10648df is already attached to instances: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments HTTP/1.1 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 74 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: {"volumeAttachment": {"volumeId": "32685d93-e15e-46e0-ac19-721eb10648df"}} Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid volume: volume 32685d93-e15e-46e0-ac19-721eb10648df is already attached to instances: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': '69765fbb-916c-4ca2-81fd-8ceeccde7cb1', 'body': {'volumeAttachment': {'volumeId': '32685d93-e15e-46e0-ac19-721eb10648df'}}} Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 32685d93-e15e-46e0-ac19-721eb10648df is already attached to instances: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:03.246306 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 32685d93-e15e-46e0-ac19-721eb10648df is already attached to instances: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 32685d93-e15e-46e0-ac19-721eb10648df is already attached to instances: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 400 to user: Invalid volume: volume 32685d93-e15e-46e0-ac19-721eb10648df is already attached to instances: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:03.254915 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eda5c3be-0d0e-4902-b449-bb31f3be5ad0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.273138 Nov 02 12:49:03.258011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:03.258270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2625/5176] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:49:02 2022] POST /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 174 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:49:03.269097 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6fd48cfb-c979-4490-ac75-dbe677ea7a5d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.590664 Nov 02 12:49:03.308129 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2552/5177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:02 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:03.311300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3588cce-5edf-45fc-9f8a-083a05d9e3cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:03.312198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f3588cce-5edf-45fc-9f8a-083a05d9e3cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: c4756fa9-bca4-4274-9d00-55e9ad2e2c24] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:03.327977 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f3588cce-5edf-45fc-9f8a-083a05d9e3cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance c4756fa9-bca4-4274-9d00-55e9ad2e2c24 could not be found. Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3588cce-5edf-45fc-9f8a-083a05d9e3cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/c4756fa9-bca4-4274-9d00-55e9ad2e2c24/action HTTP/1.1 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 18 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: {"unshelve": null} Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance c4756fa9-bca4-4274-9d00-55e9ad2e2c24 could not be found. Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'c4756fa9-bca4-4274-9d00-55e9ad2e2c24', 'body': {'unshelve': None}} Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4756fa9-bca4-4274-9d00-55e9ad2e2c24 could not be found. Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4756fa9-bca4-4274-9d00-55e9ad2e2c24 could not be found. Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.331087 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4756fa9-bca4-4274-9d00-55e9ad2e2c24 could not be found. Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3588cce-5edf-45fc-9f8a-083a05d9e3cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance c4756fa9-bca4-4274-9d00-55e9ad2e2c24 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:03.338025 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f3588cce-5edf-45fc-9f8a-083a05d9e3cc tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/c4756fa9-bca4-4274-9d00-55e9ad2e2c24/action" status: 404 len: 111 microversion: 2.1 time: 0.027884 Nov 02 12:49:03.356589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:03.359772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:03.374283 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2626/5178] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:49:03 2022] POST /compute/v2.1/servers/c4756fa9-bca4-4274-9d00-55e9ad2e2c24/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:49:03.389937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.390492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:03.391067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:03.392571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.393057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.393826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.394339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.394786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.429042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.432176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.435273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.438304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.440700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.443197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.695875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lazy-loading 'services' on Instance uuid 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:49:03.772881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:03.781586 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04d79689-1362-4568-be6a-d64e1766fcab tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.439512 Nov 02 12:49:03.790688 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2553/5179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:03 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:03.824477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:03.825351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:03.835598 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-95a81be6-dda9-4ada-92bb-fd882aac2712 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments/32685d93-e15e-46e0-ac19-721eb10648df" status: 202 len: 0 microversion: 2.1 time: 0.451361 Nov 02 12:49:03.835945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.836565 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2627/5180] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:49:03 2022] DELETE /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments/32685d93-e15e-46e0-ac19-721eb10648df => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:49:03.836794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.838295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.839109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.840532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.841422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.868192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:03.875372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:03.892124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.898812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.899379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.900289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.900839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.901459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.979861 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e1b895d-f2a5-469c-bafb-c1aa2ba263af tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126993 Nov 02 12:49:03.982446 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2628/5181] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:03 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:04.136091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:04.150713 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-968342c0-a8d9-4eb8-971f-4699dc96e452 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.334476 Nov 02 12:49:04.152850 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2554/5182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:03 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:04.181918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:04.182915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:04.194682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:04.195488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:04.196121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:04.197044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:04.197677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:04.198311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:04.279803 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Cannot 'unshelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action HTTP/1.1 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 18 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: {"unshelve": null} Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: exception: Cannot 'unshelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'unshelve': None}} Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b in vm_state active. Cannot unshelve while the instance is in this state. Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:49:04.281709 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 409 to user: Cannot 'unshelve' instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b while it is in vm_state active {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:04.287070 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fbdf0761-e051-4b44-8bb9-09317285836b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action" status: 409 len: 146 microversion: 2.1 time: 0.105691 Nov 02 12:49:04.288072 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2629/5183] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:49:04 2022] POST /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b/action => generated 146 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:49:04.293827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:04.294922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:04.312677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:04.313212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:04.313669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:04.326992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:04.327544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:04.333402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:04.664188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:04.678239 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1bf7888-bdfd-4a0c-818d-63e4e4f13989 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.389377 Nov 02 12:49:04.681992 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2555/5184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:04 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:04.712641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:04.713270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:04.736232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:04.736747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:04.737200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:04.739535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:04.740061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:04.742360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:04.994432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:04.996683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:05.015879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:05.016382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:05.016830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:05.017547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:05.018124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:05.018456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:05.018943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:05.041624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-17ee338e-22bd-4a6a-8aab-ed28dc7cc256 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.334213 Nov 02 12:49:05.055229 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2630/5185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:04 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:05.074436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63a21706-9341-4c84-bd33-29ec0f29fa3b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-605068225_updated"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:05.077359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63a21706-9341-4c84-bd33-29ec0f29fa3b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: e8ad04c3-11e4-4b4d-a83b-07454b9886a3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:05.091198 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cccc3450-23bb-42a4-b238-58a95e5ef485 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100919 Nov 02 12:49:05.092116 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2556/5186] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:04 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:05.093360 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-63a21706-9341-4c84-bd33-29ec0f29fa3b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance e8ad04c3-11e4-4b4d-a83b-07454b9886a3 could not be found. Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63a21706-9341-4c84-bd33-29ec0f29fa3b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/servers/e8ad04c3-11e4-4b4d-a83b-07454b9886a3 HTTP/1.1 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 80 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-605068225_updated"}} Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance e8ad04c3-11e4-4b4d-a83b-07454b9886a3 could not be found. Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'e8ad04c3-11e4-4b4d-a83b-07454b9886a3', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-605068225_updated'}}} Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ad04c3-11e4-4b4d-a83b-07454b9886a3 could not be found. Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 12:49:05.097670 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ad04c3-11e4-4b4d-a83b-07454b9886a3 could not be found. Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ad04c3-11e4-4b4d-a83b-07454b9886a3 could not be found. Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63a21706-9341-4c84-bd33-29ec0f29fa3b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance e8ad04c3-11e4-4b4d-a83b-07454b9886a3 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63a21706-9341-4c84-bd33-29ec0f29fa3b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "PUT /compute/v2.1/servers/e8ad04c3-11e4-4b4d-a83b-07454b9886a3" status: 404 len: 111 microversion: 2.1 time: 0.034373 Nov 02 12:49:05.110852 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2631/5187] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:49:05 2022] PUT /compute/v2.1/servers/e8ad04c3-11e4-4b4d-a83b-07454b9886a3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:49:05.115904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:05.115904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:05.135603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:05.136118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:05.136647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:05.137334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:05.137799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:05.138311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:05.486103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:05.495685 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20f54ac8-13d9-400e-8338-e523ef6b2732 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.385497 Nov 02 12:49:05.496288 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2557/5188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:05 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:05.529295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:05.530302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:05.540624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:05.542110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:05.542892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:05.543917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:05.544624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:05.545333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:05.887002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:05.901525 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-474b054c-0bbd-4cec-af00-768bb17d6018 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.376494 Nov 02 12:49:05.908305 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2632/5189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:05 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:05.938161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-262782b8-d34e-461b-a089-7d242e9935b2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-262782b8-d34e-461b-a089-7d242e9935b2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: request: PUT /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b HTTP/1.1 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 280 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.944952 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:49:05.952156 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:05.960162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-262782b8-d34e-461b-a089-7d242e9935b2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:05.963508 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-262782b8-d34e-461b-a089-7d242e9935b2 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "PUT /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 400 len: 619 microversion: 2.1 time: 0.031735 Nov 02 12:49:05.966599 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2558/5190] 10.222.0.45 () {60 vars in 1257 bytes} [Wed Nov 2 12:49:05 2022] PUT /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:49:05.978447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:05.979341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:05.988182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:05.989545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:05.990356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:05.991398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:05.992076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:05.992708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.108284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:06.113203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:06.146796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.147528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.148103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.148949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.149454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.149862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.258410 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c381056-48c2-497e-81fa-fa8daa13cbdb tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158046 Nov 02 12:49:06.272634 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2559/5191] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:06 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:06.280666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:06.296415 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-61a11276-08d6-4f94-85ac-959e46ba1b4b tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.325012 Nov 02 12:49:06.302725 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2633/5192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:05 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:06.332943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:06.334204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:06.344090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.347324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.350564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.352807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.359817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.360679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.795952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:06.808234 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65c780db-18eb-4cbc-bd80-019d21080eac tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.479377 Nov 02 12:49:06.811134 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2560/5193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:06 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:06.844809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d7f43e5-b5d9-4a27-9b99-ace564685363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d7f43e5-b5d9-4a27-9b99-ace564685363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: request: PUT /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b HTTP/1.1 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 24 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": ""}} Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b', 'body': {'server': {'name': ''}}} Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi '' Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:49:06.852172 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:49:06.858071 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:06.867405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d7f43e5-b5d9-4a27-9b99-ace564685363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:06.872506 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d7f43e5-b5d9-4a27-9b99-ace564685363 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "PUT /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 400 len: 108 microversion: 2.1 time: 0.037311 Nov 02 12:49:06.873876 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2634/5194] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 12:49:06 2022] PUT /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:49:06.885279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:06.886647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:06.903910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.904858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.906601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.908535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.912294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.914116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:07.286566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:07.298299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:07.354553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:07.360698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:07.361500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:07.372558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:07.376025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:07.381157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:07.485686 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-54e7bb9b-e787-471e-b0eb-e065d641451b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205767 Nov 02 12:49:07.498214 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2635/5195] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:07 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:07.518479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:07.532948 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c137a6a-1055-4c4c-8243-c99e609d3475 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1505 microversion: 2.1 time: 0.654499 Nov 02 12:49:07.538289 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2561/5196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:06 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:08.508559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:08.510605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:08.556827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:08.558846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:08.559425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:08.562554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:08.563110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:08.564464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:08.680422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:08.683062 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64051345-934c-4321-b01f-dc871fb83340 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181760 Nov 02 12:49:08.700646 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2636/5197] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:08 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:09.696655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:09.699135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:09.726543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:09.728329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:09.728835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:09.734603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:09.735353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:09.736140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:09.790333 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:49:09.794276 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 12:49:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments (ip 10.222.0.45) !!! Nov 02 12:49:09.832361 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fad8e70c-0b20-4e15-b64d-e7e0ad3dd4d2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140353 Nov 02 12:49:09.838753 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2562/5198] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:09 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:10.847424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:10.850229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:10.866701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:10.867673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:10.868418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:10.869476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:10.870266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:10.870984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:10.914171 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69b27b82-2a97-492a-8e6f-fd773a6d8728 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072205 Nov 02 12:49:10.915327 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2637/5199] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:10 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:11.936405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:11.936405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:11.946235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:11.950684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:11.951532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:11.952471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:11.954340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:11.954998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:12.030495 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e4d50e2-4ab1-4310-8d43-b09a10f4dcaf tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106457 Nov 02 12:49:12.040955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2563/5200] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:11 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:13.049220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:13.051751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:13.070306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:13.071174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:13.071447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:13.072258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:13.072757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:13.073183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:13.150936 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02e138df-9ee6-47c0-91a5-2c4967089112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106072 Nov 02 12:49:13.162871 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2638/5201] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:13 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:14.165947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:14.169041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:14.187716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:14.188508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:14.189151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:14.190097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:14.192353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:14.198836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:14.263506 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e3785de-6892-42b0-aea7-f138b1e59cb5 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103033 Nov 02 12:49:14.264124 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2564/5202] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:14 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:15.279259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:15.284689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:15.312954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:15.314769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:15.316427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:15.319279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:15.321360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:15.323565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:15.384232 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b24f8298-613b-449d-a9a8-9504de8dd6fd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110591 Nov 02 12:49:15.386397 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2639/5203] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:49:15 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:49:15.466541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:15.467750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:15.476958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:15.477769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:15.478420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:15.479339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:15.480176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:15.481369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:15.515030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:49:15.626950 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6c83c222-747f-424c-8453-6a357c3c3a03 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 204 len: 0 microversion: 2.1 time: 0.164154 Nov 02 12:49:15.628274 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2565/5204] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:49:15 2022] DELETE /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:49:15.640913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:15.641727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:15.648542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:15.649044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:15.649707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:15.650469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:15.650928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:15.651574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:15.984136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:15.993318 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ca17c643-e5fb-48a3-90f6-df836f728f1e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1683 microversion: 2.1 time: 0.358890 Nov 02 12:49:15.993921 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2640/5205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:15 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1683 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:17.022123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:17.022962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:17.055084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.055595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.056055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.057291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.080549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.081881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.104119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:17.104781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:17.126217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.126655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.136327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.137428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.138112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.138833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.185298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:17.199960 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 HTTP/1.1 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '438595d5-1ffa-4c37-a45a-86ee201a1db1'} Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:49:17.208912 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.215398 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.219682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:17.225699 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c89be12b-a587-4967-add6-08904a591445 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "DELETE /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 404 len: 111 microversion: 2.1 time: 0.126785 Nov 02 12:49:17.228029 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2641/5206] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:49:17 2022] DELETE /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:49:17.242821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:17.248914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 438595d5-1ffa-4c37-a45a-86ee201a1db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:17.275743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.279473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.280865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.283672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.284485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.285139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.348148 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 HTTP/1.1 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '438595d5-1ffa-4c37-a45a-86ee201a1db1'} Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:17.354225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 438595d5-1ffa-4c37-a45a-86ee201a1db1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:17.360416 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-107a6786-675b-459a-90b9-ccf2dd4de7bf tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1" status: 404 len: 111 microversion: 2.1 time: 0.121989 Nov 02 12:49:17.362217 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2642/5207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:17 2022] GET /compute/v2.1/servers/438595d5-1ffa-4c37-a45a-86ee201a1db1 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:49:17.381694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:17.384972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:17.405669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.411958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.412718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.413662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.414960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.416041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.505287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:49:17.721045 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6068d6c2-ee2b-466d-be40-37a7945bf943 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "DELETE /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 204 len: 0 microversion: 2.1 time: 0.352235 Nov 02 12:49:17.725614 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2643/5208] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:49:17 2022] DELETE /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:49:17.740129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:17.744375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:17.753715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.754606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.755681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:17.756774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:17.757765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:17.758573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:18.203697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:18.222085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d7a42a0a-74d3-45c7-b348-49786ca3f971 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 0.489337 Nov 02 12:49:18.223587 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2644/5209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:17 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:18.264540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:18.280946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da4f3df1-b279-4c4a-9f43-2ab198fbc9cd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1683 microversion: 2.1 time: 1.264684 Nov 02 12:49:18.296637 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2566/5210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:17 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1683 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:19.276041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:19.277315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:19.300106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:19.301918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:19.302657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:19.303570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:19.304211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:19.304831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:19.323403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:19.325272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:19.355663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:19.356259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:19.356899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:19.357648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:19.358143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:19.365608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:19.671224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:19.685461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b589a1b-df31-4c25-850e-4485a3101034 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1683 microversion: 2.1 time: 0.374269 Nov 02 12:49:19.686871 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2567/5211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:19 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1683 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:19.907357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:19.922793 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-457de934-b04a-4ace-9d76-70fe8852c785 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 0.655560 Nov 02 12:49:19.928127 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2645/5212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:19 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:20.715723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:20.717202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:20.725423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:20.726334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:20.726951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:20.727927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:20.728564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:20.729163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:20.854578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:20.873431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a74a6d3b-45fc-4e48-aee4-e3186a86f117 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1616 microversion: 2.1 time: 0.160823 Nov 02 12:49:20.885060 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2568/5213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:20 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1616 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:20.969252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:20.970545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:20.987199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:20.989068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:20.989845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:20.990854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:20.991755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:20.992393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:21.284894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:21.295182 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c45b045-8d84-4fc0-a83b-1be45361f7be tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1511 microversion: 2.1 time: 0.335770 Nov 02 12:49:21.297558 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2646/5214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:20 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:21.903278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:21.904009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:21.912467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:21.913634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:21.914364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:21.926313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:21.926954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:21.927411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:22.019296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:22.028724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fefd2ef8-ab22-41a5-9695-af7423b573f0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1616 microversion: 2.1 time: 0.131265 Nov 02 12:49:22.029647 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2569/5215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:21 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1616 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:22.329203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:22.331278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:22.342208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:22.344475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:22.345128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:22.346129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:22.346798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:22.347412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:22.493167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-5176a611-772c-4600-bc2e-62c808bbccb0 req-d641623e-74fa-44fc-ab07-f17021de28d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69765fbb-916c-4ca2-81fd-8ceeccde7cb1", "name": "network-vif-deleted", "tag": "d953cfbe-13b1-40ef-b3d8-ad291007d677"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:22.512941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5176a611-772c-4600-bc2e-62c808bbccb0 req-d641623e-74fa-44fc-ab07-f17021de28d3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:22.513453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5176a611-772c-4600-bc2e-62c808bbccb0 req-d641623e-74fa-44fc-ab07-f17021de28d3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:22.513956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5176a611-772c-4600-bc2e-62c808bbccb0 req-d641623e-74fa-44fc-ab07-f17021de28d3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:22.536478 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-5176a611-772c-4600-bc2e-62c808bbccb0 req-d641623e-74fa-44fc-ab07-f17021de28d3 service nova] Creating event network-vif-deleted:d953cfbe-13b1-40ef-b3d8-ad291007d677 for instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 on n-h2-855650-5 Nov 02 12:49:22.549047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-5176a611-772c-4600-bc2e-62c808bbccb0 req-d641623e-74fa-44fc-ab07-f17021de28d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059918 Nov 02 12:49:22.552097 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2570/5216] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:49:22.615988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:22.635052 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a0f05a0-743f-49a3-aff4-67d58ccf994d tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1469 microversion: 2.1 time: 0.314965 Nov 02 12:49:22.635667 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2647/5217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:22 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1469 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:23.055805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:23.057126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:23.077928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:23.081600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:23.082964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:23.085695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:23.088180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:23.090988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:23.189433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:23.190110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:23.192123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:23.192816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lazy-loading 'fault' on Instance uuid 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:49:23.393873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:23.406763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f63aa917-e88d-43f0-b918-c13a2b3e576b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 200 len: 1332 microversion: 2.1 time: 0.357256 Nov 02 12:49:23.413128 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2571/5218] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:23 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 1332 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:23.660518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:23.661093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:23.668161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:23.668680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:23.689675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:23.690799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:23.694343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:23.696211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:23.822789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:23.824124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:23.824903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:23.830543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lazy-loading 'fault' on Instance uuid 38f9ad93-6e10-49ae-86ca-8dc87c6b301b {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:49:23.939810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c51571bab4abf88e5affcdfad2d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74689b473ca04e9199c55b3874096d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:23.954916 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a362fcc0-c44d-4370-95d9-415f84f05836 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 200 len: 1306 microversion: 2.1 time: 0.298274 Nov 02 12:49:23.958112 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2648/5219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:23 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 1306 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:24.442244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:24.443703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:24.459567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:24.461005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:24.461819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:24.466498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:24.467208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:24.467824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:24.510838 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 HTTP/1.1 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '69765fbb-916c-4ca2-81fd-8ceeccde7cb1'} Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:24.512882 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:24.517832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:24.517832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:24.517832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:24.517832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:24.517832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:24.517832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:49:24.517832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:24.525267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:24.526456 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fbbdb48c-678e-4145-9cda-cd7732f644d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 404 len: 111 microversion: 2.1 time: 0.091272 Nov 02 12:49:24.527572 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2572/5220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:24 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:49:24.537752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ebe3dce-2bd9-49c7-9504-b39740d13cda tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '.version_select at 0x7f228e8c2040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:24.584339 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:49:24.585800 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 12:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-2129407573 (ip 10.222.0.45) !!! Nov 02 12:49:24.612225 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ebe3dce-2bd9-49c7-9504-b39740d13cda tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129407573" status: 202 len: 0 microversion: 2.1 time: 0.079173 Nov 02 12:49:24.613310 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2649/5221] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:49:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129407573 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:49:24.980671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:24.981529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] [instance: 38f9ad93-6e10-49ae-86ca-8dc87c6b301b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:24.995070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:24.995706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:25.001007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:25.002243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:25.002843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:25.003489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:25.037783 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] HTTP exception thrown: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b could not be found. Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Request method failure captured: Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b HTTP/1.1 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmYtHH2UnS57X9T4CbyV20nJzzSNGWEglBKqN_xFc1wqnkI_8HlzTAWEj13YVY7Kr90KiQtOsioH9e4i4AJwkdjQuvt9CF8n7O5r3RYast5-U0xONqCOfZ3pEBCmb_2x875Rph4ybGS8GJ4Le1rt65xIAlO92X6bErbdA6QIk6LyATc Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74689b473ca04e9199c55b3874096d40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74689b473ca04e9199c55b3874096d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74689b473ca04e9199c55b3874096d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 74689b473ca04e9199c55b3874096d40 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1509311516 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d76c51571bab4abf88e5affcdfad2d34 Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1509311516-project Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b could not be found. Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '38f9ad93-6e10-49ae-86ca-8dc87c6b301b'} Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b could not be found. Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b could not be found. Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:25.042723 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:25.049208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:25.049208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:25.049208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:25.049208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:25.049208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:25.049208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b could not be found. Nov 02 12:49:25.049208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:49:25.052370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] Returning 404 to user: Instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:25.056491 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02e1e3a2-24a9-4047-8ae8-ea956ecd8b72 tempest-ServersNegativeTestJSON-1509311516 tempest-ServersNegativeTestJSON-1509311516-project] 10.222.0.45 "GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b" status: 404 len: 111 microversion: 2.1 time: 0.080056 Nov 02 12:49:25.057626 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2573/5222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:24 2022] GET /compute/v2.1/servers/38f9ad93-6e10-49ae-86ca-8dc87c6b301b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:49:25.127843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7d945d7e-ab4d-4b5d-b879-c0ff0a92e18d req-3554480e-af9a-4d77-a2ce-2100ed5e6fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f9ad93-6e10-49ae-86ca-8dc87c6b301b", "name": "network-vif-deleted", "tag": "75616d16-546a-49d9-aa00-26848131158f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:25.147750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7d945d7e-ab4d-4b5d-b879-c0ff0a92e18d req-3554480e-af9a-4d77-a2ce-2100ed5e6fa2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:25.148243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7d945d7e-ab4d-4b5d-b879-c0ff0a92e18d req-3554480e-af9a-4d77-a2ce-2100ed5e6fa2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:25.148683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7d945d7e-ab4d-4b5d-b879-c0ff0a92e18d req-3554480e-af9a-4d77-a2ce-2100ed5e6fa2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:25.181222 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7d945d7e-ab4d-4b5d-b879-c0ff0a92e18d req-3554480e-af9a-4d77-a2ce-2100ed5e6fa2 service nova] Creating event network-vif-deleted:75616d16-546a-49d9-aa00-26848131158f for instance 38f9ad93-6e10-49ae-86ca-8dc87c6b301b on n-h1-855650-5 Nov 02 12:49:25.192503 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7d945d7e-ab4d-4b5d-b879-c0ff0a92e18d req-3554480e-af9a-4d77-a2ce-2100ed5e6fa2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069716 Nov 02 12:49:25.196767 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2650/5223] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:27.926068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:27.926966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:27.945120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:27.945640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:27.950779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:27.953452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:27.957858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:27.958602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:28.886693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:28.903385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:28.910400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:28.914887 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-13220516-6cf9-4adc-826f-30dc1a8dced5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2953 microversion: 2.42 time: 0.993193 Nov 02 12:49:28.916584 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2574/5224] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:49:27 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2953 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:49:28.952346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:28.956763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:28.978131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:28.985834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:28.994734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:29.002710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:29.003376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:29.004466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:29.520325 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-862fb5df-e53e-4f3b-af3c-b7fb5505e1c7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.574060 Nov 02 12:49:29.521489 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2651/5225] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Nov 2 12:49:28 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819/os-interface => generated 1831 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:49:30.944313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fcedc37b-a1e5-4e5d-b415-5d81b4421dd9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: .version_select at 0x7f228ebfa9d0>, body: {"keypair": {"name": "tempest-keypair-492633949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBizVs3vO+daDdhLLuYT+aVToYCGoFp1LVTcCyyzZt3b37PlwP8PuONbSllbvYnnAZpAOZq15Kde2FUAHTp7DVmymreO6Nkq/C8q4xHDp7O2cCYOnd+xqdciIv3jLA7+g=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:30.984768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fcedc37b-a1e5-4e5d-b415-5d81b4421dd9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:49:30.997883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fcedc37b-a1e5-4e5d-b415-5d81b4421dd9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for user be15916efb09427eb892d0104e3db5ff and project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:49:31.082537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fcedc37b-a1e5-4e5d-b415-5d81b4421dd9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144376 Nov 02 12:49:31.083510 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2575/5226] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:49:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:37.892536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1643642814", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92a568cc-930f-412f-9bc6-cc5b26f3a471"}], "security_groups": [{"name": "tempest-securitygroup--1234769224"}], "key_name": "tempest-keypair-492633949", "user_data": "}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:37.907226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:38.325730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] validate_networks() for [('92a568cc-930f-412f-9bc6-cc5b26f3a471', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:49:39.055340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:40.180531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:49:40.184284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:49:40.187109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:49:40.188137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:49:40.188663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:49:40.199471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:40.200348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:40.200956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:40.202464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:40.203356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:40.204155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:40.234107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:49:40.248354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Getting quotas for user be15916efb09427eb892d0104e3db5ff and project 729f04bcc75843d6beb94e3679bff2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:49:40.265553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:49:40.269775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:49:40.342840 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bfe701ea-41be-4973-aa98-384648c8781d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.458303 Nov 02 12:49:40.344557 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2652/5227] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:49:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:49:40.362557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-865de739-97ff-4712-8437-739bcc2c3358 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:40.363747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-865de739-97ff-4712-8437-739bcc2c3358 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:40.367048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=42 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:40.368250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:40.407791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:40.408424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:40.421614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:40.422414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:40.422583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:40.423290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:40.423999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:40.426499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:40.563577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-865de739-97ff-4712-8437-739bcc2c3358 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:40.577953 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-865de739-97ff-4712-8437-739bcc2c3358 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1241 microversion: 2.1 time: 0.222016 Nov 02 12:49:40.578581 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2576/5228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:40 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1241 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:41.161872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:41.181948 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-873f6218-434e-4bcc-af33-1199341ada0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.777871 Nov 02 12:49:41.183043 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2653/5229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:40 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:41.211984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:41.212670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:41.232042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:41.235514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:41.236002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:41.236775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:41.239335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:41.242040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:41.608937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:41.609768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:41.622725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:41.622922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:41.629594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:41.630704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:41.636138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:41.636745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:41.886624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:41.903749 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f051dd7e-142a-4196-87fc-724c73e0dedd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1293 microversion: 2.1 time: 0.298352 Nov 02 12:49:41.906146 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2654/5230] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:41 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1293 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:41.990116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:42.006082 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90fc00df-0de8-4d7d-8796-e0f28ec9242d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.797559 Nov 02 12:49:42.012962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2577/5231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:41 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:42.040743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:42.041388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:42.057572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:42.058125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:42.058585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:42.059325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:42.061570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:42.062124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:42.933317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:42.933955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:42.953855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:42.954418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:42.954872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:42.955602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:42.956073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:42.956587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:43.137879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:43.142258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:43.155112 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cbe8831c-14f7-4f99-95ca-bcf4d0ef75e0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.121139 Nov 02 12:49:43.156144 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c018705-80a3-4ff3-81af-df9d6c303e38 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1299 microversion: 2.1 time: 0.229023 Nov 02 12:49:43.169994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2578/5232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:42 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:43.172831 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2655/5233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:42 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:43.189423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2017814283"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:43.193378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:43.200726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:43.201305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:43.202537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:43.203413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:43.204133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:43.204689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:43.526477 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01b75514-16dc-4281-9241-d0e92dce4c30 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.345225 Nov 02 12:49:43.529330 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2579/5234] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:49:43 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 12:49:44.181875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:44.183181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:44.200125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:44.200963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:44.201792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:44.204895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:44.206054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:44.207926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:44.427228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:44.445196 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2f2dd9d2-b8bb-4994-b260-f9097a8252b0 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1299 microversion: 2.1 time: 0.267195 Nov 02 12:49:44.464708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2656/5235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:44 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1299 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:45.470486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:45.471227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:45.501279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:45.501810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:45.508449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:45.509287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:45.509994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:45.510251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:46.124570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:46.142921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-61f4379f-f1d7-4b9e-8ae1-97f080d9a58b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 0.674261 Nov 02 12:49:46.144463 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2580/5236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:45 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:47.172302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:47.173005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:47.185353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:47.191153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:47.191981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:47.192821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:47.193379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:47.193910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:47.460479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:47.470651 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b9ebb252-d587-4b4d-a91c-9576372817c9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 0.302828 Nov 02 12:49:47.471501 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2657/5237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:47 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:48.501632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:48.503297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:48.527282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:48.529141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:48.529656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:48.532805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:48.533317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:48.538738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:49.571001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7c54c39c-5cc6-4a60-8768-4df9379f63c5 req-a753b374-8b08-4c6b-a7d2-aa0f0cc4a44e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e632eace-df7e-4848-8b7f-584fd66859a8", "tag": "5cd4b237-744c-4737-9ae2-0ff3f31c60e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:49.582305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7c54c39c-5cc6-4a60-8768-4df9379f63c5 req-a753b374-8b08-4c6b-a7d2-aa0f0cc4a44e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:49.582818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7c54c39c-5cc6-4a60-8768-4df9379f63c5 req-a753b374-8b08-4c6b-a7d2-aa0f0cc4a44e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:49.583243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7c54c39c-5cc6-4a60-8768-4df9379f63c5 req-a753b374-8b08-4c6b-a7d2-aa0f0cc4a44e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:49.612261 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7c54c39c-5cc6-4a60-8768-4df9379f63c5 req-a753b374-8b08-4c6b-a7d2-aa0f0cc4a44e service nova] Creating event network-changed:5cd4b237-744c-4737-9ae2-0ff3f31c60e2 for instance e632eace-df7e-4848-8b7f-584fd66859a8 on n-h2-855650-5 Nov 02 12:49:49.622853 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7c54c39c-5cc6-4a60-8768-4df9379f63c5 req-a753b374-8b08-4c6b-a7d2-aa0f0cc4a44e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056323 Nov 02 12:49:49.624362 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2658/5238] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:49.796055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:49.820874 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-58824445-55b9-43c3-be1b-81628afd9c3d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 1.326307 Nov 02 12:49:49.830732 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2581/5239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:48 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:50.860752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:50.862337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:50.865042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:50.870195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:50.907432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:50.914683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:50.915416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:50.916464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:50.917090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:50.917701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:51.390996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:51.399971 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2dd5318f-d099-4eaf-9259-edc7a2c30b9f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 0.543669 Nov 02 12:49:51.403809 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2659/5240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:50 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:52.427627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:52.428324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:52.431340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:52.447375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:52.447881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:52.448303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:52.449254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:52.449883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:52.450335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:52.619699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:52.639636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9cf6bee3-4f13-4a45-8b81-cd69ef551c8a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 0.215389 Nov 02 12:49:52.641627 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2582/5241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:52 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:52.995672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1b23c0cb-b720-42d6-9a47-5851c6c3c8ac req-d7da35f5-4365-46a6-8d74-f0ab15a3b2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "name": "network-vif-plugged", "status": "completed", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:53.013021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1b23c0cb-b720-42d6-9a47-5851c6c3c8ac req-d7da35f5-4365-46a6-8d74-f0ab15a3b2a8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:53.013785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1b23c0cb-b720-42d6-9a47-5851c6c3c8ac req-d7da35f5-4365-46a6-8d74-f0ab15a3b2a8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:53.015071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1b23c0cb-b720-42d6-9a47-5851c6c3c8ac req-d7da35f5-4365-46a6-8d74-f0ab15a3b2a8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:53.036803 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1b23c0cb-b720-42d6-9a47-5851c6c3c8ac req-d7da35f5-4365-46a6-8d74-f0ab15a3b2a8 service nova] Creating event network-vif-plugged:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:49:53.046117 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1b23c0cb-b720-42d6-9a47-5851c6c3c8ac req-d7da35f5-4365-46a6-8d74-f0ab15a3b2a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056297 Nov 02 12:49:53.048863 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2660/5242] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:53.667504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:53.668167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:53.676288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:53.677152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:53.677775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:53.679425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:53.680195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:53.680847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:53.958743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:53.969039 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fd8dfdd-b69c-4c9c-869d-fe5cf9a8c8dd tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 0.308151 Nov 02 12:49:53.969923 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2583/5243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:53 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:54.998980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:55.000380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:55.009882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:55.011507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:55.012619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:55.013906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:55.014854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:55.015545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:55.510808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:55.536491 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f6d75fae-48e2-4a6e-8440-f360650f8091 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 0.539919 Nov 02 12:49:55.537518 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2661/5244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:54 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:56.593725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:56.594395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:56.610907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:56.611863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:56.612574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:56.618760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:56.620451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:56.621062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:57.553875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:57.591570 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-685aab40-f570-42c4-95ef-763638fdee0a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 1.003611 Nov 02 12:49:57.595237 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2584/5245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:56 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:58.621224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:58.622788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:58.637077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:58.649295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:58.663651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:58.673291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:58.674513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:58.680565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:59.402293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:59.420892 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2cd77069-ffbf-4ad5-b7ac-0fff5245dcf2 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 0.804234 Nov 02 12:49:59.432059 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2662/5246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:58 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:00.458345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:00.459795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:00.471220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:00.476903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:00.477794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:00.484193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:00.485487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:00.487854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:01.563501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7b881244-a808-44cc-8ad9-41549ec1084b req-5511f6ab-087f-40a3-82ae-445f9069fb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e632eace-df7e-4848-8b7f-584fd66859a8", "name": "network-vif-plugged", "status": "completed", "tag": "5cd4b237-744c-4737-9ae2-0ff3f31c60e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:01.613436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7b881244-a808-44cc-8ad9-41549ec1084b req-5511f6ab-087f-40a3-82ae-445f9069fb7e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:01.622427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7b881244-a808-44cc-8ad9-41549ec1084b req-5511f6ab-087f-40a3-82ae-445f9069fb7e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:01.623131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7b881244-a808-44cc-8ad9-41549ec1084b req-5511f6ab-087f-40a3-82ae-445f9069fb7e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:01.656054 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7b881244-a808-44cc-8ad9-41549ec1084b req-5511f6ab-087f-40a3-82ae-445f9069fb7e service nova] Creating event network-vif-plugged:5cd4b237-744c-4737-9ae2-0ff3f31c60e2 for instance e632eace-df7e-4848-8b7f-584fd66859a8 on n-h2-855650-5 Nov 02 12:50:01.668298 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7b881244-a808-44cc-8ad9-41549ec1084b req-5511f6ab-087f-40a3-82ae-445f9069fb7e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112469 Nov 02 12:50:01.675255 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2663/5247] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:01.939082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:01.955448 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17a4d147-d522-40ee-b606-e77fb21f518a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 1.502318 Nov 02 12:50:01.971924 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2585/5248] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:00 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:03.001310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:03.002427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:03.052781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:03.060484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:03.064709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:03.070347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:03.074189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:03.084665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:04.142868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:04.171641 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5f79f04-2f93-4aca-a255-b6a7cac00fcc tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1367 microversion: 2.1 time: 1.180248 Nov 02 12:50:04.177746 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2664/5249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:02 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1367 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:05.236690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:05.237347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:05.266561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:05.276369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:05.276854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:05.285269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:05.287270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:05.287992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:06.478410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7da93db4-d6bd-4845-9bce-3e7a077f6bb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'create', calling method: .version_select at 0x7f228e12adc0>, body: {"keypair": {"name": "tempest-keypair-878360556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh/JI9swVPYoA2Fl22tFt67MJwO6bHhEvlRJbsTVgiDajLK1Bc7MNgL0AMuwQGudhU6tM44m64lYNhWi2Q1goELTVxVsmNtLQ1FiO1ngWz8B0xsj2cumZcCRJdg+h8i0w=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:06.553778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7da93db4-d6bd-4845-9bce-3e7a077f6bb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Getting quotas for project d1efa37c130b4c5e9403e55baab92ae9. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:50:06.575751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7da93db4-d6bd-4845-9bce-3e7a077f6bb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Getting quotas for user 01eeb1d7c0c64c11a84c57906221efb2 and project d1efa37c130b4c5e9403e55baab92ae9. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:50:06.646059 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7da93db4-d6bd-4845-9bce-3e7a077f6bb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.728154 Nov 02 12:50:06.647220 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2665/5250] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:50:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:06.808918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:06.836391 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a6f21f63-65be-4dea-a91d-deeb745a9d08 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1557 microversion: 2.1 time: 1.621154 Nov 02 12:50:06.866002 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2586/5251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:05 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1557 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:06.884894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:06.885431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:06.910662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:06.916537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:06.922309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:06.928571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:06.929636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:06.932424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:07.452039 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd79dd47-f19d-41a7-98ad-8c02bad7150e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.573133 Nov 02 12:50:07.462059 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2666/5252] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:50:06 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-interface => generated 284 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:08.545760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1612924180", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1bd60dac-d138-4e97-ac31-06294bd3bb1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c2de958-5bb8-43d5-9f50-0267f3814230"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:08.846077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] validate_networks() for [('5c2de958-5bb8-43d5-9f50-0267f3814230', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:10.989917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:50:10.991181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:50:10.992144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:50:10.992580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:50:10.993862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:50:11.002249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=26 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:11.024975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:11.025513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:11.031144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:11.032278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:11.032783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:11.033242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:11.076735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:11.128551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:50:11.167328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for user 15b6ee9295464444a626601b16db2574 and project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:50:11.410585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:50:11.414392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bd60dac-d138-4e97-ac31-06294bd3bb1a',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:50:11.939636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b36ac1b-fcd6-4f92-a789-bf7f526d6ed5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.403967 Nov 02 12:50:11.942351 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2587/5253] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:50:11.962368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed001373-5fb4-4e4c-9c10-22b9ec8f61d2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:11.963140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ed001373-5fb4-4e4c-9c10-22b9ec8f61d2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:11.996694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:12.366198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ed001373-5fb4-4e4c-9c10-22b9ec8f61d2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:12.404613 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ed001373-5fb4-4e4c-9c10-22b9ec8f61d2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1057 microversion: 2.1 time: 0.448651 Nov 02 12:50:12.419706 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2667/5254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:11 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1057 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:13.451034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f142ab6-ac08-4cbc-950d-fe374b5d6362 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:13.454663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0f142ab6-ac08-4cbc-950d-fe374b5d6362 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:13.807632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0f142ab6-ac08-4cbc-950d-fe374b5d6362 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:13.826333 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f142ab6-ac08-4cbc-950d-fe374b5d6362 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1057 microversion: 2.1 time: 0.372126 Nov 02 12:50:13.830476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2588/5255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:13 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1057 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:14.888281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:14.912372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:14.962685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1376732716", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c60a69a5-c164-49ab-b0c6-382a4af9e62a"}], "security_groups": [{"name": "tempest-securitygroup--397007226"}], "key_name": "tempest-keypair-878360556", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:14.969213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:14.970839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:14.970839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:14.972148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:14.972834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:14.973557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:15.044491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=67 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:15.621929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:15.657999 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ffb6229-ee2c-4199-8ae4-ed5494a58d4d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1099 microversion: 2.1 time: 0.783729 Nov 02 12:50:15.693377 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2668/5256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:14 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1099 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:15.726667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-31b04e8f-9f53-489f-8801-58c3ffaadf5d req-da3a9c15-698c-4c04-b83c-d64c1550c830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e632eace-df7e-4848-8b7f-584fd66859a8", "tag": "5cd4b237-744c-4737-9ae2-0ff3f31c60e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:15.765561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-31b04e8f-9f53-489f-8801-58c3ffaadf5d req-da3a9c15-698c-4c04-b83c-d64c1550c830 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:15.770650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-31b04e8f-9f53-489f-8801-58c3ffaadf5d req-da3a9c15-698c-4c04-b83c-d64c1550c830 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:15.771448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-31b04e8f-9f53-489f-8801-58c3ffaadf5d req-da3a9c15-698c-4c04-b83c-d64c1550c830 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:15.800383 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-31b04e8f-9f53-489f-8801-58c3ffaadf5d req-da3a9c15-698c-4c04-b83c-d64c1550c830 service nova] Creating event network-changed:5cd4b237-744c-4737-9ae2-0ff3f31c60e2 for instance e632eace-df7e-4848-8b7f-584fd66859a8 on n-h2-855650-5 Nov 02 12:50:15.812834 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-31b04e8f-9f53-489f-8801-58c3ffaadf5d req-da3a9c15-698c-4c04-b83c-d64c1550c830 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117235 Nov 02 12:50:15.821061 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2669/5257] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:15.842976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] validate_networks() for [('c60a69a5-c164-49ab-b0c6-382a4af9e62a', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:16.713878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:16.716180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:16.734612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:16.736147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:16.737789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:16.739479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:16.741162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:16.742259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:16.950669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:16.968975 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2e91d33-a0b6-4573-b881-c35d7f589d9e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1173 microversion: 2.1 time: 0.263686 Nov 02 12:50:16.988555 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2670/5258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:16 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1173 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:17.841785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:50:17.842292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:50:17.842724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:50:17.843145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:50:17.843821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:50:17.877087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:17.878233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:17.878762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:17.882308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:17.883041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:17.883692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:17.939940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Getting quotas for project d1efa37c130b4c5e9403e55baab92ae9. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:50:17.947255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Getting quotas for user 01eeb1d7c0c64c11a84c57906221efb2 and project d1efa37c130b4c5e9403e55baab92ae9. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:50:17.991919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:50:17.995239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:50:18.018130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:18.020823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:18.099806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:18.101346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:18.101815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:18.109195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:18.109706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:18.110200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:18.162017 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-affe1a9a-f972-425b-bc21-0a84d980ec0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.206149 Nov 02 12:50:18.174376 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2589/5259] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:50:18.199249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57b1f3e4-630c-40d6-87a3-a86a8d36dd7f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:18.199884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-57b1f3e4-630c-40d6-87a3-a86a8d36dd7f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:18.516291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-57b1f3e4-630c-40d6-87a3-a86a8d36dd7f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:18.533327 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-57b1f3e4-630c-40d6-87a3-a86a8d36dd7f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1237 microversion: 2.1 time: 0.356977 Nov 02 12:50:18.558006 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2590/5260] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:18 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1237 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:18.675156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:18.737538 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ddf7f0f1-dc94-4ece-8514-6be0538adeb2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1173 microversion: 2.1 time: 0.727345 Nov 02 12:50:18.748054 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2671/5261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:18 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1173 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:19.581167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-201b913e-11f4-4a54-8f1e-035dd2cd25b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:19.581791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-201b913e-11f4-4a54-8f1e-035dd2cd25b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:19.796028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:19.800115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:19.838475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:19.839077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:19.842100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:19.845078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:19.867327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:19.867951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:21.008019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:21.020436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-201b913e-11f4-4a54-8f1e-035dd2cd25b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:21.022290 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-154db61d-b620-420b-9fbf-78c658d1c89b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1173 microversion: 2.1 time: 1.239955 Nov 02 12:50:21.025213 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2672/5262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:19 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1173 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:21.028708 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-201b913e-11f4-4a54-8f1e-035dd2cd25b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1237 microversion: 2.1 time: 1.452301 Nov 02 12:50:21.067714 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2591/5263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:19 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1237 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:22.062304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:22.063909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:22.065750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:22.066116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:22.074476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:22.075386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:22.076052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:22.077811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:22.079602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:22.080362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:22.122930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:22.130389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:22.131336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:22.134982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:22.137158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:22.139018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:22.188107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:22.197310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-311000b9-794f-40be-b9ac-91f084bc90de tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1295 microversion: 2.1 time: 0.145182 Nov 02 12:50:22.197924 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2592/5264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:22 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:22.344152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:22.355664 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c284ecda-2c58-4612-a355-7d8edb4fa22c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1173 microversion: 2.1 time: 0.306521 Nov 02 12:50:22.357879 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2673/5265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:22 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1173 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:23.221136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:23.222463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:23.246537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:23.261943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:23.264576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:23.266221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:23.271790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:23.272521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:23.383452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:23.385599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:23.388760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:23.436835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:23.438125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:23.444031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:23.448399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:23.457730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:23.462368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:24.293365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:24.315657 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b428540-ac3e-481c-a13b-29b14f2bbf0c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1362 microversion: 2.1 time: 1.092930 Nov 02 12:50:24.316402 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2593/5266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:23 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1362 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:24.405830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:24.420272 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c0608d45-5bd6-4a13-a8f6-2b79755b7b53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1215 microversion: 2.1 time: 1.041232 Nov 02 12:50:24.429750 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2674/5267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:23 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1215 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:25.343089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:25.343732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:25.365124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:25.365642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:25.366156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:25.366902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:25.367437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:25.367897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:25.452288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:25.453009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:25.472026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:25.475426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:25.476035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:25.480075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:25.483773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:25.486142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:26.301185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:26.338864 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f27952ea-7ac4-4549-b8d8-c227602958d1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1215 microversion: 2.1 time: 0.890404 Nov 02 12:50:26.340166 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2675/5268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:25 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1215 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:26.345245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-506848d4-cd73-42fb-9554-38049f646536 req-73429edd-fe33-4fbf-9cf8-ee7360de9a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6b5ad4-9ed7-469c-bd63-c9be03c4002d", "tag": "0bfaa540-12f1-48b5-ae5f-191236fda2d1"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:26.372670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-506848d4-cd73-42fb-9554-38049f646536 req-73429edd-fe33-4fbf-9cf8-ee7360de9a34 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:26.378270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:26.393958 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25cc8b52-8279-445f-9e54-6b2db2103f7c tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1362 microversion: 2.1 time: 1.054931 Nov 02 12:50:26.394420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-506848d4-cd73-42fb-9554-38049f646536 req-73429edd-fe33-4fbf-9cf8-ee7360de9a34 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:26.396379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-506848d4-cd73-42fb-9554-38049f646536 req-73429edd-fe33-4fbf-9cf8-ee7360de9a34 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:26.405260 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2594/5269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:25 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1362 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:26.425353 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-506848d4-cd73-42fb-9554-38049f646536 req-73429edd-fe33-4fbf-9cf8-ee7360de9a34 service nova] Creating event network-changed:0bfaa540-12f1-48b5-ae5f-191236fda2d1 for instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d on n-h2-855650-5 Nov 02 12:50:26.451530 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-506848d4-cd73-42fb-9554-38049f646536 req-73429edd-fe33-4fbf-9cf8-ee7360de9a34 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109822 Nov 02 12:50:26.461626 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2676/5270] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:27.365562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:27.366762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:27.386185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:27.389266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:27.390030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:27.392297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:27.397406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:27.399329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:27.432571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:27.434069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:27.449650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:27.457126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:27.459690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:27.461330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:27.467324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:27.472267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:27.916587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:28.285870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:28.287931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:28.297319 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f04b7e7-abf6-45fc-bb99-cada77ba0adb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1215 microversion: 2.1 time: 0.937774 Nov 02 12:50:28.297923 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2595/5271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:27 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1215 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:28.312615 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-43883d7d-3975-4736-85c6-5cfec5498d44 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1362 microversion: 2.1 time: 0.884487 Nov 02 12:50:28.351402 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2677/5272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:27 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1362 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:28.683595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9418490a-0fc1-49fa-932d-4eb8a4383c10 req-607cb1f1-4cb1-4b00-9d8d-6f0e95dcbcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4025b3f8-7d8a-4314-b405-8eae0c7226bb", "tag": "23cbc681-0665-4e49-b7d6-42128afeadcf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:28.701328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9418490a-0fc1-49fa-932d-4eb8a4383c10 req-607cb1f1-4cb1-4b00-9d8d-6f0e95dcbcb9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:28.705914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9418490a-0fc1-49fa-932d-4eb8a4383c10 req-607cb1f1-4cb1-4b00-9d8d-6f0e95dcbcb9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:28.707946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9418490a-0fc1-49fa-932d-4eb8a4383c10 req-607cb1f1-4cb1-4b00-9d8d-6f0e95dcbcb9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:28.729394 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9418490a-0fc1-49fa-932d-4eb8a4383c10 req-607cb1f1-4cb1-4b00-9d8d-6f0e95dcbcb9 service nova] Creating event network-changed:23cbc681-0665-4e49-b7d6-42128afeadcf for instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb on n-h1-855650-5 Nov 02 12:50:28.736421 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9418490a-0fc1-49fa-932d-4eb8a4383c10 req-607cb1f1-4cb1-4b00-9d8d-6f0e95dcbcb9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.430301 Nov 02 12:50:28.738981 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2596/5273] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:29.329037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:29.331277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:29.349720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:29.351743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:29.352006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:29.352295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:29.356458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:29.357268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:29.358018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:29.358601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:29.372011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:29.372509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:29.372817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:29.380062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:29.380733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:29.381841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:29.936800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:29.947051 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ee61a7ad-5c6e-4303-b2d7-e7f10f2cfcbd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.623139 Nov 02 12:50:29.947691 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2678/5274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:29 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:29.958329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:29.972130 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31be048c-667a-4a71-9b8a-a9afeb30ee6e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1362 microversion: 2.1 time: 0.626710 Nov 02 12:50:29.974263 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2597/5275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:29 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1362 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:30.982867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:30.986315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:31.030832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:31.036320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:31.039789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:31.041235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:31.044041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:31.046727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:31.048183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:31.052937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:31.056097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=18 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:31.072883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:31.076812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:31.079046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:31.081396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:31.085097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:31.088747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:31.741512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:31.758308 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a15891ca-48be-412f-8845-302a97614779 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1362 microversion: 2.1 time: 0.760219 Nov 02 12:50:31.761451 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2598/5276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:30 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1362 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:31.808909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:31.835250 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-11c46f0e-c979-44d4-9032-2a089f82b41c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.860739 Nov 02 12:50:31.838582 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2679/5277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:30 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:32.803004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:32.803828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:32.818389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:32.818924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:32.819587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:32.820805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:32.821776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:32.822668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:32.882175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:32.888047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:32.904096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:32.904972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:32.905954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:32.907792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:32.909073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:32.909803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:33.107635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:33.117687 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cba02a3a-668f-4ebe-9f4a-47b7a4e1e593 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1362 microversion: 2.1 time: 0.321804 Nov 02 12:50:33.129766 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2599/5278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:32 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:33.188060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:33.209555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2441ec95-8246-4687-92df-0048973ca400 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.344869 Nov 02 12:50:33.214109 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2680/5279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:32 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:33.645813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7655ebc7-e9af-49e7-a14e-0c9d034d9583 req-9e4ba216-7be7-424c-9704-d735df22d16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6b5ad4-9ed7-469c-bd63-c9be03c4002d", "name": "network-vif-plugged", "status": "completed", "tag": "0bfaa540-12f1-48b5-ae5f-191236fda2d1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:33.661889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7655ebc7-e9af-49e7-a14e-0c9d034d9583 req-9e4ba216-7be7-424c-9704-d735df22d16b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:33.662716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7655ebc7-e9af-49e7-a14e-0c9d034d9583 req-9e4ba216-7be7-424c-9704-d735df22d16b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:33.663384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7655ebc7-e9af-49e7-a14e-0c9d034d9583 req-9e4ba216-7be7-424c-9704-d735df22d16b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:33.681845 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7655ebc7-e9af-49e7-a14e-0c9d034d9583 req-9e4ba216-7be7-424c-9704-d735df22d16b service nova] Creating event network-vif-plugged:0bfaa540-12f1-48b5-ae5f-191236fda2d1 for instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d on n-h2-855650-5 Nov 02 12:50:33.695362 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7655ebc7-e9af-49e7-a14e-0c9d034d9583 req-9e4ba216-7be7-424c-9704-d735df22d16b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330747 Nov 02 12:50:33.702968 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2600/5280] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:33.739606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:33.740432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:33.753761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:33.754313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:33.754761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:33.755497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:33.760382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:33.760948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:34.157659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:34.160533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:34.170069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:34.172892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:34.173821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:34.175662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:34.176768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:34.177521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:34.280587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:34.298768 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-505f7387-5959-4904-9292-339e995a8d46 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.564133 Nov 02 12:50:34.300853 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2681/5281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:33 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:34.314928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:34.315924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:34.323368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:34.324322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:34.325099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:34.326704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:34.327649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:34.328358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:34.966794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:34.976449 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-510e183e-fc23-47eb-9cf9-b9dd41cb1f8f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1362 microversion: 2.1 time: 0.824123 Nov 02 12:50:34.977812 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2601/5282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:34 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1362 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:34.983313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1657712996"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:34.985838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:34.993608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:34.994145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:34.994590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:34.995309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:34.995881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:34.996448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:35.053661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:35.077231 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-458532ea-6635-4788-8c52-c2d4aa13c401 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.773707 Nov 02 12:50:35.078489 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2682/5283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:34 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:35.244788 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1fe7194-93bb-4e0d-be58-8c43aa26a722 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.264735 Nov 02 12:50:35.246535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2602/5284] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:50:34 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 12:50:36.005204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:36.006940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:36.015915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:36.016634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:36.017262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:36.019112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:36.021313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:36.021675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:36.111191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:36.112114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:36.119240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:36.119834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:36.120354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:36.121345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:36.121878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:36.122571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:36.365053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:36.382792 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2f554f8c-9770-4d13-a2e4-76eff0241705 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1362 microversion: 2.1 time: 0.382478 Nov 02 12:50:36.383445 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2683/5285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:35 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:36.423433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:36.433577 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7a38b334-b28c-48ed-a81c-ac55f453cb9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.328870 Nov 02 12:50:36.435497 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2603/5286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:36 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:37.269141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-809261c2-254d-42ae-8ed1-b1e5fec205b1 req-a229ae87-4de7-4b8e-a6b2-ebd27cbda5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "name": "network-vif-unplugged", "status": "completed", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:37.294828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-809261c2-254d-42ae-8ed1-b1e5fec205b1 req-a229ae87-4de7-4b8e-a6b2-ebd27cbda5ce service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.295658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-809261c2-254d-42ae-8ed1-b1e5fec205b1 req-a229ae87-4de7-4b8e-a6b2-ebd27cbda5ce service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.296274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-809261c2-254d-42ae-8ed1-b1e5fec205b1 req-a229ae87-4de7-4b8e-a6b2-ebd27cbda5ce service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.315739 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-809261c2-254d-42ae-8ed1-b1e5fec205b1 req-a229ae87-4de7-4b8e-a6b2-ebd27cbda5ce service nova] Creating event network-vif-unplugged:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:50:37.327365 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-809261c2-254d-42ae-8ed1-b1e5fec205b1 req-a229ae87-4de7-4b8e-a6b2-ebd27cbda5ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062535 Nov 02 12:50:37.328761 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2684/5287] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:37.407974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:37.409143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:37.419306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.419810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.420264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.420991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.421453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.424045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.472329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:37.473901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:37.525189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.528537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.536677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.539471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.542883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.547065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.740772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:37.750429 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39f52c2b-a128-4b6e-a6b1-4c415b8a5154 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1548 microversion: 2.1 time: 0.346536 Nov 02 12:50:37.752470 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2604/5288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:37 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1548 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:37.777920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:37.778768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:37.786864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.787666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.788286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.789807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.790479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.791220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.909053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:37.918576 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a35b61b9-d2ae-4ba9-b45e-0b682ef25439 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.457568 Nov 02 12:50:37.922585 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2685/5289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:37 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:37.941133 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9adc1b2b-beb5-4a3b-a66e-ea0f1a44bf0e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167355 Nov 02 12:50:37.943830 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2605/5290] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:50:37 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:50:38.944796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:38.947481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:38.957424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:38.958197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:38.958875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:38.959773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:38.960395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:38.960989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:39.242261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-be5ef34f-0147-4953-9147-8247b9557310 req-82a1e9d9-8130-4128-bd74-4ad86dfdd2fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6b5ad4-9ed7-469c-bd63-c9be03c4002d", "tag": "0bfaa540-12f1-48b5-ae5f-191236fda2d1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:39.263534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be5ef34f-0147-4953-9147-8247b9557310 req-82a1e9d9-8130-4128-bd74-4ad86dfdd2fe service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:39.264051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be5ef34f-0147-4953-9147-8247b9557310 req-82a1e9d9-8130-4128-bd74-4ad86dfdd2fe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:39.271880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:39.274993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:39.282856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be5ef34f-0147-4953-9147-8247b9557310 req-82a1e9d9-8130-4128-bd74-4ad86dfdd2fe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:39.287578 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b1bf1785-407d-4aa0-a26b-8e1dbf1a50c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.341617 Nov 02 12:50:39.297999 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2686/5291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:38 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:39.320166 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-be5ef34f-0147-4953-9147-8247b9557310 req-82a1e9d9-8130-4128-bd74-4ad86dfdd2fe service nova] Creating event network-changed:0bfaa540-12f1-48b5-ae5f-191236fda2d1 for instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d on n-h2-855650-5 Nov 02 12:50:39.337311 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-be5ef34f-0147-4953-9147-8247b9557310 req-82a1e9d9-8130-4128-bd74-4ad86dfdd2fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100358 Nov 02 12:50:39.341243 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2606/5292] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:40.312408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:40.313894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:40.324684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:40.326218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:40.326855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:40.328290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:40.329050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:40.329712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:40.575856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:40.585495 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a68a8d53-5754-4d1c-8d05-a458b296ca74 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.277469 Nov 02 12:50:40.586335 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2687/5293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:40 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:41.430971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6135a8b2-a47a-4439-8312-a2a111ef9b7e req-f9dd58dc-cca7-455f-9bec-7ee8059cbdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025b3f8-7d8a-4314-b405-8eae0c7226bb", "name": "network-vif-plugged", "status": "completed", "tag": "23cbc681-0665-4e49-b7d6-42128afeadcf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:41.440425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:41.460879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6135a8b2-a47a-4439-8312-a2a111ef9b7e req-f9dd58dc-cca7-455f-9bec-7ee8059cbdf5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:41.464615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6135a8b2-a47a-4439-8312-a2a111ef9b7e req-f9dd58dc-cca7-455f-9bec-7ee8059cbdf5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:41.465176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6135a8b2-a47a-4439-8312-a2a111ef9b7e req-f9dd58dc-cca7-455f-9bec-7ee8059cbdf5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:41.471552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:41.490956 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6135a8b2-a47a-4439-8312-a2a111ef9b7e req-f9dd58dc-cca7-455f-9bec-7ee8059cbdf5 service nova] Creating event network-vif-plugged:23cbc681-0665-4e49-b7d6-42128afeadcf for instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb on n-h1-855650-5 Nov 02 12:50:41.500729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6135a8b2-a47a-4439-8312-a2a111ef9b7e req-f9dd58dc-cca7-455f-9bec-7ee8059cbdf5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076913 Nov 02 12:50:41.502214 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2607/5294] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:41.611109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:41.612424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:41.627342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:41.630342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:41.631066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:41.635617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:41.636349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:41.636986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:42.017602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:42.026894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d1196f84-810c-4b7f-a69f-d5df2c9a20f3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.420119 Nov 02 12:50:42.028251 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2688/5295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:41 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:43.055551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:43.056279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:43.077109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:43.077653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:43.078244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:43.085754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:43.086322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:43.086779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:43.532658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6ee410d1-d766-4d23-86d5-503b8ccaa063 req-0574d06f-3eff-4df9-b715-98383ce749d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "name": "network-vif-plugged", "status": "completed", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:43.554732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=46 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:43.559022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6ee410d1-d766-4d23-86d5-503b8ccaa063 req-0574d06f-3eff-4df9-b715-98383ce749d3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:43.559625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6ee410d1-d766-4d23-86d5-503b8ccaa063 req-0574d06f-3eff-4df9-b715-98383ce749d3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:43.560231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6ee410d1-d766-4d23-86d5-503b8ccaa063 req-0574d06f-3eff-4df9-b715-98383ce749d3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:43.620082 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6ee410d1-d766-4d23-86d5-503b8ccaa063 req-0574d06f-3eff-4df9-b715-98383ce749d3 service nova] Creating event network-vif-plugged:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:50:43.629221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6ee410d1-d766-4d23-86d5-503b8ccaa063 req-0574d06f-3eff-4df9-b715-98383ce749d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100633 Nov 02 12:50:43.630401 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2689/5296] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:50:43.886860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:43.895448 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8a519ab-04b9-402a-9e1a-de8c8a1ebe72 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1203 microversion: 2.1 time: 0.847774 Nov 02 12:50:43.910644 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2608/5297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:43 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1203 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:44.929321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:44.933255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:44.946296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:44.947390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:44.948426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:44.949558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:44.950167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:44.951086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:45.131874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:45.149402 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-aaa887fa-2919-49cb-a963-482ea5b4ff82 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1390 microversion: 2.1 time: 0.231124 Nov 02 12:50:45.160392 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2690/5298] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:44 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:45.184367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:45.185163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:45.195874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:45.196691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:45.197320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:45.198650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:45.199403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:45.200014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:45.481373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:45.493799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf013a78-a3e6-41a7-aeeb-786cf4e173ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1390 microversion: 2.1 time: 0.320139 Nov 02 12:50:45.495027 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2609/5299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:45 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1390 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:45.518158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:45.520595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:45.529703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:45.531332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:45.532633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:45.534372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:45.534920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:45.535718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:45.798124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:45.812053 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-24d11174-c882-4ec2-840a-0b705ac5fed6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1390 microversion: 2.1 time: 0.298965 Nov 02 12:50:45.813274 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2691/5300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:45 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1390 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:45.837783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:45.838727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:45.847333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:45.848065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:45.848669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:45.849548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:45.850194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:45.850780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:45.927679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:50:46.117398 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99ff0654-2daa-4918-a598-efd27ebf1bf8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 204 len: 0 microversion: 2.1 time: 0.283862 Nov 02 12:50:46.118994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2610/5301] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:50:45 2022] DELETE /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:50:46.131675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:46.132673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:46.144134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:46.144982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:46.145532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:46.146434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:46.146963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:46.147400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:46.436427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:46.448208 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e1c471f5-4ef3-4912-afe5-4d5c691fdf68 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1396 microversion: 2.1 time: 0.324111 Nov 02 12:50:46.449035 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2692/5302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:46 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1396 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:47.475249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:47.476156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:47.489684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:47.495841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:47.496865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:47.498887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:47.501075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:47.503698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:47.849664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:47.858277 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1499fd56-bd48-4cf0-bba7-c746f38cc386 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1396 microversion: 2.1 time: 0.389068 Nov 02 12:50:47.863132 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2611/5303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:47 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1396 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:48.888344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:48.889153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:48.905728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:48.912564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:48.913266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:48.914934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:48.915648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:48.916402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:49.318489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:49.341288 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d3db89e-9d70-4e72-86cc-f065a58f8651 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1396 microversion: 2.1 time: 0.458876 Nov 02 12:50:49.361578 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2693/5304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:48 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1396 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:49.802474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9559f97e-e10c-4608-b04e-ae1bc3b02cda req-e5199e33-4985-4b9a-8e76-19106c6d7227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025b3f8-7d8a-4314-b405-8eae0c7226bb", "name": "network-vif-deleted", "tag": "23cbc681-0665-4e49-b7d6-42128afeadcf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:49.840110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9559f97e-e10c-4608-b04e-ae1bc3b02cda req-e5199e33-4985-4b9a-8e76-19106c6d7227 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:49.841746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9559f97e-e10c-4608-b04e-ae1bc3b02cda req-e5199e33-4985-4b9a-8e76-19106c6d7227 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:49.844709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9559f97e-e10c-4608-b04e-ae1bc3b02cda req-e5199e33-4985-4b9a-8e76-19106c6d7227 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:49.863583 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9559f97e-e10c-4608-b04e-ae1bc3b02cda req-e5199e33-4985-4b9a-8e76-19106c6d7227 service nova] Creating event network-vif-deleted:23cbc681-0665-4e49-b7d6-42128afeadcf for instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb on n-h1-855650-5 Nov 02 12:50:49.871499 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9559f97e-e10c-4608-b04e-ae1bc3b02cda req-e5199e33-4985-4b9a-8e76-19106c6d7227 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073396 Nov 02 12:50:49.872469 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2612/5305] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:50.377350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:50.378259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:50.395415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:50.396503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:50.397550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:50.401728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:50.404191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:50.404993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:50.629100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:50.645876 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-286e4de6-585f-4a12-bc0f-d6508a5025aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1188 microversion: 2.1 time: 0.272375 Nov 02 12:50:50.649618 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2694/5306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:50 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:51.687650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:51.688388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:51.703444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:51.703969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:51.704437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:51.705836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:51.706525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:51.707108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:51.882107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:51.901400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15e7e0df-94df-44ea-a51a-9356e6fa9aa8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1188 microversion: 2.1 time: 0.223969 Nov 02 12:50:51.904049 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2613/5307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:51 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1188 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:52.945215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:52.946778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:52.959260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:52.966208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:52.967200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:52.968206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:52.974830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:52.975641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:53.328974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:53.363128 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-984c97b8-5bf4-429c-850b-c075c2889226 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1188 microversion: 2.1 time: 0.422035 Nov 02 12:50:53.387219 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2695/5308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:52 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1188 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:54.407618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:54.408987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:54.430892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:54.433477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:54.437739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:54.440849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:54.441553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:54.444902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:54.714262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:54.749532 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4bd2223a-6575-45d4-992c-42a086f11e3b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1188 microversion: 2.1 time: 0.347114 Nov 02 12:50:54.770336 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2614/5309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:54 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:55.777542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:55.778214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:55.800014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:55.805185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:55.808376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:55.812162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:55.815832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:55.816643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:56.011942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:56.026647 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ce831f2-1d19-48ce-890b-761c70ab3cc8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1188 microversion: 2.1 time: 0.253587 Nov 02 12:50:56.040395 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2696/5310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:55 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1188 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:57.063458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:57.064112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:57.073266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:57.074516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:57.075219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:57.076125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:57.076553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:57.076994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:57.315172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:57.334979 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1caa7868-91cb-4848-88c7-e449778f3fc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1188 microversion: 2.1 time: 0.275464 Nov 02 12:50:57.335578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2615/5311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:57 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:58.367028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:58.367827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:58.382066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:58.384820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:58.385344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:58.387633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:58.389846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:58.390940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:58.600533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:58.623101 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f433f03f-305d-4484-afaa-a3e384668e4a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 200 len: 1188 microversion: 2.1 time: 0.262343 Nov 02 12:50:58.638496 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2697/5312] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:58 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 1188 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:59.648917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:59.649742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4025b3f8-7d8a-4314-b405-8eae0c7226bb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:59.663051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:59.663480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:59.665226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:59.668130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:59.671260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:59.674901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:59.722791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb could not be found. Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb HTTP/1.1 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb could not be found. Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4025b3f8-7d8a-4314-b405-8eae0c7226bb'} Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb could not be found. Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb could not be found. Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:59.724554 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:50:59.728144 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:59.728144 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:59.728144 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:59.728144 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:59.728144 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:59.728144 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb could not be found. Nov 02 12:50:59.728144 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:50:59.728144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 4025b3f8-7d8a-4314-b405-8eae0c7226bb could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:59.735463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d2a9698-847e-44d3-b211-fcac1ce2f8e0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb" status: 404 len: 111 microversion: 2.1 time: 0.086977 Nov 02 12:50:59.736493 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2616/5313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:59 2022] GET /compute/v2.1/servers/4025b3f8-7d8a-4314-b405-8eae0c7226bb => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:10.348648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1136327287", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e95facef-c4e0-4a9e-a384-e1b0e41f4b11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c2de958-5bb8-43d5-9f50-0267f3814230"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:10.361584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=17 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:10.362471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=63 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:10.440147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] validate_networks() for [('5c2de958-5bb8-43d5-9f50-0267f3814230', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:51:10.920857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:10.922071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:10.925079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:10.925915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:10.932506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:10.933099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:10.933631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:10.934658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:10.935219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:10.935718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.391660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:11.400143 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d78fb427-6ddd-4632-a7bf-970232d5ddcd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.483374 Nov 02 12:51:11.401394 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2617/5314] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:10 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:11.425250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-146571655"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:11.428417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:11.436731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:11.438442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:11.440364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.442664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:11.444596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:11.445423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.738670 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2b9a5f93-b6ab-4c91-879d-1b1024f9fe34 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.319224 Nov 02 12:51:11.740407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2618/5315] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:51:11 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Nov 02 12:51:11.753260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:11.754978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:11.756263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:51:11.756754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:51:11.758203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:51:11.758638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:51:11.759304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:51:11.768612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:11.769292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:11.770231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.773105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:11.774552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:11.774965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:11.775072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.776026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:11.776738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.777735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:11.778607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:11.779249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.841804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:51:11.856947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for user 15b6ee9295464444a626601b16db2574 and project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:51:11.957824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:51:11.961216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e95facef-c4e0-4a9e-a384-e1b0e41f4b11',volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:51:12.175837 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0fc43832-9b03-4ab2-ad37-c4cc8ef9d17f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834258 Nov 02 12:51:12.177128 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2698/5316] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:51:12.189688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8392e134-9d9b-4346-a98d-d5da5f7f732d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:12.190633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8392e134-9d9b-4346-a98d-d5da5f7f732d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:12.265730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:12.281445 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56623f6b-9a8c-4a6b-8a7f-f6464df0b399 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.535833 Nov 02 12:51:12.283436 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2619/5317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:11 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:12.398781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8392e134-9d9b-4346-a98d-d5da5f7f732d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:12.407037 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8392e134-9d9b-4346-a98d-d5da5f7f732d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1057 microversion: 2.1 time: 0.221966 Nov 02 12:51:12.414741 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2699/5318] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:12 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1057 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:13.308971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:13.310613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:13.323663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:13.324643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:13.325372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:13.326589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:13.327384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:13.328095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:13.432936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:13.433561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:13.441785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:13.443458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:13.444151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:13.445568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:13.446549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:13.447276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:13.581169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:13.592673 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-85c08ee9-5e39-4952-95ef-88086a180560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1155 microversion: 2.1 time: 0.163672 Nov 02 12:51:13.594818 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2700/5319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:13 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1155 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:13.797055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:13.807040 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b43f9a3-17ed-4a77-bf5c-e7ed9ccf511c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.503894 Nov 02 12:51:13.811614 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2620/5320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:13 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:14.621355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:14.622145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:14.631120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:14.631940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:14.632591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:14.633626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:14.634408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:14.635091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:14.796214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:14.813067 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-def130ab-7116-4ae1-b71c-989a16097e3a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1173 microversion: 2.1 time: 0.196030 Nov 02 12:51:14.814831 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2701/5321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:14 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1173 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:14.839741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:14.841150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:14.850600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:14.851483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:14.852171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:14.855765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:14.856951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:14.858266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:15.109426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:15.124400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f2fef47-6478-40c0-a82c-a553dbb023bd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.288437 Nov 02 12:51:15.127152 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2621/5322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:14 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:15.436344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-cae31457-3a85-4109-a4d6-cb7691117e66 req-9fae49c8-2c05-4391-8bf1-5e9b46b4d1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "name": "network-vif-unplugged", "status": "completed", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:15.453419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cae31457-3a85-4109-a4d6-cb7691117e66 req-9fae49c8-2c05-4391-8bf1-5e9b46b4d1db service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:15.455360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cae31457-3a85-4109-a4d6-cb7691117e66 req-9fae49c8-2c05-4391-8bf1-5e9b46b4d1db service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:15.466629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-cae31457-3a85-4109-a4d6-cb7691117e66 req-9fae49c8-2c05-4391-8bf1-5e9b46b4d1db service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:15.484885 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-cae31457-3a85-4109-a4d6-cb7691117e66 req-9fae49c8-2c05-4391-8bf1-5e9b46b4d1db service nova] Creating event network-vif-unplugged:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:51:15.503176 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-cae31457-3a85-4109-a4d6-cb7691117e66 req-9fae49c8-2c05-4391-8bf1-5e9b46b4d1db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070500 Nov 02 12:51:15.504252 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2702/5323] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:15.843728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:15.845989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:15.879611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:15.880132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:15.882948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:15.883426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:15.883917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:15.884366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:16.153362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:16.154103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:16.170289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:16.170799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:16.171395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:16.172119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:16.172576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:16.173042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:16.404075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:16.418888 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65258080-9070-49ab-89eb-1f3b68759a40 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1215 microversion: 2.1 time: 0.583936 Nov 02 12:51:16.435235 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2622/5324] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:15 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1215 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:16.535964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:16.550711 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-def4509f-91ce-4689-abf4-4a4081450c41 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1688 microversion: 2.1 time: 0.404368 Nov 02 12:51:16.552315 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2703/5325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:16 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1688 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:17.455287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:17.458327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:17.468275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:17.469077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:17.469675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:17.471349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:17.472342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:17.473042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:17.581424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:17.582939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:17.593221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:17.593954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:17.594952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:17.596707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:17.597372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:17.598014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:18.053548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:18.063697 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e41793a7-0fd6-44be-8cd8-0ca6b75a4c84 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1215 microversion: 2.1 time: 0.614818 Nov 02 12:51:18.064632 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2623/5326] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:17 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1215 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:18.071227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1e73ca30-159b-40a7-bce3-e24c3cb44fb6 req-017cd7ce-55e9-4799-8152-520e4c8abbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be61419-9a02-4106-9e63-8e26e61cd499", "tag": "17ed63b6-0515-4b30-aa36-4a72218964c4"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:18.085333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1e73ca30-159b-40a7-bce3-e24c3cb44fb6 req-017cd7ce-55e9-4799-8152-520e4c8abbcb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:18.085825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1e73ca30-159b-40a7-bce3-e24c3cb44fb6 req-017cd7ce-55e9-4799-8152-520e4c8abbcb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:18.086303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1e73ca30-159b-40a7-bce3-e24c3cb44fb6 req-017cd7ce-55e9-4799-8152-520e4c8abbcb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:18.101170 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1e73ca30-159b-40a7-bce3-e24c3cb44fb6 req-017cd7ce-55e9-4799-8152-520e4c8abbcb service nova] Creating event network-changed:17ed63b6-0515-4b30-aa36-4a72218964c4 for instance 4be61419-9a02-4106-9e63-8e26e61cd499 on n-h1-855650-5 Nov 02 12:51:18.107770 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1e73ca30-159b-40a7-bce3-e24c3cb44fb6 req-017cd7ce-55e9-4799-8152-520e4c8abbcb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041296 Nov 02 12:51:18.109193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2624/5327] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:18.179856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:18.195279 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c24ceac7-fa6b-4615-9e57-3ef543a2d87a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1688 microversion: 2.1 time: 0.622046 Nov 02 12:51:18.199058 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2704/5328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:17 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1688 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:19.087646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:19.089288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:19.104588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:19.105728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:19.106388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:19.107321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:19.108175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:19.108972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:19.223585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:19.224991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:19.238557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:19.239306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:19.242264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:19.243246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:19.243874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:19.244478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:19.599784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:19.608044 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-61fe7305-4fe7-449f-b668-6bc69edddaad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1215 microversion: 2.1 time: 0.524706 Nov 02 12:51:19.609362 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2625/5329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:19 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1215 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:19.615619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f4aa869d-881b-4d7d-8cf8-cd9ad8aef60a req-4e590883-51a7-4729-8ab3-fcf4d0f3088a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "name": "network-vif-plugged", "status": "completed", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:19.633306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f4aa869d-881b-4d7d-8cf8-cd9ad8aef60a req-4e590883-51a7-4729-8ab3-fcf4d0f3088a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:19.634158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f4aa869d-881b-4d7d-8cf8-cd9ad8aef60a req-4e590883-51a7-4729-8ab3-fcf4d0f3088a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:19.634682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f4aa869d-881b-4d7d-8cf8-cd9ad8aef60a req-4e590883-51a7-4729-8ab3-fcf4d0f3088a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:19.648292 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f4aa869d-881b-4d7d-8cf8-cd9ad8aef60a req-4e590883-51a7-4729-8ab3-fcf4d0f3088a service nova] Creating event network-vif-plugged:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:51:19.654001 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f4aa869d-881b-4d7d-8cf8-cd9ad8aef60a req-4e590883-51a7-4729-8ab3-fcf4d0f3088a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042764 Nov 02 12:51:19.654668 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2626/5330] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:19.703973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:19.718135 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6a289730-abbd-4480-9957-c744f495aa73 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1688 microversion: 2.1 time: 0.501159 Nov 02 12:51:19.718883 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2705/5331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:19 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1688 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:20.639644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:20.640527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:20.648276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:20.648959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:20.649673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:20.650691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:20.651366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:20.652020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:20.746683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:20.747722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:20.762337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:20.769101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:20.769577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:20.770380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:20.771015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:20.771600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:21.013497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:21.027683 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2aa65a81-83f6-41fc-a6ec-fcd75e390177 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1215 microversion: 2.1 time: 0.398410 Nov 02 12:51:21.028647 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2627/5332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:20 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1215 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:21.050237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:21.061671 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5cebeb10-8592-46cc-8d9f-33b7a55a8c62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1688 microversion: 2.1 time: 0.319846 Nov 02 12:51:21.074139 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2706/5333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:20 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1688 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:22.054662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:22.056240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:22.073277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:22.075898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:22.076641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:22.077508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:22.080783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:22.081367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:22.089512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:22.090528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:22.094456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:22.114792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:22.123035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:22.123883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:22.124763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:22.125496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:22.125882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:22.406881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:22.610263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:22.624016 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ec9ac68-95a2-4de4-97e4-2fccef56d0bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.538237 Nov 02 12:51:22.625424 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2707/5334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:22 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:22.678320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:22.689401 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95e6e615-3e04-4cee-bcc0-51b68f90e115 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1215 microversion: 2.1 time: 0.640067 Nov 02 12:51:22.694148 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2628/5335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:22 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1215 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:23.653047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:23.653610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:23.669286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:23.670161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:23.670624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:23.675055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:23.679208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:23.681378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:23.717864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:23.719098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:23.736045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:23.736781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:23.737379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:23.738276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:23.738886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:23.739501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:24.457274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:24.472020 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a26c8af1-8eb6-46ce-b91d-68b0f6035d5c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.758663 Nov 02 12:51:24.472881 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2629/5336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:23 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:24.483404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:24.500228 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-266de02f-2f59-4138-aa52-b0b38c31445c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.851188 Nov 02 12:51:24.502154 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2708/5337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:23 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:25.498863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:25.500127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:25.518491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:25.524963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:25.526588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:25.530978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:25.533222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:25.534617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:25.535903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:25.539362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:25.546102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:25.546992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:25.550712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:25.551731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:25.554732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:25.556202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:26.556497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:26.573917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ca25b63f-b923-4973-b4bd-fcb318d83b17 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 1.053159 Nov 02 12:51:26.578299 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2709/5338] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:25 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:26.748752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:26.762412 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e328b72-f9c2-42f7-8af5-4e13a3968cec tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 1.267873 Nov 02 12:51:26.769239 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2630/5339] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:25 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:27.611772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:27.613139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:27.633330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:27.635752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:27.636399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:27.641736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:27.642536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:27.643171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:27.796233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:27.799170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:27.809177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:27.810959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:27.811649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:27.812796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:27.814877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:27.815516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:27.963813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:27.973802 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-156ddfd2-5234-4262-870f-50b19ce7e3f4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.371948 Nov 02 12:51:27.974945 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2710/5340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:27 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:28.097537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:28.112245 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2de29c2b-e675-4cfb-a12d-f2dada6c0df4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.323420 Nov 02 12:51:28.116493 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2631/5341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:27 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:28.999678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:29.001777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:29.012639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:29.019489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:29.020191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:29.021096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:29.021707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:29.022345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:29.144180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:29.144958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:29.167279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:29.173904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:29.175045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:29.178398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:29.179615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:29.186859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:29.388381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:29.399644 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6d3aa70-6841-4537-9499-d7c9fa1ed519 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.403883 Nov 02 12:51:29.410242 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2711/5342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:28 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:29.496261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:29.512785 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fd09d65-f5b7-4561-a364-478903b53e16 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.373382 Nov 02 12:51:29.518959 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2632/5343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:29 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:30.437099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:30.437859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:30.450846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:30.451759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:30.452362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:30.453625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:30.462900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:30.463679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:30.548802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:30.550364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:30.566880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:30.567764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:30.569228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:30.570301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:30.580470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:30.582250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:30.652068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:31.001586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:31.009807 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f4483658-aa13-46a7-a9f8-ab47ec042cdb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.576774 Nov 02 12:51:31.010439 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2712/5344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:30 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:31.059680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:31.072360 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ae50404-93c9-4ee8-9732-e5d2be7c021b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.528641 Nov 02 12:51:31.082125 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2633/5345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:30 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:32.038875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:32.040184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:32.069668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:32.072601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:32.075442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:32.077886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:32.082647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:32.084363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:32.112063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:32.118838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:32.141432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:32.142343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:32.146320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:32.147419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:32.148159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:32.148837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:32.658899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:32.688116 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0fb1f9c1-6c66-4947-a9be-c17b4b72a5a0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.655778 Nov 02 12:51:32.689650 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2713/5346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:32 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:32.742819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:32.751229 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64ea5130-3470-4bff-9ccb-2d2b2b331a7e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.645792 Nov 02 12:51:32.762214 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2634/5347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:32 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:33.733297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:33.734086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:33.750552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:33.751154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:33.751623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:33.752321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:33.752790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:33.753285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:34.403001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:34.403674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:34.445190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:34.445899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:34.446330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:34.455964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:34.456597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:34.481905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:34.627856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:34.639913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d91bf09b-1f7e-4e9c-b4bb-a7c819b2d826 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.911481 Nov 02 12:51:34.648695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2635/5348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:33 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:34.650066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:51:34.656418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:34.657873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:34.669177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:34.669958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:34.670837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:34.673693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:34.674491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:34.687536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:34.972771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:34.981874 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-784a0f60-ac07-439b-8cc1-828711330b59 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 204 len: 0 microversion: 2.42 time: 1.314461 Nov 02 12:51:34.987740 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2714/5349] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:51:33 2022] DELETE /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 0 bytes in 1318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:51:34.988997 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c969fae7-8457-4467-80dd-261f8acf27fb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.337255 Nov 02 12:51:34.989933 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2636/5350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:34 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:35.011344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:35.012311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:35.016106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d479b7c2-72b5-4111-9814-0dd94df91eb8 req-e54c2450-a44e-4fa0-a75f-6439dcb21841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be61419-9a02-4106-9e63-8e26e61cd499", "name": "network-vif-plugged", "status": "completed", "tag": "17ed63b6-0515-4b30-aa36-4a72218964c4"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:35.029193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:35.030067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:35.030715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:35.031694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:35.033029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:35.033708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:35.059278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d479b7c2-72b5-4111-9814-0dd94df91eb8 req-e54c2450-a44e-4fa0-a75f-6439dcb21841 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:35.060118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d479b7c2-72b5-4111-9814-0dd94df91eb8 req-e54c2450-a44e-4fa0-a75f-6439dcb21841 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:35.060773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d479b7c2-72b5-4111-9814-0dd94df91eb8 req-e54c2450-a44e-4fa0-a75f-6439dcb21841 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:35.066070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:35.083924 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d479b7c2-72b5-4111-9814-0dd94df91eb8 req-e54c2450-a44e-4fa0-a75f-6439dcb21841 service nova] Creating event network-vif-plugged:17ed63b6-0515-4b30-aa36-4a72218964c4 for instance 4be61419-9a02-4106-9e63-8e26e61cd499 on n-h1-855650-5 Nov 02 12:51:35.095708 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d479b7c2-72b5-4111-9814-0dd94df91eb8 req-e54c2450-a44e-4fa0-a75f-6439dcb21841 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105342 Nov 02 12:51:35.098327 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2715/5351] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:35.684686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:35.685423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:35.711825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:35.716926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:35.717400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:35.718211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:35.718681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:35.719113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:35.743233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:35.761484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:35.763100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:35.764633 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70eb34d0-6376-41ad-87bd-21a09dae3f03 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2959 microversion: 2.42 time: 0.773277 Nov 02 12:51:35.765075 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2637/5352] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:34 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2959 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:36.013632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:36.015552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:36.027870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:36.033254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:36.034581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:36.042472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:36.043333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:36.044158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:36.467239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:36.478294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c1163590-9b4a-4565-94a0-d8bfa1bff431 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.468712 Nov 02 12:51:36.489193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2638/5353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:36 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:36.745309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:36.758735 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b705537-7215-4384-a7e1-490fb439016d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 1.080402 Nov 02 12:51:36.760067 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2716/5354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:35 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:36.808649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:36.810274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:36.831558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:36.834454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:36.835237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:36.836247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:36.840436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:36.841721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:37.514435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:37.521725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:37.559048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:37.559816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:37.561667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:37.563831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:37.566238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:37.569603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:38.374571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:38.395971 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a6437e1-f3b4-468e-ab70-87b91b2ae00f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.882801 Nov 02 12:51:38.404951 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2717/5355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:37 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:38.428471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:38.430580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:38.446812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:38.451528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:38.452018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:38.452787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:38.453257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:38.459184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:38.843564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:38.883067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:38.884717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:38.886140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2ed127a-0eeb-44d3-b338-cb398d013d71 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2959 microversion: 2.42 time: 2.081733 Nov 02 12:51:38.886745 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2639/5356] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:36 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2959 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:39.096426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:39.117071 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-01248445-2f53-4d11-ac09-7bfc8ddd21cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.702020 Nov 02 12:51:39.132846 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2718/5357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:38 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:39.432228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:39.433872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:39.449080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:39.449890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:39.453516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:39.455327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:39.457661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:39.459505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:39.915841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:39.916616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:39.934254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:39.936321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:39.936982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:39.940083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:39.941710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:39.942319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:40.288139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:40.307416 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6ebc4d39-0277-4814-a067-03481fa8c592 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1203 microversion: 2.1 time: 0.879803 Nov 02 12:51:40.311186 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2640/5358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:39 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1203 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:40.318805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:40.352073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:40.362145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:40.362931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:40.363984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:40.365005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:40.365291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:40.365833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:40.826357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:40.833362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:40.862941 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e2495ba-080c-4920-9f8b-ce3ec7e56d09 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.547016 Nov 02 12:51:40.864525 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2641/5359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:40 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:40.875777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:40.899489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:40.901363 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d90dd0e-6e0a-4dce-b0c5-46e80dde36dd tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2959 microversion: 2.42 time: 0.990395 Nov 02 12:51:40.904370 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2719/5360] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:39 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2959 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:51:41.011149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ff6a2bf2-42c8-47ec-b713-82121d65c0b2 req-8d232161-b881-432c-b8f3-da9715eb26c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-unplugged", "status": "completed", "tag": "cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:41.032227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=51 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:41.034688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ff6a2bf2-42c8-47ec-b713-82121d65c0b2 req-8d232161-b881-432c-b8f3-da9715eb26c7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.037214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ff6a2bf2-42c8-47ec-b713-82121d65c0b2 req-8d232161-b881-432c-b8f3-da9715eb26c7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.037926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ff6a2bf2-42c8-47ec-b713-82121d65c0b2 req-8d232161-b881-432c-b8f3-da9715eb26c7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:41.088729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ff6a2bf2-42c8-47ec-b713-82121d65c0b2 req-8d232161-b881-432c-b8f3-da9715eb26c7 service nova] Creating event network-vif-unplugged:cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:41.102356 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ff6a2bf2-42c8-47ec-b713-82121d65c0b2 req-8d232161-b881-432c-b8f3-da9715eb26c7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095036 Nov 02 12:51:41.108661 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2642/5361] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:41.352559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:41.354210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:41.368164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.371262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.371985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:41.372955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.373633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.376517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:41.392587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:41.393244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:41.396767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:41.422186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.423549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.427019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:41.434885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.436758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.438640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:41.573397 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b904cd88-0645-4e3a-8754-7ead4ac306ee tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/ips" status: 200 len: 150 microversion: 2.1 time: 0.541613 Nov 02 12:51:41.581360 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2720/5362] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:41 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/ips => generated 150 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:51:41.837110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:41.880310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0d8db86-5a05-468e-a817-2bcf4df2162f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1390 microversion: 2.1 time: 0.545003 Nov 02 12:51:41.889745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:41.889925 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2643/5363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:41 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1390 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:41.890611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:41.904200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.905065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.914328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:41.914700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:41.915538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:41.915714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.916209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.916666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:41.923837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.924569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.925441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:41.926690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:41.927310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:41.927924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:42.743803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:42.763860 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2796b35d-49bc-4900-8079-24f7311bdf86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1390 microversion: 2.1 time: 0.853863 Nov 02 12:51:42.764949 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2644/5364] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:41 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1390 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:42.773174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:42.773788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:42.798362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:42.798866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:42.799314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:42.800289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:42.800801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:42.801232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:42.872633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:42.887036 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a0cf12a-eb98-442a-9e76-51e18ea25e83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 1.001998 Nov 02 12:51:42.891636 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2721/5365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:41 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:42.905637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:42.907311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:42.927975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:42.930926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:42.931418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:42.934477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:42.934971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:42.935418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:43.908000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:43.917754 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a83276f5-8ca6-456f-9815-03eb86ce4663 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1390 microversion: 2.1 time: 1.023835 Nov 02 12:51:43.926758 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2722/5366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:42 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1390 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:43.936119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-491c3b5d-0c4f-434f-ac1b-d3f506de7ec3 req-97c11a3d-be79-4353-a31e-6b02aff1a6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-unplugged", "status": "completed", "tag": "1b72dfc0-e39d-4182-b6fb-9a2ef7753062"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-unplugged", "status": "completed", "tag": "08d946d8-b737-4d8f-a0f8-2a4f7e6c893b"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-unplugged", "status": "completed", "tag": "e7168472-9de7-4506-b496-895fda51cfd5"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:43.957764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-491c3b5d-0c4f-434f-ac1b-d3f506de7ec3 req-97c11a3d-be79-4353-a31e-6b02aff1a6be service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:43.958868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-491c3b5d-0c4f-434f-ac1b-d3f506de7ec3 req-97c11a3d-be79-4353-a31e-6b02aff1a6be service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:43.959673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-491c3b5d-0c4f-434f-ac1b-d3f506de7ec3 req-97c11a3d-be79-4353-a31e-6b02aff1a6be service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:43.976107 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-491c3b5d-0c4f-434f-ac1b-d3f506de7ec3 req-97c11a3d-be79-4353-a31e-6b02aff1a6be service nova] Creating event network-vif-unplugged:1b72dfc0-e39d-4182-b6fb-9a2ef7753062 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:43.977099 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-491c3b5d-0c4f-434f-ac1b-d3f506de7ec3 req-97c11a3d-be79-4353-a31e-6b02aff1a6be service nova] Creating event network-vif-unplugged:08d946d8-b737-4d8f-a0f8-2a4f7e6c893b for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:43.978044 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-491c3b5d-0c4f-434f-ac1b-d3f506de7ec3 req-97c11a3d-be79-4353-a31e-6b02aff1a6be service nova] Creating event network-vif-unplugged:e7168472-9de7-4506-b496-895fda51cfd5 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:43.988754 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-491c3b5d-0c4f-434f-ac1b-d3f506de7ec3 req-97c11a3d-be79-4353-a31e-6b02aff1a6be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.060326 Nov 02 12:51:43.990078 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2723/5367] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:43.997545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:43.998704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:44.006535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:44.007594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:44.008253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:44.009243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:44.009922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:44.010580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:44.193751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:44.264199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:44.273189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:44.275693 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02c12bcd-ad17-4546-a5d4-f47f34a6e025 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2959 microversion: 2.42 time: 1.509602 Nov 02 12:51:44.276273 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2645/5368] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:42 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2959 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:44.371987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:44.372675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:44.389948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:44.400657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:44.401410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:44.402429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:44.403146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:44.403831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:44.455204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:51:44.658536 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70b30fdf-01f1-4006-ac9e-c080643e4500 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 204 len: 0 microversion: 2.1 time: 0.313611 Nov 02 12:51:44.662810 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2646/5369] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:51:44 2022] DELETE /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:51:44.673110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:44.678633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:44.693663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:44.694606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:44.697991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:44.699132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:44.717887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:44.718791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:45.444083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:45.456281 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98131492-ba40-4632-b56a-2f06b4829844 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 1.462942 Nov 02 12:51:45.475260 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2724/5370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:43 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:45.481993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:45.482946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:45.506247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:45.506836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:45.507294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:45.508080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:45.508557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:45.509005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:45.564226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:45.581814 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-927dd8f9-0d51-4496-a20a-e0524eebea09 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1396 microversion: 2.1 time: 0.917271 Nov 02 12:51:45.583031 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2647/5371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:44 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1396 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:45.793861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdc67136-7dff-4411-b4eb-29b0f44638bc"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:45.801074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:45.819064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:45.819577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:45.820029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:45.824694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:45.826622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:45.840415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:46.060626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:46.095913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:46.097610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:46.102208 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac260d96-2604-4735-9974-897c94e640ef tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2938 microversion: 2.42 time: 0.625632 Nov 02 12:51:46.102896 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2725/5372] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:45 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2938 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:46.158259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:46.258583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7533f2a4-8130-410b-a4cb-feb45e2c0585 req-fad0c6c9-775e-44ac-9f69-9f27a4619f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-unplugged", "status": "completed", "tag": "3fcc22ed-2130-410f-b618-7d1d71081222"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-unplugged", "status": "completed", "tag": "8007eff5-a08a-4593-94af-120b1b805694"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-unplugged", "status": "completed", "tag": "880ff257-ea6b-45a9-abe1-67bba3951184"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:46.273119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7533f2a4-8130-410b-a4cb-feb45e2c0585 req-fad0c6c9-775e-44ac-9f69-9f27a4619f12 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:46.277315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7533f2a4-8130-410b-a4cb-feb45e2c0585 req-fad0c6c9-775e-44ac-9f69-9f27a4619f12 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:46.279686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7533f2a4-8130-410b-a4cb-feb45e2c0585 req-fad0c6c9-775e-44ac-9f69-9f27a4619f12 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:46.305645 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7533f2a4-8130-410b-a4cb-feb45e2c0585 req-fad0c6c9-775e-44ac-9f69-9f27a4619f12 service nova] Creating event network-vif-unplugged:3fcc22ed-2130-410f-b618-7d1d71081222 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:46.313012 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7533f2a4-8130-410b-a4cb-feb45e2c0585 req-fad0c6c9-775e-44ac-9f69-9f27a4619f12 service nova] Creating event network-vif-unplugged:8007eff5-a08a-4593-94af-120b1b805694 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:46.313643 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7533f2a4-8130-410b-a4cb-feb45e2c0585 req-fad0c6c9-775e-44ac-9f69-9f27a4619f12 service nova] Creating event network-vif-unplugged:880ff257-ea6b-45a9-abe1-67bba3951184 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:46.321437 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7533f2a4-8130-410b-a4cb-feb45e2c0585 req-fad0c6c9-775e-44ac-9f69-9f27a4619f12 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.066621 Nov 02 12:51:46.326513 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2726/5373] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:46.481940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:46.482675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:46.498587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:46.499112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:46.499726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:46.500704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:46.501313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:46.501913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:46.521069 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3e126f8-bc9f-4386-a6e3-0847f7d90e84 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "POST /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730556 Nov 02 12:51:46.540361 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2648/5374] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:51:45 2022] POST /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:46.610410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:46.612357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:46.694912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:46.695431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:46.708360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:46.709413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:46.718098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:46.724014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:47.012864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:47.030908 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5591c01-cb41-4fc3-a3f7-23f9a834456f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.553242 Nov 02 12:51:47.031761 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2727/5375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:46 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:47.134853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:47.135493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:47.147710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:47.162017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:47.170649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:47.171250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:47.172075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:47.173365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:47.174008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:47.175612 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-69e682a4-f368-47cd-a9e9-0af14305f37f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1396 microversion: 2.1 time: 0.569702 Nov 02 12:51:47.193957 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2649/5376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:46 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1396 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:47.673652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:47.706917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:47.708516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:47.721171 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7fb5f610-c60d-4540-80c6-f0f0dd080637 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2938 microversion: 2.42 time: 0.579459 Nov 02 12:51:47.722469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2728/5377] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:47 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2938 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:51:48.060457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:48.061087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:48.086044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:48.086552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:48.087006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:48.107746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:48.108287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:48.109558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:48.206176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:48.206802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:48.229387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:48.229894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:48.234668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:48.240887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:48.241393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:48.241835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:48.332889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:48.378890 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9242f8e-0015-44a5-9926-eab0a8331aa8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1683 microversion: 2.1 time: 0.310647 Nov 02 12:51:48.382352 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2650/5378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:48 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1683 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:48.581712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:48.593748 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de84756d-20a9-4532-8d9f-80f172006094 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1396 microversion: 2.1 time: 0.391562 Nov 02 12:51:48.597280 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2729/5379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:48 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1396 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:48.753547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:48.754129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:48.763267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:48.764927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:48.767285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:48.769691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:48.770577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:48.771243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:49.151817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:49.172012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:49.173549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:49.174911 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6bbbc585-e8ec-4f28-ae11-39d4e6741d67 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2917 microversion: 2.42 time: 0.425989 Nov 02 12:51:49.189993 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2651/5380] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:48 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2917 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:49.410144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:49.411410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:49.427657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:49.428575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:49.429055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:49.429875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:49.430396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:49.433357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:49.623881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:49.624703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:49.640682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:49.640682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:49.641130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:49.641864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:49.642364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:49.642827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:49.996539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:50.020959 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f2bac57-673e-40fc-8313-1185a1abc6d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1354 microversion: 2.1 time: 0.400974 Nov 02 12:51:50.043464 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2652/5381] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:49 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1354 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:50.056790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0588158e-e318-4edf-8e0b-88fc33be9dbb req-3e028f41-a146-448a-b463-f81a02495b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be61419-9a02-4106-9e63-8e26e61cd499", "name": "network-vif-deleted", "tag": "17ed63b6-0515-4b30-aa36-4a72218964c4"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:50.071341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0588158e-e318-4edf-8e0b-88fc33be9dbb req-3e028f41-a146-448a-b463-f81a02495b18 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:50.072071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0588158e-e318-4edf-8e0b-88fc33be9dbb req-3e028f41-a146-448a-b463-f81a02495b18 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:50.072716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0588158e-e318-4edf-8e0b-88fc33be9dbb req-3e028f41-a146-448a-b463-f81a02495b18 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:50.103114 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0588158e-e318-4edf-8e0b-88fc33be9dbb req-3e028f41-a146-448a-b463-f81a02495b18 service nova] Creating event network-vif-deleted:17ed63b6-0515-4b30-aa36-4a72218964c4 for instance 4be61419-9a02-4106-9e63-8e26e61cd499 on n-h1-855650-5 Nov 02 12:51:50.110416 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0588158e-e318-4edf-8e0b-88fc33be9dbb req-3e028f41-a146-448a-b463-f81a02495b18 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064288 Nov 02 12:51:50.111446 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2653/5382] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:50.206011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:50.206809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:50.222354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:50.222868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:50.223483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:50.224048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:50.224511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:50.225065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:50.261481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:50.277947 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93975ccf-ce44-4733-9f41-4a4c57eac4be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.872896 Nov 02 12:51:50.296119 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2730/5383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:49 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:50.882286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:50.905623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:50.931805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:50.933190 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9927b1e3-1e4c-479c-8a0a-dfe6077fd530 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2870 microversion: 2.42 time: 0.731790 Nov 02 12:51:50.933767 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2654/5384] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:50 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2870 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:51:51.057791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:51.063343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:51.078826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:51.086872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:51.087601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:51.088542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:51.089169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:51.089864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:51.313757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:51.325212 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5f03e628-2420-4f96-b07f-bf4c6af3b313 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1188 microversion: 2.1 time: 0.280217 Nov 02 12:51:51.336708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2731/5385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:51 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:51.541246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:51.543570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:51.561845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:51.562389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:51.562895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:51.563623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:51.564090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:51.564525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:51.960649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:51.968220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:51.971185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:51.985744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:51.986175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:51.987523 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aaa979cf-c6cf-4534-b74e-3d4e3ec27546 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.454320 Nov 02 12:51:51.988951 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2655/5386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:51 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:51.991683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:51.992497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:51.992990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:51.993442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:52.290352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a0dc7faa-a9ae-4620-bf69-c83f1af37cef req-bf95bf0a-e993-4097-93fa-899fc34938ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-deleted", "tag": "e7168472-9de7-4506-b496-895fda51cfd5"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-deleted", "tag": "3fcc22ed-2130-410f-b618-7d1d71081222"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:52.311671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0dc7faa-a9ae-4620-bf69-c83f1af37cef req-bf95bf0a-e993-4097-93fa-899fc34938ae service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:52.315468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0dc7faa-a9ae-4620-bf69-c83f1af37cef req-bf95bf0a-e993-4097-93fa-899fc34938ae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:52.316022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0dc7faa-a9ae-4620-bf69-c83f1af37cef req-bf95bf0a-e993-4097-93fa-899fc34938ae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:52.354504 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a0dc7faa-a9ae-4620-bf69-c83f1af37cef req-bf95bf0a-e993-4097-93fa-899fc34938ae service nova] Creating event network-vif-deleted:e7168472-9de7-4506-b496-895fda51cfd5 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:52.355146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a0dc7faa-a9ae-4620-bf69-c83f1af37cef req-bf95bf0a-e993-4097-93fa-899fc34938ae service nova] Creating event network-vif-deleted:3fcc22ed-2130-410f-b618-7d1d71081222 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:52.367426 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a0dc7faa-a9ae-4620-bf69-c83f1af37cef req-bf95bf0a-e993-4097-93fa-899fc34938ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081280 Nov 02 12:51:52.368964 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2656/5387] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:51:52.376670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:52.377810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:52.386867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:52.387823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:52.389253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:52.393067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:52.395398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:52.396604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:52.603511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:52.622179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86b1b43f-8275-48b1-a365-19870eff4f4c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1188 microversion: 2.1 time: 0.245559 Nov 02 12:51:52.622868 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2657/5388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:52 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1188 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:52.664491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:52.677104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:52.678467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:52.679769 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c0956e7c-9e1a-4e69-95f7-6e980ee32e78 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2776 microversion: 2.42 time: 0.716978 Nov 02 12:51:52.680739 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2732/5389] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:51 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2776 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:53.592644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:53.593715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:53.608816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:53.609398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:53.610424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:53.612506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:53.613021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:53.613704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:53.647040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:53.647666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:53.656183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:53.658295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:53.663820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:53.666134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:53.666657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:53.668843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:53.865293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:53.879887 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-33ae62c9-5d59-437f-9aa0-a90cca490cd3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1188 microversion: 2.1 time: 0.236539 Nov 02 12:51:53.880499 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2733/5390] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:53 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1188 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:53.903487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:53.904130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:53.916253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:53.916839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:53.917290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:53.919586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:53.921403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:53.922651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:53.929025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:53.946483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:53.957003 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f6ec9c5-0b5b-4404-8804-87836d0cd036 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.369255 Nov 02 12:51:53.958069 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2658/5391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:53 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:53.983696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-34bff8e7-ec39-4791-97bd-a13e271367fb req-87e6d307-d106-45d5-b191-deb4c26a1539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "name": "network-vif-unplugged", "status": "completed", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:54.014507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34bff8e7-ec39-4791-97bd-a13e271367fb req-87e6d307-d106-45d5-b191-deb4c26a1539 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:54.015364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34bff8e7-ec39-4791-97bd-a13e271367fb req-87e6d307-d106-45d5-b191-deb4c26a1539 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:54.017050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34bff8e7-ec39-4791-97bd-a13e271367fb req-87e6d307-d106-45d5-b191-deb4c26a1539 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:54.047219 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-34bff8e7-ec39-4791-97bd-a13e271367fb req-87e6d307-d106-45d5-b191-deb4c26a1539 service nova] Creating event network-vif-unplugged:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:51:54.061187 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-34bff8e7-ec39-4791-97bd-a13e271367fb req-87e6d307-d106-45d5-b191-deb4c26a1539 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081563 Nov 02 12:51:54.063807 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2659/5392] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:54.077690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:54.081530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:54.096484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:54.097241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:54.099598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:54.100766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:54.102592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:54.105291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:54.792034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:54.809188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:54.818065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:54.819907 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-42380ba9-0771-4656-82e7-98c2fdd364e6 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 2549 microversion: 2.42 time: 0.924586 Nov 02 12:51:54.830902 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2734/5393] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:53 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 2549 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:54.856226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d062d701-ac92-4db2-8167-cb9762674a00 req-213c8afe-5ac7-4402-b758-d5a814ac0cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-deleted", "tag": "8007eff5-a08a-4593-94af-120b1b805694"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:54.877742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d062d701-ac92-4db2-8167-cb9762674a00 req-213c8afe-5ac7-4402-b758-d5a814ac0cb5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:54.878273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d062d701-ac92-4db2-8167-cb9762674a00 req-213c8afe-5ac7-4402-b758-d5a814ac0cb5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:54.878725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d062d701-ac92-4db2-8167-cb9762674a00 req-213c8afe-5ac7-4402-b758-d5a814ac0cb5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:54.915536 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d062d701-ac92-4db2-8167-cb9762674a00 req-213c8afe-5ac7-4402-b758-d5a814ac0cb5 service nova] Creating event network-vif-deleted:8007eff5-a08a-4593-94af-120b1b805694 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:54.926924 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d062d701-ac92-4db2-8167-cb9762674a00 req-213c8afe-5ac7-4402-b758-d5a814ac0cb5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094557 Nov 02 12:51:54.930914 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2735/5394] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:54.944976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:54.945920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:54.961143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:54.961651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:54.969585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:54.970408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:54.970884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:54.971328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:55.131596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:55.143380 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2a01ecde-7e01-4afc-ba1d-7ca8303159f0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1188 microversion: 2.1 time: 0.210741 Nov 02 12:51:55.169629 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2736/5395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:54 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1188 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:55.188584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:55.197099 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55a1f877-985f-48db-9be0-53b26c1abea6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.129987 Nov 02 12:51:55.198182 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2660/5396] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:54 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:55.230358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:55.231235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:55.249206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:55.250551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:55.251164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:55.252100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:55.257745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:55.258539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:55.807726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:55.842212 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e657c1b-3afa-4bb6-a01e-aadddb0413b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.616024 Nov 02 12:51:55.845644 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2737/5397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:55 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:55.858412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:55.858412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:55.866190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:55.870364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:55.871104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:55.872055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:55.873293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:55.873954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:55.891034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:55.893369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:55.915625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:55.916151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:55.916609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:55.917566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:55.917825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:55.918302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:56.045835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:56.062878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:56.067613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:56.072936 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95e9b3df-4ec3-42de-bf8a-5b9f65e4709b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.223973 Nov 02 12:51:56.074086 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2661/5398] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:55 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:56.176347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:56.177824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:56.180495 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0006b55-7863-4be1-a5f2-8a46e2db7444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.293243 Nov 02 12:51:56.186348 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2738/5399] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:51:55 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:51:56.191910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:56.192563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:56.193267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:56.197246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:56.199182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:56.200311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:56.201178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:56.204209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:56.223745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:56.228836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:56.229754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:56.230938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:56.235487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:56.236218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:56.472006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:56.490931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-caaf31fa-4a99-4690-a87b-6511f62cb560 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1188 microversion: 2.1 time: 0.322766 Nov 02 12:51:56.492525 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2662/5400] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:56 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:56.799834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:56.814374 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e91527c1-89a4-44ff-894d-d625e0f7f982 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1672 microversion: 2.1 time: 0.621446 Nov 02 12:51:56.816181 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2739/5401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:56 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1672 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:57.022720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d4509e2d-07e2-49f2-a757-63058c50569d req-a4ca4674-6c96-434a-af1a-9dde4229ea66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-deleted", "tag": "cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe"}, {"server_uuid": "d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819", "name": "network-vif-deleted", "tag": "880ff257-ea6b-45a9-abe1-67bba3951184"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:57.037474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d4509e2d-07e2-49f2-a757-63058c50569d req-a4ca4674-6c96-434a-af1a-9dde4229ea66 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:57.038487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d4509e2d-07e2-49f2-a757-63058c50569d req-a4ca4674-6c96-434a-af1a-9dde4229ea66 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:57.039642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d4509e2d-07e2-49f2-a757-63058c50569d req-a4ca4674-6c96-434a-af1a-9dde4229ea66 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:57.054117 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d4509e2d-07e2-49f2-a757-63058c50569d req-a4ca4674-6c96-434a-af1a-9dde4229ea66 service nova] Creating event network-vif-deleted:cdd96583-7b80-4cec-9f5b-4e8acf6e4bfe for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:57.055274 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d4509e2d-07e2-49f2-a757-63058c50569d req-a4ca4674-6c96-434a-af1a-9dde4229ea66 service nova] Creating event network-vif-deleted:880ff257-ea6b-45a9-abe1-67bba3951184 for instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 on n-h1-855650-5 Nov 02 12:51:57.061480 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d4509e2d-07e2-49f2-a757-63058c50569d req-a4ca4674-6c96-434a-af1a-9dde4229ea66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042930 Nov 02 12:51:57.063750 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2663/5402] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:57.129587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:57.131051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:57.141738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:57.143544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:57.144585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:57.146620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:57.147329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:57.148804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:57.447412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:57.467678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:57.472397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:57.475652 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-13a6781e-cd20-405d-9524-6c67face3481 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.352361 Nov 02 12:51:57.479405 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2740/5403] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:57 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:57.515677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:57.517677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:57.527553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:57.528702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:57.529326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:57.530082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:57.531044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:57.532161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:57.669142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:57.679133 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9536769b-86cb-4085-8df3-1973abd49ac7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1188 microversion: 2.1 time: 0.168100 Nov 02 12:51:57.694496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2664/5404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:57 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1188 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:57.845167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:57.845787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:57.874427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:57.875042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:57.875506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:57.876271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:57.876731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:57.877162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:58.220374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:58.220776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:58.233504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:58.234026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:58.234952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:58.235892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:58.236590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:58.237534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:58.295316 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b030c353-436c-45f1-87ce-2ef8ef2778f6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/ips" status: 200 len: 146 microversion: 2.1 time: 0.079014 Nov 02 12:51:58.296655 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2665/5405] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:58 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/ips => generated 146 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:58.430482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:58.441993 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ce8f970-145b-4498-a670-83489942933e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1672 microversion: 2.1 time: 0.602926 Nov 02 12:51:58.442691 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2741/5406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:57 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1672 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:58.506124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:58.506644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:58.523970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:58.524684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:58.525513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:58.526447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:58.526921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:58.527352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:58.623171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:58.634986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:58.636821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:58.638396 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b780fbf-625f-4bc7-8da7-c94f7a666101 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.136734 Nov 02 12:51:58.639172 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2666/5407] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:58 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:58.713615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:58.714274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:58.729818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:58.730344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:58.730793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:58.731513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:58.731978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:58.732410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:58.819015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:58.829169 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bbbac268-395d-4ff5-a4f4-cbc38cbe9572 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1188 microversion: 2.1 time: 0.118615 Nov 02 12:51:58.830424 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2742/5408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:58 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:59.484280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:59.491421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:59.516630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:59.519514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:59.520182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:59.521872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:59.525782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:59.527210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:59.607534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:59.666827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:59.667449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:59.680310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:59.681214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:59.682295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:59.685431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:59.686405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:59.688193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:59.841953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:59.864239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:59.884303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:59.887750 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e861d8c3-0785-4b82-bab2-f3b10c824bb9 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.224005 Nov 02 12:51:59.889262 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2743/5409] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:51:59 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:59.900555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:59.903772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:59.920858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:59.923286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:59.923956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:59.924846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:59.925734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:59.926376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:59.969705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:59.972517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:59.972974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:59.973447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lazy-loading 'fault' on Instance uuid 4be61419-9a02-4106-9e63-8e26e61cd499 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:52:00.078840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:00.087548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f5e79386-a8de-4f8b-ac9b-c67fc398593e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 200 len: 1193 microversion: 2.1 time: 0.196542 Nov 02 12:52:00.102622 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2744/5410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:59 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 1193 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:00.134927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:00.147489 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d8568a7d-5e3f-435d-b9a1-fe08ecd5c496 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.675390 Nov 02 12:52:00.148663 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2667/5411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:59 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:00.170839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:00.173861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:00.187548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:00.189267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:00.189991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:00.193052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:00.194417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:00.195144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:00.278380 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-22dda8e5-aed3-465e-a081-b9cd8f45fd62 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 200 len: 324 microversion: 2.1 time: 0.110518 Nov 02 12:52:00.285631 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2745/5412] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:52:00 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 324 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:00.292904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:00.293543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:00.305806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:00.306522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:00.309006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:00.309822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:00.312183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:00.312709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:00.601980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:00.612495 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-479919b9-2384-4c8d-b969-d6f1a0d7060a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.325363 Nov 02 12:52:00.613351 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2668/5413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:00 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:00.639783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:00.640428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:00.648423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:00.648932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:00.649560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:00.650413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:00.650919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:00.651380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:00.918374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:00.918991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:00.930265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:00.930946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:00.932949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:00.935516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:00.936780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:00.937592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.022155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:01.035350 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-159c93d2-2231-4322-8cd6-e5eb8c5791e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.399306 Nov 02 12:52:01.048516 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2746/5414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:00 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:01.058619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:01.059160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:01.069490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.070360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.071141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.072058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.072739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.073815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.080694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:01.102226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:01.109078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:01.110569 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a0a8612-f4be-49de-b33f-d88380a34887 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.196145 Nov 02 12:52:01.111646 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2669/5415] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:00 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:52:01.118800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:01.119715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 4be61419-9a02-4106-9e63-8e26e61cd499] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:01.128263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.128951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.129555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.130575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.131190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.131779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.148250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 4be61419-9a02-4106-9e63-8e26e61cd499 could not be found. Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 HTTP/1.1 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 4be61419-9a02-4106-9e63-8e26e61cd499 could not be found. Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4be61419-9a02-4106-9e63-8e26e61cd499'} Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be61419-9a02-4106-9e63-8e26e61cd499 could not be found. Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be61419-9a02-4106-9e63-8e26e61cd499 could not be found. Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:01.150240 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:01.154196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:01.154196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:01.154196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:01.154196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:52:01.154196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:52:01.154196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be61419-9a02-4106-9e63-8e26e61cd499 could not be found. Nov 02 12:52:01.154196 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:01.156053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 4be61419-9a02-4106-9e63-8e26e61cd499 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:52:01.157244 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cc72b7f1-7b84-45dc-b3d6-fcbe7dbe4fab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499" status: 404 len: 111 microversion: 2.1 time: 0.044437 Nov 02 12:52:01.158098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2670/5416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:01 2022] GET /compute/v2.1/servers/4be61419-9a02-4106-9e63-8e26e61cd499 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:52:01.382692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:01.392878 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5ccb1f12-40e3-472a-9397-0558196c2432 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.338211 Nov 02 12:52:01.393584 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2747/5417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:01 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:01.419618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:01.420307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:01.427509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.428012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.428662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.429529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.430257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.430779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.692308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:01.707368 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fbce5ae-56e1-4720-ac1c-d3a72de7b99f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.293840 Nov 02 12:52:01.708077 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2671/5418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:01 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:01.921172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-831909922", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "27a2ec76-336c-4d46-b2bd-166a4b3d0fe4"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:02.000709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] validate_networks() for [('27a2ec76-336c-4d46-b2bd-166a4b3d0fe4', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:52:02.141876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:02.142779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:02.160963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:02.163024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:02.165116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:02.166003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:02.167629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:02.168169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:02.323906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:02.336814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:02.340385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:02.341947 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3dd3ac3b-e84e-4928-8eb1-000aa70adf4f tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.204642 Nov 02 12:52:02.344394 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2672/5419] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:02 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:52:03.342605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:52:03.345804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:52:03.346566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:52:03.347619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:52:03.348126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:52:03.360041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:03.360786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:03.361296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:03.362322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:03.362918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:03.363483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:03.374277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:03.374891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:03.382102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:03.383561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:03.384327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:03.385302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:03.387404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:03.388393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:03.396317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:03.408735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for user 856c99b2530442b9bfb9d795a2d1d079 and project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:03.431867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:52:03.435330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:52:03.491076 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f966c17d-0cf5-411f-9072-194adb1e2df6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574358 Nov 02 12:52:03.491936 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2748/5420] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:52:03.503613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d7cc8af4-204a-4992-842c-9e0d30961bd7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:03.504641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d7cc8af4-204a-4992-842c-9e0d30961bd7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:03.537389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:03.549778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:03.552015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:03.553567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-001d3b74-e5e3-425f-b721-c430ba782e4e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.183493 Nov 02 12:52:03.554682 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2673/5421] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:03 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:52:03.621521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d7cc8af4-204a-4992-842c-9e0d30961bd7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:03.638826 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d7cc8af4-204a-4992-842c-9e0d30961bd7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1214 microversion: 2.1 time: 0.133440 Nov 02 12:52:03.659646 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2749/5422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:03 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:04.583744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:04.584899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:04.602888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:04.605131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:04.605659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:04.608651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:04.609279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:04.609780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:04.667351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:04.668517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:04.677347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:04.678142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:04.678736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:04.679604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:04.680229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:04.680805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:04.747831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:04.762378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:04.765104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:04.767586 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b1e0cb5-3a54-4ab5-b53e-3156d9a98d05 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.187743 Nov 02 12:52:04.768534 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2674/5423] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:04 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:04.825912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:04.842971 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-26ecb5cb-7e8b-448f-9924-51a453ca37ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1266 microversion: 2.1 time: 0.179828 Nov 02 12:52:04.844341 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2750/5424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:04 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:05.798664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:05.800613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:05.808555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:05.809628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:05.810134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:05.810861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:05.811518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:05.812112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:05.873596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:05.874264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:05.892010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:05.892524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:05.892975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:05.893705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:05.895542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:05.899890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:05.923832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:05.937353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:05.944169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:05.947242 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f0e12c58-4113-4b6d-93c3-7d0ff47a883b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.153590 Nov 02 12:52:05.972705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2675/5425] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:05 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:06.034410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:06.042998 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1add9a91-105f-4c51-b967-4f576cf802e5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1272 microversion: 2.1 time: 0.174554 Nov 02 12:52:06.044080 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2751/5426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:05 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:06.982409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:06.983039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:06.998950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:07.003089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:07.003878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:07.004898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:07.006927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:07.007698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:07.074525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:07.075147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:07.099500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:07.103757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:07.104416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:07.105193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:07.107871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:07.111719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:07.132076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:07.173084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:07.193421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:07.197657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:07.200194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da7d87d9-c249-46d0-b4cc-f9c5a60b3475 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.223773 Nov 02 12:52:07.215281 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2676/5427] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:06 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:07.583215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:07.602507 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-67e3a842-5ab1-43d6-a4c1-42a58043b94f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1314 microversion: 2.1 time: 0.530225 Nov 02 12:52:07.605607 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2752/5428] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:07 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:08.188097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e2728b65-ed3f-4224-8930-e2ddfb933e95 req-07e4ef5d-4328-461e-8087-27258475d062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb39c862-0ce7-4225-94d8-b0c0769c67d8", "tag": "0d126042-0f5d-4895-9144-cfede503f910"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:08.206854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2728b65-ed3f-4224-8930-e2ddfb933e95 req-07e4ef5d-4328-461e-8087-27258475d062 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:08.207968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2728b65-ed3f-4224-8930-e2ddfb933e95 req-07e4ef5d-4328-461e-8087-27258475d062 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:08.209082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2728b65-ed3f-4224-8930-e2ddfb933e95 req-07e4ef5d-4328-461e-8087-27258475d062 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:08.223595 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e2728b65-ed3f-4224-8930-e2ddfb933e95 req-07e4ef5d-4328-461e-8087-27258475d062 service nova] Creating event network-changed:0d126042-0f5d-4895-9144-cfede503f910 for instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 on n-h1-855650-5 Nov 02 12:52:08.229821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e2728b65-ed3f-4224-8930-e2ddfb933e95 req-07e4ef5d-4328-461e-8087-27258475d062 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045230 Nov 02 12:52:08.233828 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2677/5429] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:08.245516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:08.246121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:08.258014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:08.265668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:08.275803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:08.276844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:08.277494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:08.278133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:08.419643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:08.431981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:08.433929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:08.435333 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bd0b3d4b-7afe-4534-b2f2-a3071247047e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.194237 Nov 02 12:52:08.436351 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2753/5430] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:08 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:08.631525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:08.632534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:08.641190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:08.644861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:08.646363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:08.647271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:08.648900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:08.649645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:08.900451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:08.913038 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0dbbf97f-b06a-4e79-85d3-7fcd0fa7fac8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1314 microversion: 2.1 time: 0.285824 Nov 02 12:52:08.914129 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2678/5431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:08 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:09.469081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:09.470782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:09.481672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:09.482805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:09.483441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:09.485044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:09.485735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:09.486639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:09.569386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:09.584175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:09.587054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:09.588453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55b65ae1-84ad-4046-981b-c898c38930e7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.127741 Nov 02 12:52:09.589571 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2754/5432] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:09 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:09.787924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5b4ee89-93ff-4b4d-9b2a-0af1a4147cf5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:09.792745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:09.826263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:09.826263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:09.826263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:09.826263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:09.826263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:09.826263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:09.937083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:09.938598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:09.947496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:09.948007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:09.948486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:09.949215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:09.950348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:09.950927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:10.250975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:10.261489 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba0d5985-7d69-46d4-b0d5-077bf32f3d83 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1314 microversion: 2.1 time: 0.328524 Nov 02 12:52:10.274828 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2755/5433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:09 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:10.366762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8cf4d310-8833-4300-9368-f7205003235d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.585729 Nov 02 12:52:10.368488 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2679/5434] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:52:09 2022] POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/os-volume_attachments => generated 194 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:10.616488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:10.617755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:10.625144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:10.626009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:10.626733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:10.627719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:10.628398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:10.629275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:10.726307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:10.741702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:10.743187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:10.744434 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a5afe53-f9d3-4afd-8808-462d2f6a1c40 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.132017 Nov 02 12:52:10.744993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2756/5435] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:10 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:11.289527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:11.290268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:11.308863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:11.314186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:11.314698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:11.315319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:11.316194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:11.318644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:11.319666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:11.794965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:11.797074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:11.814089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:11.814943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:11.817293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:11.818797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:11.820334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:11.822212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:11.851501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:11.866919 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-042c5e7b-8c51-4642-9132-3df636c0022e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1314 microversion: 2.1 time: 0.582740 Nov 02 12:52:11.868624 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2680/5436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:11 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:12.027488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:12.042660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:12.044563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:12.047556 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66689a3b-476c-4819-95e2-1fb78b0a7527 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.263612 Nov 02 12:52:12.058352 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2757/5437] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:11 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:12.896115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:12.897153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:12.908160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:12.909198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:12.909891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:12.910878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:12.911574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:12.912220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:13.083211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:13.083852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:13.087823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:13.109625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:13.111695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:13.113299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:13.117059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:13.119909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:13.123138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:13.230516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:13.241644 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f4bec9fb-1522-486f-9c76-53b8c8a4bcdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1314 microversion: 2.1 time: 0.349348 Nov 02 12:52:13.254531 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2681/5438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:12 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:13.320132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:13.364035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-51eb1471-b3c2-4676-8216-6f31733bfd78 req-60f727c8-1c8e-4bcc-96ce-78d6cf0e7edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb39c862-0ce7-4225-94d8-b0c0769c67d8", "name": "network-vif-plugged", "status": "completed", "tag": "0d126042-0f5d-4895-9144-cfede503f910"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:13.371190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:13.373251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:13.380070 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bd6392c6-4179-4e6a-b744-0fe3d2c1252d tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.301225 Nov 02 12:52:13.380732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-51eb1471-b3c2-4676-8216-6f31733bfd78 req-60f727c8-1c8e-4bcc-96ce-78d6cf0e7edf service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:13.381557 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2758/5439] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:13 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:52:13.386970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-51eb1471-b3c2-4676-8216-6f31733bfd78 req-60f727c8-1c8e-4bcc-96ce-78d6cf0e7edf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:13.394001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-51eb1471-b3c2-4676-8216-6f31733bfd78 req-60f727c8-1c8e-4bcc-96ce-78d6cf0e7edf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:13.418357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-51eb1471-b3c2-4676-8216-6f31733bfd78 req-60f727c8-1c8e-4bcc-96ce-78d6cf0e7edf service nova] Creating event network-vif-plugged:0d126042-0f5d-4895-9144-cfede503f910 for instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 on n-h1-855650-5 Nov 02 12:52:13.429785 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-51eb1471-b3c2-4676-8216-6f31733bfd78 req-60f727c8-1c8e-4bcc-96ce-78d6cf0e7edf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073590 Nov 02 12:52:13.431334 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2682/5440] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 12:52:14.273792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:14.275508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:14.288282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:14.291066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:14.296773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:14.298399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:14.299132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:14.301544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:14.303671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:14.304545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:14.419544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:14.420261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:14.437478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:14.438654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:14.439291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:14.441787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:14.444002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:14.445267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:14.568647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:14.579005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac9d11e5-41f3-4d94-94e5-ce29d1ac9856 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1314 microversion: 2.1 time: 0.310895 Nov 02 12:52:14.579114 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2759/5441] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:14 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:14.639593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:14.654111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:14.658507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:14.663998 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9379df9e-122a-409a-a4ea-98248376408e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.250596 Nov 02 12:52:14.664754 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2683/5442] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:14 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:15.605997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:15.606675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:15.630719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:15.634946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:15.635580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:15.643349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:15.645397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:15.645994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:15.691418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:15.692031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:15.702155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:15.705484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:15.706518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:15.707723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:15.708494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:15.709113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:15.877211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:15.883007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:15.911452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:15.914588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:15.930618 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f398530-68ac-483c-88f2-23e5db82b9b2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.244150 Nov 02 12:52:15.935444 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2684/5443] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:15 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:52:16.015007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:16.026999 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7bb829de-adf1-48f1-9e1c-ad57459b0a81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1501 microversion: 2.1 time: 0.425299 Nov 02 12:52:16.031531 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2760/5444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:15 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1501 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:16.055849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f33f8e9-cacf-4bf6-a720-fd3c2c14811b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:16.063396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f33f8e9-cacf-4bf6-a720-fd3c2c14811b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:16.064229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f33f8e9-cacf-4bf6-a720-fd3c2c14811b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:16.064845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f33f8e9-cacf-4bf6-a720-fd3c2c14811b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:16.097809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f33f8e9-cacf-4bf6-a720-fd3c2c14811b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Going to try to stop instance {{(pid=120722) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:52:16.160766 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f33f8e9-cacf-4bf6-a720-fd3c2c14811b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8/action" status: 202 len: 0 microversion: 2.1 time: 0.110097 Nov 02 12:52:16.163097 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2685/5445] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:52:16 2022] POST /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:16.170100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:16.170919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:16.180780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:16.181509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:16.182006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:16.182725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:16.183187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:16.183922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:16.469379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:16.480444 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a83e83c5-6431-46f7-94a3-77e2b7ab6c1e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.314667 Nov 02 12:52:16.482414 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2761/5446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:16 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:16.966186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:16.967159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:16.976363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:16.976721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:16.977187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:16.977918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:16.978405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:16.978841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:17.117148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:17.129005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:17.131281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:17.132530 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dfda6bc1-1abe-4356-a7ce-51c7e1a44fb2 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.171393 Nov 02 12:52:17.143472 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2686/5447] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:16 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:17.504059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:17.504859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:17.517575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:17.518122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:17.518586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:17.519325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:17.519796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:17.520236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:17.831499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:17.851618 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0e5a063c-24be-4085-8891-597f4e846b4a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.350738 Nov 02 12:52:17.855478 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2762/5448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:17 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:18.162583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:18.163219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:18.188204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:18.190242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:18.192901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:18.193901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:18.196075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:18.199763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:18.313754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:18.336870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:18.341189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:18.342495 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b93e6209-2798-44ba-b85d-833f9965600b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.184952 Nov 02 12:52:18.343079 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2687/5449] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:18 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:18.880566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:18.881845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:18.890567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:18.891360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:18.891982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:18.892899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:18.893635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:18.894259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:19.098703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:19.107840 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ac72b51-e2e1-4110-8a93-950d9ac55e38 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.233234 Nov 02 12:52:19.124981 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2763/5450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:18 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:19.372464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:19.373672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:19.381644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:19.382444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:19.383047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:19.383924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:19.384531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:19.385111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:19.491452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:19.508499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:19.512530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:19.514460 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f2b179f-f57e-460f-9877-a19741b7a779 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.146477 Nov 02 12:52:19.516384 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2688/5451] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:19 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:20.132954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:20.133569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:20.142775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:20.143276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:20.143723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:20.144438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:20.156446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:20.156983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:20.514450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:20.524960 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-74ac1b9d-7ebc-4e12-8b3b-f75d3e8d99b5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.395821 Nov 02 12:52:20.532663 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2764/5452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:20 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:20.544103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:20.544779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:20.561505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:20.567445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:20.568183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:20.569322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:20.569739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:20.570218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:20.699142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:20.713065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:20.719408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:20.724132 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9e5804e-fbd5-4777-ad97-3f7bcd7a68a8 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.182912 Nov 02 12:52:20.725465 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2689/5453] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:20 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:21.556245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:21.557935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:21.579442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:21.580925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:21.581794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:21.584232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:21.585816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:21.587697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:21.754330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:21.756080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:21.767257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:21.768479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:21.769150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:21.770382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:21.771379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:21.772023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:21.958480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:21.977326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:21.980725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:21.981552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:21.986415 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-581096e7-5eb3-4903-8789-c7bf1774afb7 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.237197 Nov 02 12:52:21.987021 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2690/5454] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:21 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:21.992142 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39fb1482-02f3-4af4-90b4-dfdf2f733750 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.440619 Nov 02 12:52:21.997238 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2765/5455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:21 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:23.019134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:23.020231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:23.028958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:23.029583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:23.031383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:23.032632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:23.033361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:23.035595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:23.036402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:23.037054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:23.042332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:23.042838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:23.043280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:23.043990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:23.044448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:23.044878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:23.177339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:23.191533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:23.194387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:23.195891 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-517b807e-a6b8-4fbf-9194-e9fd13de3493 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.183001 Nov 02 12:52:23.211366 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2691/5456] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:23 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:23.557278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:23.573301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b890157-ccf5-488d-9fb3-88a66321cfae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.547423 Nov 02 12:52:23.574547 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2766/5457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:23 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:24.225498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:24.226847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:24.241428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:24.241944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:24.245389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:24.246183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:24.246666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:24.247106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:24.408147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:24.426509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:24.428170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:24.429675 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53217869-9078-463e-ba2d-848ec95c704b tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1601 microversion: 2.42 time: 0.208225 Nov 02 12:52:24.430809 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2692/5458] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:24 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1601 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:24.600357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:24.601226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:24.620603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:24.621879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:24.624912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:24.626490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:24.627431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:24.628878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:24.860441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:24.869693 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-540bbd6d-d36a-4989-9a05-055c2e3a1fb6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.274108 Nov 02 12:52:24.890739 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2767/5459] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:24 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:25.459893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:25.461956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:25.473103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:25.473799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:25.475189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:25.476210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:25.476690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:25.477379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:25.538764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:25.539617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:25.540307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:25.541573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lazy-loading 'fault' on Instance uuid d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:52:25.613205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:25.627351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:25.628835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04c1e4d0344f444db533d8b419cee797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72292c4dd7214be4a630e6c175b8453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:25.638403 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f0405ab9-8211-42c0-a52e-5d21f2cd077e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 200 len: 1606 microversion: 2.42 time: 0.176730 Nov 02 12:52:25.639134 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2693/5460] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:25 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 1606 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:25.910648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:25.910648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:25.940561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:25.941262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:25.941906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:25.943096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:25.944429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:25.944429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:26.197068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:26.204540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:26.211782 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e4c88a9-d857-4719-aca5-254cef50f565 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.309387 Nov 02 12:52:26.213159 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2768/5461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:25 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:26.559494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:26.560624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:26.579891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:26.580619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:26.581230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:26.582474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:26.584266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:26.585443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:26.667994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:26.669052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:26.683804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:26.685205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:26.687230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:26.692356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:26.700185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:26.734825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:26.785983 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] HTTP exception thrown: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Request method failure captured: Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 HTTP/1.1 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmZKAR1ewY5Wx--ofmICu_jhhp24EUXAGSlGipx0bfeA3Qk9F_1l12Ob-zr8__3xaMKVAMm76zZU5okwgDppDRwnvA7ev5h99-aJTP4NdXj0bJHDkHJkUkQi41rPeuFxhZoSI1WwtlIsjkTgmeE0GZB-hXx4fHwmMIDnFdqfG5YGLAc Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 72292c4dd7214be4a630e6c175b8453e Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 72292c4dd7214be4a630e6c175b8453e Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TaggedBootDevicesTest_v242-1182835135-project Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 04c1e4d0344f444db533d8b419cee797 Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1182835135-project Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'd7e7c7d4-5eb8-49d9-b498-8a6aa88b6819'} Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:26.796978 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Returning 404 to user: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20ff39b0-a141-4161-9769-a918624e4b00 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 404 len: 111 microversion: 2.42 time: 0.136461 Nov 02 12:52:26.802002 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2769/5462] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:26 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:52:26.819046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d540729-5d21-473f-bf64-e7bbfb7aaf74 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '.version_select at 0x7f2292a5b670>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:26.836350 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7d540729-5d21-473f-bf64-e7bbfb7aaf74 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [58f6817e-0e64-4d70-86fd-4ecc655506dc] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:52:27.074886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lazy-loading 'services' on Instance uuid e632eace-df7e-4848-8b7f-584fd66859a8 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:52:27.834828 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f24b4c61-21f7-4f01-a14d-fe90447bfe59 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments/cdc67136-7dff-4411-b4eb-29b0f44638bc" status: 202 len: 0 microversion: 2.1 time: 1.280458 Nov 02 12:52:27.844681 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [None req-7d540729-5d21-473f-bf64-e7bbfb7aaf74 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [58f6817e-0e64-4d70-86fd-4ecc655506dc] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 34832. Nov 02 12:52:27.850062 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2694/5463] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:52:26 2022] DELETE /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments/cdc67136-7dff-4411-b4eb-29b0f44638bc => generated 0 bytes in 1289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:27.867699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:27.868444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:27.895887 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d540729-5d21-473f-bf64-e7bbfb7aaf74 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811820979" status: 204 len: 0 microversion: 2.42 time: 1.087462 Nov 02 12:52:27.897334 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2770/5464] 10.222.0.45 () {60 vars in 1259 bytes} [Wed Nov 2 12:52:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811820979 => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:52:27.903018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:27.903465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:27.903922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:27.907114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:27.908132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:27.910617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:27.911396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:27.913857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:27.932071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:27.932557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:27.933014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:27.933741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:27.939980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:27.940829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:28.072993 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e1d74af1-3b9c-4d64-8f43-f8f0813d0a6f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172838 Nov 02 12:52:28.075669 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2771/5465] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:27 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:28.500324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:28.514224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-079de95c-c558-4e3b-8aaa-39f148445b66 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.654324 Nov 02 12:52:28.519263 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2695/5466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:27 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:29.091663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:29.100856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:29.152755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:29.154813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:29.157771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:29.160971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:29.162463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:29.166777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:29.349438 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-28c5ec9a-173a-4277-bd0f-f98deccbed8e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.266166 Nov 02 12:52:29.355594 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2772/5467] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:29 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:29.543408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:29.544995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:29.570527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:29.571045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:29.571518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:29.572303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:29.572773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:29.579630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:29.863794 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:52:29.863794 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 12:52:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 (ip 10.222.0.45) !!! Nov 02 12:52:30.092174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:30.131350 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8248f2a4-c874-4bb4-b7cf-020c2efc1326 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.584715 Nov 02 12:52:30.133992 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2696/5468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:29 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:30.378380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:30.399052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:30.430222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:30.431120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:30.432860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:30.441065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:30.442102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:30.442905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:30.512823 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d9a166a-1fc4-4199-b702-f3c395e416b9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152149 Nov 02 12:52:30.517105 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2773/5469] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:30 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:31.163074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:31.164029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:31.187481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:31.189314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:31.192055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:31.193280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:31.194002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:31.195873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:31.528949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:31.531631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:31.558966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:31.559475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:31.559930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:31.560668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:31.561135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:31.578668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:31.704960 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a0dc8776-4912-4e7a-8960-d7d10a910113 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180511 Nov 02 12:52:31.719228 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2774/5470] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:31 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:32.447863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:32.467669 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5d59fb59-5319-4ad4-bf22-178de2a0f9a4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 1.309863 Nov 02 12:52:32.489648 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2697/5471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:31 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:32.723066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:32.741997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:32.773468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:32.774187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:32.774669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:32.789353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:32.789859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:32.790348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:32.881042 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b66287c9-f628-4e35-9113-b42c26e08af9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166623 Nov 02 12:52:32.881677 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2775/5472] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:32 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:33.496562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:33.498013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:33.534153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.535799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.537631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.544454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.545272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.545941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.897091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:33.899823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:33.927405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.930501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.935491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.936695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.940495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.944752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.963263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:33.974475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3bed8c93-dbbf-4d52-826d-4f36dd04f2cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.482214 Nov 02 12:52:33.977556 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2698/5473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:33 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:34.036609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41de11de-b6bb-485a-acc4-bf198c31e546 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143408 Nov 02 12:52:34.040315 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2776/5474] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:33 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:35.007922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:35.008992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:35.034576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.035419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.036358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.038674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.043460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.043920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.056527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:35.063112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:35.075364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.076884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.090764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:35.106596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.121185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.122066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.131050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.290133 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c651ef23-1132-42d5-8781-48a0780bd46f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.241070 Nov 02 12:52:35.293367 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2777/5475] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:35 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:35.538477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:35.561813 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3759898f-791f-4ea3-93dd-864325b0cf69 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.561515 Nov 02 12:52:35.565349 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2699/5476] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:34 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:36.312376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:36.337747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:36.368483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:36.369002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:36.371351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:36.372359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:36.375189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:36.375638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:36.443508 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84123185-fb49-4b04-9346-bbb41f7b766b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133562 Nov 02 12:52:36.446521 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2778/5477] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:36 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:36.591024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:36.594630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:36.615322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:36.616073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:36.616875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:36.617905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:36.618558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:36.625624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:37.084438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:37.085768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:37.099936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:37.102469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:37.103126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:37.106500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:37.108060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:37.110546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:37.135793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:37.148200 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] HTTP exception thrown: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.149417 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a7ee7e2-aaf1-4413-8b21-77e88050152f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.564406 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Request method failure captured: Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 HTTP/1.1 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmZKAR1ewY5Wx--ofmICu_jhhp24EUXAGSlGipx0bfeA3Qk9F_1l12Ob-zr8__3xaMKVAMm76zZU5okwgDppDRwnvA7ev5h99-aJTP4NdXj0bJHDkHJkUkQi41rPeuFxhZoSI1WwtlIsjkTgmeE0GZB-hXx4fHwmMIDnFdqfG5YGLAc Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 72292c4dd7214be4a630e6c175b8453e Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 72292c4dd7214be4a630e6c175b8453e Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TaggedBootDevicesTest_v242-1182835135-project Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 04c1e4d0344f444db533d8b419cee797 Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1182835135-project Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'd7e7c7d4-5eb8-49d9-b498-8a6aa88b6819'} Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:52:37.149872 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.156916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.169881 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2700/5478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:36 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:37.178076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Returning 404 to user: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:52:37.179269 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-23c0aa79-bdd8-4a7a-9e2f-bf07748f3a1e tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 404 len: 111 microversion: 2.42 time: 0.098722 Nov 02 12:52:37.180192 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2779/5479] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:52:37 2022] DELETE /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:52:37.204454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:37.205091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] [instance: d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:37.221296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:37.221806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:37.224279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:37.228377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:37.229292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:37.229897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:37.260975 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] HTTP exception thrown: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Request method failure captured: Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 HTTP/1.1 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmZKAR1ewY5Wx--ofmICu_jhhp24EUXAGSlGipx0bfeA3Qk9F_1l12Ob-zr8__3xaMKVAMm76zZU5okwgDppDRwnvA7ev5h99-aJTP4NdXj0bJHDkHJkUkQi41rPeuFxhZoSI1WwtlIsjkTgmeE0GZB-hXx4fHwmMIDnFdqfG5YGLAc Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 72292c4dd7214be4a630e6c175b8453e Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_72292c4dd7214be4a630e6c175b8453e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 72292c4dd7214be4a630e6c175b8453e Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1182835135 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TaggedBootDevicesTest_v242-1182835135-project Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 04c1e4d0344f444db533d8b419cee797 Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1182835135-project Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'd7e7c7d4-5eb8-49d9-b498-8a6aa88b6819'} Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.272301 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:37.276313 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.276313 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:37.276313 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:37.276313 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:37.276313 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:52:37.276313 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:52:37.276313 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. Nov 02 12:52:37.276313 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:37.280927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] Returning 404 to user: Instance d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:52:37.284485 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46f7af4e-b863-4e9d-bf3c-b581977b59b5 tempest-TaggedBootDevicesTest_v242-1182835135 tempest-TaggedBootDevicesTest_v242-1182835135-project] 10.222.0.45 "GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819" status: 404 len: 111 microversion: 2.42 time: 0.090072 Nov 02 12:52:37.286039 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2701/5480] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:37 2022] GET /compute/v2.1/servers/d7e7c7d4-5eb8-49d9-b498-8a6aa88b6819 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:52:37.458533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:37.461071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:37.472645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:37.474302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:37.475010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:37.476068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:37.476703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:37.477281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:37.535259 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df1bf5e4-520d-44f3-ab1d-16730ae7f52e tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081193 Nov 02 12:52:37.536514 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2780/5481] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:37 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:38.198297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:38.198839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:38.212389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.212618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.213069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.213787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.214296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.214726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.549353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:38.551777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:38.559226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.560630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.560630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.561158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.561656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.562360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.573807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:38.583008 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9aa3653-cdfc-4e37-ba9a-0dbe280ec7dc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.389698 Nov 02 12:52:38.584230 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2702/5482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:38 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:38.621435 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b56860f3-da5a-44aa-9ffd-693d2220d112 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075360 Nov 02 12:52:38.622428 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2781/5483] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:38 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:39.606819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:39.607565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:39.616061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:39.616791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:39.617387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:39.618451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:39.619076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:39.619987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:39.634561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:39.637061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:39.655033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:39.655632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:39.658191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:39.658953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:39.659431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:39.661326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:39.765730 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a4541b95-76a1-42e6-a262-cbcb68283520 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125080 Nov 02 12:52:39.774274 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2782/5484] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:52:39 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:52:39.864744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:39.882030 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6dac4df3-15c1-4196-bcec-82ef971b9fa4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.279309 Nov 02 12:52:39.882971 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2703/5485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:39 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:40.824750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:40.825267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:40.840531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.841042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.841494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.842256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.842814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.843251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.886004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:52:40.908668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:40.909313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:40.922341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.923219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.923739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.924585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.925052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.925495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:41.120903 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-87ef319a-495b-4994-99bc-f3b927cd8d0b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 204 len: 0 microversion: 2.1 time: 0.297778 Nov 02 12:52:41.123834 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2783/5486] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:52:40 2022] DELETE /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:52:41.137128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:41.138131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:41.153587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:41.154190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:41.154763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:41.157365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:41.157924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:41.158395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:41.726143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:41.738946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-061360a9-002d-4982-9484-2cb68a5dbb11 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1511 microversion: 2.1 time: 0.831277 Nov 02 12:52:41.739998 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2704/5487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:40 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1511 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:41.778769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:41.793597 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-db2910a0-9897-4665-a191-b07693d10e94 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1682 microversion: 2.1 time: 0.664873 Nov 02 12:52:41.796318 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2784/5488] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:41 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1682 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:42.770612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:42.771757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:42.788013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=52 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:42.828031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:42.828673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:42.834876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:42.836403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:42.838332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:42.840890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:42.844339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:42.845096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:42.848657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:42.849163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:42.849610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:42.850378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:42.850846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:42.851280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:44.203578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:44.213022 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1dca49f4-2a70-49ca-a939-2d26f793b0ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1488 microversion: 2.1 time: 1.451823 Nov 02 12:52:44.225831 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2705/5489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:42 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1488 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:44.245052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:44.250394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:44.267284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:44.268221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:44.268937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:44.269885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:44.270568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:44.271169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:44.429837 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6793afbb-3458-40e8-b6ec-3215aca73ba0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 200 len: 198 microversion: 2.1 time: 0.191639 Nov 02 12:52:44.431074 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2706/5490] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:52:44 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 198 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:44.443352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:44.444280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:44.493690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:44.496221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:44.499703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:44.500733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:44.506798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:44.507544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:44.566675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:44.584178 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a23b3990-5e70-4c59-aab1-3da2d0c4c7d9 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1682 microversion: 2.1 time: 1.760783 Nov 02 12:52:44.610396 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2785/5491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:42 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1682 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:45.216142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:45.252013 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-57650ad2-fab9-4f41-b447-622914dd7801 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.814398 Nov 02 12:52:45.252879 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2707/5492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:44 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:45.294466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:45.301500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:45.364014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:45.404087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:45.410865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:45.414331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:45.426639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:45.428078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:45.429048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:45.442641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:45.628564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:45.640103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:45.700112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:45.701020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:45.713080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:45.717053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:45.723527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:45.728976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:46.664608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:46.680398 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ecafb03d-de32-496b-bf43-1818ec30b847 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1682 microversion: 2.1 time: 1.070937 Nov 02 12:52:46.695170 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2708/5493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:45 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1682 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:47.065231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:47.083875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-141d9d7d-aa56-4759-8388-53e4edec3786 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.801779 Nov 02 12:52:47.085192 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2786/5494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:45 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:47.112127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:47.112800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:47.136087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.137945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.140890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:47.143842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.144976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.147261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:47.720102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:47.721039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:47.750534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.758097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.758764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:47.760965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:47.761605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.761780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.762311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:47.775228 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62488c7a-3836-4254-9981-1f07acf9b9e8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.668846 Nov 02 12:52:47.785348 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2709/5495] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:47 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:47.808609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:47.809570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:47.823655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.828572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.829414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:47.834753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.836131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.839202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:48.551138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:48.564608 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d3e3dca5-4b52-4368-ba58-3b7743dcf647 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1614 microversion: 2.1 time: 0.857882 Nov 02 12:52:48.570125 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2787/5496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:47 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1614 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:48.615553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6afc8cb3-b399-451f-8f1d-45d0e5f40e23 req-66515ffb-92f8-482d-b762-5b9097909035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e632eace-df7e-4848-8b7f-584fd66859a8", "name": "network-vif-deleted", "tag": "5cd4b237-744c-4737-9ae2-0ff3f31c60e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:48.634360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6afc8cb3-b399-451f-8f1d-45d0e5f40e23 req-66515ffb-92f8-482d-b762-5b9097909035 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:48.638030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6afc8cb3-b399-451f-8f1d-45d0e5f40e23 req-66515ffb-92f8-482d-b762-5b9097909035 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:48.638856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6afc8cb3-b399-451f-8f1d-45d0e5f40e23 req-66515ffb-92f8-482d-b762-5b9097909035 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:48.667458 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6afc8cb3-b399-451f-8f1d-45d0e5f40e23 req-66515ffb-92f8-482d-b762-5b9097909035 service nova] Creating event network-vif-deleted:5cd4b237-744c-4737-9ae2-0ff3f31c60e2 for instance e632eace-df7e-4848-8b7f-584fd66859a8 on n-h2-855650-5 Nov 02 12:52:48.685023 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6afc8cb3-b399-451f-8f1d-45d0e5f40e23 req-66515ffb-92f8-482d-b762-5b9097909035 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068882 Nov 02 12:52:48.687470 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2788/5497] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:48.813470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:48.835801 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ff41d70-7e3b-4c20-af87-91844f94b5c0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.031725 Nov 02 12:52:48.885334 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2710/5498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:47 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:49.144871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1162476632", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "27a2ec76-336c-4d46-b2bd-166a4b3d0fe4"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:49.286777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] validate_networks() for [('27a2ec76-336c-4d46-b2bd-166a4b3d0fe4', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:52:49.615857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:49.618154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:49.668259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:49.669663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:49.671400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:49.673285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:49.674432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:49.675931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:49.825441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:49.828442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:49.831400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:49.832235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lazy-loading 'fault' on Instance uuid e632eace-df7e-4848-8b7f-584fd66859a8 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:52:50.055668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be15916efb09427eb892d0104e3db5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729f04bcc75843d6beb94e3679bff2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:50.078590 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9994ad8-6427-4da5-8761-d93b4970c59f tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 200 len: 1331 microversion: 2.1 time: 0.482407 Nov 02 12:52:50.101044 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2711/5499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:49 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 1331 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:50.757142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:52:50.758044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:52:50.759018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:52:50.759732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:52:50.760388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:52:50.795237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:50.799090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:50.827578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:50.828892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:50.833455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:50.834229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:50.913901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:50.924051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for user 856c99b2530442b9bfb9d795a2d1d079 and project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:50.964555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:52:50.973946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:52:51.147461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:51.148582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:51.188947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:51.199268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:51.199268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:51.200230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:51.203255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:51.204179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:51.260968 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 HTTP/1.1 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'e632eace-df7e-4848-8b7f-584fd66859a8'} Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:51.263067 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:51.267412 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:51.267412 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:51.267412 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:51.267412 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:52:51.267412 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:52:51.267412 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:52:51.267412 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:52:51.271647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:52:51.272620 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7414baf1-1031-4a96-bc38-f9bcce6e98ba tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 404 len: 111 microversion: 2.1 time: 0.147705 Nov 02 12:52:51.276673 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84749b48-b3a0-4197-a0a1-59345812b9db tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.125781 Nov 02 12:52:51.276673 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2789/5500] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:52:51.287512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2712/5501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:51 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:52:51.294189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f00102e5-dca8-477b-a765-a239ad707c81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:51.295246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f00102e5-dca8-477b-a765-a239ad707c81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:51.305775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da55b3b1-24d3-40e4-b52b-b1b0dcfcb99b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '.version_select at 0x7f228da51550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:51.380831 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da55b3b1-24d3-40e4-b52b-b1b0dcfcb99b tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-492633949" status: 202 len: 0 microversion: 2.1 time: 0.090704 Nov 02 12:52:51.384743 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2713/5502] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:52:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-492633949 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:51.476969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37674191-4a6f-4109-9de6-674d1c8f5f64 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:51.512635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37674191-4a6f-4109-9de6-674d1c8f5f64 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:51.513423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37674191-4a6f-4109-9de6-674d1c8f5f64 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:51.523449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37674191-4a6f-4109-9de6-674d1c8f5f64 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:51.596093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f00102e5-dca8-477b-a765-a239ad707c81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:51.606581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37674191-4a6f-4109-9de6-674d1c8f5f64 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Going to try to stop instance {{(pid=120722) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:52:51.611423 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f00102e5-dca8-477b-a765-a239ad707c81 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1215 microversion: 2.1 time: 0.324335 Nov 02 12:52:51.612451 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2790/5503] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:51 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:51.846936 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37674191-4a6f-4109-9de6-674d1c8f5f64 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/action" status: 202 len: 0 microversion: 2.1 time: 0.373547 Nov 02 12:52:51.851269 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2714/5504] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:52:51 2022] POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:51.858401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:51.859062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:51.917638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:51.939907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:51.940387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:51.941311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:51.941642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:51.962466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:52.656954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89b7176b-aec9-4de1-9a09-88bee2b4c8ee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:52.658564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89b7176b-aec9-4de1-9a09-88bee2b4c8ee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:52.914784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89b7176b-aec9-4de1-9a09-88bee2b4c8ee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:52.933357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89b7176b-aec9-4de1-9a09-88bee2b4c8ee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1215 microversion: 2.1 time: 0.279114 Nov 02 12:52:52.934637 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2715/5505] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:52 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:53.121366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:53.145121 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-002dec42-a348-41e6-ac5c-52ab0f0eaae8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 1.291927 Nov 02 12:52:53.154484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2791/5506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:51 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:53.962763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:53.963400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:54.013682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:54.019796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:54.021176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:54.059103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:54.059516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:54.071103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:54.188306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:54.192782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:54.224480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:54.244804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:54.253715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:54.265522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:54.266771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:54.267839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:54.741469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:54.775780 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb0eb048-db7d-49d3-8105-f704a457551b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1267 microversion: 2.1 time: 0.817192 Nov 02 12:52:54.790971 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2716/5507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:53 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1267 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:54.884356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:54.897630 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be9e69dc-9fc2-4e9a-8875-1257fb37b198 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.716362 Nov 02 12:52:54.898641 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2792/5508] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:54 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:55.806220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:55.807097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:55.865612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:55.874246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:55.879459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:55.888028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:55.895133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:55.898176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:55.933089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:55.934563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:55.966357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:55.981096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:55.992803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:56.002404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:56.005744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:56.012341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:56.229902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:56.238646 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a93e2ee0-4f8c-486b-a6c8-03242b2e22c2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1273 microversion: 2.1 time: 0.438681 Nov 02 12:52:56.242449 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2717/5509] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:55 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1273 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:56.402594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:56.413459 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1b78692f-ab71-4a25-baef-caedfee273e8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.485704 Nov 02 12:52:56.435056 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2793/5510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:55 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:57.274577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:57.276852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:57.303966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:57.310554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:57.315038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:57.317858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:57.322904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:57.326634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:57.421195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:57.453581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:57.454315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:57.511602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:57.519566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:57.526747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:57.533066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:57.534405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:57.549411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:58.108139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:58.124802 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-294d83f5-0dca-40aa-8dce-8f3b4a47e4f2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1315 microversion: 2.1 time: 0.862639 Nov 02 12:52:58.145413 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2718/5511] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:57 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:58.193157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:58.206505 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-350da2f5-30d5-4b9c-b7fb-e80f92e1d8e9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.761663 Nov 02 12:52:58.207367 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2794/5512] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:57 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:58.820660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-14ae0fe1-d038-4491-adcb-94f6f0dda572 req-aa93b891-16b4-423d-be18-13390f875e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b52bde3-d835-41b1-99e2-70b6c90800cc", "tag": "e4c7b6eb-1916-42fa-b70a-d00f038ebca8"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:58.831848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-14ae0fe1-d038-4491-adcb-94f6f0dda572 req-aa93b891-16b4-423d-be18-13390f875e01 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:58.832642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-14ae0fe1-d038-4491-adcb-94f6f0dda572 req-aa93b891-16b4-423d-be18-13390f875e01 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:58.833306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-14ae0fe1-d038-4491-adcb-94f6f0dda572 req-aa93b891-16b4-423d-be18-13390f875e01 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:58.860893 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-14ae0fe1-d038-4491-adcb-94f6f0dda572 req-aa93b891-16b4-423d-be18-13390f875e01 service nova] Creating event network-changed:e4c7b6eb-1916-42fa-b70a-d00f038ebca8 for instance 2b52bde3-d835-41b1-99e2-70b6c90800cc on n-h1-855650-5 Nov 02 12:52:58.881733 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-14ae0fe1-d038-4491-adcb-94f6f0dda572 req-aa93b891-16b4-423d-be18-13390f875e01 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065920 Nov 02 12:52:58.888573 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2719/5513] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:59.158221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:59.158959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:59.182946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:59.183835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:59.184530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:59.186140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:59.186847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:59.187538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:59.250874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:59.257349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:59.311362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:59.312176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:59.312969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:59.367054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:59.368093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.054s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:59.368885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:00.081751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:00.097943 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be7a5d00-d6ef-4dec-8048-21dc673a3560 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1315 microversion: 2.1 time: 0.942567 Nov 02 12:53:00.100190 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2795/5514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:59 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:00.126067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:00.136083 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6f0d102-f722-49e0-87d9-1f638c359490 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.903421 Nov 02 12:53:00.137429 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2720/5515] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:59 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:01.126018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:01.127315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:01.130613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:01.163423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:01.164201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:01.164949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:01.165816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:01.166445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:01.167720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:01.229810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:01.231124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:01.251727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:01.252222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:01.252663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:01.253380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:01.253833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:01.263060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:01.552820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:01.567981 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64d85adb-e521-4ed9-924c-745e606d9383 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1315 microversion: 2.1 time: 0.446591 Nov 02 12:53:01.568586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2796/5516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:01 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:01.722069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:01.730896 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f599f04-50a1-4a2b-82b0-d8e6540d4864 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.516166 Nov 02 12:53:01.736150 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2721/5517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:01 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:02.597239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:02.598158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:02.606983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:02.654085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:02.659036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:02.659837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:02.660915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:02.661663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:02.662624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:02.756230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:02.757465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:02.767699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:02.768372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:02.769171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:02.770153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:02.770833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:02.771521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:02.922992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:03.535260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:03.557827 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9fdd0cf3-4142-4880-ac80-d8fec5e7efe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.801431 Nov 02 12:53:03.559286 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2722/5518] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:02 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:03.576585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:03.595674 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-250c017a-a85f-4022-95fa-add6b1e77e03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1315 microversion: 2.1 time: 1.003666 Nov 02 12:53:03.602920 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2797/5519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:02 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1315 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:04.114809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:04.115954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:04.131902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:04.133545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:04.134354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:04.137260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:04.138003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:04.141799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:04.190264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 HTTP/1.1 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'e632eace-df7e-4848-8b7f-584fd66859a8'} Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:04.193657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.197361 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.199541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:04.207033 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-679d2787-6cee-4407-8a00-b7d7f854a3b4 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 404 len: 111 microversion: 2.1 time: 0.100225 Nov 02 12:53:04.215956 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2723/5520] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:53:04 2022] DELETE /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:04.228681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:04.230720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: e632eace-df7e-4848-8b7f-584fd66859a8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:04.250451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:04.253737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:04.255590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:04.256777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:04.262303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:04.262847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:04.316153 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 HTTP/1.1 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'e632eace-df7e-4848-8b7f-584fd66859a8'} Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:04.362928 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.367566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:04.367566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:04.367566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:04.367566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:04.367566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:04.367566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. Nov 02 12:53:04.367566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:04.372431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance e632eace-df7e-4848-8b7f-584fd66859a8 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:04.379769 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bbf3bf5e-59bf-43f3-982a-27431a003c96 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8" status: 404 len: 111 microversion: 2.1 time: 0.154989 Nov 02 12:53:04.383298 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2798/5521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:04 2022] GET /compute/v2.1/servers/e632eace-df7e-4848-8b7f-584fd66859a8 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:04.593523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:04.594454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:04.607315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:04.608650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:04.609254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:04.610189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:04.615220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:04.617088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:04.632496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:04.633135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:04.654358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:04.660832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:04.661365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:04.668368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:04.673420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:04.675000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:05.900974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:05.928755 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5db6df42-22ab-4072-8e73-c62ac7dca5ae tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 1.334229 Nov 02 12:53:05.952011 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2724/5522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:04 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:06.258751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:06.277352 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b48bdc14-9a9c-4e73-a4c7-05b3be43ebb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1315 microversion: 2.1 time: 1.649272 Nov 02 12:53:06.280419 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2799/5523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:04 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1315 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:06.978949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:06.978949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:07.002770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:07.003600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:07.004068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:07.004804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:07.010743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:07.011853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:07.311389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:07.312289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:07.328266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:07.331193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:07.334744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:07.337082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:07.337707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:07.343583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:07.369922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:07.387953 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e05132c-768a-465c-977c-853c23154120 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.415479 Nov 02 12:53:07.389476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2725/5524] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:06 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:07.982751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a8af9fe1-42e2-4277-956d-c91f5780bf7c req-8c085e8d-d8bf-4215-a75d-419228f435a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b52bde3-d835-41b1-99e2-70b6c90800cc", "name": "network-vif-plugged", "status": "completed", "tag": "e4c7b6eb-1916-42fa-b70a-d00f038ebca8"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:08.010756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a8af9fe1-42e2-4277-956d-c91f5780bf7c req-8c085e8d-d8bf-4215-a75d-419228f435a5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:08.014996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a8af9fe1-42e2-4277-956d-c91f5780bf7c req-8c085e8d-d8bf-4215-a75d-419228f435a5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:08.016023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a8af9fe1-42e2-4277-956d-c91f5780bf7c req-8c085e8d-d8bf-4215-a75d-419228f435a5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:08.050450 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a8af9fe1-42e2-4277-956d-c91f5780bf7c req-8c085e8d-d8bf-4215-a75d-419228f435a5 service nova] Creating event network-vif-plugged:e4c7b6eb-1916-42fa-b70a-d00f038ebca8 for instance 2b52bde3-d835-41b1-99e2-70b6c90800cc on n-h1-855650-5 Nov 02 12:53:08.064927 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a8af9fe1-42e2-4277-956d-c91f5780bf7c req-8c085e8d-d8bf-4215-a75d-419228f435a5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086653 Nov 02 12:53:08.067314 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2726/5525] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:53:08.119657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:08.132858 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3da22457-6238-4212-b81a-dfe511ab1037 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1315 microversion: 2.1 time: 0.825180 Nov 02 12:53:08.151228 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2800/5526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:07 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1315 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:08.433786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:08.436050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:08.460470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:08.460470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:08.460470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:08.468650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:08.469288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:08.478386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:09.168203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:09.171943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:09.202150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:09.203038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:09.207003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:09.208097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:09.210274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:09.210988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:09.761736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:09.807673 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c70c9d62-591f-446d-939c-3710380925ea tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 1.379267 Nov 02 12:53:09.813246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2727/5527] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:08 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:10.315312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:10.356949 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df0fde25-8477-48cf-b389-6f40854d31c1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1315 microversion: 2.1 time: 1.192148 Nov 02 12:53:10.361338 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2801/5528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:09 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1315 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:10.854672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:10.855343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:10.883972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:10.884499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:10.887644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:10.894073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:10.894782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:10.899082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:11.391363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:11.391980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:11.397161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:11.407703 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f23da3d5-694b-48d7-984c-b2f08856326b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.562092 Nov 02 12:53:11.418929 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2728/5529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:10 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:11.448073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:11.449482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:11.450617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:11.453079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:11.459449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:11.460241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:12.021509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:12.039390 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d8050ce-4af1-4135-bf68-d76149610ea5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1503 microversion: 2.1 time: 0.657121 Nov 02 12:53:12.047600 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2802/5530] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:11 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1503 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:12.074051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:12.077238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:12.113417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:12.117610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:12.118913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:12.127105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:12.129996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:12.132044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:12.270206 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bcce49af-6ea7-494d-bbc6-baeecf5eee5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 14 microversion: 2.1 time: 0.200816 Nov 02 12:53:12.271608 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2729/5531] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:12 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:53:12.454553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:12.456668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:12.491592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:12.502110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:12.502931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:12.506923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:12.507778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:12.509711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:12.996877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:13.021502 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe973e56-5956-47a4-a7a8-991209dc11b2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.575019 Nov 02 12:53:13.022602 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2803/5532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:12 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:13.283072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:13.285495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:13.295063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:13.334005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:13.334520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:13.335002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:13.335817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:13.336309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:13.336753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:13.526397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bf7449bf-8607-4f32-8e3b-4a68856dff04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 14 microversion: 2.1 time: 0.247415 Nov 02 12:53:13.530034 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2730/5533] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:13 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:53:14.051498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:14.052356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:14.073915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:14.078174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:14.080177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:14.086317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:14.087510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:14.089450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:14.539687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:14.542898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:14.585395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:14.585928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:14.588794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:14.592526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:14.594348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:14.598588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:14.838537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ced4bf93-43ac-4371-9d58-ff567a2a0110 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 14 microversion: 2.1 time: 0.304060 Nov 02 12:53:14.839781 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2731/5534] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:14 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 14 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:53:14.907564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:14.932032 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fdec098a-f3bf-4e6d-b593-c50bec12e6e0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.885251 Nov 02 12:53:14.933054 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2804/5535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:14 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:15.297948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.298824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:15.321030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.321939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.325782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.327127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.328728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.331759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.381466 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 HTTP/1.1 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '69765fbb-916c-4ca2-81fd-8ceeccde7cb1'} Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:15.390262 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.395083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.405328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:15.407185 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ec9aa7c-01ae-4997-b340-209adc9510f7 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 404 len: 111 microversion: 2.1 time: 0.114134 Nov 02 12:53:15.408960 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2732/5536] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:53:15 2022] DELETE /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:15.431254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.431907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 69765fbb-916c-4ca2-81fd-8ceeccde7cb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:15.466260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.467491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.467986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.468724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.469286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.478284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.544889 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 HTTP/1.1 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '69765fbb-916c-4ca2-81fd-8ceeccde7cb1'} Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:15.546759 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.550584 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.550584 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:15.550584 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:15.550584 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:15.550584 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:15.550584 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. Nov 02 12:53:15.550584 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.555270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance 69765fbb-916c-4ca2-81fd-8ceeccde7cb1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:15.563132 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-85c51561-2c7a-4d46-817e-48af0249e797 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1" status: 404 len: 111 microversion: 2.1 time: 0.148922 Nov 02 12:53:15.567444 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2805/5537] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:15 2022] GET /compute/v2.1/servers/69765fbb-916c-4ca2-81fd-8ceeccde7cb1 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:15.572804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.573385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:15.590157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.590681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.591137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.591925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.592404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.592819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.664815 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe HTTP/1.1 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'b3006885-3516-4839-9208-d9671c6626fe'} Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:15.677809 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:15.682864 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-887f80d0-200e-450a-8303-ef39f370d2d1 tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 404 len: 111 microversion: 2.1 time: 0.112884 Nov 02 12:53:15.690768 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2733/5538] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:53:15 2022] DELETE /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:15.698937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.699871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: b3006885-3516-4839-9208-d9671c6626fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:15.709674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:15.719047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.720180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.720847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.721800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.725121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.725856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.740502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:15.850831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:15.853636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:15.880778 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.883539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.884168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.884627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.885372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe HTTP/1.1 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b3006885-3516-4839-9208-d9671c6626fe'} Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:15.889347 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance b3006885-3516-4839-9208-d9671c6626fe could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:15.893936 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1534bb00-eff5-40c3-9960-67c057cf2a4c tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe" status: 404 len: 111 microversion: 2.1 time: 0.196931 Nov 02 12:53:15.894671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.894671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.906079 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2806/5539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:15 2022] GET /compute/v2.1/servers/b3006885-3516-4839-9208-d9671c6626fe => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:15.959358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.960330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:15.969662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.983523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.983896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.984630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.985102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.985586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:16.103028 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2d032fce-9b42-412d-8d83-e722de7e3cd4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 14 microversion: 2.1 time: 0.257071 Nov 02 12:53:16.104087 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2734/5540] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:15 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 14 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:53:16.398686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:16.410838 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-61c4b6da-63f0-4eb4-bf27-6907e5f98657 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.455669 Nov 02 12:53:16.437255 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2807/5541] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:15 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:17.114664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:17.117008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:17.133751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:17.144712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:17.145222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:17.145953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:17.154892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:17.155553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:17.267049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84933851-686b-4ca5-84f2-dafe8d418a7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 14 microversion: 2.1 time: 0.156495 Nov 02 12:53:17.271762 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2735/5542] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:17 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:53:17.457800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:17.459957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:17.477283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:17.477786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:17.478258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:17.479157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:17.486463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:17.487419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:18.144777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:18.179180 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5515b18-d336-493c-a8b1-23e7948b479d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.729039 Nov 02 12:53:18.190636 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2808/5543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:17 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:18.282249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:18.286863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:18.344670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:18.345344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:18.351734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:18.352610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:18.353110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:18.353562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:18.550194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-06102378-8279-4889-a6ab-54acfb7b4dae tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 14 microversion: 2.1 time: 0.274295 Nov 02 12:53:18.567403 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2736/5544] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:18 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 14 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:53:19.215025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:19.215835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:19.231910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:19.236647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:19.240691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:19.241528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:19.242040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:19.246117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:19.567797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:19.574213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:19.614772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:19.615693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:19.616771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:19.620095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:19.622224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:19.624682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:19.743029 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5dc6ae8c-90bb-42b8-8c9c-2d6edd4038d8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 14 microversion: 2.1 time: 0.180562 Nov 02 12:53:19.748875 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2737/5545] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:19 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:53:19.951272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:19.962553 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93e38113-bdf5-4616-ab3a-7f9fcbfe92a4 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.752344 Nov 02 12:53:19.973658 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2809/5546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:19 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:20.758740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:20.769257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:20.796563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:20.797308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:20.797934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:20.799745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:20.800562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:20.801488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:20.987625 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-180551ac-32f5-4501-8ae2-757cca208f16 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 14 microversion: 2.1 time: 0.231149 Nov 02 12:53:20.987625 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2738/5547] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:20 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 14 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:53:20.999869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:21.001145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:21.031405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:21.031913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:21.032357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:21.033080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:21.033534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:21.033988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:21.626662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:21.635609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7948baa7-3918-41ff-99a8-b813403c83af tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1723 microversion: 2.1 time: 0.646710 Nov 02 12:53:21.656212 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2810/5548] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:20 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1723 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:21.996251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:21.999406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:22.022378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:22.022874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:22.023313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:22.024035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:22.024494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:22.024923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:22.210002 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fef48d55-d44b-4a1d-ab59-94825e7ea28a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action" status: 200 len: 8167 microversion: 2.1 time: 0.217751 Nov 02 12:53:22.218181 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2739/5549] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:21 2022] POST /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc/action => generated 8167 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:22.221379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:22.222043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:22.261444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:22.264761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:22.265520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:22.271730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:22.273669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:22.276034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:22.667703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:22.668703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:22.736939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:22.737623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:22.743365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:22.746889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:22.747540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:22.748146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:23.146558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:23.163388 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-11fa2aa7-9dc1-43c6-9bc1-887fb4156494 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.945546 Nov 02 12:53:23.165610 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2811/5550] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:22 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:23.195910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:23.196783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:23.211169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:23.212998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:23.214921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:23.217351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:23.220078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:23.222593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:23.398807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:23.410297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e876025-efef-4dde-80a1-cc6b5a0bbad5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1700 microversion: 2.1 time: 0.748854 Nov 02 12:53:23.413247 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2740/5551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:22 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1700 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:23.448331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f3fb1d5-1f0b-45f9-a58b-83efa73b635b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:23.458766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f3fb1d5-1f0b-45f9-a58b-83efa73b635b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:23.459609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f3fb1d5-1f0b-45f9-a58b-83efa73b635b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:23.460632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f3fb1d5-1f0b-45f9-a58b-83efa73b635b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:23.517636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:23.528535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f3fb1d5-1f0b-45f9-a58b-83efa73b635b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Going to try to start instance {{(pid=120722) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:53:23.616241 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f3fb1d5-1f0b-45f9-a58b-83efa73b635b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/action" status: 202 len: 0 microversion: 2.1 time: 0.177772 Nov 02 12:53:23.617626 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2741/5552] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:23 2022] POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:53:23.633591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:23.642638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:23.666685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:23.667487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:23.668175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:23.669104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:23.670402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:23.671178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:23.745583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:23.756914 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-283c96b0-7763-4c61-9c6a-48a3c87b299a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.565037 Nov 02 12:53:23.762499 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2812/5553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:23 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:23.789548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:23.790541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:23.807783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:23.810939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:23.811584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:23.815803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:23.815803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:23.816771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:25.026195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:25.047748 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b608c844-9f33-4a1a-bb0e-498e146dd3f7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1709 microversion: 2.1 time: 1.418558 Nov 02 12:53:25.053273 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2742/5554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:23 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1709 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:25.320820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:25.323219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:25.355337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:25.355894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:25.356300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:25.357168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:25.357637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:25.366282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:25.449138 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 HTTP/1.1 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '849b433f-9fa9-413b-8f1e-21a92e07c013'} Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:25.451041 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af92c2e1-4f5f-4a4c-85e9-f34c6da09b1a tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 404 len: 111 microversion: 2.1 time: 0.146163 Nov 02 12:53:25.455066 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2743/5555] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:53:25 2022] DELETE /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:53:25.464914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:25.465550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] [instance: 849b433f-9fa9-413b-8f1e-21a92e07c013] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:25.491489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:25.491983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:25.492432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:25.493142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:25.499274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:25.499902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:25.545129 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] HTTP exception thrown: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Request method failure captured: Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 HTTP/1.1 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmV1TJzh4w6dcuxMZ2TAS8FUWuQVJdHAtPcGltxk07lijSUaQr3qh6wvYEnLAoXQaJbvJcwATzovtXqHXKYgSySjBfPJBunUTiSd40XjtImvqcSOaIjm6n94xRdQxrCZjoUniCbQ7vteCpLusFsxPlUFcZ9U1MAs2-6ADpSh-sWgIBw Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_729f04bcc75843d6beb94e3679bff2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 729f04bcc75843d6beb94e3679bff2e5 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-11580046 Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: be15916efb09427eb892d0104e3db5ff Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-11580046-project Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '849b433f-9fa9-413b-8f1e-21a92e07c013'} Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:25.547402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.552457 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:25.552457 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:25.552457 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:25.552457 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:25.552457 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:25.552457 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. Nov 02 12:53:25.552457 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:53:25.553917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] Returning 404 to user: Instance 849b433f-9fa9-413b-8f1e-21a92e07c013 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:25.555191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1372b569-41ef-45c2-8193-ac4d64b82d2d tempest-AttachVolumeNegativeTest-11580046 tempest-AttachVolumeNegativeTest-11580046-project] 10.222.0.45 "GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013" status: 404 len: 111 microversion: 2.1 time: 0.094543 Nov 02 12:53:25.564729 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2744/5556] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:25 2022] GET /compute/v2.1/servers/849b433f-9fa9-413b-8f1e-21a92e07c013 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:25.707455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:25.727111 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b82fc8bb-1310-4dfe-adad-357664959cc3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.935978 Nov 02 12:53:25.742093 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2813/5557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:23 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:25.762620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:25.763772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:25.796642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:25.797147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:25.797590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:25.798330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:25.798791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:25.799220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:26.079805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:26.080443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:26.126303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:26.129679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:26.130279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:26.132915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:26.133465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:26.134602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:28.141337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:28.172364 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa902edf-7647-4baa-91cc-268ac9f7dfe0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 2.403531 Nov 02 12:53:28.174770 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2745/5558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:25 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 2420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:28.227353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:28.236636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:28.256052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:28.259477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:28.260158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:28.262854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:28.263625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:28.265117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:28.359854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Locking {{(pid=120722) lock /opt/stack/nova/nova/compute/api.py:4845}} Nov 02 12:53:28.493883 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b060cfc-2915-4239-a343-35371164f800 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.293950 Nov 02 12:53:28.500269 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2746/5559] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:28 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:53:28.518713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:28.520760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:28.544155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:28.545776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:28.546539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:28.558045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:28.558862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:28.559425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:28.594406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:28.623172 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8af884c6-cd43-4dcf-85a7-bce01db149ff tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1709 microversion: 2.1 time: 2.549352 Nov 02 12:53:28.630280 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2814/5560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:26 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1709 bytes in 2555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:29.076737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:29.085512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7e9a30eb-69f6-4a44-9172-bf7811947eee tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.583863 Nov 02 12:53:29.089713 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2747/5561] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:28 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:29.156373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8e194707-1698-4d57-91d0-1aab02a2c15e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:29.167267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e194707-1698-4d57-91d0-1aab02a2c15e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:29.168090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e194707-1698-4d57-91d0-1aab02a2c15e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:29.168739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e194707-1698-4d57-91d0-1aab02a2c15e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:29.300683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8e194707-1698-4d57-91d0-1aab02a2c15e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] HTTP exception thrown: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 is locked Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8e194707-1698-4d57-91d0-1aab02a2c15e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Request method failure captured: Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action HTTP/1.1 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 15 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmbwqPdXAjwHRx2HHyO7P8SY40490kvF4jFGHmSsdCX8AyHr6MK24NXoU0Q_GjisdO8__QjnB2uaKPS64a69dQH2TLAACEqwIuJcwP-nbzwIULG_KxQ8xPT3aO33oDoq-XRlvI7I9BSIHcf41UbofEWpgX_XPonCaY5LR_RfPkxAh_Q Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 856c99b2530442b9bfb9d795a2d1d079 Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: {"os-stop": {}} Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 is locked Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '248aeed7-1bf5-458f-91f2-0ba79e600a16', 'body': {'os-stop': {}}} Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 is locked Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 is locked Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 is locked Nov 02 12:53:29.309945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:53:29.316656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8e194707-1698-4d57-91d0-1aab02a2c15e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Returning 409 to user: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 is locked {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:29.321209 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8e194707-1698-4d57-91d0-1aab02a2c15e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 409 len: 107 microversion: 2.1 time: 0.177310 Nov 02 12:53:29.321645 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2815/5562] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:29 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 107 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:53:29.341396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:29.342451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:29.358789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:29.362564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:29.363089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:29.363860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:29.369207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:29.370104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:29.448475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Unlocking {{(pid=120722) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 12:53:29.569891 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f8515fd9-a1bf-45e8-ba46-468ed8cce261 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.233203 Nov 02 12:53:29.577860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2748/5563] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:29 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:53:29.584345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4afec9cd-1560-4425-aa02-88fa17c68bf1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:29.598799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4afec9cd-1560-4425-aa02-88fa17c68bf1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:29.599545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4afec9cd-1560-4425-aa02-88fa17c68bf1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:29.602258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4afec9cd-1560-4425-aa02-88fa17c68bf1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:29.657945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:29.658815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:29.673457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:29.674357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:29.678361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:29.679191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:29.679738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:29.680249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:29.690138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4afec9cd-1560-4425-aa02-88fa17c68bf1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Going to try to stop instance {{(pid=120723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:53:29.858366 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4afec9cd-1560-4425-aa02-88fa17c68bf1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.273037 Nov 02 12:53:29.861119 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2816/5564] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:29 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:53:29.897854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:29.898688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:29.923248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:29.923759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:29.924205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:29.924927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:29.925589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:29.926728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:31.181218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.201701 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c1a200b-46f5-4e7a-821a-04ffb6a9be45 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1709 microversion: 2.1 time: 1.550360 Nov 02 12:53:31.219399 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2749/5565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:29 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1709 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:31.277484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.299376 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57226a99-0e80-44a8-a89e-f24e678b6ccf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 1.419685 Nov 02 12:53:31.300862 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2817/5566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:29 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:32.233015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:32.234033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:32.260399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:32.262373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:32.264576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:32.269648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:32.271291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:32.273437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:32.331890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:32.332757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:32.359472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:32.362939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:32.363537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:32.368349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:32.368990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:32.369861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:33.357518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.371662 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c4edacb2-b290-4404-8d9a-12a2aae7f5bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1713 microversion: 2.1 time: 1.143101 Nov 02 12:53:33.395871 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2750/5567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:32 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1713 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:33.416110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.428907 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-61f06f26-fa1b-4210-a2f7-bbe38a8910ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 1.101806 Nov 02 12:53:33.429511 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2818/5568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:32 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:34.458632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:34.459259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:34.476553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:34.478074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:34.481347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:34.488520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:34.502008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:34.507848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:35.218866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:35.235482 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7bf9a298-c32b-4eb6-ac41-a864a346e6be tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.781872 Nov 02 12:53:35.260567 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2751/5569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:34 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:36.292224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:36.292889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:36.324917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:36.325896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:36.327948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:36.330412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:36.331156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:36.331851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:36.770317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:36.791677 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2c1cf83-f60c-46b9-8467-909dcafa96ce tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.507473 Nov 02 12:53:36.795249 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2819/5570] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:36 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:37.821158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:37.822439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:37.831213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:37.832091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:37.832810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:37.833776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:37.842070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:37.847677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:39.030227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:39.044910 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6875d7b4-a13b-4def-a4d7-86c5c68a6641 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 1.228589 Nov 02 12:53:39.047130 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2752/5571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:37 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:39.431342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1271162320", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8ab447f3-cb67-4daa-b4c6-cbe3709f40f5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5c2de958-5bb8-43d5-9f50-0267f3814230"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:39.619940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] validate_networks() for [('5c2de958-5bb8-43d5-9f50-0267f3814230', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:53:40.082174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:40.085806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:40.105294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:40.105727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:40.106301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:40.111065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:40.111857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:40.113144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:40.183238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:40.825632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:40.843450 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f0195c1-5caa-4d2a-9059-fd2afc32211d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.771679 Nov 02 12:53:40.868388 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2753/5572] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:40 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:41.252684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:53:41.254285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:53:41.255467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:53:41.256202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:53:41.256883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:53:41.328476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:41.329935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:41.331685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:41.334026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:41.334757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:41.344474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:41.386860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:53:41.395714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for user 15b6ee9295464444a626601b16db2574 and project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:53:41.415838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:53:41.418836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8ab447f3-cb67-4daa-b4c6-cbe3709f40f5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:53:41.528172 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e2f8352-8420-483d-b8a2-42dee2d4df33 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.100996 Nov 02 12:53:41.530299 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2820/5573] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:53:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:53:41.548566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-976ee53b-5f7e-4ad7-b9d7-f33bae7e4ec6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:41.550185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-976ee53b-5f7e-4ad7-b9d7-f33bae7e4ec6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:41.659794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-976ee53b-5f7e-4ad7-b9d7-f33bae7e4ec6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:41.673916 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-976ee53b-5f7e-4ad7-b9d7-f33bae7e4ec6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1057 microversion: 2.1 time: 0.131011 Nov 02 12:53:41.676873 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2754/5574] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:41 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1057 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:41.889449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:41.891018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:41.900240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:41.901080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:41.902188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:41.903989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:41.904639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:41.905361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:42.253085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:42.267304 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4e0c5748-ba58-4d79-aaf1-0809738295e4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1657 microversion: 2.1 time: 0.387997 Nov 02 12:53:42.270719 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2821/5575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:41 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1657 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:42.298160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66f13cdf-2ddd-4a56-8a73-832e1bf803cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:42.312308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66f13cdf-2ddd-4a56-8a73-832e1bf803cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:42.312818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66f13cdf-2ddd-4a56-8a73-832e1bf803cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:42.313259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66f13cdf-2ddd-4a56-8a73-832e1bf803cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:42.378586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-66f13cdf-2ddd-4a56-8a73-832e1bf803cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Going to try to start instance {{(pid=120722) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:53:42.541507 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66f13cdf-2ddd-4a56-8a73-832e1bf803cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.244820 Nov 02 12:53:42.547043 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2755/5576] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:42 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:53:42.552456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:42.553075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:42.574368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:42.574896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:42.575377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:42.579066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:42.579555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:42.579998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:42.725135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:42.726116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:42.745599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:42.746335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:42.750402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:42.751554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:42.753029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:42.755487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:42.881946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:42.896250 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8cd8804f-f4fa-4fbf-b8f3-746e03d5723d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1666 microversion: 2.1 time: 0.348718 Nov 02 12:53:42.898659 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2822/5577] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:42 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1666 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:42.946864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:42.969771 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03ba7f8b-92e5-419e-88db-34b72702302c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1061 microversion: 2.1 time: 0.253875 Nov 02 12:53:42.978071 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2756/5578] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:42 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1061 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:43.926854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:43.927489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:43.949983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:43.952379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:43.953722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:43.955691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:43.956193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:43.956637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:44.000401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:44.001022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:44.016198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=56 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:44.025589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:44.026821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:44.030076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:44.031640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:44.038838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:44.052081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:44.053550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:44.395480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:44.411354 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6117da79-4d36-4e80-a620-4f4bff2192ef tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1109 microversion: 2.1 time: 0.415737 Nov 02 12:53:44.414231 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2757/5579] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:43 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1109 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:44.604182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:44.634928 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-99a8534d-65b8-48c9-8bca-9761a15481e3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1666 microversion: 2.1 time: 0.715986 Nov 02 12:53:44.650936 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2823/5580] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:43 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1666 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:45.448601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:45.449258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:45.466317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:45.466841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:45.468146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:45.469775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:45.474027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:45.475163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:45.614776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:45.624922 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ab29276-d9d6-4a57-8cac-268fd6448fed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1127 microversion: 2.1 time: 0.183528 Nov 02 12:53:45.642256 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2758/5581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:45 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1127 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:45.666457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:45.667071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:45.678949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:45.681563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:45.683912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:45.686772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:45.691130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:45.691594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.179821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:46.197126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dceba40a-d86e-4fd8-bed0-235895ae62f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.534767 Nov 02 12:53:46.201890 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2824/5582] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:45 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:46.225392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:46.226105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:46.239710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:46.242584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:46.244243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.247361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:46.248034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:46.249763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.648027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:46.649296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:46.650589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:46.691463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:46.692079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:46.692398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.693116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:46.693572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:46.702470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.787751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:46.811920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-243a6048-e36b-4b08-883f-53c67f9cf415 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.594094 Nov 02 12:53:46.847487 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2759/5583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:46 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:46.865414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:46.866056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:46.884678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:46.885128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:46.885758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.886519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:46.887602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:46.888443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.983467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Unlocking {{(pid=120722) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 12:53:47.151628 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ce01d110-8579-4d21-a382-7be959e07faa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.302824 Nov 02 12:53:47.152933 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2760/5584] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:46 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:53:47.181351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:47.184453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:47.213179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:47.218695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:47.219407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:47.220576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:47.227258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:47.227963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:47.616963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:47.630700 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-293480c7-e71e-4510-ba6b-819bf1586bbc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.986412 Nov 02 12:53:47.631300 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2825/5585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:46 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:48.047912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:48.065916 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d9c367c-5707-468b-b2cb-4bce3789cd75 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.902511 Nov 02 12:53:48.103912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:48.105398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:48.108678 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2761/5586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:47 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:48.116867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:48.117715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:48.118399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:48.119270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:48.119912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:48.120529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:48.516247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:48.544695 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-530ef212-4ed9-451d-a6a0-43fe84d4a456 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.451890 Nov 02 12:53:48.559581 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2826/5587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:48 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:48.569601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:48.570275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:48.584096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ab89cb20-d787-4d71-b76b-4574bdef6628 req-6eab11a9-0b12-45f5-8090-bd47dec5afac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b800506a-c063-4688-9f25-d2bd5c44f01a", "tag": "6b9ebd59-fd43-451e-8f6a-f2855306cef4"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:48.585821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:48.586360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:48.586817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:48.591498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:48.591976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:48.592422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:48.618858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ab89cb20-d787-4d71-b76b-4574bdef6628 req-6eab11a9-0b12-45f5-8090-bd47dec5afac service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:48.620095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ab89cb20-d787-4d71-b76b-4574bdef6628 req-6eab11a9-0b12-45f5-8090-bd47dec5afac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:48.621325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ab89cb20-d787-4d71-b76b-4574bdef6628 req-6eab11a9-0b12-45f5-8090-bd47dec5afac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:48.658284 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ab89cb20-d787-4d71-b76b-4574bdef6628 req-6eab11a9-0b12-45f5-8090-bd47dec5afac service nova] Creating event network-changed:6b9ebd59-fd43-451e-8f6a-f2855306cef4 for instance b800506a-c063-4688-9f25-d2bd5c44f01a on n-h2-855650-5 Nov 02 12:53:48.672942 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ab89cb20-d787-4d71-b76b-4574bdef6628 req-6eab11a9-0b12-45f5-8090-bd47dec5afac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106321 Nov 02 12:53:48.677502 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2827/5588] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:53:48.695763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:48.696488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:48.715469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:48.716543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:48.717139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:48.718547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:48.719018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:48.719582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:49.563452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:49.573193 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bd2e51fb-9afa-414f-bee7-24a69f8b7391 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.892596 Nov 02 12:53:49.573807 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2828/5589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:48 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:49.580317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:49.591628 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d703691-1c84-4971-a365-10587274e75e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.024693 Nov 02 12:53:49.626622 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2762/5590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:48 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:49.641022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:49.644731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:49.661867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:49.664359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:49.667171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:49.673364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:49.675867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:49.678059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:49.933641 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b12b47d9-3338-409d-af6a-f1a0ed83b2f6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.301816 Nov 02 12:53:49.938641 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2829/5591] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:49 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:53:49.951532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:49.951532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:49.975154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:49.978471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:49.983263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:49.984781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:49.985476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:49.986139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:50.605668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:50.607132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:50.665707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:50.667720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:50.670911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:50.681196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:50.681954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:50.682971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:50.885724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:50.918400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-927925d4-8427-47f9-8b5d-4ebc8ce5ae9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1675 microversion: 2.1 time: 0.975348 Nov 02 12:53:50.927896 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2763/5592] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:49 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1675 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:51.164121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:51.185541 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e36c7535-21c2-46ad-8a60-4a98f035c26d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.583888 Nov 02 12:53:51.205752 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2830/5593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:50 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:51.956158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:51.958069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:51.966302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:51.970679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:51.971595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:51.974385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:51.977731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:51.978810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:51.979440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:52.215579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:52.217170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:52.220859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:52.222514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:52.237301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:52.238819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:52.240644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:52.241645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:52.242557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:52.243497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:52.453280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:52.498498 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c905e293-e093-4155-b561-b10596fa70a2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1655 microversion: 2.1 time: 0.544637 Nov 02 12:53:52.517885 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2764/5594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:51 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1655 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:52.524805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:52.531602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:52.550922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:52.551753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:52.552201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:52.553136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:52.560003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:52.560560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:52.603974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:52.620639 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6b65102-3665-4a8a-9426-604f134b6571 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.411954 Nov 02 12:53:52.638003 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2831/5595] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:52 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:52.845348 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f826ac8c-64f8-4649-9513-f6f31c04d480 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.322425 Nov 02 12:53:52.850176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2765/5596] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:52 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:53:52.855687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:52.857441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:52.868438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:52.869283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:52.871001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:52.873453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:52.874217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:52.876453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:53.647641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:53.648692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:53.678174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:53.689534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:53.697797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:53.701005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:53.701734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:53.705893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:54.323676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:54.365586 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5cdfa667-a1e0-413c-bf31-b3118f348364 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1662 microversion: 2.1 time: 1.506566 Nov 02 12:53:54.370782 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2832/5597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:52 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1662 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:54.497449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:54.501458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:54.525549 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5678eb7d-a7ca-4e6b-8273-883a1bb1175c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.870855 Nov 02 12:53:54.527038 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2766/5598] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:53 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:55.164480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1959602073", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "5bea8c9d-402f-4fb0-80df-3c224969206c"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:55.361159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] validate_networks() for [('5bea8c9d-402f-4fb0-80df-3c224969206c', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:53:55.408780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:55.409426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:55.444546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:55.447586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:55.449413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:55.454984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:55.457815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:55.458503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:55.923738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:55.944029 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4bb2078d-05e1-4634-8afd-869292e34c87 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.539490 Nov 02 12:53:55.946021 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2767/5599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:55 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:55.956118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:55.956610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:56.012834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:56.013344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:56.013803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:56.021299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:56.022468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:56.023309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:56.939919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:56.944822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:53:56.945763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:53:56.946628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:53:56.947494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:53:56.948277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:53:56.950668 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d187c065-4efc-4a83-b369-b821b4face7f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 1.002802 Nov 02 12:53:56.954307 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2768/5600] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:55 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:56.965776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:56.969513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:56.998734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:57.000756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:57.001377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:57.003029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:57.004688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:57.005485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:57.015258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:57.018681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:57.019589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:57.020577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:57.021040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:57.023522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:57.083533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Getting quotas for project 1c681e5678d3452286a3113aaac4a72a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:53:57.094562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Getting quotas for user 8fdc60c1012d435d9a33a97bd556db99 and project 1c681e5678d3452286a3113aaac4a72a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:53:57.112411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:53:57.116459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:53:57.221410 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce5ccfd2-31c8-4dcc-a0e0-a3e753c9ec90 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.831603 Nov 02 12:53:57.238863 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2833/5601] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:53:57.433652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:57.442368 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3d33fe0-f785-408c-9432-cb2fa8493d37 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.486773 Nov 02 12:53:57.471329 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2769/5602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:56 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:57.479258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:57.486238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:57.520605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:57.521426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:57.523823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:57.524760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:57.526312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:57.526989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:57.853683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1487928078", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "5bea8c9d-402f-4fb0-80df-3c224969206c"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:57.980227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] validate_networks() for [('5bea8c9d-402f-4fb0-80df-3c224969206c', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:53:58.650187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:58.682952 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-74a2592c-fa77-41d9-8132-66639cda6481 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.212386 Nov 02 12:53:58.684708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2834/5603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:57 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:58.705470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:58.708409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:58.732733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:58.744763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:58.745561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:58.753911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:58.754682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:58.758735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:59.852291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:59.861166 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49296a5d-2f91-40dc-82ed-c2081b9dbea5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 1.175126 Nov 02 12:53:59.867375 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2835/5604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:58 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:59.884583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:59.889783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:59.929424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:59.930419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:59.939377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:59.947906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:59.951022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:59.954786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:00.750383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:00.767345 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7fce71b0-6f91-4d1a-9a3c-c3389b97bb57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.898329 Nov 02 12:54:00.767916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:54:00.768410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:54:00.769088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:54:00.769494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:54:00.769922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:54:00.780636 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2836/5605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:59 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:00.807325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:00.808137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:00.809462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:00.811579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:00.813111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:00.814478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:00.857031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:00.860098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:00.862366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Getting quotas for project 1c681e5678d3452286a3113aaac4a72a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:54:00.875537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Getting quotas for user 8fdc60c1012d435d9a33a97bd556db99 and project 1c681e5678d3452286a3113aaac4a72a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:54:00.908896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:00.910246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:54:00.912914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:00.914662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:54:00.917792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:00.923550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:00.929369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:00.932537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:01.023811 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e656d3b-0456-4538-8d2a-67fa1a007155 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.173745 Nov 02 12:54:01.026388 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2770/5606] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:54:01.058089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:01.060785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:01.098534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:01.099043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:01.103474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:01.105511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:01.106235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:01.107407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:01.850666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:01.887077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:01.925816 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-23bdd44d-8bb4-4022-9204-cc3959967bda tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.098597 Nov 02 12:54:01.929326 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2837/5607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:00 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:01.944634 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c82a26fa-6ce7-4bfd-82f8-df593227b1f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.914627 Nov 02 12:54:01.951497 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2771/5608] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:01 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:01.963845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1713285066", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "451", "networks": [{"uuid": "5bea8c9d-402f-4fb0-80df-3c224969206c"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:01.975361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:01.975998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:01.996892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:02.002807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:02.005012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:02.006871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:02.009529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:02.012632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:02.158969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] validate_networks() for [('5bea8c9d-402f-4fb0-80df-3c224969206c', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:54:02.584391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:02.596821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9f20dd2-7841-42cb-b1aa-ead714ccdd95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.625729 Nov 02 12:54:02.619716 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2772/5609] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:01 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:02.982072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:02.982901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:03.012277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:03.012793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:03.013241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:03.013980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:03.016134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:03.031386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:03.465096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:03.480189 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c1cb3dd-7c9d-4625-94df-374c8728d817 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.506120 Nov 02 12:54:03.496947 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2773/5610] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:02 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:03.513669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:54:03.515196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:54:03.515961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:54:03.517527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:54:03.518215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:54:03.533665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:03.535699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:03.537118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:03.539117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:03.539716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:03.540311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:03.569551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Getting quotas for project 1c681e5678d3452286a3113aaac4a72a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:54:03.578211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Getting quotas for user 8fdc60c1012d435d9a33a97bd556db99 and project 1c681e5678d3452286a3113aaac4a72a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:54:03.599749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:54:03.603645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:54:03.661150 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8c4fb407-97a1-4f9c-8672-c317353f4961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.728236 Nov 02 12:54:03.662702 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2838/5611] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:54:03.675107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a193d5e6-7410-4ca2-8f3f-3219054fafb9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:03.676693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a193d5e6-7410-4ca2-8f3f-3219054fafb9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:03.782081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a193d5e6-7410-4ca2-8f3f-3219054fafb9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:03.793008 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a193d5e6-7410-4ca2-8f3f-3219054fafb9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1221 microversion: 2.1 time: 0.123278 Nov 02 12:54:03.796023 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2774/5612] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:03 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:04.510480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:04.511493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:04.532053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:04.532732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:04.537176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:04.538314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:04.541100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:04.543838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:04.824438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:04.826086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:04.835069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:04.836288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:04.836893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:04.838531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:04.847564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:04.848223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:05.203719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:05.234317 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18de4749-3360-4b26-ae88-1d202e06065d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1225 microversion: 2.1 time: 0.415121 Nov 02 12:54:05.251244 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2775/5613] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:04 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1225 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:05.257415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fe9f61fd-f1d1-4648-8a25-6b4654c29f83 req-da7a9a07-1910-4a95-92c0-c3dc32c693cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa0875b-f988-417b-b891-d9fc9e9a1fad", "tag": "3bac5ef2-442b-4c77-97e5-f1c693ca0e04"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:05.271933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fe9f61fd-f1d1-4648-8a25-6b4654c29f83 req-da7a9a07-1910-4a95-92c0-c3dc32c693cd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:05.272640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fe9f61fd-f1d1-4648-8a25-6b4654c29f83 req-da7a9a07-1910-4a95-92c0-c3dc32c693cd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:05.273442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fe9f61fd-f1d1-4648-8a25-6b4654c29f83 req-da7a9a07-1910-4a95-92c0-c3dc32c693cd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:05.308202 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fe9f61fd-f1d1-4648-8a25-6b4654c29f83 req-da7a9a07-1910-4a95-92c0-c3dc32c693cd service nova] Creating event network-changed:3bac5ef2-442b-4c77-97e5-f1c693ca0e04 for instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad on n-h1-855650-5 Nov 02 12:54:05.322831 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fe9f61fd-f1d1-4648-8a25-6b4654c29f83 req-da7a9a07-1910-4a95-92c0-c3dc32c693cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069287 Nov 02 12:54:05.323522 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2776/5614] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:05.377896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:05.396367 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f88823d1-77e0-4edb-817c-8c1b080e6445 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.891282 Nov 02 12:54:05.413747 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2839/5615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:04 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:06.259840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:06.260559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:06.273479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:06.273904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:06.274389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:06.275110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:06.275618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:06.276006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:06.429078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:06.430459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:06.443633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:06.449209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:06.450259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:06.451208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:06.451871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:06.454300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:07.273130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:07.292658 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d3d8513-912b-40f8-a0c5-35e9129d0bda tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1291 microversion: 2.1 time: 1.034580 Nov 02 12:54:07.295842 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2777/5616] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:06 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1291 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:07.490362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:07.503574 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cfe4ab5b-ac48-43c6-950c-59464f3aad53 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 1.078117 Nov 02 12:54:07.506235 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2840/5617] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:06 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:08.318847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:08.319599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:08.360126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:08.362292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:08.362880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:08.365099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:08.366412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:08.368248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:08.532222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:08.533071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:08.549248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:08.550446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:08.552145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:08.555741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:08.556401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:08.556990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:08.612574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:08.622657 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ecd274c-b12e-49b6-bfea-1e95c363be84 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1279 microversion: 2.1 time: 0.306565 Nov 02 12:54:08.627589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:08.651027 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2778/5618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:08 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:09.013230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:09.028706 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b59c6ea-d693-4c2f-80f5-30cc112e5c99 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.501391 Nov 02 12:54:09.031717 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2841/5619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:08 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:09.649216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:09.650575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:09.669864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:09.670772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:09.672512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:09.674938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:09.677520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:09.678261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:10.013161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:10.041235 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd492780-44a6-45f9-96e4-f75956e283e4 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.394821 Nov 02 12:54:10.042972 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2779/5620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:09 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:10.065292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:10.066002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:10.075764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:10.076537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:10.077170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:10.078078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:10.078738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:10.079415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:10.391640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-630ef747-5a6c-4bb8-9866-bc1b9bc4b742 req-9eba2e7d-4334-4161-bdaf-eedf92d67e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d00de80-fc65-454f-a9c1-64a88b144db1", "tag": "bdbb7c14-764d-4f34-a6af-a2bd462719a1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:10.428739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-630ef747-5a6c-4bb8-9866-bc1b9bc4b742 req-9eba2e7d-4334-4161-bdaf-eedf92d67e54 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:10.431419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-630ef747-5a6c-4bb8-9866-bc1b9bc4b742 req-9eba2e7d-4334-4161-bdaf-eedf92d67e54 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:10.434072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-630ef747-5a6c-4bb8-9866-bc1b9bc4b742 req-9eba2e7d-4334-4161-bdaf-eedf92d67e54 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:10.481908 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-630ef747-5a6c-4bb8-9866-bc1b9bc4b742 req-9eba2e7d-4334-4161-bdaf-eedf92d67e54 service nova] Creating event network-changed:bdbb7c14-764d-4f34-a6af-a2bd462719a1 for instance 7d00de80-fc65-454f-a9c1-64a88b144db1 on n-h2-855650-5 Nov 02 12:54:10.496614 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-630ef747-5a6c-4bb8-9866-bc1b9bc4b742 req-9eba2e7d-4334-4161-bdaf-eedf92d67e54 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110676 Nov 02 12:54:10.497892 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2780/5621] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:10.954559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:10.966730 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-82778499-99ff-41b9-8c16-1ea942e80160 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.905539 Nov 02 12:54:10.967311 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2842/5622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:10 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:11.064644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:11.071450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:11.078240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:11.091987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:11.094580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:11.095274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:11.098972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:11.099708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:11.100458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:11.395155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:11.406119 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-41faf606-0513-41b6-91e5-5e9ade7b0afe tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.343583 Nov 02 12:54:11.410782 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2781/5623] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:11 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:11.995120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:11.995749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:12.014017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:12.018982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:12.019475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:12.020246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:12.020728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:12.021166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:12.443388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:12.443951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:12.487837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:12.488411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:12.488971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:12.489811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:12.492500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:12.504108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:12.752432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:12.764629 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9d3c466-6b52-4008-9a8c-e0d396bf79e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.773774 Nov 02 12:54:12.767987 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2843/5624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:11 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:13.224464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:13.234455 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d49655dd-0f6a-401a-b4de-c6144b7679d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.798698 Nov 02 12:54:13.239348 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2782/5625] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:12 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:13.791213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:13.792667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:13.798567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:13.801614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:13.836886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:13.839178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:13.840420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:13.842616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:13.843667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:13.844631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:13.956815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-148cc96d-a5f3-430f-baf3-bf48ab92d6d0 req-704ce334-092d-46d5-8363-aa960379473d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185dc9c0-d216-4cad-b4c4-5351d9692219", "tag": "6e181eeb-d0dc-4fe7-85f4-8c26cc4290f0"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:13.992511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:13.994941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-148cc96d-a5f3-430f-baf3-bf48ab92d6d0 req-704ce334-092d-46d5-8363-aa960379473d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:13.997242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-148cc96d-a5f3-430f-baf3-bf48ab92d6d0 req-704ce334-092d-46d5-8363-aa960379473d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:13.998696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-148cc96d-a5f3-430f-baf3-bf48ab92d6d0 req-704ce334-092d-46d5-8363-aa960379473d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:14.041449 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-148cc96d-a5f3-430f-baf3-bf48ab92d6d0 req-704ce334-092d-46d5-8363-aa960379473d service nova] Creating event network-changed:6e181eeb-d0dc-4fe7-85f4-8c26cc4290f0 for instance 185dc9c0-d216-4cad-b4c4-5351d9692219 on n-h1-855650-5 Nov 02 12:54:14.056257 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-148cc96d-a5f3-430f-baf3-bf48ab92d6d0 req-704ce334-092d-46d5-8363-aa960379473d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112246 Nov 02 12:54:14.057687 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2783/5626] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:14.184209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:14.202258 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-492fdbb0-2f8e-48ec-b0da-ea80bb946c18 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.412506 Nov 02 12:54:14.203511 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2844/5627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:13 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:14.264547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:14.265794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:14.282950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:14.289740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:14.291001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:14.291703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:14.293958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:14.298641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:14.299369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:14.732618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:14.742479 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03947c34-78cd-4bb7-b319-e209cfd19c29 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.481844 Nov 02 12:54:14.744635 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2784/5628] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:14 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:15.227997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:15.229182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:15.249555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:15.250377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:15.250997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:15.252079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:15.252836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:15.253441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:15.553591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:15.563830 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-282647b8-92bf-4185-aaab-188aca02684e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.339776 Nov 02 12:54:15.569828 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2845/5629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:15 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:15.777862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:15.779300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:15.797828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:15.801055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:15.801790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:15.802566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:15.803040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:15.803964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:16.356468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-65229e52-54d3-48d8-8c8c-768b30cd7cbf req-dd10ccc1-857b-4cc7-9e61-defafe15df30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa0875b-f988-417b-b891-d9fc9e9a1fad", "name": "network-vif-plugged", "status": "completed", "tag": "3bac5ef2-442b-4c77-97e5-f1c693ca0e04"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:16.378354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-65229e52-54d3-48d8-8c8c-768b30cd7cbf req-dd10ccc1-857b-4cc7-9e61-defafe15df30 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:16.381064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-65229e52-54d3-48d8-8c8c-768b30cd7cbf req-dd10ccc1-857b-4cc7-9e61-defafe15df30 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:16.384034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-65229e52-54d3-48d8-8c8c-768b30cd7cbf req-dd10ccc1-857b-4cc7-9e61-defafe15df30 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:16.413294 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-65229e52-54d3-48d8-8c8c-768b30cd7cbf req-dd10ccc1-857b-4cc7-9e61-defafe15df30 service nova] Creating event network-vif-plugged:3bac5ef2-442b-4c77-97e5-f1c693ca0e04 for instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad on n-h1-855650-5 Nov 02 12:54:16.421566 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-65229e52-54d3-48d8-8c8c-768b30cd7cbf req-dd10ccc1-857b-4cc7-9e61-defafe15df30 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095457 Nov 02 12:54:16.422933 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2846/5630] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:54:16.600546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:16.603169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:16.655352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:16.657828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:16.658524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:16.664152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:16.664945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:16.665569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:16.749397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:16.759792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-533bf031-a1f6-4ac8-9c9c-8b976d4f61e0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.986736 Nov 02 12:54:16.760404 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2785/5631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:15 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:16.937749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:16.955181 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3cc51176-eb8e-4e98-884e-ceadbbb8bb04 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.361847 Nov 02 12:54:16.956466 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2847/5632] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:16 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:17.786622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:17.786622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:17.791806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:17.795744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:17.799476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:17.800392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:17.801034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:17.802429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:17.981909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:17.982800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:17.992394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:18.012954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:18.018373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:18.018373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:18.021651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:18.023842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:18.025434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:18.429595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:18.442897 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e3396ed-1722-4f72-b105-18e41b38e8d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.662748 Nov 02 12:54:18.445765 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2786/5633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:17 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:18.475127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:18.483233 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-822d65f2-f190-44d8-82d1-1dfcac66b87a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1169 microversion: 2.1 time: 0.506328 Nov 02 12:54:18.486872 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2848/5634] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:17 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1169 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:19.469908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:19.471014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:19.489922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:19.496058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:19.496851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:19.499554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:19.500499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:19.503914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:19.512046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:19.512839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:19.531447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:19.535636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:19.536763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:19.537918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:19.538756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:19.539349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:19.596972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:19.911118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:19.924511 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b696d05-3822-4143-9e6e-507c7af11ac2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.459194 Nov 02 12:54:19.926592 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2787/5635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:19 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:20.372438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:20.388183 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba738149-54c2-452f-8ae9-7a292f70f4f6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.877496 Nov 02 12:54:20.389162 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2849/5636] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:19 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:20.855406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-b2cc648f-2581-43de-a2ff-7a928aae112f req-86102201-63f1-49a3-a1a4-20fdf20eac81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185dc9c0-d216-4cad-b4c4-5351d9692219", "name": "network-vif-plugged", "status": "completed", "tag": "6e181eeb-d0dc-4fe7-85f4-8c26cc4290f0"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:20.879467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b2cc648f-2581-43de-a2ff-7a928aae112f req-86102201-63f1-49a3-a1a4-20fdf20eac81 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:20.882303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b2cc648f-2581-43de-a2ff-7a928aae112f req-86102201-63f1-49a3-a1a4-20fdf20eac81 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:20.883583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b2cc648f-2581-43de-a2ff-7a928aae112f req-86102201-63f1-49a3-a1a4-20fdf20eac81 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:20.918682 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-b2cc648f-2581-43de-a2ff-7a928aae112f req-86102201-63f1-49a3-a1a4-20fdf20eac81 service nova] Creating event network-vif-plugged:6e181eeb-d0dc-4fe7-85f4-8c26cc4290f0 for instance 185dc9c0-d216-4cad-b4c4-5351d9692219 on n-h1-855650-5 Nov 02 12:54:20.926806 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-b2cc648f-2581-43de-a2ff-7a928aae112f req-86102201-63f1-49a3-a1a4-20fdf20eac81 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074920 Nov 02 12:54:20.928161 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2788/5637] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:20.965144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:20.968564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:21.008396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:21.025012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:21.025561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:21.026480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:21.030433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:21.035748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:21.302700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:21.322926 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-579661fd-3a69-4447-8d9a-96ba2b6db394 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.371004 Nov 02 12:54:21.323853 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2850/5638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:20 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:21.422633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:21.423595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:21.450163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:21.450782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:21.453350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:21.455948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:21.457092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:21.458403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:21.651379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:21.663872 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8234f29-e420-4cc7-a791-c863d148e06a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.252206 Nov 02 12:54:21.666471 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2789/5639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:21 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:22.352639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:22.354146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:22.372157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:22.372676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:22.375319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:22.377637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:22.379538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:22.380074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:22.587167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:22.598275 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-349e8a5d-793e-40bc-b4c2-eb7963cda7c6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1321 microversion: 2.1 time: 0.252927 Nov 02 12:54:22.599555 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2851/5640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:22 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:22.696409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:22.697733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:22.708169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:22.710141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:22.710871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:22.711814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:22.712449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:22.713194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:22.983879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:22.994462 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b628b372-67a3-4597-bb20-591a13ab3390 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.302605 Nov 02 12:54:22.995558 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2790/5641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:22 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:23.085139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-eca0979c-b5cc-4c38-891a-39268b821670 req-6f9b47da-30dc-4576-8208-68fd0a1e71d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d00de80-fc65-454f-a9c1-64a88b144db1", "name": "network-vif-plugged", "status": "completed", "tag": "bdbb7c14-764d-4f34-a6af-a2bd462719a1"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:23.103488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-eca0979c-b5cc-4c38-891a-39268b821670 req-6f9b47da-30dc-4576-8208-68fd0a1e71d5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:23.108333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-eca0979c-b5cc-4c38-891a-39268b821670 req-6f9b47da-30dc-4576-8208-68fd0a1e71d5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:23.109170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-eca0979c-b5cc-4c38-891a-39268b821670 req-6f9b47da-30dc-4576-8208-68fd0a1e71d5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:23.130292 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-eca0979c-b5cc-4c38-891a-39268b821670 req-6f9b47da-30dc-4576-8208-68fd0a1e71d5 service nova] Creating event network-vif-plugged:bdbb7c14-764d-4f34-a6af-a2bd462719a1 for instance 7d00de80-fc65-454f-a9c1-64a88b144db1 on n-h2-855650-5 Nov 02 12:54:23.138751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-eca0979c-b5cc-4c38-891a-39268b821670 req-6f9b47da-30dc-4576-8208-68fd0a1e71d5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057598 Nov 02 12:54:23.140130 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2852/5642] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:23.625397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:23.626263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:23.645590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:23.649286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:23.650281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:23.653489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:23.655121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:23.656168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:24.025294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:24.026155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:24.043666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:24.044890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:24.046490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:24.056031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:24.057180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:24.060731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:24.108407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:24.130799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-427402ef-4b19-48a5-b43e-022355118a60 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1512 microversion: 2.1 time: 0.503139 Nov 02 12:54:24.131496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2791/5643] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:23 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:24.157443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:24.158141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:24.169169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:24.169775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:24.170333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:24.179421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:24.179950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:24.180437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:24.552482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:24.566045 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5505a8d5-64b6-4a65-9a3f-3f2c70aab88f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.549423 Nov 02 12:54:24.582882 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2853/5644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:24 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:24.667130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:24.682084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2f20e6b-dd90-4be2-8ba1-2db63fa33670 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1512 microversion: 2.1 time: 0.523978 Nov 02 12:54:24.683195 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2792/5645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:24 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1512 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:24.713597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:24.716199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:24.726635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:24.727605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:24.728639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:24.729887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:24.730872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:24.731894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:24.988687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:25.008853 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-62cd8acd-1c8c-485a-ae15-e4c4b7e48301 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 200 len: 1321 microversion: 2.1 time: 0.295873 Nov 02 12:54:25.023202 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2854/5646] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:24 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:25.594512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:25.595273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:25.608560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:25.613628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:25.614138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:25.616814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:25.617334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:25.627637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:25.871278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:25.885592 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d4706446-da26-4f16-9648-061ab5a79e86 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.294508 Nov 02 12:54:25.895545 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2793/5647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:25 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:26.037936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:26.038698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:26.046940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:26.047540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:26.048369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:26.049455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:26.050214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:26.050834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:26.419892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:26.448374 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bdfae747-6944-499c-8db2-1491a51763ed tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 200 len: 1513 microversion: 2.1 time: 0.415637 Nov 02 12:54:26.461993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2855/5648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:26 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 1513 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:26.477581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:26.485136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:26.487077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:26.504158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:26.505998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:26.509163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:26.510220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:26.511244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:26.512772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:26.748772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:26.908348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:26.919083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:26.922736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:26.923061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:26.924107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:26.925378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:26.936834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:26.937848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:26.938612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:26.939679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:26.940306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:26.940898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:27.236441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1eaa1a1-ee59-4f98-b39b-e865d36c31be tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.763758 Nov 02 12:54:27.236996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2794/5649] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Nov 2 12:54:26 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:27.264821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:27.272104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:27.273162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1959602073', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:27.281407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:27.282234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:27.283024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:27.284095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:27.284776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:27.285774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:27.316997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:27.345676 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1dc0f022-56d5-430b-a29e-a8b7b2cbc4bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.430081 Nov 02 12:54:27.348684 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2856/5650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:26 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:27.409374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:27.757058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:27.766324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:27.767263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:27.767874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:28.371712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:28.372340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:28.396508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:28.418215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:28.423544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:28.428475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:28.431735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:28.432559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:28.572967 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b50e212-ec29-453a-8b91-b747819f987f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1959602073" status: 200 len: 1515 microversion: 2.1 time: 1.312720 Nov 02 12:54:28.573640 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2795/5651] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 12:54:27 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1959602073 => generated 1515 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:28.603138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:28.612458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:28.613607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:28.622202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:28.623006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:28.623684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:28.624683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:28.625402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:28.626263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:28.867782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:29.052327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:29.061069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:29.061811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:29.062436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:29.076801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:29.086510 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-72e3bd1c-253f-43bb-81db-e8c3be45b0db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.719755 Nov 02 12:54:29.087109 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2857/5652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:28 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:29.339718 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fcad4d17-576b-4dee-a61f-c04ce864699d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.742241 Nov 02 12:54:29.340922 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2796/5653] 10.222.0.45 () {58 vars in 1173 bytes} [Wed Nov 2 12:54:28 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:29.376300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:29.381359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:29.381810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.compute.servers [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Removing options 'limit' from query {{(pid=120723) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:54:29.392421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:29.417314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:29.418324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:29.423454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:29.425385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:29.426279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:29.427279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:29.486643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:29.499958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:29.500468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:29.500911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:29.719824 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ec059fa-e574-47c4-a3f3-c89b1a746432 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.347785 Nov 02 12:54:29.720659 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2858/5654] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 12:54:29 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:29.747625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:29.756368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:29.757275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:29.780685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:29.781251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:29.781715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:29.782662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:29.783132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:29.783569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:29.990394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:30.112571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:30.113528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:30.124250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.131161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.131781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.132529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.136861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.140674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.147760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c98da9d3-0e76-40a5-8e65-c0cc0df7d9fc tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.404600 Nov 02 12:54:30.149099 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2797/5655] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 12:54:29 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:30.168679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:30.168921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:30.176142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.177252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.servers [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Removing options 'limit' from query {{(pid=120722) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:54:30.178942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:30.185558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.186469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.187168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.188896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.189627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.190437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.232605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:30.294222 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa3e1660-2dc4-487b-8408-703a6412ac1a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.131543 Nov 02 12:54:30.295340 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2798/5656] 10.222.0.45 () {58 vars in 1150 bytes} [Wed Nov 2 12:54:30 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:30.307766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:30.321413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.324959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:30.338888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.341768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.342706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.346069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.350051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.350859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.420252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:30.482959 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-922c90eb-6f35-4a47-b069-30e34ef269d7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.179341 Nov 02 12:54:30.483919 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2799/5657] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 12:54:30 2022] GET /compute/v2.1/servers => generated 1012 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:30.497586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:30.507578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.508308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:30.534350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.534862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.535315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.536066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.536735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.537170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.639143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:30.722190 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab0a6d8f-7c19-4201-99d0-661a0202b70a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.229137 Nov 02 12:54:30.723614 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2800/5658] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:54:30 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:30.738860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:30.745550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.746864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.servers [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Removing options 'limit' from query {{(pid=120722) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:54:30.748026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:30.755235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.756114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.757682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.758733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.759579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.760630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.784237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:30.803180 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f74afbee-127c-4deb-a920-4bf49550670c tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.069875 Nov 02 12:54:30.804361 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2801/5659] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Nov 2 12:54:30 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:30.830141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:30.840268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.841318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1959602073', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:30.851183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.852487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.853488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.854914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:30.856473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:30.857144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:30.955574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.967246 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e9c9fbef-2d0b-4217-97e1-10429bc391f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.860203 Nov 02 12:54:30.970708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2859/5660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:30 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:31.029088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:31.212545 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a7c3226-cc5d-4910-a348-c4cbaf36ae36 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1959602073" status: 200 len: 346 microversion: 2.1 time: 0.395476 Nov 02 12:54:31.216776 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2802/5661] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 12:54:30 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1959602073 => generated 346 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:31.230582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-05a26db8-5d0d-496c-b1e7-13b1d23ba3fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:31.243380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05a26db8-5d0d-496c-b1e7-13b1d23ba3fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:31.244146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05a26db8-5d0d-496c-b1e7-13b1d23ba3fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:31.245219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-05a26db8-5d0d-496c-b1e7-13b1d23ba3fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:31.294012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-05a26db8-5d0d-496c-b1e7-13b1d23ba3fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Going to try to stop instance {{(pid=120723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:54:31.381630 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-05a26db8-5d0d-496c-b1e7-13b1d23ba3fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "POST /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad/action" status: 202 len: 0 microversion: 2.1 time: 0.155475 Nov 02 12:54:31.382653 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2860/5662] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:54:31 2022] POST /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:54:31.394461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:31.396170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:31.410863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:31.411624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:31.412272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:31.413987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:31.418122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:31.418923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:31.651600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:31.662441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-132a3a07-59d2-48f6-a6f7-133281713dfb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.273549 Nov 02 12:54:31.663784 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2803/5663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:31 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:31.996278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:31.996992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:32.011148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:32.012211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:32.022692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:32.024856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:32.030983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:32.031553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:32.539055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:32.548815 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-011577a5-ba6b-4e9f-badb-c920ea60a311 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.558323 Nov 02 12:54:32.552607 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2861/5664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:31 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:32.690156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:32.690156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:32.703627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:32.704146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:32.705083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:32.705843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:32.715389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:32.716065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:33.059500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:33.067902 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c445b08d-cb94-4dfa-977b-b9dd53b67480 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.384831 Nov 02 12:54:33.088136 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2804/5665] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:32 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:33.577230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:33.578049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:33.587319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:33.590716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:33.592452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:33.597800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:33.598487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:33.599047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:34.047873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:34.060377 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-27ae60d1-2937-463e-8ebc-d91bffe8af8c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.487327 Nov 02 12:54:34.077578 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2862/5666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:33 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:34.100971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:34.102562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:34.126012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:34.128026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:34.128910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:34.131759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:34.133924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:34.139496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:34.415083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:34.438602 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e65efa2-8d8c-4a6c-b4de-c71f01b75038 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.342671 Nov 02 12:54:34.453994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2805/5667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:34 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:34.738583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-30bc1ffe-9e08-414d-939c-fd4a44f8bd6a req-828ccd66-68aa-453c-8854-3651f60fd84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b800506a-c063-4688-9f25-d2bd5c44f01a", "name": "network-vif-plugged", "status": "completed", "tag": "6b9ebd59-fd43-451e-8f6a-f2855306cef4"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:34.761455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-30bc1ffe-9e08-414d-939c-fd4a44f8bd6a req-828ccd66-68aa-453c-8854-3651f60fd84d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:34.762738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-30bc1ffe-9e08-414d-939c-fd4a44f8bd6a req-828ccd66-68aa-453c-8854-3651f60fd84d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:34.763853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-30bc1ffe-9e08-414d-939c-fd4a44f8bd6a req-828ccd66-68aa-453c-8854-3651f60fd84d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:34.795602 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-30bc1ffe-9e08-414d-939c-fd4a44f8bd6a req-828ccd66-68aa-453c-8854-3651f60fd84d service nova] Creating event network-vif-plugged:6b9ebd59-fd43-451e-8f6a-f2855306cef4 for instance b800506a-c063-4688-9f25-d2bd5c44f01a on n-h2-855650-5 Nov 02 12:54:34.806334 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-30bc1ffe-9e08-414d-939c-fd4a44f8bd6a req-828ccd66-68aa-453c-8854-3651f60fd84d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077474 Nov 02 12:54:34.807837 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2863/5668] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:35.087970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:35.090934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:35.108062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:35.108749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:35.111265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:35.114503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:35.115794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:35.117639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:35.469667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:35.470841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:35.486263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:35.487177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:35.488377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:35.491229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:35.491956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:35.493768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:35.516196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:35.532841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9bb7da6d-8d3f-4110-bbcb-c1afe087274c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.451775 Nov 02 12:54:35.537376 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2806/5669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:35 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:35.878444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:35.893584 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bd17c0c4-b163-4283-87d4-d044b3d9dc83 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.429522 Nov 02 12:54:35.898515 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2864/5670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:35 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:36.564678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:36.565410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:36.579715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:36.580220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:36.580663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:36.581374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:36.581829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:36.582284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:36.796995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:36.806743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1ac877eb-3e51-4809-a635-7893b6bf5ab8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.247579 Nov 02 12:54:36.824363 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2807/5671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:36 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:36.924394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:36.925071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:36.936985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:36.937499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:36.937956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:36.938714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:36.939182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:36.939624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:37.275174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:37.289304 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c10acd6-8d8e-4d76-8873-c1f8914fe789 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.368686 Nov 02 12:54:37.294378 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2865/5672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:36 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:37.830928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:37.831547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:37.849180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:37.849719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:37.850288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:37.850920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:37.851558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:37.852276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:38.166746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:38.183205 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca49ab86-88e2-4633-9f21-879da828163e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1203 microversion: 2.1 time: 0.356056 Nov 02 12:54:38.184168 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2808/5673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:37 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1203 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:38.318879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:38.320368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:38.344149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:38.347795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:38.349483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:38.351043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:38.351535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:38.351981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:38.629286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:38.644874 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-12e52341-75a9-4ed6-90e4-579e2f7253c0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.331709 Nov 02 12:54:38.647333 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2866/5674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:38 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:39.212142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:39.212778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:39.218395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:39.227407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:39.240242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:39.244354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:39.245958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:39.254857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:39.255715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:39.676068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:39.677707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:39.691649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:39.693162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:39.695893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:39.702436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:39.703186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:39.704105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:39.704767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:39.705542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:40.151287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:40.163035 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9ea8360-a627-47f1-9e9e-bc7f14b26821 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1390 microversion: 2.1 time: 0.955151 Nov 02 12:54:40.170156 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2809/5675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:39 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1390 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:40.191442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:40.194497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:40.208446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:40.208956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:40.214801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:40.216809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:40.217258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:40.217706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:40.315462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:40.326058 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2229824d-d6be-4706-a230-72647da4d8a6 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.654508 Nov 02 12:54:40.342477 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2867/5676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:39 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:40.904219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=18 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:41.021269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:41.022610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:41.040667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:41.041845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:41.046037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:41.049151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:41.052432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:41.054146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:41.306827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lazy-loading 'services' on Instance uuid 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:54:41.479429 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-456ce555-ad5a-4896-bd26-37150bd40383 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/os-volume_attachments/f5b4ee89-93ff-4b4d-9b2a-0af1a4147cf5" status: 202 len: 0 microversion: 2.1 time: 0.460619 Nov 02 12:54:41.481745 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2868/5677] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:54:41 2022] DELETE /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/os-volume_attachments/f5b4ee89-93ff-4b4d-9b2a-0af1a4147cf5 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:54:41.506402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:41.514227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:41.529341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:41.530763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:41.537721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:41.539504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:41.549565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:41.554396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:41.637838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:41.650622 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6cb03015-ecbd-4079-a069-d3b79d3e31d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1390 microversion: 2.1 time: 1.467367 Nov 02 12:54:41.670615 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2810/5678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:40 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1390 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:41.689368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:41.701573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:41.719373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:41.720258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:41.721942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:41.727247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:41.730917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:41.731728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:42.378202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:42.395095 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff85a406-417c-4b32-98ad-083ee57a1ad7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.903176 Nov 02 12:54:42.395714 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2869/5679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:41 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:42.484186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:42.499796 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4573b8e5-002b-48aa-bef3-277d745944e7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1390 microversion: 2.1 time: 0.816602 Nov 02 12:54:42.500453 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2811/5680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:41 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1390 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:42.685299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:42.686146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:42.699003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:42.699557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:42.701403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:42.703383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:42.705288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:42.706275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:42.789210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:54:42.963466 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-663cefc5-007f-4046-b0a3-ad963eb3a3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 204 len: 0 microversion: 2.1 time: 0.277863 Nov 02 12:54:42.967656 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2870/5681] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:54:42 2022] DELETE /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:54:42.984467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:42.989816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:42.999459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:43.000320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:43.000953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:43.001934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:43.002598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:43.003207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:43.427166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:43.428326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:43.450204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:43.455974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:43.456577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:43.457611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:43.458125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:43.458566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:43.505032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:43.522198 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7597da4f-2bf6-4900-bf7e-7b1212d2814a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1396 microversion: 2.1 time: 0.549239 Nov 02 12:54:43.531747 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2812/5682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:42 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1396 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:44.018213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:44.044935 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2a6c7250-c805-453c-8d57-0953f9c72b71 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.624741 Nov 02 12:54:44.050377 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2871/5683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:43 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:44.561048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:44.564552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:44.584853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=68 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:44.591192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:44.591817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:44.593537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:44.594369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:44.600796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:44.602341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:44.973571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:44.989083 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfc3fcad-b0a6-4fd9-be99-211cf7b6abfc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1396 microversion: 2.1 time: 0.435425 Nov 02 12:54:45.010311 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2813/5684] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:44 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1396 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:45.106046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:45.107282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:45.116184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:45.117018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:45.117617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:45.118912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:45.119569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:45.120780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:45.484949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:45.498079 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b66e4cb4-65f4-464a-915d-bd2b54aab1fa tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.400387 Nov 02 12:54:45.499100 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2872/5685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:45 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:46.018265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:46.019830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:46.040312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:46.042552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:46.048534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:46.049640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:46.050356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:46.050883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:46.527664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:46.528881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:46.543702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:46.545617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:46.546866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:46.548363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:46.550759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:46.552056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:46.617593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:46.714246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:46.737139 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-068af142-4d5f-40f3-99fc-6618d5993b64 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1396 microversion: 2.1 time: 0.722856 Nov 02 12:54:46.740172 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2814/5686] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:46 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1396 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:47.082659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:47.091940 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93542295-ffed-40a0-a183-5a491b452dec tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.572397 Nov 02 12:54:47.109341 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2873/5687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:46 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:47.665144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-dd0518fb-e8b1-4b7a-920f-034b84a22fa5 req-30e915c6-fd81-42b3-b0c8-0b536e38ce47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b800506a-c063-4688-9f25-d2bd5c44f01a", "name": "network-vif-deleted", "tag": "6b9ebd59-fd43-451e-8f6a-f2855306cef4"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:47.693370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dd0518fb-e8b1-4b7a-920f-034b84a22fa5 req-30e915c6-fd81-42b3-b0c8-0b536e38ce47 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:47.693859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dd0518fb-e8b1-4b7a-920f-034b84a22fa5 req-30e915c6-fd81-42b3-b0c8-0b536e38ce47 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:47.694326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dd0518fb-e8b1-4b7a-920f-034b84a22fa5 req-30e915c6-fd81-42b3-b0c8-0b536e38ce47 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:47.717373 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-dd0518fb-e8b1-4b7a-920f-034b84a22fa5 req-30e915c6-fd81-42b3-b0c8-0b536e38ce47 service nova] Creating event network-vif-deleted:6b9ebd59-fd43-451e-8f6a-f2855306cef4 for instance b800506a-c063-4688-9f25-d2bd5c44f01a on n-h2-855650-5 Nov 02 12:54:47.727678 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-dd0518fb-e8b1-4b7a-920f-034b84a22fa5 req-30e915c6-fd81-42b3-b0c8-0b536e38ce47 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066654 Nov 02 12:54:47.728748 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2815/5688] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:54:47.767402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:47.768635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:47.777956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:47.778474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:47.778932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:47.779637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:47.780099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:47.780531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:47.928289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:47.941082 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a7c99e9e-2869-4938-afca-83ae50c8918c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.177830 Nov 02 12:54:47.942079 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2874/5689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:47 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:48.117590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:48.118421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:48.144929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:48.146372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:48.147098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:48.148578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:48.149299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:48.152055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:48.555598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:48.572629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59f9a0e7-9108-42f6-b72e-35bb6293f675 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.459199 Nov 02 12:54:48.574669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2816/5690] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:48 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:48.970161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:48.971801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:48.974797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:48.998059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:48.998577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:48.999035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:49.005751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:49.007328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:49.012295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:49.222216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:49.232211 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-95e56c62-baa0-4d6b-89ca-420be6aa9c0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.267066 Nov 02 12:54:49.236012 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2875/5691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:48 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:49.598118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:49.598749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:49.611189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:49.614536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:49.615014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:49.620279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:49.620932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:49.621393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:50.144463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:50.162417 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3ed029c-0cc7-4ec6-a182-6f646faafda1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.567347 Nov 02 12:54:50.178926 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2817/5692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:49 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:50.259239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:50.262234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:50.288261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:50.298324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:50.301107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:50.303500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:50.306226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:50.308124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:50.497433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:50.513046 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1199da1f-52ae-4f17-8536-41450beee62e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.259949 Nov 02 12:54:50.513908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2876/5693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:50 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:51.195397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:51.196168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:51.219527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:51.220546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:51.221345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:51.223203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:51.227070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:51.227938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:51.282920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:51.500102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:51.514289 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-757d9679-4a3e-46b8-96bf-ab0c5ad141e5 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1522 microversion: 2.1 time: 0.324723 Nov 02 12:54:51.514918 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2818/5694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:51 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:51.537855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:51.538577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:51.568435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:51.569218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:51.569675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:51.571395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:51.571890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:51.572338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:51.686879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:51.715889 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-376657c5-1a0f-4623-b141-86af34a7a167 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.181055 Nov 02 12:54:51.718356 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2877/5695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:51 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:52.542146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:52.543624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:52.570575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:52.571945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:52.574135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:52.576311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:52.578057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:52.580978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:52.755698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:52.757098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:52.784569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:52.792486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:52.793884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:52.796283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:52.800272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:52.803673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:53.116794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:53.126742 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-519f29ca-a0a8-4d57-b6ae-8979d5eec31c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.377460 Nov 02 12:54:53.134834 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2878/5696] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:52 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:53.160253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:53.185071 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe828296-f976-4ae0-91c7-57e83c1c3f96 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1499 microversion: 2.1 time: 0.648103 Nov 02 12:54:53.199060 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2819/5697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:52 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1499 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:53.221949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.230340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:53.231259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:53.248378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:53.248766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:53.249218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:53.250009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:53.258137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:53.258849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:53.366331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:54:53.437659 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff7a7e24-bb80-46f7-bb39-63fa2e8c99c8 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.219241 Nov 02 12:54:53.443717 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2879/5698] 10.222.0.45 () {58 vars in 1154 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:53.462817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ff58049-180c-47c0-8cbc-68a0077c1e87 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:53.483554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff58049-180c-47c0-8cbc-68a0077c1e87 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:53.487157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff58049-180c-47c0-8cbc-68a0077c1e87 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:53.488981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff58049-180c-47c0-8cbc-68a0077c1e87 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:53.551003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ff58049-180c-47c0-8cbc-68a0077c1e87 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Going to try to start instance {{(pid=120722) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:54:53.631006 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ff58049-180c-47c0-8cbc-68a0077c1e87 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "POST /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad/action" status: 202 len: 0 microversion: 2.1 time: 0.174902 Nov 02 12:54:53.632049 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2820/5699] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:54:53 2022] POST /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:54:53.644987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.646276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:53.677592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:53.678123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:53.679186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:53.687503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:53.687896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:53.688364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:53.997454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:54.017993 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bc9e958a-a89e-4bdb-a8e6-528819ef846a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1508 microversion: 2.1 time: 0.378966 Nov 02 12:54:54.021283 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2880/5700] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:54.162994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:54.163965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:54.182319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:54.183470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:54.184229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:54.185189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:54.185922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:54.186557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:54.365090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-655cda60-8b7d-4043-b0b7-2f6fe05e01a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:54.422770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:54.438278 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-13464689-5b91-436c-a8f4-b249e27ede2b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.279460 Nov 02 12:54:54.440322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-655cda60-8b7d-4043-b0b7-2f6fe05e01a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:54.446316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-655cda60-8b7d-4043-b0b7-2f6fe05e01a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:54.451210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-655cda60-8b7d-4043-b0b7-2f6fe05e01a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:54.462044 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2821/5701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:54 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:54.547047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-655cda60-8b7d-4043-b0b7-2f6fe05e01a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Going to try to stop instance {{(pid=120723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:54:54.720865 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-655cda60-8b7d-4043-b0b7-2f6fe05e01a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/action" status: 202 len: 0 microversion: 2.1 time: 0.363431 Nov 02 12:54:54.731088 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2881/5702] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:54:54 2022] POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:54:54.741055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:54.743741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:54.759134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:54.764030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:54.765465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:54.768534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:54.769238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:54.770881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:55.069696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:55.070586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:55.081997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:55.082517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:55.082967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:55.083702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:55.084169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:55.084601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:55.580981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:55.594898 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2097db7-3b39-44fc-abb2-a5321040ef3b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 0.858050 Nov 02 12:54:55.600540 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2822/5703] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:54 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:55.617684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:55.622660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:55.643887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:55.645046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:55.646868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:55.648524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:55.649865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:55.651948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:55.791733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:55.805410 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0684f08b-ec6f-46d8-bdc2-6b9b42e1dc7f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1508 microversion: 2.1 time: 0.740500 Nov 02 12:54:55.818003 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2882/5704] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:55 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1508 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:55.986343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:55.994665 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8988de78-d045-494c-88d7-37d2d933f07e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.391339 Nov 02 12:54:55.995819 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2823/5705] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:55 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:56.645126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:56.645685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:56.662094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:56.662699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:56.663222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:56.664027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:56.664628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:56.665427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:56.836127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:56.836761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:56.845876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:56.846794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:56.847467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:56.848458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:56.849153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:56.850008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:57.303485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:57.319629 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58381206-47b4-425d-a228-10f64ba1b2ed tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 0.676014 Nov 02 12:54:57.320601 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2883/5706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:56 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:57.348623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:57.348623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:57.371763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:57.372284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:57.372788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:57.373555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:57.374045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:57.374485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:57.667198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:57.683755 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-062abaa2-6e17-4549-972f-51fbf4ec94c5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.360392 Nov 02 12:54:57.684355 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2884/5707] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:57 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:57.685416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:57.697355 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42b7344d-877d-4756-b691-bed08d745d19 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1512 microversion: 2.1 time: 0.865083 Nov 02 12:54:57.700746 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2824/5708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:56 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1512 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:57.741940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:57.751577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:57.752496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.compute.servers [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Removing options 'limit' from query {{(pid=120723) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:54:57.754472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:54:57.757220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:57.758040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:57.758739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:57.760447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:57.761170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:57.761842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:57.764636 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a2504b1-b4d4-47a2-a2b6-c87646f3f0d0 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.030166 Nov 02 12:54:57.765543 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2885/5709] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Nov 2 12:54:57 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:54:57.779914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:57.781446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:57.791109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:57.792598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:57.793270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:57.794641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:57.795234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:57.796123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:58.194824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:58.205370 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-083283e4-ccba-40bb-a083-0e997c6362db tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1512 microversion: 2.1 time: 0.429228 Nov 02 12:54:58.206008 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2825/5710] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:57 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:58.230327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:58.231433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:58.239911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:58.241012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:58.242486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:58.243648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:58.245150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:58.246272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:58.351597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:58.352308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:58.364645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:58.365645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:58.366375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:58.367575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:58.368345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:58.369002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:58.752186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:58.767358 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2aab9bce-3d62-4a46-9c46-85826d983db3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 0.418419 Nov 02 12:54:58.768265 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2826/5711] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:58 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:58.785421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:58.788940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:58.813247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:58.814216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:58.815924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:58.822238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:58.831031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:58.831974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:59.160141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:59.173009 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1df2710b-ecf4-46ac-a562-e3a59c6ffcc5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.403041 Nov 02 12:54:59.183828 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2827/5712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:58 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:59.239476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:59.256716 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b001ce32-9c4a-4935-aef5-b8649118b123 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 200 len: 1513 microversion: 2.1 time: 1.028606 Nov 02 12:54:59.278355 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2886/5713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:58 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 1513 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:59.287833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:59.288629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:59.306195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:59.311396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:59.315641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:59.317759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:59.323661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:59.325096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:59.807109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:59.817708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:54:59.836041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:59.838132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:59.840395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:54:59.842829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:54:59.844100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:54:59.845153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:01.111635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:01.136390 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ac64b05-ea30-4dc7-adbc-416cb526e0a7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1512 microversion: 2.1 time: 1.852149 Nov 02 12:55:01.164499 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2828/5714] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:59 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1512 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:01.192497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:01.193148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:01.245417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:01.250436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:01.251738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:01.253769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:01.255127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:01.265377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:01.285470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:01.307197 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65eef0b2-14d8-4aa3-b63d-910f36c38ccc tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 1.510699 Nov 02 12:55:01.324208 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2887/5715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:59 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:01.353070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:01.392872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:01.409461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:55:01.578640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:01.593406 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6c8f6a5-fa4b-4372-bfbe-41a64996ec02 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.427558 Nov 02 12:55:01.617034 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2829/5716] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:01 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:01.730836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:01.731625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:01.732310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:01.733355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:01.734090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:01.734731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:01.887903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:55:02.091680 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-07eb1885-c308-4887-817b-02ae51c292cb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.760867 Nov 02 12:55:02.092579 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2888/5717] 10.222.0.45 () {58 vars in 1154 bytes} [Wed Nov 2 12:55:01 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:55:02.122868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:02.123904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:02.132132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:02.133358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:02.134269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:02.137003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:02.137764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:02.138451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:02.481429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:02.482286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:02.493922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:02.507146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:02.510962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:02.512008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:02.515276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:02.517813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:02.540881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:02.563856 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94f8686c-46b6-4681-a4dd-44301310d32d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1512 microversion: 2.1 time: 0.447806 Nov 02 12:55:02.565295 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2830/5718] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:02 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1512 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:02.622226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:02.630893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:02.631754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:02.669504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:02.671748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:02.672902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:02.681010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:02.681876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:02.682739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:03.180816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:03.193901 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0254fe07-ae92-41a0-b961-ea24213a3150 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 200 len: 1513 microversion: 2.1 time: 0.583083 Nov 02 12:55:03.198333 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2831/5719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:02 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 1513 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:03.215714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:03.216908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:03.238367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:03.240307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:03.242471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:03.246669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:03.248989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:03.252615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:03.258063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:03.271532 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-998cb971-37a4-4b1c-921b-06999f4424f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 0.794563 Nov 02 12:55:03.306501 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2889/5720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:02 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:03.324084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:03.344974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:03.366587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:03.367167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:03.373234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:03.374043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:03.374548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:03.378298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:03.621305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:03.630790 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e9b189a-d570-47ed-b1d3-06e94814b9a0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.430848 Nov 02 12:55:03.637760 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2832/5721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:03 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:04.082826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:04.108842 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e32b5971-aeaf-4608-98ab-a98a6124e33f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1512 microversion: 2.1 time: 0.797412 Nov 02 12:55:04.110230 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2890/5722] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:03 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1512 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:04.165479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:04.188157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:04.200003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:55:04.230380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:04.231646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:04.234406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:04.236165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:04.242710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:04.243998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:04.319214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:04.321265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:04.336061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:04.337573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:04.340447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:04.350339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:04.360149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:04.361355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:04.580798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:55:04.639227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:04.678252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:04.689519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:04.690070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:04.690529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:04.998829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:05.023041 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a0c340e8-d0ce-4ab1-ae97-7d53a7655ce5 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 0.715070 Nov 02 12:55:05.026874 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2891/5723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:04 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:05.080512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab8391ae-d678-47fb-b6bf-f9137f800efb tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.926133 Nov 02 12:55:05.081420 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2833/5724] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:55:04 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:05.115512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:05.122624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:05.122938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:55:05.448715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:05.449615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:05.450261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:05.451585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:05.452084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:05.452581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:05.475541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:05.477167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:05.485867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:05.487270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:05.488526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:05.489535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:05.490340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:05.491106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:05.593034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:05.607321 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eac8a235-0b4d-4953-8a97-04ec02776248 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1188 microversion: 2.1 time: 0.574900 Nov 02 12:55:05.612800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:55:05.613736 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2892/5725] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:05 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1188 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:05.687632 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f9a178a-72f3-468e-926b-c757d2a250f9 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.576414 Nov 02 12:55:05.698863 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2834/5726] 10.222.0.45 () {58 vars in 1150 bytes} [Wed Nov 2 12:55:05 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:05.704458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:05.711015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:05.712803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:55:05.722229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:05.726384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:05.727586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:05.728825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:05.730870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:05.733674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:05.976950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:55:06.050417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:06.051267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:06.063324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:06.066853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:06.070991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:06.072182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:06.074492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:06.076237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:06.118038 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f973e98d-7013-4a3c-8daa-fb8cb0d8b13a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.409646 Nov 02 12:55:06.124147 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2893/5727] 10.222.0.45 () {58 vars in 1212 bytes} [Wed Nov 2 12:55:05 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:06.143683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:06.172992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:06.178168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:55:06.196917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:06.199822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:06.200747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:06.203238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:06.204081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:06.206559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:06.490128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:55:06.608100 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-27010ab2-3706-467d-8519-dcbd982dbc2d tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.482589 Nov 02 12:55:06.611182 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2894/5728] 10.222.0.45 () {58 vars in 1196 bytes} [Wed Nov 2 12:55:06 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:06.660883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:06.691990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:06.695222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'name': '1959602073', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:55:06.729343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:06.732056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:06.735044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:06.740776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:06.742649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:06.744071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:06.776261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:06.788656 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17e864ca-0190-47bc-abeb-b412a703ad3d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 0.742994 Nov 02 12:55:06.792260 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2835/5729] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:06 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:06.806333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:06.808440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:06.840460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:06.843735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:06.844575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:06.845469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:06.849665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:06.850552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:07.057670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:07.058719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:07.070675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:07.073377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lazy-loading 'fault' on Instance uuid b800506a-c063-4688-9f25-d2bd5c44f01a {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:55:07.157497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:55:07.305606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:07.361944 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c112bff1-036c-412c-8e45-380697803844 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?name=1959602073" status: 200 len: 346 microversion: 2.1 time: 0.740561 Nov 02 12:55:07.367544 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2895/5730] 10.222.0.45 () {58 vars in 1156 bytes} [Wed Nov 2 12:55:06 2022] GET /compute/v2.1/servers?name=1959602073 => generated 346 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:55:07.377839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:07.383901 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-584adb57-5fdb-4a24-82e4-9062d8006fac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 200 len: 1147 microversion: 2.1 time: 0.587751 Nov 02 12:55:07.391794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:07.392506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:55:07.404442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:07.404924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:07.405366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:07.407641 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2836/5731] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:06 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 1147 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:07.412361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:07.413004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:07.413444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:07.483722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:07.487720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:07.507448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:07.508452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:07.510028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:07.512588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:07.513426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:07.516174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:07.754879 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca710ccd-7115-4d25-9335-504b18b828a6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.277972 Nov 02 12:55:07.758405 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2837/5732] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:55:07 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:55:07.781417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:07.783359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:07.801483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:07.803579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:07.806727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:07.809297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:07.809875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:07.810518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:08.057433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:55:08.146395 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d78650de-ddf9-459f-bea8-ba5fd2678007 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.773717 Nov 02 12:55:08.147869 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2896/5733] 10.222.0.45 () {58 vars in 1154 bytes} [Wed Nov 2 12:55:07 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:08.154017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:08.154904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:08.165368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:08.166438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:08.168026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:08.169119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:08.169887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:08.170618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:08.501322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:08.511998 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cef48d10-f79a-4fd1-b88f-6159dd0825d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1672 microversion: 2.1 time: 0.748784 Nov 02 12:55:08.513282 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2838/5734] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:07 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1672 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:08.537535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:08.565433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:08.566715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-195960207', 'deleted': False, 'project_id': '1c681e5678d3452286a3113aaac4a72a'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:55:08.581264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:08.584152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:08.586505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:08.588015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:08.591119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:08.592556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:08.798489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:08.810060 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8299ccf3-9363-4ff1-bb80-4428967a212e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 0.660792 Nov 02 12:55:08.813449 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2897/5735] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:08 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:08.825430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:55:08.832439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:08.833265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:08.847858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:08.852582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:08.853129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:08.854127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:08.854614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:08.855052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:08.888724 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a HTTP/1.1 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b800506a-c063-4688-9f25-d2bd5c44f01a'} Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:08.890492 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:55:08.895535 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5060712-e60d-404b-ba2a-999b1044e91f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 404 len: 111 microversion: 2.1 time: 0.077393 Nov 02 12:55:08.897937 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2898/5736] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:08 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:55:09.029422 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07a6b8a3-4dfa-41e5-bd0d-966f02633468 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-195960207" status: 200 len: 346 microversion: 2.1 time: 0.504087 Nov 02 12:55:09.031335 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2839/5737] 10.222.0.45 () {58 vars in 1228 bytes} [Wed Nov 2 12:55:08 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-195960207 => generated 346 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:55:09.053232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:09.053803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:09.064146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:09.065376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:09.066006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:09.066963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:09.067620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:09.068219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:09.104756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:55:09.275481 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-17ed24b5-41ac-4452-a6c6-de3b6700c461 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "DELETE /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 204 len: 0 microversion: 2.1 time: 0.226724 Nov 02 12:55:09.276615 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2899/5738] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:55:09 2022] DELETE /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:55:09.284890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:09.285653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:09.294144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:09.294984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:09.295671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:09.296795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:09.297469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:09.298146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:09.556964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:09.557784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:09.570698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:09.572119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:09.573348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:09.576674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:09.577857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:09.578394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:10.009779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:10.041230 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46147b35-5be3-4f7a-af90-dd677c37b6ae tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1518 microversion: 2.1 time: 0.760165 Nov 02 12:55:10.051303 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2840/5739] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:09 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1518 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:10.078444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:10.079429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:10.095822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:10.096352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:10.096811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:10.108135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:10.108656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:10.109111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:10.283014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:10.304274 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ee418cf6-409e-4a69-b3be-6a57f3573f72 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1677 microversion: 2.1 time: 0.752596 Nov 02 12:55:10.306746 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2900/5740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:09 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1677 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:10.561764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:10.580212 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-51ef6b6f-4e87-4200-91e5-fc472697bb22 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1677 microversion: 2.1 time: 0.521880 Nov 02 12:55:10.583691 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2841/5741] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:10 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1677 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:11.091965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:11.092614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:11.112746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:11.114544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:11.115200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:11.116487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:11.117170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:11.117893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:11.337629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:11.338953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:11.355191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:11.364008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:11.365905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:11.368293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:11.368984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:11.378902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:12.439102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:12.456917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:12.464566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-35e25715-246c-4148-835d-5f0730ddca9c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.130903 Nov 02 12:55:12.470705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2842/5742] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:11 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:12.492480 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4814deb3-a8f4-4592-91fe-58a6edf61961 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 200 len: 1518 microversion: 2.1 time: 1.405313 Nov 02 12:55:12.509385 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2901/5743] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:11 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 1518 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:12.536903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:12.539002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:12.545613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a1e9b0ae-df0d-46e5-86c5-49f438c02ea0 req-b147d11a-5e37-4d4c-a059-e825773d2ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185dc9c0-d216-4cad-b4c4-5351d9692219", "name": "network-vif-deleted", "tag": "6e181eeb-d0dc-4fe7-85f4-8c26cc4290f0"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:12.595156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:12.601503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:12.603743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:12.606712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:12.607041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:12.607479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:12.618582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a1e9b0ae-df0d-46e5-86c5-49f438c02ea0 req-b147d11a-5e37-4d4c-a059-e825773d2ba4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:12.626820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a1e9b0ae-df0d-46e5-86c5-49f438c02ea0 req-b147d11a-5e37-4d4c-a059-e825773d2ba4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:12.627463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a1e9b0ae-df0d-46e5-86c5-49f438c02ea0 req-b147d11a-5e37-4d4c-a059-e825773d2ba4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:12.686110 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a1e9b0ae-df0d-46e5-86c5-49f438c02ea0 req-b147d11a-5e37-4d4c-a059-e825773d2ba4 service nova] Creating event network-vif-deleted:6e181eeb-d0dc-4fe7-85f4-8c26cc4290f0 for instance 185dc9c0-d216-4cad-b4c4-5351d9692219 on n-h1-855650-5 Nov 02 12:55:12.724776 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a1e9b0ae-df0d-46e5-86c5-49f438c02ea0 req-b147d11a-5e37-4d4c-a059-e825773d2ba4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211665 Nov 02 12:55:12.739008 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2902/5744] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:55:13.535356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:13.537341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 185dc9c0-d216-4cad-b4c4-5351d9692219] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:13.551298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:13.552022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:13.552462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:13.553286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:13.563336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:13.571028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:13.607580 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] HTTP exception thrown: Instance 185dc9c0-d216-4cad-b4c4-5351d9692219 could not be found. Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Request method failure captured: Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 HTTP/1.1 Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmhhAp2NnEWD0PGNHv2SkOZtjjFQx3EijW1CGDsJLxxhBxQNBvws6IMKuuSWPk2ZTmYJhPV0e6D97GmgFmxen-SqX-DGG6cht9Mke5Ynw2_mLUkN1I0NwO9v3RuAsMxoAt0yfzrAvdZeo6exWOCKdEIdLdNb5WkU5-nAU4GFU_uVXWQ Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1c681e5678d3452286a3113aaac4a72a Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1c681e5678d3452286a3113aaac4a72a Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListServerFiltersTestJSON-2098714282-project Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 8fdc60c1012d435d9a33a97bd556db99 Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListServerFiltersTestJSON-2098714282-project Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 185dc9c0-d216-4cad-b4c4-5351d9692219 could not be found. Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '185dc9c0-d216-4cad-b4c4-5351d9692219'} Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185dc9c0-d216-4cad-b4c4-5351d9692219 could not be found. Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185dc9c0-d216-4cad-b4c4-5351d9692219 could not be found. Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:13.609798 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:13.614474 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:13.614474 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:13.614474 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:13.614474 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:55:13.614474 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:55:13.614474 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185dc9c0-d216-4cad-b4c4-5351d9692219 could not be found. Nov 02 12:55:13.614474 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:13.615758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Returning 404 to user: Instance 185dc9c0-d216-4cad-b4c4-5351d9692219 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:55:13.617135 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3a96b16b-9452-4c8d-9ebf-58e4dbdf2c42 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219" status: 404 len: 111 microversion: 2.1 time: 0.086297 Nov 02 12:55:13.618276 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2903/5745] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:13 2022] GET /compute/v2.1/servers/185dc9c0-d216-4cad-b4c4-5351d9692219 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:55:13.635660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:13.636861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:13.652624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:13.655852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:13.657338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:13.660237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:13.663355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:13.664056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:13.735069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:55:13.755060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:13.945754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:13.962299 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f706116-0d43-4df1-a2fb-a0a95302555e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1654 microversion: 2.1 time: 1.479206 Nov 02 12:55:13.972553 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2843/5746] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:12 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1654 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:13.991977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:13.993871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:14.020949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.031711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.041375 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e54042b-af1e-49e9-bb71-a1147ef5f1c7 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 204 len: 0 microversion: 2.1 time: 0.417766 Nov 02 12:55:14.048325 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2904/5747] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:55:13 2022] DELETE /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:55:14.055184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.064284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.068019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.069109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.072018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a41c02e7-5e99-4302-90da-0b024c375e38 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:14.088143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a41c02e7-5e99-4302-90da-0b024c375e38 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.090994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a41c02e7-5e99-4302-90da-0b024c375e38 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.091711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a41c02e7-5e99-4302-90da-0b024c375e38 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.120729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a HTTP/1.1 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'b800506a-c063-4688-9f25-d2bd5c44f01a'} Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:55:14.154936 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.158993 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.159693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:55:14.168319 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fda5852c-3b27-40a9-9bea-ee7b703e8cb1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 404 len: 111 microversion: 2.1 time: 0.189527 Nov 02 12:55:14.170980 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2844/5748] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:55:13 2022] DELETE /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:55:14.191605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:14.193430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:14.200883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a41c02e7-5e99-4302-90da-0b024c375e38 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Going to try to start instance {{(pid=120723) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:55:14.223175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.223695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.224141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.224951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.235736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.236253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.317210 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a41c02e7-5e99-4302-90da-0b024c375e38 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/action" status: 202 len: 0 microversion: 2.1 time: 0.264953 Nov 02 12:55:14.318273 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2905/5749] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:55:14 2022] POST /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:55:14.330524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:14.335174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: b800506a-c063-4688-9f25-d2bd5c44f01a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:14.348328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.350563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.351144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.352333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.356552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.357585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.418290 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a HTTP/1.1 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'b800506a-c063-4688-9f25-d2bd5c44f01a'} Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:14.420091 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.426169 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:14.426169 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:14.426169 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:14.426169 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:55:14.426169 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:55:14.426169 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. Nov 02 12:55:14.426169 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:14.426169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance b800506a-c063-4688-9f25-d2bd5c44f01a could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:55:14.428069 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91b901ac-e70f-43f4-98b0-446e26eaf898 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a" status: 404 len: 111 microversion: 2.1 time: 0.105934 Nov 02 12:55:14.428811 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2906/5750] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:14 2022] GET /compute/v2.1/servers/b800506a-c063-4688-9f25-d2bd5c44f01a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:55:14.456977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:14.458861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:14.495067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.503087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.503693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.504561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:14.507211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:14.507784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:14.678222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:14.779711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:14.826680 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2561b6e-d490-4ad3-80f2-cf59bbe6e204 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 200 len: 1519 microversion: 2.1 time: 0.645694 Nov 02 12:55:14.827753 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2845/5751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:14 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 1519 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:15.124441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:15.133491 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-efb94976-c145-44d0-a421-f32c6d2beaba tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1663 microversion: 2.1 time: 0.694693 Nov 02 12:55:15.156072 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2907/5752] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:14 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1663 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:15.868387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:15.870372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:15.888618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=68 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:15.891843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:15.894774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:15.899125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:15.900322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:15.901031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:15.901677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:16.177132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:16.178738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:16.207816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:16.211086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:16.212015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:16.217325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:16.219348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:16.221175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:17.041398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:17.087686 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b245ea2a-05d0-48ed-80fc-fbae85439d2a tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 200 len: 1519 microversion: 2.1 time: 1.222908 Nov 02 12:55:17.088717 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2846/5753] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:15 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 1519 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:17.182846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:17.199396 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5123acc8-8d52-4b51-9448-130943d9e59e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1663 microversion: 2.1 time: 1.038471 Nov 02 12:55:17.200086 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2908/5754] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:16 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1663 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:18.117896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:18.119385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:18.131008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:18.131492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:18.131928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:18.139275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:18.140011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:18.140603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:18.234228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:18.237621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:18.253937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:18.261893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:18.262993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:18.263739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:18.265466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:18.266215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:18.267222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:18.439851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:18.455008 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf417946-dd5b-4485-ade7-b3e529e27d13 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 200 len: 1477 microversion: 2.1 time: 0.341079 Nov 02 12:55:18.460833 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2847/5755] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:18 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 1477 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:18.763532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:18.883357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:18.924855 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2f4be6fa-b08c-4d9c-872a-6aac7a498389 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1663 microversion: 2.1 time: 0.690353 Nov 02 12:55:18.924855 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2909/5756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:18 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1663 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:19.272406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f26a11b4-7cc5-4c76-aa7b-f40e29658962 req-0cc7abf6-29bf-41de-a0aa-ad9c8183edd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d00de80-fc65-454f-a9c1-64a88b144db1", "name": "network-vif-deleted", "tag": "bdbb7c14-764d-4f34-a6af-a2bd462719a1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:19.289738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f26a11b4-7cc5-4c76-aa7b-f40e29658962 req-0cc7abf6-29bf-41de-a0aa-ad9c8183edd4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:19.295863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f26a11b4-7cc5-4c76-aa7b-f40e29658962 req-0cc7abf6-29bf-41de-a0aa-ad9c8183edd4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:19.296392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f26a11b4-7cc5-4c76-aa7b-f40e29658962 req-0cc7abf6-29bf-41de-a0aa-ad9c8183edd4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:19.332626 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f26a11b4-7cc5-4c76-aa7b-f40e29658962 req-0cc7abf6-29bf-41de-a0aa-ad9c8183edd4 service nova] Creating event network-vif-deleted:bdbb7c14-764d-4f34-a6af-a2bd462719a1 for instance 7d00de80-fc65-454f-a9c1-64a88b144db1 on n-h2-855650-5 Nov 02 12:55:19.349522 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f26a11b4-7cc5-4c76-aa7b-f40e29658962 req-0cc7abf6-29bf-41de-a0aa-ad9c8183edd4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.593248 Nov 02 12:55:19.350821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2848/5757] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:55:19.490488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:19.491780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:19.495288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:19.506520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:19.507132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:19.507666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:19.509011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:19.510297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:19.510973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:19.569435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:19.570991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:19.571638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:19.572892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lazy-loading 'fault' on Instance uuid 7d00de80-fc65-454f-a9c1-64a88b144db1 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:55:19.693161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:19.715301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6609a47f-4702-410c-89d9-78e9985445ca tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 200 len: 1311 microversion: 2.1 time: 0.230081 Nov 02 12:55:19.715901 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2910/5758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:19 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:19.954434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:19.956107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:19.981037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:19.981037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:19.981037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:19.981037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:19.981037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:19.981037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:20.058355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:20.391547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:20.404457 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8de38dce-82ec-49a3-8963-085737998cf3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1667 microversion: 2.1 time: 0.458169 Nov 02 12:55:20.405360 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2849/5759] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:19 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1667 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:20.746286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:20.746913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7d00de80-fc65-454f-a9c1-64a88b144db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:20.764287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:20.765188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:20.765665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:20.770611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:20.771456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:20.771551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:20.808198 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] HTTP exception thrown: Instance 7d00de80-fc65-454f-a9c1-64a88b144db1 could not be found. Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Request method failure captured: Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 HTTP/1.1 Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmhhAp2NnEWD0PGNHv2SkOZtjjFQx3EijW1CGDsJLxxhBxQNBvws6IMKuuSWPk2ZTmYJhPV0e6D97GmgFmxen-SqX-DGG6cht9Mke5Ynw2_mLUkN1I0NwO9v3RuAsMxoAt0yfzrAvdZeo6exWOCKdEIdLdNb5WkU5-nAU4GFU_uVXWQ Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1c681e5678d3452286a3113aaac4a72a Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1c681e5678d3452286a3113aaac4a72a Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ListServerFiltersTestJSON-2098714282-project Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 8fdc60c1012d435d9a33a97bd556db99 Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ListServerFiltersTestJSON-2098714282-project Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 7d00de80-fc65-454f-a9c1-64a88b144db1 could not be found. Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '7d00de80-fc65-454f-a9c1-64a88b144db1'} Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d00de80-fc65-454f-a9c1-64a88b144db1 could not be found. Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d00de80-fc65-454f-a9c1-64a88b144db1 could not be found. Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:20.810796 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:20.816256 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:20.816256 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:20.816256 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:20.816256 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:55:20.816256 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:55:20.816256 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d00de80-fc65-454f-a9c1-64a88b144db1 could not be found. Nov 02 12:55:20.816256 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:55:20.817783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Returning 404 to user: Instance 7d00de80-fc65-454f-a9c1-64a88b144db1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:55:20.819423 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd99be4a-4c42-4f7b-998c-47e8660c0ca1 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1" status: 404 len: 111 microversion: 2.1 time: 0.077917 Nov 02 12:55:20.823791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2911/5760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:20 2022] GET /compute/v2.1/servers/7d00de80-fc65-454f-a9c1-64a88b144db1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:55:20.828795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:20.829305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:20.847402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:20.847940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:20.848403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:20.849138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:20.870656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:20.871538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:20.938602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:55:21.084971 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0698a783-bff8-4eb6-ae6e-41c1bf1d04f2 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 204 len: 0 microversion: 2.1 time: 0.259768 Nov 02 12:55:21.086663 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2850/5761] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:55:20 2022] DELETE /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:55:21.095768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:21.096470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:21.114162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:21.117373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:21.120166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:21.122983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:21.123597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:21.127367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:21.647099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:21.680202 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-86b572a7-a7dc-450c-8895-004582f8201f tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1518 microversion: 2.1 time: 0.588867 Nov 02 12:55:21.682355 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2912/5762] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:21 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1518 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:22.716215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:22.725677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:22.751709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:22.754720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:22.755399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:22.757570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:22.761926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:22.762632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:23.153271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:23.171001 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f265fba2-9bd0-4b43-a670-83f5551b7c00 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1518 microversion: 2.1 time: 0.458632 Nov 02 12:55:23.173175 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2851/5763] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:22 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1518 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:24.201485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:24.203676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:24.217631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:24.235347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:24.236242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:24.236576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:24.237040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:24.237470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:25.259053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-be057eb3-0c37-4168-b4fb-5cd03c41554d req-8493d965-cbc0-40c7-8871-076b931b060b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa0875b-f988-417b-b891-d9fc9e9a1fad", "name": "network-vif-deleted", "tag": "3bac5ef2-442b-4c77-97e5-f1c693ca0e04"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:25.310746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be057eb3-0c37-4168-b4fb-5cd03c41554d req-8493d965-cbc0-40c7-8871-076b931b060b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:25.311645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be057eb3-0c37-4168-b4fb-5cd03c41554d req-8493d965-cbc0-40c7-8871-076b931b060b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:25.312510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be057eb3-0c37-4168-b4fb-5cd03c41554d req-8493d965-cbc0-40c7-8871-076b931b060b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:25.346710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-be057eb3-0c37-4168-b4fb-5cd03c41554d req-8493d965-cbc0-40c7-8871-076b931b060b service nova] Creating event network-vif-deleted:3bac5ef2-442b-4c77-97e5-f1c693ca0e04 for instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad on n-h1-855650-5 Nov 02 12:55:25.374493 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-be057eb3-0c37-4168-b4fb-5cd03c41554d req-8493d965-cbc0-40c7-8871-076b931b060b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114784 Nov 02 12:55:25.375550 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2852/5764] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:55:26.027505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc60c1012d435d9a33a97bd556db99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c681e5678d3452286a3113aaac4a72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:26.057006 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-195139fa-b8e8-48fd-8098-979af95af40b tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 200 len: 1518 microversion: 2.1 time: 1.855528 Nov 02 12:55:26.067289 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2913/5765] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:24 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 1518 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:27.087672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:27.093783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] [instance: 7aa0875b-f988-417b-b891-d9fc9e9a1fad] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:27.131781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:27.132939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:27.134026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:27.135827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:27.137256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:27.139135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:27.179421 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] HTTP exception thrown: Instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad could not be found. Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Request method failure captured: Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad HTTP/1.1 Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmhhAp2NnEWD0PGNHv2SkOZtjjFQx3EijW1CGDsJLxxhBxQNBvws6IMKuuSWPk2ZTmYJhPV0e6D97GmgFmxen-SqX-DGG6cht9Mke5Ynw2_mLUkN1I0NwO9v3RuAsMxoAt0yfzrAvdZeo6exWOCKdEIdLdNb5WkU5-nAU4GFU_uVXWQ Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1c681e5678d3452286a3113aaac4a72a Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c681e5678d3452286a3113aaac4a72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1c681e5678d3452286a3113aaac4a72a Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2098714282 Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ListServerFiltersTestJSON-2098714282-project Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 8fdc60c1012d435d9a33a97bd556db99 Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ListServerFiltersTestJSON-2098714282-project Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad could not be found. Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '7aa0875b-f988-417b-b891-d9fc9e9a1fad'} Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad could not be found. Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad could not be found. Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:55:27.181504 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:27.186095 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:55:27.186095 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:55:27.186095 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:55:27.186095 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:55:27.186095 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:55:27.186095 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad could not be found. Nov 02 12:55:27.186095 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:55:27.195919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] Returning 404 to user: Instance 7aa0875b-f988-417b-b891-d9fc9e9a1fad could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:55:27.198326 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d27b1d7e-3612-414d-b223-ffaef5176f09 tempest-ListServerFiltersTestJSON-2098714282 tempest-ListServerFiltersTestJSON-2098714282-project] 10.222.0.45 "GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad" status: 404 len: 111 microversion: 2.1 time: 0.114958 Nov 02 12:55:27.204509 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2853/5766] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:27 2022] GET /compute/v2.1/servers/7aa0875b-f988-417b-b891-d9fc9e9a1fad => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:55:48.616557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=9 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:48.617249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:49.468906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1069531346", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a88af682-1349-4fb0-ad45-816792b91fdc"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:49.642962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] validate_networks() for [('a88af682-1349-4fb0-ad45-816792b91fdc', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:55:51.593406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:55:51.594876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:55:51.596511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:55:51.597163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:55:51.597772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:55:51.624270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:51.624805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:51.625261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:51.626122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:51.629039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:51.629602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:51.698851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Getting quotas for project bb6ea7d5f2de4a5c9bed813e6b6e4324. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:55:51.719442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Getting quotas for user 18379b6a5e9d4866ad9e46c8cc755991 and project bb6ea7d5f2de4a5c9bed813e6b6e4324. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:55:51.752189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:55:51.755517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:55:51.844024 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7ed37ad5-1bca-41d6-8d0e-20c78cec6cd8 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.242074 Nov 02 12:55:51.850867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2914/5767] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:55:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:55:51.858724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07542813-65f5-4e3e-bbb3-697be11aeeca tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:51.859840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07542813-65f5-4e3e-bbb3-697be11aeeca tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:51.870894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:51.874568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:51.877817 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:55:51.877817 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 12:55:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda (ip 10.222.0.45) !!! Nov 02 12:55:51.992729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07542813-65f5-4e3e-bbb3-697be11aeeca tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:52.034332 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07542813-65f5-4e3e-bbb3-697be11aeeca tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1225 microversion: 2.1 time: 0.175938 Nov 02 12:55:52.036209 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2854/5768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:51 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1225 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:53.066650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-21d61377-fc77-4d48-b7c4-9c6f9f56359c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:53.067659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-21d61377-fc77-4d48-b7c4-9c6f9f56359c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:53.309578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-21d61377-fc77-4d48-b7c4-9c6f9f56359c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:53.322377 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-21d61377-fc77-4d48-b7c4-9c6f9f56359c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1225 microversion: 2.1 time: 0.263524 Nov 02 12:55:53.324959 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2915/5769] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:53 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1225 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:54.371174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:54.385844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:54.438784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:54.446549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:54.447511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:54.450208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:54.451926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:54.455185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:54.902711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:54.936075 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f78fa51-f455-4afb-82ed-42e82dc064df tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1277 microversion: 2.1 time: 0.591097 Nov 02 12:55:54.936681 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2855/5770] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:54 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1277 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:55.960782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:55.961409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:55.993809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:55.997979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:55.998512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:56.005636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:56.009274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:56.009791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:56.392240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:56.400668 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f767e9cb-a446-4963-9c13-013fca1ea12d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1283 microversion: 2.1 time: 0.443815 Nov 02 12:55:56.403707 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2916/5771] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:55 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1283 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:57.430879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:57.432008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:57.473576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:57.480703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:57.481676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:57.492724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:57.493388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:57.494720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:58.438276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:58.454770 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95c5bfeb-5149-474e-9778-35f00fcf93a4 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 1.030162 Nov 02 12:55:58.458745 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2856/5772] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:57 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:59.481617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:59.482270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:59.495346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:59.495845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:59.496288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:59.501768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:59.502323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:59.502824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:59.952531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:59.982706 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20a05855-84f4-4dc5-8753-5deddb8b1193 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 0.505062 Nov 02 12:55:59.988282 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2917/5773] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:59 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:00.110124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-812e5d73-cc71-4ae1-9d55-9d51616b42b6 req-9d9d00be-b279-4fb0-9fa6-32c1d23bf1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a469da7f-fe01-421e-bad0-9d5bdf6f0bda", "tag": "7c2095cb-089c-4f48-925d-4b2d52c23faa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:00.157577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-812e5d73-cc71-4ae1-9d55-9d51616b42b6 req-9d9d00be-b279-4fb0-9fa6-32c1d23bf1f7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:00.158834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-812e5d73-cc71-4ae1-9d55-9d51616b42b6 req-9d9d00be-b279-4fb0-9fa6-32c1d23bf1f7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:00.160195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-812e5d73-cc71-4ae1-9d55-9d51616b42b6 req-9d9d00be-b279-4fb0-9fa6-32c1d23bf1f7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:00.185472 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-812e5d73-cc71-4ae1-9d55-9d51616b42b6 req-9d9d00be-b279-4fb0-9fa6-32c1d23bf1f7 service nova] Creating event network-changed:7c2095cb-089c-4f48-925d-4b2d52c23faa for instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda on n-h2-855650-5 Nov 02 12:56:00.200968 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-812e5d73-cc71-4ae1-9d55-9d51616b42b6 req-9d9d00be-b279-4fb0-9fa6-32c1d23bf1f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109006 Nov 02 12:56:00.202664 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2857/5774] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:01.018560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:01.019064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:01.038397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:01.051863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:01.055153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:01.059818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:01.060627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:01.064310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:01.660434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:01.950184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:01.959055 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ebf13120-233d-4165-9e18-519c933e8508 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 0.944527 Nov 02 12:56:01.959667 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2918/5775] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:01 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:02.259465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:02.551711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1664878256", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "d0c03422-bda9-4e36-b148-5f3f535f0844"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:02.644916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] validate_networks() for [('d0c03422-bda9-4e36-b148-5f3f535f0844', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:56:02.993035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:02.993790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:03.014952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:03.015682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:03.016221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:03.018691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:03.021083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:03.021889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:03.321950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:03.399437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:03.415131 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-45c5cc4b-153a-46d4-abc0-f897cd770d22 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 0.431728 Nov 02 12:56:03.415949 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2919/5776] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:02 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:04.076014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:56:04.077116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:56:04.077996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:56:04.078616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:56:04.079250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:56:04.094469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:04.095365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:04.096030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:04.097007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:04.097727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:04.098652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:04.120896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Getting quotas for project 46350576da804cce9582ee12039cc492. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:56:04.128506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Getting quotas for user ee24703e9582468ca2c3313f111a6c80 and project 46350576da804cce9582ee12039cc492. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:56:04.149777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:56:04.152834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:56:04.218810 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f8b31663-eb1e-4b56-b15a-01a22cc4a011 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.975338 Nov 02 12:56:04.223521 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2858/5777] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:56:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:56:04.231538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-971cc092-1790-4673-9719-62306661f229 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:04.232522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-971cc092-1790-4673-9719-62306661f229 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:04.323712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-971cc092-1790-4673-9719-62306661f229 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:04.337881 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-971cc092-1790-4673-9719-62306661f229 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1214 microversion: 2.1 time: 0.110630 Nov 02 12:56:04.340138 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2920/5778] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:04 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:04.444435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:04.446950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:04.462368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:04.462884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:04.463404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:04.464034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:04.464482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:04.464908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:04.677369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:04.700934 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1dacbcc6-35ea-4866-a4ff-d5a207ce0291 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 0.253235 Nov 02 12:56:04.701615 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2859/5779] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:04 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:05.366336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:05.367089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:05.380309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:05.380992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:05.381612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:05.382526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:05.387451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:05.388217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:05.737681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:05.738989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:05.763013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:05.763841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:05.766039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:05.767090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:05.767798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:05.768686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:06.546757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:06.562791 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d0a5e963-66bc-4ff6-b303-8e314f1a0659 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1210 microversion: 2.1 time: 1.200454 Nov 02 12:56:06.565820 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2921/5780] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:05 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1210 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:06.578385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1509679324", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0c54864c-e4b6-4d19-b4b1-f383b7120ce0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5c2de958-5bb8-43d5-9f50-0267f3814230"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:06.816425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] validate_networks() for [('5c2de958-5bb8-43d5-9f50-0267f3814230', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:56:07.012464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:07.042692 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a488e663-e715-493f-af88-e6145d21ac8d tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 1.318267 Nov 02 12:56:07.043356 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2860/5781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:05 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:07.590168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:07.590820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:07.615299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:07.615834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:07.616299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:07.618111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:07.622825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:07.623461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:08.640991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:08.651396 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a47d460-7870-400e-bb84-6798ef9e61a8 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1314 microversion: 2.1 time: 1.066634 Nov 02 12:56:08.655297 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2861/5782] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:07 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1314 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:08.669106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:08.669995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:08.709239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:08.710512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:08.713427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:08.714411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:08.715042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:08.717103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:09.433726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:56:09.435987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:56:09.436726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:56:09.436866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:09.437551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:56:09.438194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:56:09.449306 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9486ec4b-2a28-43c2-9027-1688384be8e1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 0.785639 Nov 02 12:56:09.450421 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2862/5783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:08 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:09.464101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:09.464633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:09.465091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:09.465898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:09.500784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:09.501062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:09.545591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:56:09.552335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for user 15b6ee9295464444a626601b16db2574 and project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:56:09.577635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1f6e7176-8a4b-4470-9989-974f9a3a7ddf req-dcea4ea3-b211-4528-8bd8-bdf64b9c68de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502c6d6b-1031-4a1e-b0ab-668d23c24d4a", "tag": "afa70b1f-6510-45ce-a341-16bbee380145"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:09.598105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1f6e7176-8a4b-4470-9989-974f9a3a7ddf req-dcea4ea3-b211-4528-8bd8-bdf64b9c68de service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:09.598714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1f6e7176-8a4b-4470-9989-974f9a3a7ddf req-dcea4ea3-b211-4528-8bd8-bdf64b9c68de service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:09.600398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1f6e7176-8a4b-4470-9989-974f9a3a7ddf req-dcea4ea3-b211-4528-8bd8-bdf64b9c68de service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:09.640344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1f6e7176-8a4b-4470-9989-974f9a3a7ddf req-dcea4ea3-b211-4528-8bd8-bdf64b9c68de service nova] Creating event network-changed:afa70b1f-6510-45ce-a341-16bbee380145 for instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a on n-h1-855650-5 Nov 02 12:56:09.660327 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1f6e7176-8a4b-4470-9989-974f9a3a7ddf req-dcea4ea3-b211-4528-8bd8-bdf64b9c68de service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208480 Nov 02 12:56:09.660962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2863/5784] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:09.695056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:56:09.697571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c54864c-e4b6-4d19-b4b1-f383b7120ce0',volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:56:09.716927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:09.720159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:09.736347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:09.739398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:09.740328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:09.743613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:09.744305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:09.746219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:10.005853 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1d6b1649-8166-424d-9619-e64106f600c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.438622 Nov 02 12:56:10.013647 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2922/5785] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:56:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:56:10.159258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-05951679-6ae1-4312-b3a1-e0b141947c1e req-be5b9be6-cd5c-4508-bc31-0c011d4ee73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a469da7f-fe01-421e-bad0-9d5bdf6f0bda", "name": "network-vif-plugged", "status": "completed", "tag": "7c2095cb-089c-4f48-925d-4b2d52c23faa"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:10.171853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-05951679-6ae1-4312-b3a1-e0b141947c1e req-be5b9be6-cd5c-4508-bc31-0c011d4ee73d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:10.172726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-05951679-6ae1-4312-b3a1-e0b141947c1e req-be5b9be6-cd5c-4508-bc31-0c011d4ee73d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:10.173387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-05951679-6ae1-4312-b3a1-e0b141947c1e req-be5b9be6-cd5c-4508-bc31-0c011d4ee73d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:10.186163 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-05951679-6ae1-4312-b3a1-e0b141947c1e req-be5b9be6-cd5c-4508-bc31-0c011d4ee73d service nova] Creating event network-vif-plugged:7c2095cb-089c-4f48-925d-4b2d52c23faa for instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda on n-h2-855650-5 Nov 02 12:56:10.192020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-05951679-6ae1-4312-b3a1-e0b141947c1e req-be5b9be6-cd5c-4508-bc31-0c011d4ee73d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176580 Nov 02 12:56:10.192981 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2923/5786] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:10.200018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e555288-d729-4adb-b1b6-32e37ace21cf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:10.201220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e555288-d729-4adb-b1b6-32e37ace21cf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:10.354170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5e555288-d729-4adb-b1b6-32e37ace21cf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:10.402249 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e555288-d729-4adb-b1b6-32e37ace21cf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1071 microversion: 2.1 time: 0.207765 Nov 02 12:56:10.405952 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2924/5787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:10 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1071 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:10.477221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:10.477923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:10.486185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:10.489075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:10.489768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:10.490702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:10.494488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:10.495118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:10.571439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:10.579855 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb0389bd-e444-4112-83bd-d6866d7b55e5 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1314 microversion: 2.1 time: 0.884009 Nov 02 12:56:10.580765 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2864/5788] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:09 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:10.769754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:10.817672 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-036c7212-8702-4383-a2ba-3b4fd4012c48 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 0.343683 Nov 02 12:56:10.822807 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2925/5789] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:10 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:11.429296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:11.430006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:11.450752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:11.451690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:11.452396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:11.453764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:11.454477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:11.455225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:11.595512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:11.604535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:11.605868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:11.612849 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5eed16ff-f0c0-4cca-8546-ff6c2ced5aba tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1121 microversion: 2.1 time: 0.187742 Nov 02 12:56:11.622102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:11.626619 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2865/5790] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:11 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1121 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:11.629267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:11.630458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:11.635008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:11.635860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:11.636531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:11.845515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:11.850981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:11.859886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:11.864772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:11.872911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:11.874066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:11.874555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:11.875170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:13.344937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:13.385461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5f977de9-38b4-4418-b2cd-a2cf4e5ff166 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1314 microversion: 2.1 time: 1.785284 Nov 02 12:56:13.404206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:13.413415 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2926/5791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:11 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1314 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:13.419775 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b24c3a7c-5e99-4eef-a8d4-39bcaff66b74 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1325 microversion: 2.1 time: 1.578565 Nov 02 12:56:13.432351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:13.434159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:13.439098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2866/5792] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:11 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1325 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:13.447871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:13.448663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:13.449912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:13.452569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:13.458272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:13.459069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:13.758909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:13.803129 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2aab8ee5-293a-460b-9abd-ac9ab848b860 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1187 microversion: 2.1 time: 0.386642 Nov 02 12:56:13.806986 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2927/5793] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:13 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1187 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:14.421626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:14.422359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:14.425252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:14.427431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:14.454806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:14.455313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:14.455624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:14.455718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:14.456452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:14.471054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:14.471620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:14.472082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:14.477363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:14.478515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:14.481900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:14.484286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:14.485754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:14.487734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:15.599923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:15.637747 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e9443b51-0bd3-4b56-bd9e-7ca62c05faa1 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1522 microversion: 2.1 time: 1.194821 Nov 02 12:56:15.642219 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2928/5794] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:14 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1522 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:15.673237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:15.676038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:15.695439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:15.699288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:15.700062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:15.701078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:15.702040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:15.703653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:15.775709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:15.800369 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-deaced51-ae29-4906-9839-96bfff5358fe tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1314 microversion: 2.1 time: 1.381332 Nov 02 12:56:15.803037 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2867/5795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:14 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1314 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:15.832735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:15.833431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:15.840048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:15.840549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:15.841083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:15.842883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:15.843783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:15.844682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:15.919893 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] HTTP exception thrown: Instance is not a member of specified network Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Request method failure captured: Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda/ips/invalid HTTP/1.1 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmjULFlIgWZN8IbYbdDmHmS-z44f_q1gOjJbgdKMoo24tIUANyZOCWjxPio28dIRLGZLIzZ0Rzi9ngnUpOJ19AyqOhErwvb-iemxNybKcIz2XAE5s5QLPE_JDU5NtKmh6B00jS0rOAIS00VvyqrXXnIOfDX9UN0g_TDOLbm6ElZZpA4 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: bb6ea7d5f2de4a5c9bed813e6b6e4324 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: bb6ea7d5f2de4a5c9bed813e6b6e4324 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerAddressesNegativeTestJSON-1213218303-project Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 18379b6a5e9d4866ad9e46c8cc755991 Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1213218303-project Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance is not a member of specified network Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': 'a469da7f-fe01-421e-bad0-9d5bdf6f0bda', 'id': 'invalid'} Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Nov 02 12:56:15.958052 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:15.962604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:56:15.964875 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f1ec28f1-0635-417e-837f-5686d0f03dda tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.160575 Nov 02 12:56:15.966579 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2868/5796] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 12:56:15 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda/ips/invalid => generated 91 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:56:15.989591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd628c2b-f868-4b37-b948-6a908869732c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:15.995117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd628c2b-f868-4b37-b948-6a908869732c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Failed to fetch instance by id 999 {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:56:15.995767 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-dd628c2b-f868-4b37-b948-6a908869732c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] HTTP exception thrown: Instance 999 could not be found. Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd628c2b-f868-4b37-b948-6a908869732c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Request method failure captured: Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmjULFlIgWZN8IbYbdDmHmS-z44f_q1gOjJbgdKMoo24tIUANyZOCWjxPio28dIRLGZLIzZ0Rzi9ngnUpOJ19AyqOhErwvb-iemxNybKcIz2XAE5s5QLPE_JDU5NtKmh6B00jS0rOAIS00VvyqrXXnIOfDX9UN0g_TDOLbm6ElZZpA4 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: bb6ea7d5f2de4a5c9bed813e6b6e4324 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: bb6ea7d5f2de4a5c9bed813e6b6e4324 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerAddressesNegativeTestJSON-1213218303-project Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 18379b6a5e9d4866ad9e46c8cc755991 Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1213218303-project Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 999 could not be found. Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': '999'} Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 12:56:16.001511 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:16.012294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd628c2b-f868-4b37-b948-6a908869732c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:56:16.012294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd628c2b-f868-4b37-b948-6a908869732c tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.031578 Nov 02 12:56:16.012294 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2869/5797] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:56:15 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:56:16.040205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:16.058010 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba10cec9-6283-4d62-850c-4a0ff48b7e66 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1187 microversion: 2.1 time: 0.404602 Nov 02 12:56:16.063550 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2929/5798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:15 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1187 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:16.064101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:16.064947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:16.089358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:16.091335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:16.093514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:16.101372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:16.102641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:16.105314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:16.186902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:56:16.353374 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84c08f8e-e71c-48b9-98ba-3b147f552495 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 204 len: 0 microversion: 2.1 time: 0.340661 Nov 02 12:56:16.355076 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2870/5799] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:56:16 2022] DELETE /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:56:16.363143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:16.363809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:16.381381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:16.382807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:16.386993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:16.388622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:16.390635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:16.391265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:16.829710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:16.831311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:16.861393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:16.862673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:16.863422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:16.868289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:16.868901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:16.871165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:16.915172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:16.932314 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d96a7d25-67b0-499d-934a-8916ed864de6 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1528 microversion: 2.1 time: 0.566857 Nov 02 12:56:16.957759 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2930/5800] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:16 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1528 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:17.090272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:17.090904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:17.105403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:17.105928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:17.106407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:17.109637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:17.112108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:17.114946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:17.892712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:17.908862 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08f8c949-0a18-4f88-8715-7f809391d4b7 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1314 microversion: 2.1 time: 1.083816 Nov 02 12:56:17.909908 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2871/5801] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:16 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:17.916378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-35a8bfd5-4f07-4512-acd4-9aaba1004983 req-0aeb579a-9023-4cc0-bcbb-014c5d4d921c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502c6d6b-1031-4a1e-b0ab-668d23c24d4a", "name": "network-vif-plugged", "status": "completed", "tag": "afa70b1f-6510-45ce-a341-16bbee380145"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:17.938031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:17.948214 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bca528c6-a238-4e2e-835a-748aba106533 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1229 microversion: 2.1 time: 0.862914 Nov 02 12:56:17.951363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-35a8bfd5-4f07-4512-acd4-9aaba1004983 req-0aeb579a-9023-4cc0-bcbb-014c5d4d921c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:17.951852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-35a8bfd5-4f07-4512-acd4-9aaba1004983 req-0aeb579a-9023-4cc0-bcbb-014c5d4d921c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:17.952291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-35a8bfd5-4f07-4512-acd4-9aaba1004983 req-0aeb579a-9023-4cc0-bcbb-014c5d4d921c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:17.966007 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2931/5802] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:17 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1229 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:17.970926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:17.972490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:17.983955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:17.985317 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-35a8bfd5-4f07-4512-acd4-9aaba1004983 req-0aeb579a-9023-4cc0-bcbb-014c5d4d921c service nova] Creating event network-vif-plugged:afa70b1f-6510-45ce-a341-16bbee380145 for instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a on n-h1-855650-5 Nov 02 12:56:17.986122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:17.990272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:17.993163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:17.993163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:17.993163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:17.999206 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-35a8bfd5-4f07-4512-acd4-9aaba1004983 req-0aeb579a-9023-4cc0-bcbb-014c5d4d921c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087847 Nov 02 12:56:18.000176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2872/5803] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:18.527468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:18.580142 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5dda8a6d-fd6f-45c1-9e24-103c4f5a7585 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1528 microversion: 2.1 time: 0.613464 Nov 02 12:56:18.598045 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2932/5804] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:17 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1528 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:18.940180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:18.941630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:18.958266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:18.959516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:18.964465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:18.968084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:18.968619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:18.971807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:18.983031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:18.983671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:18.986740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:19.016535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:19.019733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:19.021041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:19.030437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:19.030942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:19.031405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:19.125846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=85 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:19.528829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:20.392625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:20.441751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:20.445762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:20.454720 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cbd3235-010f-4c23-8715-02f14d5a962e tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1314 microversion: 2.1 time: 1.521124 Nov 02 12:56:20.456294 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2873/5805] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:18 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1314 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:20.462984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fb9280fd-c001-4b4d-b389-1e79f1789d3a req-2adbf485-2062-43b3-88e7-6036afb91317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a469da7f-fe01-421e-bad0-9d5bdf6f0bda", "name": "network-vif-deleted", "tag": "7c2095cb-089c-4f48-925d-4b2d52c23faa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:20.476431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fb9280fd-c001-4b4d-b389-1e79f1789d3a req-2adbf485-2062-43b3-88e7-6036afb91317 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:20.477894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fb9280fd-c001-4b4d-b389-1e79f1789d3a req-2adbf485-2062-43b3-88e7-6036afb91317 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:20.478549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fb9280fd-c001-4b4d-b389-1e79f1789d3a req-2adbf485-2062-43b3-88e7-6036afb91317 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:20.493431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fb9280fd-c001-4b4d-b389-1e79f1789d3a req-2adbf485-2062-43b3-88e7-6036afb91317 service nova] Creating event network-vif-deleted:7c2095cb-089c-4f48-925d-4b2d52c23faa for instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda on n-h2-855650-5 Nov 02 12:56:20.499875 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fb9280fd-c001-4b4d-b389-1e79f1789d3a req-2adbf485-2062-43b3-88e7-6036afb91317 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041740 Nov 02 12:56:20.501639 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2874/5806] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:20.509585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:20.510338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:20.519017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:20.519436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:20.520081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:20.521053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:20.521539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:20.522193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:20.565133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:20.565802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:20.566851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:20.567827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lazy-loading 'fault' on Instance uuid a469da7f-fe01-421e-bad0-9d5bdf6f0bda {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:56:20.622472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:20.636938 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d75facf0-1839-4db9-b688-9bb72101f238 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1229 microversion: 2.1 time: 1.655910 Nov 02 12:56:20.638005 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2933/5807] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:18 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1229 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:20.692890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18379b6a5e9d4866ad9e46c8cc755991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6ea7d5f2de4a5c9bed813e6b6e4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:20.707395 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-024faba3-b49e-41cf-a528-32e8f5750aa0 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 200 len: 1315 microversion: 2.1 time: 0.204070 Nov 02 12:56:20.708333 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2875/5808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:20 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:20.875811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5e1bb06a-e831-4394-912a-191bba4303a7 req-c4742a6b-5046-456f-9314-f7c4904f0995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9addd4f4-648b-49c9-a39c-be40c7f1fb85", "tag": "a2289616-b13c-4d57-b795-2b3fe52b301a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:20.901878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5e1bb06a-e831-4394-912a-191bba4303a7 req-c4742a6b-5046-456f-9314-f7c4904f0995 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:20.903548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5e1bb06a-e831-4394-912a-191bba4303a7 req-c4742a6b-5046-456f-9314-f7c4904f0995 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:20.904724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5e1bb06a-e831-4394-912a-191bba4303a7 req-c4742a6b-5046-456f-9314-f7c4904f0995 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:20.937577 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5e1bb06a-e831-4394-912a-191bba4303a7 req-c4742a6b-5046-456f-9314-f7c4904f0995 service nova] Creating event network-changed:a2289616-b13c-4d57-b795-2b3fe52b301a for instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 on n-h2-855650-5 Nov 02 12:56:20.956940 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5e1bb06a-e831-4394-912a-191bba4303a7 req-c4742a6b-5046-456f-9314-f7c4904f0995 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094924 Nov 02 12:56:20.969260 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2934/5809] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:21.483777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:21.484400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:21.497440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:21.497950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:21.498427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:21.499156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:21.508215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:21.509090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:21.661629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:21.663022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:21.677083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:21.678160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:21.684812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:21.685841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:21.686585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:21.687186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:22.184580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:22.225761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37dcde54-6e4d-4299-b25a-a52b1e68d325 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1497 microversion: 2.1 time: 0.738205 Nov 02 12:56:22.230630 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2876/5810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:21 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1497 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:22.284636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:22.287492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] [instance: a469da7f-fe01-421e-bad0-9d5bdf6f0bda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:22.292315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:22.307068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:22.307577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:22.308028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:22.308761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:22.320518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:22.321663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:22.369931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:22.383548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab35f77c-bdc7-4fbd-b895-61557af1968c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1229 microversion: 2.1 time: 0.722653 Nov 02 12:56:22.397331 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] HTTP exception thrown: Instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda could not be found. Nov 02 12:56:22.403833 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2935/5811] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:21 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1229 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Request method failure captured: Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda HTTP/1.1 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmjULFlIgWZN8IbYbdDmHmS-z44f_q1gOjJbgdKMoo24tIUANyZOCWjxPio28dIRLGZLIzZ0Rzi9ngnUpOJ19AyqOhErwvb-iemxNybKcIz2XAE5s5QLPE_JDU5NtKmh6B00jS0rOAIS00VvyqrXXnIOfDX9UN0g_TDOLbm6ElZZpA4 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: bb6ea7d5f2de4a5c9bed813e6b6e4324 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb6ea7d5f2de4a5c9bed813e6b6e4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: bb6ea7d5f2de4a5c9bed813e6b6e4324 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1213218303 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerAddressesNegativeTestJSON-1213218303-project Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 18379b6a5e9d4866ad9e46c8cc755991 Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1213218303-project Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda could not be found. Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a469da7f-fe01-421e-bad0-9d5bdf6f0bda'} Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda could not be found. Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda could not be found. Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:22.410293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda could not be found. Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] Returning 404 to user: Instance a469da7f-fe01-421e-bad0-9d5bdf6f0bda could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:56:22.415799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1ac57cf1-da66-40b9-9a5c-f4675fbce512 tempest-ServerAddressesNegativeTestJSON-1213218303 tempest-ServerAddressesNegativeTestJSON-1213218303-project] 10.222.0.45 "GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda" status: 404 len: 111 microversion: 2.1 time: 0.158958 Nov 02 12:56:22.416962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2877/5812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:22 2022] GET /compute/v2.1/servers/a469da7f-fe01-421e-bad0-9d5bdf6f0bda => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:56:23.411980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:23.413477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:23.428551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:23.429438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:23.430672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:23.431658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:23.437578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:23.438456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:24.451058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:24.463737 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-31f3c8ae-e34a-49a8-ba1f-1e87d08bf273 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1229 microversion: 2.1 time: 1.055915 Nov 02 12:56:24.466626 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2936/5813] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:23 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1229 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:24.836097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:24.837428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:24.863972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:24.864596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:24.874359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:24.876198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:24.879960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:24.881855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:25.309354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:25.323426 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25a67e06-8225-4bd0-bd1d-2bf9002cb8c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.492224 Nov 02 12:56:25.355307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:25.356056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:25.364285 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2878/5814] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:24 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:25.378813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:25.379700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:25.380538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:25.381465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:25.382226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:25.382927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:25.502308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:25.503249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:25.512661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:25.513399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:25.514049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:25.514935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:25.517092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:25.517542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:27.007068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:27.042313 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-006a94c8-a4c6-42e4-be59-c4e975c2473c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.690345 Nov 02 12:56:27.042313 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2937/5815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:25 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:27.072350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:27.072978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:27.103396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:27.103898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:27.104323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:27.105045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:27.120404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:27.121185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:27.892390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:27.915915 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-51d9dc88-a312-4b52-9160-f8e942e467ac tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1229 microversion: 2.1 time: 2.422527 Nov 02 12:56:27.924152 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2879/5816] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:25 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1229 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:28.169560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:28.170970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:28.185685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:28.186653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:28.186653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:28.187407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:28.187966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:28.188447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:28.243807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:56:28.399135 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7bccb0ac-7634-42df-b1db-04588f3129bf tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "DELETE /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 204 len: 0 microversion: 2.1 time: 0.232337 Nov 02 12:56:28.404367 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2880/5817] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:56:28 2022] DELETE /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:56:28.415330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:28.416410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:28.416982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:28.426611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:28.427562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:28.428506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:28.429570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:28.430220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:28.431061 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7870f80f-8915-4145-a514-a92df8b44a03 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.364034 Nov 02 12:56:28.431313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:28.434166 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2938/5818] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:27 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:28.465051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:28.466157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:28.489433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:28.492519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:28.495847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:28.497118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:28.497790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:28.498465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:29.149698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:29.163438 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b05f41d-302a-4f4c-9788-19255af389c6 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1503 microversion: 2.1 time: 0.757310 Nov 02 12:56:29.166780 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2881/5819] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:28 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1503 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:29.192862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:29.193499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:29.211670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:29.212178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:29.212622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:29.213531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:29.214726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:29.217333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:29.251449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:29.260401 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-19b3db30-5363-4ac8-9f2f-0759bbe23eb4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.802501 Nov 02 12:56:29.266004 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2939/5820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:28 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:29.530900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1982782425", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "27a2ec76-336c-4d46-b2bd-166a4b3d0fe4"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:29.597394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] validate_networks() for [('27a2ec76-336c-4d46-b2bd-166a4b3d0fe4', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:56:29.967366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:29.980821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17837630-9aba-45f1-b0f7-944afaef7568 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 0.796406 Nov 02 12:56:29.982013 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2882/5821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:29 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:30.189942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:30.191452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:30.201017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:30.203648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:30.205183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:30.207015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:30.208146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:30.209307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:30.849919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:30.898142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a002eb4d-31e8-478a-adf1-6ec2b3b2eb20 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1503 microversion: 2.1 time: 0.709349 Nov 02 12:56:30.911973 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2883/5822] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:30 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1503 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:31.008055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:31.008921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:31.024385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:31.027004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:31.028127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:31.029430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:31.030656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:31.031533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:31.280779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:56:31.281312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:56:31.281691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:56:31.285404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:56:31.287265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:56:31.304477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:31.305891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:31.316662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:31.318259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:31.319584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:31.320094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:31.429178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:56:31.443854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for user 856c99b2530442b9bfb9d795a2d1d079 and project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:56:31.488627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:56:31.499452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:56:31.567285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:31.582920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-716864ac-4444-4752-a242-395d96c3c514 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 0.581205 Nov 02 12:56:31.598361 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2884/5823] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:31 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:31.609405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:31.612492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:31.622852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:31.623370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:31.623837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:31.625129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:31.625898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:31.626393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:31.666922 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e87af454-1528-41de-91be-b58976f62f5b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140383 Nov 02 12:56:31.672228 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2940/5824] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:56:31.679859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3d7a0d6-a90d-49e5-941f-6f09ee26235e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:31.680493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a3d7a0d6-a90d-49e5-941f-6f09ee26235e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:31.692830 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-315ec4c5-9b44-40c7-92ad-d4698d87513b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091967 Nov 02 12:56:31.701202 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2885/5825] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:56:31 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:56:31.778802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:31.779583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:31.814823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:31.816221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:31.822028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:31.826132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:31.828149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:31.833587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:31.897934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:56:31.934959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3d7a0d6-a90d-49e5-941f-6f09ee26235e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:31.952247 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3d7a0d6-a90d-49e5-941f-6f09ee26235e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1215 microversion: 2.1 time: 0.276855 Nov 02 12:56:31.961465 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2941/5826] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:31 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:31.995974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:31.997561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:32.019634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:32.023907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:32.041030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:32.041839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:32.042365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:32.042819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:32.222743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fec9b9b9-d505-40ca-a74b-dae79f2b4be7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 204 len: 0 microversion: 2.1 time: 0.446806 Nov 02 12:56:32.225564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:32.229663 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2886/5827] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:56:31 2022] DELETE /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:56:32.249243 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-55389000-b414-4759-90c2-1a3d420d6889 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1461 microversion: 2.1 time: 0.283875 Nov 02 12:56:32.250671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:32.251874 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2942/5828] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:31 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1461 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:32.252458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:32.263445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:32.264276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:32.264955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:32.265948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:32.266687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:32.267443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:32.616407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:32.617295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:32.634089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:32.636938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:32.638812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:32.646789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:32.647548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:32.648775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:33.311190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:33.323678 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-055a0a97-92e8-44c8-b4f9-f359513bfced tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1673 microversion: 2.1 time: 1.088101 Nov 02 12:56:33.334830 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2887/5829] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:32 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1673 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:33.357700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ac951f53-a1f1-457c-8479-8d9779205823 req-2002122e-935e-4373-9563-257b65e7f3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502c6d6b-1031-4a1e-b0ab-668d23c24d4a", "name": "network-vif-deleted", "tag": "afa70b1f-6510-45ce-a341-16bbee380145"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:33.357958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:33.389285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ac951f53-a1f1-457c-8479-8d9779205823 req-2002122e-935e-4373-9563-257b65e7f3c4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:33.389871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ac951f53-a1f1-457c-8479-8d9779205823 req-2002122e-935e-4373-9563-257b65e7f3c4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:33.390602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ac951f53-a1f1-457c-8479-8d9779205823 req-2002122e-935e-4373-9563-257b65e7f3c4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:33.396319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:33.398402 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ebe3e0ab-c09e-4225-887c-0902bfe9e1fd tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 0.790546 Nov 02 12:56:33.400451 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2943/5830] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:32 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:33.407737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:33.408537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:33.424119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:33.425248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:33.426183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:33.427525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:33.428194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ac951f53-a1f1-457c-8479-8d9779205823 req-2002122e-935e-4373-9563-257b65e7f3c4 service nova] Creating event network-vif-deleted:afa70b1f-6510-45ce-a341-16bbee380145 for instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a on n-h1-855650-5 Nov 02 12:56:33.428330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:33.428962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:33.441669 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ac951f53-a1f1-457c-8479-8d9779205823 req-2002122e-935e-4373-9563-257b65e7f3c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099984 Nov 02 12:56:33.443888 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2888/5831] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:33.469127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:33.470297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:33.482432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:33.483171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:33.483770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:33.484799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:33.485684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:33.486427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:33.534402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:33.535236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:33.536642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:33.537456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lazy-loading 'fault' on Instance uuid 502c6d6b-1031-4a1e-b0ab-668d23c24d4a {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:56:33.699122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee24703e9582468ca2c3313f111a6c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46350576da804cce9582ee12039cc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:33.707879 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3328b00-ae9c-4fdf-ad6e-11e042d39106 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 200 len: 1304 microversion: 2.1 time: 0.260561 Nov 02 12:56:33.724193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2889/5832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:33 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 1304 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:33.727033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:33.736310 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cbb112ab-07cf-4c3c-9882-2ed8337a7a95 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1219 microversion: 2.1 time: 0.334441 Nov 02 12:56:33.738723 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2944/5833] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:33 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1219 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:34.367611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:34.368236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:34.419220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:34.420248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:34.420703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:34.421808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:34.422458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:34.423141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:34.434625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:34.435732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:34.445617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:34.448022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:34.448749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:34.456933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:34.462600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:34.474943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:35.025838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:35.029996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:35.048166 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fbd3f634-2575-4c0d-92aa-9d65a1a77619 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 0.619592 Nov 02 12:56:35.057126 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2945/5834] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:34 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:35.064635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:35.066626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] [instance: 502c6d6b-1031-4a1e-b0ab-668d23c24d4a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:35.068285 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-364ba238-683c-40e2-80b4-616c48558a2f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1673 microversion: 2.1 time: 0.723186 Nov 02 12:56:35.074705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2890/5835] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:34 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1673 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:35.082184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:35.083189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:35.089413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:35.092096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:35.094157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:35.094439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:35.095979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:35.096221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:35.097032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:35.097487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:35.097648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:35.099544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:35.100480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:35.101283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:35.131648 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] HTTP exception thrown: Instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a could not be found. Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Request method failure captured: Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a HTTP/1.1 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmje3-9cs1CMLiRq4QRd18VnlTRrDfqzO524yChma9W3f6_5keGyxb70XZU3kQIW85zyPE50dfRtEQwBIEYDxerhIUpv4wM5RsJ6uP0--sacpXaG8KQIsFLOXCNQWRFLMWSQGYI4WATxXInQLUZsJGlOF-r2riHLZhTpL6WXzfErnXw Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 46350576da804cce9582ee12039cc492 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-VolumesActionsTest-90484204 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46350576da804cce9582ee12039cc492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46350576da804cce9582ee12039cc492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46350576da804cce9582ee12039cc492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46350576da804cce9582ee12039cc492"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-VolumesActionsTest-90484204 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 46350576da804cce9582ee12039cc492 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-VolumesActionsTest-90484204 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-VolumesActionsTest-90484204-project Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: ee24703e9582468ca2c3313f111a6c80 Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-VolumesActionsTest-90484204-project Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a could not be found. Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '502c6d6b-1031-4a1e-b0ab-668d23c24d4a'} Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a could not be found. Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a could not be found. Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:35.134497 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a could not be found. Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] Returning 404 to user: Instance 502c6d6b-1031-4a1e-b0ab-668d23c24d4a could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:56:35.140485 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4898c2b8-16c8-4e9a-b7f9-c5ec9fa6a0d2 tempest-VolumesActionsTest-90484204 tempest-VolumesActionsTest-90484204-project] 10.222.0.45 "GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a" status: 404 len: 111 microversion: 2.1 time: 0.077525 Nov 02 12:56:35.141156 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2946/5836] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:35 2022] GET /compute/v2.1/servers/502c6d6b-1031-4a1e-b0ab-668d23c24d4a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:56:35.311885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:35.337225 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac4596cd-6e69-4507-b63a-ac5229f5868d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1211 microversion: 2.1 time: 0.260324 Nov 02 12:56:35.337814 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2891/5837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:35 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1211 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:35.994693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1534102355", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": "none"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:36.073665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:56:36.074885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:56:36.075941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:56:36.076543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:56:36.078220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:56:36.082515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:36.083310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:36.108704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:36.109429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:36.110225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:36.111298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:36.111951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:36.117342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:36.120560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:36.125093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:36.128185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:36.129684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:36.133869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:36.134376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:36.241414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Getting quotas for project 5957125d21c343feb9af4095b5279c10. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:56:36.254094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Getting quotas for user f2e008e22fa7462a95ce520572f328cb and project 5957125d21c343feb9af4095b5279c10. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:56:36.279907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:56:36.285208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 3a6fcfeb-bbc7-47c0-ae02-61474a747715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:56:36.472806 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3089ea8f-0780-45cb-9f98-ad686c5a002e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.789448 Nov 02 12:56:36.480107 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2947/5838] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:56:36.485807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:36.493599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:36.556529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:36.557069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:36.557517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:36.558261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:36.558718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:36.559151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:37.921090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:37.935302 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2240a0ec-8300-4372-86fb-7fd5e20ff458 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1673 microversion: 2.1 time: 1.453808 Nov 02 12:56:37.938317 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2948/5839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:36 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1673 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:37.949257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:37.951519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:37.973115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:37.976926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:37.979681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:37.983519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:37.985653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:37.988836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:38.026171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:38.091259 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0cb216a-3728-4cb2-84df-fee66ccefdfa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 1.990709 Nov 02 12:56:38.091259 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2892/5840] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:36 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:38.123624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:38.124413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 3a6fcfeb-bbc7-47c0-ae02-61474a747715] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:38.147359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:38.148380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:38.148829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:38.149542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:38.153423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:38.154889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:38.559736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:38.569559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:38.573879 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf89985d-9a01-484c-b14d-6656f99f9daa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1273 microversion: 2.1 time: 0.632731 Nov 02 12:56:38.576693 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2949/5841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:37 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1273 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:38.605252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:38.610441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:38.614881 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb770743-567c-4cc8-9d4f-6b96eb6f5d04 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715" status: 200 len: 1282 microversion: 2.47 time: 0.526265 Nov 02 12:56:38.617196 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2893/5842] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:38 2022] GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715 => generated 1282 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:38.703159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1524582358", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": "none"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:38.863360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:56:38.863998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:56:38.864643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:56:38.865230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:56:38.865824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:56:38.884583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d1a16d60-b66a-4225-b563-2962c4fd432a req-1be8e71a-7eef-4ff1-b495-7f1f540ebeab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6b5ad4-9ed7-469c-bd63-c9be03c4002d", "name": "network-vif-unplugged", "status": "completed", "tag": "0bfaa540-12f1-48b5-ae5f-191236fda2d1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:38.914899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:38.915200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d1a16d60-b66a-4225-b563-2962c4fd432a req-1be8e71a-7eef-4ff1-b495-7f1f540ebeab service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:38.915698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d1a16d60-b66a-4225-b563-2962c4fd432a req-1be8e71a-7eef-4ff1-b495-7f1f540ebeab service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:38.916893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:38.917365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:38.921117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d1a16d60-b66a-4225-b563-2962c4fd432a req-1be8e71a-7eef-4ff1-b495-7f1f540ebeab service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:38.922543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:38.923750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:38.929523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:38.966419 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d1a16d60-b66a-4225-b563-2962c4fd432a req-1be8e71a-7eef-4ff1-b495-7f1f540ebeab service nova] Creating event network-vif-unplugged:0bfaa540-12f1-48b5-ae5f-191236fda2d1 for instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d on n-h2-855650-5 Nov 02 12:56:38.967326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Getting quotas for project 5957125d21c343feb9af4095b5279c10. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:56:38.975170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Getting quotas for user f2e008e22fa7462a95ce520572f328cb and project 5957125d21c343feb9af4095b5279c10. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:56:38.999184 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d1a16d60-b66a-4225-b563-2962c4fd432a req-1be8e71a-7eef-4ff1-b495-7f1f540ebeab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107893 Nov 02 12:56:39.002870 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2894/5843] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:39.019301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:56:39.022189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:39.025050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:39.029297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:56:39.048442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:39.053490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:39.056137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:39.059310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:39.060022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:39.060668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:39.178797 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-79a337fe-13f1-493d-9356-723c04261119 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.481161 Nov 02 12:56:39.180899 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2950/5844] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 12:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:56:39.185664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:39.186391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:39.205911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:39.206589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:39.207942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:39.209149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:39.209654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:39.210586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:40.528000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:40.582624 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b714dfe3-d452-42ed-a92c-428205ca98bd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1673 microversion: 2.1 time: 1.575814 Nov 02 12:56:40.592159 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2895/5845] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:39 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1673 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:40.604538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77a63fdc-ae30-47ec-a386-ac009b1f02a4 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:40.609187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77a63fdc-ae30-47ec-a386-ac009b1f02a4 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:40.755948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:40.803540 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77a63fdc-ae30-47ec-a386-ac009b1f02a4 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "PUT /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 992 microversion: 2.47 time: 0.203296 Nov 02 12:56:40.806941 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2896/5846] 10.222.0.45 () {62 vars in 1297 bytes} [Wed Nov 2 12:56:40 2022] PUT /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 992 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:56:40.819033 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f568afaf-3c84-4a9e-8bb0-a8d2ee840b30 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 1.624834 Nov 02 12:56:40.819033 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2951/5847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:39 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:40.836109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:40.840245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:40.853304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:40.854434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:40.855262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:40.857038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:40.857708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:40.859955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:40.861861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:40.862520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:40.886519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:40.887072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:40.887522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:40.888289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:40.888761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:40.889202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:41.443781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:41.479531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:41.481530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:41.491613 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-993da65c-e96b-426e-97bc-61366f1e0d81 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1282 microversion: 2.47 time: 0.664582 Nov 02 12:56:41.531522 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2897/5848] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:40 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1282 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:41.573733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6b282efa-e070-4955-8547-94888ffc7497 req-e704cd1d-8ddf-4075-8c95-257dc3bf1518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1daa9d64-e336-489e-aeda-cee2a1a03d8c", "tag": "826bcce9-e6d1-407a-932f-a6a49c1c389a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:41.647368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6b282efa-e070-4955-8547-94888ffc7497 req-e704cd1d-8ddf-4075-8c95-257dc3bf1518 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:41.647368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6b282efa-e070-4955-8547-94888ffc7497 req-e704cd1d-8ddf-4075-8c95-257dc3bf1518 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:41.648056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6b282efa-e070-4955-8547-94888ffc7497 req-e704cd1d-8ddf-4075-8c95-257dc3bf1518 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:41.688053 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6b282efa-e070-4955-8547-94888ffc7497 req-e704cd1d-8ddf-4075-8c95-257dc3bf1518 service nova] Creating event network-changed:826bcce9-e6d1-407a-932f-a6a49c1c389a for instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c on n-h2-855650-5 Nov 02 12:56:41.706610 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6b282efa-e070-4955-8547-94888ffc7497 req-e704cd1d-8ddf-4075-8c95-257dc3bf1518 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162410 Nov 02 12:56:41.710033 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2898/5849] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:41.749751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:41.755559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:41.784037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:41.785346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:41.786413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:41.787958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:41.793037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:41.794141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:41.977024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:41.986221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-591279d4-de04-421c-809f-1a761efc6245 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1315 microversion: 2.1 time: 1.153486 Nov 02 12:56:42.004004 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2952/5850] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:40 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1315 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:42.026464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:42.027919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:42.058585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:42.059611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:42.062798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:42.064346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:42.065710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:42.067271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:42.098774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:42.117924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f21e090-f1f7-4e3d-ba17-d2f94aed55ca tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1606 microversion: 2.1 time: 0.401596 Nov 02 12:56:42.121124 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2899/5851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:41 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1606 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:42.570422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:42.572445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:42.602098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:42.602861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:42.607466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:42.613591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:42.617619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:42.618533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:43.018097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:43.028061 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eb588bba-cd24-4560-b063-4b5abe1742d7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 1.022604 Nov 02 12:56:43.037895 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2953/5852] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:42 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:43.047828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:43.061455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:43.062071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:43.062390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:43.066107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:43.071436 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33db0d10-70dc-431d-95b7-e648998e75f1 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1282 microversion: 2.47 time: 0.508515 Nov 02 12:56:43.074578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2900/5853] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:42 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1282 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:43.105207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:43.107389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:43.114253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:43.118588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:43.125657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:43.128927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:43.138335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:43.163164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7cea0bbf-a783-4421-ae86-a3c7370c1b6c req-07699c70-49ab-41b1-b9f8-14f48290eced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6b5ad4-9ed7-469c-bd63-c9be03c4002d", "name": "network-vif-deleted", "tag": "0bfaa540-12f1-48b5-ae5f-191236fda2d1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:43.197930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7cea0bbf-a783-4421-ae86-a3c7370c1b6c req-07699c70-49ab-41b1-b9f8-14f48290eced service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:43.198467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7cea0bbf-a783-4421-ae86-a3c7370c1b6c req-07699c70-49ab-41b1-b9f8-14f48290eced service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:43.198909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7cea0bbf-a783-4421-ae86-a3c7370c1b6c req-07699c70-49ab-41b1-b9f8-14f48290eced service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:43.246559 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7cea0bbf-a783-4421-ae86-a3c7370c1b6c req-07699c70-49ab-41b1-b9f8-14f48290eced service nova] Creating event network-vif-deleted:0bfaa540-12f1-48b5-ae5f-191236fda2d1 for instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d on n-h2-855650-5 Nov 02 12:56:43.261215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7cea0bbf-a783-4421-ae86-a3c7370c1b6c req-07699c70-49ab-41b1-b9f8-14f48290eced service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102179 Nov 02 12:56:43.265268 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2901/5854] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:56:43.279768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:43.282258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:43.306286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:43.307109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:43.310030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:43.311231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:43.312839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:43.314111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:43.904790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:43.926175 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e2120e7-93f6-468f-a89a-731d51c0fcb6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1606 microversion: 2.1 time: 0.659136 Nov 02 12:56:43.926799 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2902/5855] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:43 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1606 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:43.959476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-780d59d2-27c3-4a73-a6f1-cd25ae6b89f2 req-8bb77076-404c-48a5-967c-ffbbce53e9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9addd4f4-648b-49c9-a39c-be40c7f1fb85", "name": "network-vif-plugged", "status": "completed", "tag": "a2289616-b13c-4d57-b795-2b3fe52b301a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:43.984762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-780d59d2-27c3-4a73-a6f1-cd25ae6b89f2 req-8bb77076-404c-48a5-967c-ffbbce53e9a3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:43.985284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-780d59d2-27c3-4a73-a6f1-cd25ae6b89f2 req-8bb77076-404c-48a5-967c-ffbbce53e9a3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:43.987990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-780d59d2-27c3-4a73-a6f1-cd25ae6b89f2 req-8bb77076-404c-48a5-967c-ffbbce53e9a3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:44.017604 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-780d59d2-27c3-4a73-a6f1-cd25ae6b89f2 req-8bb77076-404c-48a5-967c-ffbbce53e9a3 service nova] Creating event network-vif-plugged:a2289616-b13c-4d57-b795-2b3fe52b301a for instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 on n-h2-855650-5 Nov 02 12:56:44.036854 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-780d59d2-27c3-4a73-a6f1-cd25ae6b89f2 req-8bb77076-404c-48a5-967c-ffbbce53e9a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107957 Nov 02 12:56:44.041193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2903/5856] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:44.068558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:44.069404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:44.087188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:44.087701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:44.088345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:44.090197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:44.120395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:44.120922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:44.759225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:44.771613 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f6b75f35-6837-4f45-ace6-e8e15784e41a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1315 microversion: 2.1 time: 1.732271 Nov 02 12:56:44.775502 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2954/5857] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:43 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1315 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:44.799626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:44.800589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:44.827355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:44.830495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:44.831867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:44.835114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:44.836006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:44.839054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:45.015159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:45.030075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:45.031751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:45.037959 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b65e8f5-96bd-46c7-b0da-7755a9945c75 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1338 microversion: 2.47 time: 0.251128 Nov 02 12:56:45.039903 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2955/5858] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:44 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1338 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:45.051009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:45.055397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:45.074044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:45.081307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:45.082481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:45.084527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:45.089352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:45.092378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:45.255280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:45.282149 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c74b033c-6960-4200-b70b-ce5dfceb38b8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 1.221926 Nov 02 12:56:45.290727 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2904/5859] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:44 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:45.471391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:45.497486 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-211a76dd-5944-443c-80bf-53d01fc52206 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 200 len: 1606 microversion: 2.1 time: 0.454401 Nov 02 12:56:45.499078 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2956/5860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:45 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 1606 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:45.802534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:45.805376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:45.851360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:45.857730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:45.858766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:45.860277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:45.872195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:45.875640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:46.071843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:46.074231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:46.102613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:46.103962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:46.107503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:46.113220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:46.120005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:46.121128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:46.566071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:46.586385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:46.593646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:46.599785 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d2e0fa6-896b-4ee8-ad54-e46fe134974c tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1336 microversion: 2.47 time: 0.532709 Nov 02 12:56:46.611048 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2957/5861] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:46 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1336 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:46.629347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:46.637080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:46.664175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:46.664751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:46.665459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:46.667748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:46.668434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:46.669091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:47.477259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:47.488869 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b7325d0f-3ad0-4737-a440-413d2510b435 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1315 microversion: 2.1 time: 1.691139 Nov 02 12:56:47.494515 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2905/5862] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:45 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1315 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:47.507376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:47.508027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:47.536251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:47.536762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:47.537216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:47.537995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:47.545695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:47.547745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:47.630432 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] HTTP exception thrown: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Request method failure captured: Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d HTTP/1.1 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmd9uqgMflY7nElRk7cGm0Fw4JTvdUV95oCh_BxlKUt6HePk6WG5jod0R4CjIsRuoJzXp3TTaeEmHuF3pIqSuLrC1j4q-HR3ihk-TIeqloEHLdXLbi_iepcnV4IhisACl3oyKxhnYDrbyQUqiwNipyw603EAq1M_MSbF5oO2SyikvCk Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeTestJSON-1430805297 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 01eeb1d7c0c64c11a84c57906221efb2 Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3d6b5ad4-9ed7-469c-bd63-c9be03c4002d'} Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:47.638923 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:47.643891 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:47.643891 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:47.643891 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:47.643891 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:56:47.643891 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:56:47.643891 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 12:56:47.643891 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:56:47.659478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Returning 404 to user: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:56:47.664234 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01646307-270b-43cc-9d88-c85c1e192ba8 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 404 len: 111 microversion: 2.1 time: 0.168454 Nov 02 12:56:47.667470 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2906/5863] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:47 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:56:47.683483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:47.684571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:47.701029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:47.703685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:47.706919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:47.708065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:47.710755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:47.711714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:48.078606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:48.096695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:48.102929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:48.110773 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-424a7dc1-1476-493c-b702-834145d67ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1336 microversion: 2.47 time: 0.441629 Nov 02 12:56:48.111679 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2907/5864] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:47 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1336 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:48.121236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-00658f0d-02ff-426e-99de-3ad25a7bfc62 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '.version_select at 0x7f228f008d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:48.163974 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-00658f0d-02ff-426e-99de-3ad25a7bfc62 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-878360556" status: 202 len: 0 microversion: 2.1 time: 0.050592 Nov 02 12:56:48.165192 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2908/5865] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 12:56:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-878360556 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:56:48.536166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:48.537641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:48.552210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:48.559590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:48.560452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:48.561493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:48.562290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:48.562969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:48.935818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:48.956637 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b94b429b-ea13-485a-b805-2326395343a3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1217 microversion: 2.1 time: 2.340831 Nov 02 12:56:48.964899 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2958/5866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:46 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1217 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:48.977996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6a824206-f505-418e-974a-29c93c7217b5 req-0cef3e8f-6784-427c-84ed-4f8b60b4ea2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1daa9d64-e336-489e-aeda-cee2a1a03d8c", "name": "network-vif-plugged", "status": "completed", "tag": "826bcce9-e6d1-407a-932f-a6a49c1c389a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:49.024955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:49.027718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=20 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:49.042948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6a824206-f505-418e-974a-29c93c7217b5 req-0cef3e8f-6784-427c-84ed-4f8b60b4ea2d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:49.043463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6a824206-f505-418e-974a-29c93c7217b5 req-0cef3e8f-6784-427c-84ed-4f8b60b4ea2d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:49.043916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6a824206-f505-418e-974a-29c93c7217b5 req-0cef3e8f-6784-427c-84ed-4f8b60b4ea2d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:49.090478 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6a824206-f505-418e-974a-29c93c7217b5 req-0cef3e8f-6784-427c-84ed-4f8b60b4ea2d service nova] Creating event network-vif-plugged:826bcce9-e6d1-407a-932f-a6a49c1c389a for instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c on n-h2-855650-5 Nov 02 12:56:49.109903 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6a824206-f505-418e-974a-29c93c7217b5 req-0cef3e8f-6784-427c-84ed-4f8b60b4ea2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142889 Nov 02 12:56:49.114403 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2959/5867] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:49.145185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:49.146130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:49.167877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:49.183596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:49.184993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:49.186269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:49.187041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:49.193832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:49.859936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:49.875198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:49.884631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:49.907472 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-764b7c09-be0e-47cf-bc41-d4470bf5fa36 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1336 microversion: 2.47 time: 0.768013 Nov 02 12:56:49.910017 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2960/5868] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:49 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1336 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:56:50.000622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:50.003309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:50.032016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:50.034407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:50.046998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:50.050367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:50.052883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:50.068520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:50.071107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:50.133076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:50.151640 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9db9dcf5-d8b7-4885-b269-07fb4d013f0c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1315 microversion: 2.1 time: 1.619986 Nov 02 12:56:50.153841 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2909/5869] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:48 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1315 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:50.538424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-29faad68-c6ee-4047-a5ad-e697595449d6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'create', calling method: .version_select at 0x7f2290af7f70>, body: {"keypair": {"name": "tempest-keypair-1932762540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/KTYUmUDVdghE/rk+YH+sq6/VgPeHFcbjpDs+1QM+plI+4VYWJGKOWycuKDyNPEfuqOA5J9n1YveexgYWdrN+UgS5Tshq2LtzefhVZ63TDlvCGjijzfQk8b227wc5x0g=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:50.577768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-29faad68-c6ee-4047-a5ad-e697595449d6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Getting quotas for project d1efa37c130b4c5e9403e55baab92ae9. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:56:50.586216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-29faad68-c6ee-4047-a5ad-e697595449d6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Getting quotas for user 01eeb1d7c0c64c11a84c57906221efb2 and project d1efa37c130b4c5e9403e55baab92ae9. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:56:50.631673 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-29faad68-c6ee-4047-a5ad-e697595449d6 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100069 Nov 02 12:56:50.640631 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2910/5870] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:56:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:50.825010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:50.845417 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2f749ff-1753-4db1-b3eb-c58f41fb6fdb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1404 microversion: 2.1 time: 0.850638 Nov 02 12:56:50.853311 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2961/5871] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:49 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1404 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:50.905449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:50.906174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:50.921221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:50.924372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:50.924952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:50.925419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:50.929672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:50.930244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:50.930710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:50.954446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:50.955175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:50.971820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:50.972450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:50.972979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:50.974631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:50.979614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:50.980193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:51.001546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:51.172055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:51.186692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:51.191316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:51.203624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0255ce4b-a46c-45f2-9d9b-8009b3ab0b71 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1357 microversion: 2.47 time: 0.257351 Nov 02 12:56:51.207219 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2962/5872] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:50 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:51.213347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:51.216998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:51.230472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:51.231201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:51.233857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:51.243519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:51.247077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:51.248009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:52.565110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:52.575845 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f3b53e18-472b-4445-a8b8-b5534f3403f1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1315 microversion: 2.1 time: 1.369639 Nov 02 12:56:52.581375 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2963/5873] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:51 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1315 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:52.601492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:52.609924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:52.615612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:52.626352 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4022ea88-8736-4cfe-8740-a6310f9d01c1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1404 microversion: 2.1 time: 1.718370 Nov 02 12:56:52.633808 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2911/5874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:50 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1404 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:52.634152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:52.635866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:52.636391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:52.637205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:52.641450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:52.642094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:52.656889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-112304919"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:52.664800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:52.683212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:52.684048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:52.686287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:52.689245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:52.692267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:52.694487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:52.879939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:56:52.881436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:56:52.882604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:56:52.883806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:56:52.891122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:56:52.930779 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.compute.api [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Attempting to quiesce instance before volume snapshot. Nov 02 12:56:53.021721 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.compute.api [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 02 12:56:53.059298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:53.074109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:53.075230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:53.076470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:53.077943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:53.109357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:53.109357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:53.164179 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e69cbc2-f2db-4edb-9c9a-32e130e126fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "POST /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3/action" status: 202 len: 1079 microversion: 2.47 time: 0.565421 Nov 02 12:56:53.165882 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2964/5875] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 12:56:52 2022] POST /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3/action => generated 1079 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:56:53.204930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:53.217464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:53.236687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Creating snapshot from volume 0c54864c-e4b6-4d19-b4b1-f383b7120ce0. {{(pid=120722) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Nov 02 12:56:53.253710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:53.254968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:53.255791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:53.258139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:53.258563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:53.259022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:53.558030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:53.583890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:53.588152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:53.593339 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5c63be02-7a9a-4bf0-8f72-145f0914bea6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.393722 Nov 02 12:56:53.596619 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2965/5876] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:53 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:56:53.615020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:53.615366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:53.646203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:53.648403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:53.650578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:53.655082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:53.656789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:53.659863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:54.642427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:54.669202 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7097501a-2028-4eeb-b408-5c567d095a57 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1503 microversion: 2.1 time: 1.061597 Nov 02 12:56:54.685369 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2966/5877] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:53 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1503 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:54.705336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:54.707256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:54.734398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:54.735234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:54.735999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:54.737709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:54.741517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:54.744528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:54.970624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:54.993632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:54.996533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:54.999125 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0df23b5f-7e95-4d2b-bd23-b8d88de84f62 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.311994 Nov 02 12:56:55.000389 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2967/5878] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:54 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:55.007717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:55.008994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:55.016318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:55.017241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:55.017926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:55.018937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:55.019649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:55.020321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:55.703991 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.network.security_group_api [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Removing security group eacf9863-8d4a-495f-b688-382c172f134c from port 826bcce9-e6d1-407a-932f-a6a49c1c389a Nov 02 12:56:56.847028 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b4b2126f-d37a-473f-8ed1-f48a72293db8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c/action" status: 202 len: 0 microversion: 2.1 time: 1.844355 Nov 02 12:56:56.847945 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2968/5879] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:56:55 2022] POST /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c/action => generated 0 bytes in 1846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:56:56.855101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:56.855728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:56.893773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:56.898079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:56.898964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:56.899702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:56.900176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:56.903604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:57.147492 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-966ed0c1-bc2b-415e-91b6-f67f8928c861 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85/action" status: 202 len: 0 microversion: 2.1 time: 4.491078 Nov 02 12:56:57.151370 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2912/5880] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:56:52 2022] POST /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85/action => generated 0 bytes in 4500 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:56:57.187091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:57.191624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:57.208048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:57.220410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:57.243532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:57.246375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:57.261331 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7f3246ad-d8d8-4892-988e-778544d41802 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.412295 Nov 02 12:56:57.268485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:57.273777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:57.275313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:57.277658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:57.281191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:57.284420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:57.285526 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2969/5881] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:56 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:56:57.295753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0ac77fa4-9763-472c-a2df-8693bdac038f req-b2447d0c-17bb-4805-b886-8fdbddba915c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1daa9d64-e336-489e-aeda-cee2a1a03d8c", "tag": "826bcce9-e6d1-407a-932f-a6a49c1c389a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:57.318551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0ac77fa4-9763-472c-a2df-8693bdac038f req-b2447d0c-17bb-4805-b886-8fdbddba915c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:57.319074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0ac77fa4-9763-472c-a2df-8693bdac038f req-b2447d0c-17bb-4805-b886-8fdbddba915c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:57.319519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0ac77fa4-9763-472c-a2df-8693bdac038f req-b2447d0c-17bb-4805-b886-8fdbddba915c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:57.346563 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0ac77fa4-9763-472c-a2df-8693bdac038f req-b2447d0c-17bb-4805-b886-8fdbddba915c service nova] Creating event network-changed:826bcce9-e6d1-407a-932f-a6a49c1c389a for instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c on n-h2-855650-5 Nov 02 12:56:57.371932 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0ac77fa4-9763-472c-a2df-8693bdac038f req-b2447d0c-17bb-4805-b886-8fdbddba915c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084940 Nov 02 12:56:57.383970 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2970/5882] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:57.639567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:57.653750 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a4ce79f-b67f-421c-a34a-bc6525631a6c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1461 microversion: 2.1 time: 0.481127 Nov 02 12:56:57.656058 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2913/5883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:57 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1461 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:57.696887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:57.697666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:57.708445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:57.713671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:57.714449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:57.717868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:57.719527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:57.721823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:58.177130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:58.188852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6f00f459-7056-4283-865f-c123341fa514 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.497773 Nov 02 12:56:58.189462 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2971/5884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:57 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:58.235826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:58.238783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:58.260276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:58.261124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:58.261854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:58.262691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:58.263271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:58.264139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:58.310584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:58.311383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:58.323962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:58.326231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:58.336587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:58.337698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:58.338595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:58.339312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:58.903480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:58.924974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:58.929276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:58.930617 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e27769a2-2743-43ef-89ec-78a39e62c746 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.642658 Nov 02 12:56:58.935875 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2972/5885] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:58 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:56:59.528413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:59.543514 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca1f6d01-80ac-42bd-9464-b3efbb707080 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.319729 Nov 02 12:56:59.546014 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2914/5886] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:58 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:59.606691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:59.607904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:59.649800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:59.655258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:59.656426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:59.658143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:59.662604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:59.663799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:59.961294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:59.962072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:59.974741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:59.975804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:59.976306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:59.981302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:59.982311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:59.982973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:00.317952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:00.322997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:00.333551 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-562d671a-8d6d-4493-a13a-d0cbbbe3de9d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.729510 Nov 02 12:57:00.341811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:00.349299 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2973/5887] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:59 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:00.350323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:00.355645 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ad6996e-ee24-473c-92f9-c67d212698e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.396640 Nov 02 12:57:00.357067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-549611657", "imageRef": "c94f8d07-91c7-4b77-b418-cca480b45f6a", "flavorRef": "452", "networks": [{"uuid": "5c2de958-5bb8-43d5-9f50-0267f3814230"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:00.363229 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2915/5888] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:56:59 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:57:00.386596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-111081962", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c60a69a5-c164-49ab-b0c6-382a4af9e62a"}], "security_groups": [{"name": "tempest-securitygroup--425873072"}], "key_name": "tempest-keypair-1932762540", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:00.492775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] validate_networks() for [('5c2de958-5bb8-43d5-9f50-0267f3814230', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:57:00.597150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:00.908836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] validate_networks() for [('c60a69a5-c164-49ab-b0c6-382a4af9e62a', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:57:01.847333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:57:01.848512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:57:01.849398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:57:01.850118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:57:01.851448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:57:01.880646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:01.881631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:01.890287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:01.892198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:01.892947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:01.893636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:01.948938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Getting quotas for project d1efa37c130b4c5e9403e55baab92ae9. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:57:01.964382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Getting quotas for user 01eeb1d7c0c64c11a84c57906221efb2 and project d1efa37c130b4c5e9403e55baab92ae9. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:57:01.993487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:57:01.996019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:57:02.094464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:57:02.095029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:57:02.095381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:57:02.095806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:57:02.096232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:57:02.123475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:02.124000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:02.124463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:02.125273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:02.125708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:02.134741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:02.140225 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f51daf7-5481-41d3-80fa-5a266da8fad9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.769551 Nov 02 12:57:02.141800 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2916/5889] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:57:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:57:02.156346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:02.161868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:02.192785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:02.195839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:02.197419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:02.203049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:02.204271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:02.204842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:02.206908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:57:02.233170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for user 15b6ee9295464444a626601b16db2574 and project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:57:02.275249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:57:02.279224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e6a5f3aa-83ac-4a6a-9e6b-9b3385a91ad1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:57:02.445479 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6fb44e98-ea71-4267-9b0e-53ce53d16fb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.093141 Nov 02 12:57:02.448233 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2974/5890] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:57:02.872005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:02.899459 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8631265f-cce3-4b67-9f8c-8e53d38d72e2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.756301 Nov 02 12:57:02.906897 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2917/5891] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:02 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:02.924641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:02.933302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:02.948529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:02.951169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:02.952683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:02.953711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:02.955130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:02.957555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:03.252638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:03.263547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:03.265245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:03.277910 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31f256d6-2cb2-4917-b0f7-66944a2472e7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.368932 Nov 02 12:57:03.300177 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2918/5892] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:02 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:03.304465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d952cdab-aeb7-4381-99ba-5bac91218150 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'create', calling method: .version_select at 0x7f2292a2e670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1336517644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfmZOrGUbuNNLofw17Ehf4Mh8wsWko//ZDX/fwDwnKQBQBX3+ZHKFK3qQ5vzbEWlGA2fuLpsFh3fy8F6An+2yj0LvIDalG3Wpbk69aZnt6Nz3tQFjG0L6K7TkRCMAwguw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:03.309444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:03.310657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:03.316858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:03.317369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:03.317821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:03.319087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:03.319754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:03.320370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:03.365984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-d952cdab-aeb7-4381-99ba-5bac91218150 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for project 8b8298d308cf40d6adfae4b378b13281. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:57:03.388763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-d952cdab-aeb7-4381-99ba-5bac91218150 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for user 04b040caac0349ffbe7e23b18769bad1 and project 8b8298d308cf40d6adfae4b378b13281. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:57:03.456297 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d952cdab-aeb7-4381-99ba-5bac91218150 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.003851 Nov 02 12:57:03.457301 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2975/5893] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:57:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:03.467978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:03.468841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:03.483627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:03.485576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:03.486290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:03.487256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:03.487904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:03.488514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:03.546023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:03.566523 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-235929a7-6efa-4321-86d4-e02db4e0f722 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1241 microversion: 2.1 time: 0.264798 Nov 02 12:57:03.586883 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2919/5894] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:03 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1241 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:03.598893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2069178299", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "27a2ec76-336c-4d46-b2bd-166a4b3d0fe4"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:03.685605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:03.703851 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57c4c373-7e5a-46d6-a4f9-43ff6e10d8ed tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1233 microversion: 2.1 time: 0.245069 Nov 02 12:57:03.709279 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2976/5895] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:03 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1233 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:03.743204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] validate_networks() for [('27a2ec76-336c-4d46-b2bd-166a4b3d0fe4', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:57:04.309605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:04.310470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:04.319792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:04.324999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:04.326416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:04.330758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:04.331473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:04.332132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:04.567292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:04.585389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:04.589610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:04.591451 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57030fbb-4dc1-43d8-b9f3-53337783f56f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.286743 Nov 02 12:57:04.610039 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2977/5896] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:04 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:04.624989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:04.630054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:04.650765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:04.650765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:04.651233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:04.656099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:04.659524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:04.660246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:04.969573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:04.986107 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8897a003-33fa-4ba5-8ace-a72ba0de3059 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1289 microversion: 2.1 time: 0.374496 Nov 02 12:57:05.008613 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2978/5897] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:04 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1289 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:05.019298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:05.020241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:05.027987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:05.029422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:05.030088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:05.030975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:05.031598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:05.032192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:05.239970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:05.260752 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94e386eb-fd34-4936-9585-2383950b3683 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1281 microversion: 2.1 time: 0.246554 Nov 02 12:57:05.263322 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2979/5898] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:05 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:05.556374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:57:05.557434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:57:05.558148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:57:05.558747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:57:05.559379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:57:05.572471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:05.573233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:05.573860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:05.574873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:05.575552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:05.576928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:05.623070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:05.625686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:05.630759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:57:05.660443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:05.660979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:05.661692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:05.663236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:05.663730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Getting quotas for user 856c99b2530442b9bfb9d795a2d1d079 and project bb48511f5e1a4059911bac1d3e183ff7. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:57:05.665450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:05.667969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:05.712949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:57:05.718323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:57:05.852090 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be7e6279-e711-4817-8d8b-d51ed66c2444 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.263903 Nov 02 12:57:05.853213 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2920/5899] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:57:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:57:05.866433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84fee568-6c19-42a5-b6e9-c52936b53e4e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:05.868141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84fee568-6c19-42a5-b6e9-c52936b53e4e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:06.032990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:06.060558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:06.070280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:06.073292 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c634dc5-7404-4e36-a60b-1945ad9d0da8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.455186 Nov 02 12:57:06.083583 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2980/5900] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:05 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:06.131952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:06.134389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:06.150543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:06.153209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:06.154067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:06.155070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:06.156219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:06.156895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:06.184146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-84fee568-6c19-42a5-b6e9-c52936b53e4e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:06.206100 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84fee568-6c19-42a5-b6e9-c52936b53e4e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1215 microversion: 2.1 time: 0.343766 Nov 02 12:57:06.208519 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2921/5901] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:05 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1215 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:06.290560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:06.291236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:06.308950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:06.312435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:06.349471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:06.353128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:06.353614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:06.360046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:06.381185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:06.394867 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b84a0b05-4787-495f-9f7b-51ac12cf38b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1295 microversion: 2.1 time: 0.294761 Nov 02 12:57:06.396242 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2981/5902] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:06 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1295 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:06.581764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:06.598293 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5aea09f7-1c29-42f2-ae31-51ce2a8e1148 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1299 microversion: 2.1 time: 0.313171 Nov 02 12:57:06.599498 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2922/5903] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:06 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1299 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:07.127062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:07.129664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:07.166173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:07.168468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:07.170093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:07.176642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:07.176642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:07.179102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:07.240283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:07.241042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:07.269902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:07.283078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:07.285283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:07.286307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:07.297079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:07.302191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:08.316567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:08.337629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:08.357695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:08.367461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-184d7535-2604-4f99-890c-8817634b01ea tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 1.245742 Nov 02 12:57:08.368072 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2982/5904] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:07 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:08.408168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:08.415227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:08.441215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:08.445580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:08.451192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:08.452743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:08.457406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:08.467177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:08.500078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:08.523024 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0b935ae6-236e-4e80-ab0f-e36d8d43433e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1219 microversion: 2.1 time: 1.286242 Nov 02 12:57:08.523908 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2923/5905] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:07 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1219 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:08.535074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:08.535995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:08.546102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:08.554981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:08.555746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:08.559323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:08.560566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:08.561241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:08.762044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:08.778910 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b145ff6e-d3c4-45e5-9d35-97891e370a80 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1299 microversion: 2.1 time: 0.247653 Nov 02 12:57:08.794790 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2924/5906] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:08 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1299 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:08.923566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:08.935075 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d68cdd6-0fc7-452d-876b-f3da0a0562f2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1362 microversion: 2.1 time: 0.553397 Nov 02 12:57:08.971819 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2983/5907] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:08 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:09.419763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:09.420976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:09.449544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:09.450216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:09.450776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:09.451759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:09.454037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:09.454551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:09.557006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:09.559442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:09.576094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:09.577475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:09.579059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:09.580251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:09.581996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:09.583714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:09.880372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:09.892798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:09.899993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:09.901579 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b80445c5-35ea-4663-af5b-466ab539fc92 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.489218 Nov 02 12:57:09.918931 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2925/5908] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:09 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:09.940253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:09.940903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:09.948378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:09.948813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:09.949412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:09.958635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:09.960297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:09.960965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:09.968620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:09.986333 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-21ded876-37e3-4d0f-8a2e-98c6823d5db1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1273 microversion: 2.1 time: 0.431871 Nov 02 12:57:10.002257 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2984/5909] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:09 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1273 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:10.008062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:10.010246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:10.025816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:10.027901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:10.028401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:10.031407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:10.032108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:10.033222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:11.012456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:11.030827 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98657d62-61c9-452a-a0f3-eea2bfadc41f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 1.108743 Nov 02 12:57:11.046987 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2926/5910] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:09 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:11.064830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:11.067593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:11.093542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:11.094327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:11.095222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:11.096799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:11.098329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:11.102268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:11.297570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:11.316218 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-47d018d6-6aa9-41c5-914c-1a2bca8a881f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1362 microversion: 2.1 time: 1.321131 Nov 02 12:57:11.319645 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2985/5911] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:09 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1362 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:11.333835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:11.335371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:11.347066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:11.348781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:11.349536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:11.353646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:11.354431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:11.355144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:11.625160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:11.650680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:11.657983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:11.662358 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-959cd17f-fd96-4aec-9ac1-53cb94f31b91 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.613011 Nov 02 12:57:11.665481 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2927/5912] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:11 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:12.063624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:12.064338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:12.091192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:12.097433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:12.097952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:12.110409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:12.110409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:12.110409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:12.148064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:12.165821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:12.169100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:12.189157 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e42d969-81a2-4a9d-9f57-dfea6df2aaeb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 0.866441 Nov 02 12:57:12.192756 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2986/5913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:11 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:12.349198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:12.350496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:12.384365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:12.384888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:12.389652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:12.390782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:12.391705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:12.396081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:13.419278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:13.430227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:13.471213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88ef3221-ef2f-464d-b31a-1672ae41db75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 1.411369 Nov 02 12:57:13.497868 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2928/5914] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:12 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:13.546341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e073688b-f6ee-4f87-bd0a-9e0fb06443e7 req-720c2da5-aac4-4976-a1ee-f010437a5660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a63a14b-7327-4b0c-9745-e35dc397f902", "tag": "03886e18-8931-4750-a2a9-2ffc7d0efde5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:13.584861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:13.602580 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac8a04c0-a788-4b88-ac54-c539fbc4fff7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1362 microversion: 2.1 time: 1.254069 Nov 02 12:57:13.606938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e073688b-f6ee-4f87-bd0a-9e0fb06443e7 req-720c2da5-aac4-4976-a1ee-f010437a5660 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:13.608784 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2987/5915] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:12 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1362 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:13.612066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e073688b-f6ee-4f87-bd0a-9e0fb06443e7 req-720c2da5-aac4-4976-a1ee-f010437a5660 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:13.613284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e073688b-f6ee-4f87-bd0a-9e0fb06443e7 req-720c2da5-aac4-4976-a1ee-f010437a5660 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:13.630721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:13.633472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:13.652934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:13.658494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:13.661202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:13.664831 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e073688b-f6ee-4f87-bd0a-9e0fb06443e7 req-720c2da5-aac4-4976-a1ee-f010437a5660 service nova] Creating event network-changed:03886e18-8931-4750-a2a9-2ffc7d0efde5 for instance 1a63a14b-7327-4b0c-9745-e35dc397f902 on n-h2-855650-5 Nov 02 12:57:13.666099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:13.668839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:13.674392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:13.691128 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e073688b-f6ee-4f87-bd0a-9e0fb06443e7 req-720c2da5-aac4-4976-a1ee-f010437a5660 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186321 Nov 02 12:57:13.696347 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2929/5916] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:13.721837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:13.722922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:13.746862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:13.747807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:13.748466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:13.750836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:13.752143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:13.756536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:14.054941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:14.073808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:14.081140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:14.086851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:14.097590 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-452d9002-45e5-454d-83e1-76c734c60d5f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.486762 Nov 02 12:57:14.111366 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2988/5917] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:13 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:14.518303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:14.522478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:14.541613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:14.546195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:14.548978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:14.557531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:14.558437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:14.559626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:14.648969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:14.670472 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0a217ad8-ad2c-46cd-b9c7-f82cf7f8eec9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 0.966330 Nov 02 12:57:14.673421 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2930/5918] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:13 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:14.717094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:14.718733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:14.734090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:14.735550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:14.736439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:14.738147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:14.738967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:14.739758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:15.605116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:15.761802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:15.798841 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3272786-caab-4407-aaee-1e6dcc3c8aea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 1.297665 Nov 02 12:57:15.799553 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2989/5919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:14 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:15.819071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ab83cd61-a059-4a02-b256-3986d1917f1f req-5d14dc21-29d7-4b52-90ea-ef3cd13ecd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad77bf34-a88d-44d9-9b70-091c284ba1ea", "tag": "ee74aff2-967a-4fed-bd38-a8d893001a31"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:15.862257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ab83cd61-a059-4a02-b256-3986d1917f1f req-5d14dc21-29d7-4b52-90ea-ef3cd13ecd16 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:15.863420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ab83cd61-a059-4a02-b256-3986d1917f1f req-5d14dc21-29d7-4b52-90ea-ef3cd13ecd16 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:15.864174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ab83cd61-a059-4a02-b256-3986d1917f1f req-5d14dc21-29d7-4b52-90ea-ef3cd13ecd16 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:15.895977 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ab83cd61-a059-4a02-b256-3986d1917f1f req-5d14dc21-29d7-4b52-90ea-ef3cd13ecd16 service nova] Creating event network-changed:ee74aff2-967a-4fed-bd38-a8d893001a31 for instance ad77bf34-a88d-44d9-9b70-091c284ba1ea on n-h2-855650-5 Nov 02 12:57:15.910651 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ab83cd61-a059-4a02-b256-3986d1917f1f req-5d14dc21-29d7-4b52-90ea-ef3cd13ecd16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109816 Nov 02 12:57:15.945504 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2990/5920] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:15.961208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:15.961955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:16.030279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:16.032727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:16.033376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:16.034934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:16.035911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:16.038152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:16.190370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=14 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:16.212325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:16.246068 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-071acc1b-2cc0-4a5d-82c5-47bae2018460 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1362 microversion: 2.1 time: 1.569010 Nov 02 12:57:16.248761 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2931/5921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:14 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1362 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:16.262366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:16.263496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:16.296431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:16.299528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:16.302847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:16.307423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:16.309318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:16.311149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:16.418320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:16.439817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:16.441124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:16.445857 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-644680fe-e4f5-4358-85a6-c79d63afb03d tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.490537 Nov 02 12:57:16.453771 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2991/5922] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:15 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:16.841192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:16.841930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:16.879039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:16.880510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:16.904241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:16.909527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:16.911949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:16.914273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:17.884858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:17.896421 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6bd387f1-02c7-4ae8-acd6-5c402c957cdc tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 1.645107 Nov 02 12:57:17.899351 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2932/5923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:16 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:17.941009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:17.950229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:17.969254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:17.970169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:17.970833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:17.971743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:17.972792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:17.973760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:18.007682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:18.019363 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-429491d5-3cc6-4bd9-99ea-dc16f5012f2a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 1.191474 Nov 02 12:57:18.022603 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2992/5924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:16 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:18.030141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:18.032411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:18.044562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:18.045103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:18.045753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:18.048811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:18.049405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:18.050131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:18.395243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:18.438021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:18.445105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:18.450060 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff32e0bd-da86-42e9-add6-0da47bd59502 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.425459 Nov 02 12:57:18.458339 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2993/5925] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:18 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:18.844982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:18.864582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56c6250c-273e-4739-b2d1-dc144d57858e tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1362 microversion: 2.1 time: 0.962651 Nov 02 12:57:18.879142 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2933/5926] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:17 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1362 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:18.932114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:18.932762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:18.969785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:18.972032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:18.972577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:18.973223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:18.973685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:18.977867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:19.011480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d16b86f0-ffbe-432c-98cf-90d1dbfa0595 req-bbae6cbd-055c-4e8b-b2be-1a60265df1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82257d09-9947-424b-b651-25b882181bb1", "tag": "2377dc63-8d42-4225-8a2e-f89bd9551dc1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:19.085538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d16b86f0-ffbe-432c-98cf-90d1dbfa0595 req-bbae6cbd-055c-4e8b-b2be-1a60265df1de service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:19.086902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d16b86f0-ffbe-432c-98cf-90d1dbfa0595 req-bbae6cbd-055c-4e8b-b2be-1a60265df1de service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:19.086902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d16b86f0-ffbe-432c-98cf-90d1dbfa0595 req-bbae6cbd-055c-4e8b-b2be-1a60265df1de service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:19.135579 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d16b86f0-ffbe-432c-98cf-90d1dbfa0595 req-bbae6cbd-055c-4e8b-b2be-1a60265df1de service nova] Creating event network-changed:2377dc63-8d42-4225-8a2e-f89bd9551dc1 for instance 82257d09-9947-424b-b651-25b882181bb1 on n-h1-855650-5 Nov 02 12:57:19.146302 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d16b86f0-ffbe-432c-98cf-90d1dbfa0595 req-bbae6cbd-055c-4e8b-b2be-1a60265df1de service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150134 Nov 02 12:57:19.149280 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2934/5927] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:57:19.160036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:19.163010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:19.186761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:19.204187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:19.206488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:19.211208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:19.213225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:19.217483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:19.676715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:19.688272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:19.707097 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-80ef0feb-1b84-44bd-b800-c8164319b13e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 0.780928 Nov 02 12:57:19.708888 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2994/5928] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:18 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:19.710052 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a90a8887-3b46-4ced-bea3-e03872fea6d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 0.557241 Nov 02 12:57:19.711098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2935/5929] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:19 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:19.757881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:19.768415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:19.788265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:19.793833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:19.796148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:19.799087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:19.804194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:19.805067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:19.892342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:19.892989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:19.903615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:19.904150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:19.904595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:19.905643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:19.922879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:19.923473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:20.219557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:20.232385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:20.235448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:20.236848 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bb84c935-13db-4689-9189-420f50062fc7 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1366 microversion: 2.47 time: 0.485165 Nov 02 12:57:20.238092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2995/5930] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:19 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:20.558258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:20.573104 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-09cbbeb4-d271-44bb-8981-05c7f6de474a tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1362 microversion: 2.1 time: 0.685195 Nov 02 12:57:20.573860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2936/5931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:19 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1362 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:20.740561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:20.744147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:20.745117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:20.745839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:20.750905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:20.768559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:20.773501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:20.774472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:20.775521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:20.777194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:20.778860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:20.782900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:20.783917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:20.795124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:20.802933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:20.803730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:20.810716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:21.736393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:21.751078 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d9f988ae-d7ba-450d-87b3-93706622b073 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 1.019989 Nov 02 12:57:21.754391 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2996/5932] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:20 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:21.772179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:21.773116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:21.784258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:21.785141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:21.785769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:21.786887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:21.790746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:21.791511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:21.891932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:21.904135 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-52dceeb6-ceef-4f08-a67e-8d5317779b26 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 1.168938 Nov 02 12:57:21.929231 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2937/5933] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:20 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:21.936672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:21.941113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:21.958049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:21.964048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:21.965904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:21.972098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:21.973334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:21.974019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:21.975054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:21.984043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:21.985234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:21.985721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:21.991339 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3f8d9c87-c05a-49f4-9a3e-ac127062f026 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1372 microversion: 2.47 time: 0.234730 Nov 02 12:57:22.006746 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2997/5934] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:21 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:22.233418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-55e23358-879c-406a-9b99-4103a279a70e req-49dc7f16-827c-4ecf-a019-5ff71bf8e6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a63a14b-7327-4b0c-9745-e35dc397f902", "name": "network-vif-plugged", "status": "completed", "tag": "03886e18-8931-4750-a2a9-2ffc7d0efde5"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:22.267672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-55e23358-879c-406a-9b99-4103a279a70e req-49dc7f16-827c-4ecf-a019-5ff71bf8e6ca service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:22.269680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-55e23358-879c-406a-9b99-4103a279a70e req-49dc7f16-827c-4ecf-a019-5ff71bf8e6ca service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:22.275090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-55e23358-879c-406a-9b99-4103a279a70e req-49dc7f16-827c-4ecf-a019-5ff71bf8e6ca service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:22.297561 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-55e23358-879c-406a-9b99-4103a279a70e req-49dc7f16-827c-4ecf-a019-5ff71bf8e6ca service nova] Creating event network-vif-plugged:03886e18-8931-4750-a2a9-2ffc7d0efde5 for instance 1a63a14b-7327-4b0c-9745-e35dc397f902 on n-h2-855650-5 Nov 02 12:57:22.318073 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-55e23358-879c-406a-9b99-4103a279a70e req-49dc7f16-827c-4ecf-a019-5ff71bf8e6ca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088839 Nov 02 12:57:22.319571 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2998/5935] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:57:22.643903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:22.663974 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e13cf86b-8cbd-4343-a93e-d8c9a21ef3ab tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1362 microversion: 2.1 time: 0.733032 Nov 02 12:57:22.674389 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2938/5936] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:21 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1362 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:22.786870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:22.788206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:22.806452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:22.807424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:22.808679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:22.809857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:22.810511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:22.811133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:22.942687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:22.944101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:22.954601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:22.957123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:22.962585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:22.963755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:22.964483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:22.965167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:23.201201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:23.214593 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f1ba1adf-ab8f-4d4b-b3c7-67143c7eec7b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 0.432870 Nov 02 12:57:23.216492 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2999/5937] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:22 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:23.229725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:23.241816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:23.259551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:23.265047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:23.268051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:23.269042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:23.270709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:23.272113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:23.565587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:23.579772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:23.581274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:23.583307 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f58c2bb-76af-469f-8caa-5a5322bc8ee2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1372 microversion: 2.47 time: 0.365619 Nov 02 12:57:23.600333 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3000/5938] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:23 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:23.667465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:23.676328 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cce4c45d-cbb5-43c6-8edf-b989b9ad1891 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 0.737542 Nov 02 12:57:23.689081 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2939/5939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:22 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:23.691713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:23.692331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:23.699216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:23.700341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:23.701202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:23.702200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:23.702943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:23.703601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:24.026707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:24.042888 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b500e7d-7180-484e-bf6b-0c92d58692a7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1362 microversion: 2.1 time: 0.354907 Nov 02 12:57:24.043875 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3001/5940] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:23 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:24.238584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:24.239237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:24.269040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:24.270264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:24.271799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:24.272907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:24.273606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:24.278776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:24.617474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:24.618721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:24.634857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:24.641825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:24.642425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:24.643295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:24.643762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:24.644282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:25.022143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:25.049572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:25.051070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:25.052297 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4dc235af-18ab-49c2-9dd3-4d618ea22b0f tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1372 microversion: 2.47 time: 0.443497 Nov 02 12:57:25.084507 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3002/5941] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:24 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1372 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:57:25.126306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:25.142635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:25.153492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:25.163268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:25.169812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:25.170870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:25.171511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:25.172301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:25.197511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:25.210622 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da65787a-4cb7-4220-b369-726dad011613 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 0.974302 Nov 02 12:57:25.221841 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2940/5942] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:24 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:25.228066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:25.228691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:25.282941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:25.288207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:25.289272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:25.290311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:25.294740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:25.305416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:25.670985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:25.684384 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cad8eabc-24d1-422a-a165-be72ee7a1987 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 0.571685 Nov 02 12:57:25.685132 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3003/5943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:25 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:25.883992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:25.902447 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a47f58b8-82d0-4eed-8749-8e597815a74b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1548 microversion: 2.1 time: 0.677992 Nov 02 12:57:25.924406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2941/5944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:25 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1548 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:25.938015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:25.938517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:25.961399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:25.970995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:25.972974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:25.978873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:25.982833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:25.983560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:26.121416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:26.122930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:26.142545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:26.143936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:26.150451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:26.151820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:26.152593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:26.153291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:26.529317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:26.554720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:26.559827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:26.564063 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca32ec5e-34d9-4584-85e7-580c0420ea0a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1372 microversion: 2.47 time: 0.448345 Nov 02 12:57:26.566848 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5c5bf211-5abf-4db6-8b00-88b295b678b1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.633551 Nov 02 12:57:26.567523 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2942/5945] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:26 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1372 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:26.570727 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3004/5946] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 12:57:25 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-interface => generated 284 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:26.588214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:26.593824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:26.614160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:26.615106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:26.622808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:26.624194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:26.625580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:26.626393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:26.712184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:26.712863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:26.732424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:26.733781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:26.735751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:26.737567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:26.739556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:26.742818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:27.659879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:27.681690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:27.689427 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1621edac-ddcd-4dbb-84a9-47acabd5f7e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 0.983631 Nov 02 12:57:27.692247 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bebb4c50-8383-48e0-aedf-f8763983b967 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 1.123502 Nov 02 12:57:27.707019 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3005/5947] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:26 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:27.715050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-983509c6-ad3b-412e-a639-8bc0bf7dc39b req-73e492a3-e6c8-469f-b006-670ca2f1838b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82257d09-9947-424b-b651-25b882181bb1", "name": "network-vif-plugged", "status": "completed", "tag": "2377dc63-8d42-4225-8a2e-f89bd9551dc1"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:27.722060 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2943/5948] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:26 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:27.731274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:27.743089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-983509c6-ad3b-412e-a639-8bc0bf7dc39b req-73e492a3-e6c8-469f-b006-670ca2f1838b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:27.743485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-983509c6-ad3b-412e-a639-8bc0bf7dc39b req-73e492a3-e6c8-469f-b006-670ca2f1838b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:27.743856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-983509c6-ad3b-412e-a639-8bc0bf7dc39b req-73e492a3-e6c8-469f-b006-670ca2f1838b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:27.747385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:27.758279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:27.759217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:27.759862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:27.761297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:27.763329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:27.764527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:27.773063 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-983509c6-ad3b-412e-a639-8bc0bf7dc39b req-73e492a3-e6c8-469f-b006-670ca2f1838b service nova] Creating event network-vif-plugged:2377dc63-8d42-4225-8a2e-f89bd9551dc1 for instance 82257d09-9947-424b-b651-25b882181bb1 on n-h1-855650-5 Nov 02 12:57:27.782866 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-983509c6-ad3b-412e-a639-8bc0bf7dc39b req-73e492a3-e6c8-469f-b006-670ca2f1838b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071053 Nov 02 12:57:27.783936 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3006/5949] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:27.929210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:27.952310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:27.959588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:27.961066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-408617c0-6c43-4a5c-8cfb-f07a385bfb27 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1357 microversion: 2.47 time: 0.235012 Nov 02 12:57:27.962916 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2944/5950] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:27 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:28.000645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:28.014673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:28.015924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Searching by: {'deleted': False, 'project_id': '5957125d21c343feb9af4095b5279c10'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:57:28.024496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:28.025061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:28.025452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:28.026291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:28.026751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:28.027184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:28.320810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:57:28.354996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:28.543646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:28.561142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:28.561487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:28.562166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:28.585462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:28.591320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:28.721387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:28.722161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:28.737448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:28.738575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:28.742372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:28.744840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:28.745610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:28.747033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:28.929473 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f9e214bc-8d4b-496f-9de9-8065a8a43fc9 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.933159 Nov 02 12:57:28.950512 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3007/5951] 10.222.0.45 () {60 vars in 1187 bytes} [Wed Nov 2 12:57:27 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:28.955763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:28.956502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:28.982647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:28.983524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:28.984181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:28.985120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:28.985751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:28.986400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:29.963901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:29.977990 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d9e7acd-6b2c-450f-8344-d2e2758f3ea0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1315 microversion: 2.1 time: 1.026074 Nov 02 12:57:29.990491 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3008/5952] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:28 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:29.997667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:29.997667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:30.015549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:30.018067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:30.019164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:30.020678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:30.023667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:30.025121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:30.122517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:57:30.282680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:30.295294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14d8c3ae-efdc-4364-a181-1c219ba1500e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 1.578698 Nov 02 12:57:30.295890 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2945/5953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:28 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:30.319772 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb16d221-f695-49f5-9002-393b733f620a tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "DELETE /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 204 len: 0 microversion: 2.47 time: 0.335366 Nov 02 12:57:30.320765 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3009/5954] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:57:29 2022] DELETE /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:57:30.329723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:30.330565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:30.350321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:30.351549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:30.353289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:30.355560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:30.356670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:30.358626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:30.442928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:30.950648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:30.970494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:30.976658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:30.983826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe5f635f-0df9-4c68-a9b7-9c8103173f99 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1363 microversion: 2.47 time: 0.655013 Nov 02 12:57:30.987135 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2946/5955] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:30 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1363 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:57:31.006515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:31.007304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:31.026485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:31.031914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:31.032739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:31.033787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:31.042878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:31.048464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:31.329779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:31.331495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:31.352344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:31.353858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:31.355209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:31.357324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:31.358803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:31.359484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:34.086174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:34.126644 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-593eb391-449b-4cad-9a5a-da7cc2abba17 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1341 microversion: 2.1 time: 2.806542 Nov 02 12:57:34.129628 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2947/5956] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:31 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1341 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:34.141900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:34.152462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:34.192220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:34.193774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:34.215049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:34.222828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:34.227477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:34.229358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:34.315257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:34.315764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:34.324521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:34.339274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lazy-loading 'fault' on Instance uuid 223b5855-72ec-4c1d-955c-a38bebaf76c3 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:57:35.159106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:35.201787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:35.212635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:35.219720 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-248d5936-5f86-417f-90b3-dfe46f6563e8 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 200 len: 1368 microversion: 2.47 time: 1.085423 Nov 02 12:57:35.242002 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2948/5957] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:34 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 1368 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:35.253365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:35.257792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:35.279364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:35.283811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:35.287133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:35.288600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:35.294530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:35.299574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:35.303120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:35.309593 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d376732c-9abb-4350-a3e4-a7ea4e4c24cf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1503 microversion: 2.1 time: 4.302434 Nov 02 12:57:35.310342 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3010/5958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:30 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1503 bytes in 4310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:35.358472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:35.358898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:35.369145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:35.370006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:35.370699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:35.372171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:35.372915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:35.373565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:35.490454 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0ddf8fe-392a-4329-877f-566d721ebe22 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.141666 Nov 02 12:57:35.495494 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3011/5959] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:57:35 2022] POST /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:57:35.506023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:35.507152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:35.515276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:35.516577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:35.518069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:35.519196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:35.520048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:35.520718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.123118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:37.137221 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53312a25-4f23-4e37-b0cb-28af16d73156 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1387 microversion: 2.1 time: 1.912308 Nov 02 12:57:37.142580 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2949/5960] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:35 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1387 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:37.171103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:37.171900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 223b5855-72ec-4c1d-955c-a38bebaf76c3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:37.181029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.181942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.187092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.188968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.189865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.191891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.237985 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] HTTP exception thrown: Instance 223b5855-72ec-4c1d-955c-a38bebaf76c3 could not be found. Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Request method failure captured: Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 HTTP/1.1 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmkDL7U9HqfmtMoTuS7yIMPFAPx0UwmhL4ADF_O192szyi2JvdvSwAquSYiT0sSzfuFkM03CbD_FbluL9SIuQtCkI7_UbQIWlpAd4iCXAaWiBP_t9FPgqWqwX8iEPZyBTpXvrKkbgT7PoXld4osjdX6YcvdCO4rsuUsHJSj-C6kWebE Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5957125d21c343feb9af4095b5279c10 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerShowV247Test-984432096 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5957125d21c343feb9af4095b5279c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5957125d21c343feb9af4095b5279c10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5957125d21c343feb9af4095b5279c10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5957125d21c343feb9af4095b5279c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerShowV247Test-984432096 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5957125d21c343feb9af4095b5279c10 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerShowV247Test-984432096 Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerShowV247Test-984432096-project Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f2e008e22fa7462a95ce520572f328cb Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerShowV247Test-984432096-project Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 223b5855-72ec-4c1d-955c-a38bebaf76c3 could not be found. Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '223b5855-72ec-4c1d-955c-a38bebaf76c3'} Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223b5855-72ec-4c1d-955c-a38bebaf76c3 could not be found. Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223b5855-72ec-4c1d-955c-a38bebaf76c3 could not be found. Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:57:37.286358 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223b5855-72ec-4c1d-955c-a38bebaf76c3 could not be found. Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Returning 404 to user: Instance 223b5855-72ec-4c1d-955c-a38bebaf76c3 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-476e44a2-0fcd-4fea-83ce-8cd8dd182f7e tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3" status: 404 len: 111 microversion: 2.47 time: 0.146639 Nov 02 12:57:37.299822 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2950/5961] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:37 2022] GET /compute/v2.1/servers/223b5855-72ec-4c1d-955c-a38bebaf76c3 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:57:37.310782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-614a824f-f594-4138-9b8e-b1dae19c1186 req-719d3f70-9fa9-4dda-9f8e-5c3de45da061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a63a14b-7327-4b0c-9745-e35dc397f902", "tag": "03886e18-8931-4750-a2a9-2ffc7d0efde5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:37.342921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-614a824f-f594-4138-9b8e-b1dae19c1186 req-719d3f70-9fa9-4dda-9f8e-5c3de45da061 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.362337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-614a824f-f594-4138-9b8e-b1dae19c1186 req-719d3f70-9fa9-4dda-9f8e-5c3de45da061 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.362844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-614a824f-f594-4138-9b8e-b1dae19c1186 req-719d3f70-9fa9-4dda-9f8e-5c3de45da061 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.397707 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-614a824f-f594-4138-9b8e-b1dae19c1186 req-719d3f70-9fa9-4dda-9f8e-5c3de45da061 service nova] Creating event network-changed:03886e18-8931-4750-a2a9-2ffc7d0efde5 for instance 1a63a14b-7327-4b0c-9745-e35dc397f902 on n-h2-855650-5 Nov 02 12:57:37.414199 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-614a824f-f594-4138-9b8e-b1dae19c1186 req-719d3f70-9fa9-4dda-9f8e-5c3de45da061 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120529 Nov 02 12:57:37.415069 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2951/5962] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:37.432744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:37.433652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 3a6fcfeb-bbc7-47c0-ae02-61474a747715] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:37.458023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.459537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.459654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.460519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.461006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.461630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.538214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:37.546751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-398904e3-cdd7-4f1f-80ee-382431677af3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1508 microversion: 2.1 time: 2.049493 Nov 02 12:57:37.547353 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3012/5963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:35 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1508 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:37.582103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 3a6fcfeb-bbc7-47c0-ae02-61474a747715] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:57:37.770695 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ece8128c-15e2-4855-ba02-cbe089fbb0ca tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715" status: 204 len: 0 microversion: 2.47 time: 0.351524 Nov 02 12:57:37.771821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2952/5964] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 12:57:37 2022] DELETE /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:57:37.780525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:37.781159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 3a6fcfeb-bbc7-47c0-ae02-61474a747715] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:37.790462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.790890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.791341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.792073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.792544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.792975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.994214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:38.009202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:38.011181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:38.013915 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-193973a5-131e-4016-9ef4-8ed34448c5e2 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715" status: 200 len: 1363 microversion: 2.47 time: 0.237334 Nov 02 12:57:38.014842 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3013/5965] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:37 2022] GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:57:38.179147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:38.179884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:38.193799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:38.205555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:38.206577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:38.207577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:38.208269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:38.208952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:38.577173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:38.578009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:38.591814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:38.594523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:38.598343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:38.599241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:38.599950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:38.602075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:38.602784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:38.603396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:39.174945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:39.196975 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae7b949d-80d9-46c4-a7b9-2ffa301e6be8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 1.024806 Nov 02 12:57:39.198866 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2953/5966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:38 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:39.205739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:39.206742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 3a6fcfeb-bbc7-47c0-ae02-61474a747715] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:39.220929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:39.221453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:39.222130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:39.222872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:39.223346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:39.224984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:39.380315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:39.390052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:39.391660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:39.392952 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cbcd4e30-5d36-4c86-8177-26f932204a09 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715" status: 200 len: 1363 microversion: 2.47 time: 0.192871 Nov 02 12:57:39.393630 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2954/5967] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:39 2022] GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:39.456787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:39.469384 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f35057dd-d297-4a61-b058-196cde7de356 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1488 microversion: 2.1 time: 0.897475 Nov 02 12:57:39.470133 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3014/5968] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:38 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1488 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:39.493667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:39.494128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:39.502308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:39.502863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:39.503324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:39.504056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:39.504524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:39.504972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:39.530962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lazy-loading 'flavor' on Instance uuid 82257d09-9947-424b-b651-25b882181bb1 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:57:39.793264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8181133-774c-4435-87d8-a9cfa876e9b4 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.302940 Nov 02 12:57:39.794696 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2955/5969] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:57:39 2022] POST /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:57:39.819782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:39.821468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:39.833890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:39.834977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:39.835583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:39.836556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:39.837128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:39.837707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:40.225870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:40.227108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:40.236307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:40.236775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:40.238044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:40.239061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:40.240275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:40.241040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:40.955441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:40.972208 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90438ba8-f37f-4888-aa53-540acd2a07e6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 0.751065 Nov 02 12:57:40.993284 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2956/5970] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:40 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:41.008407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:41.014105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 3a6fcfeb-bbc7-47c0-ae02-61474a747715] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:41.030459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:41.031697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:41.033000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:41.034138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:41.035002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:41.035915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:41.085524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:41.087642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:41.089109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:41.090295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:41.091671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lazy-loading 'fault' on Instance uuid 3a6fcfeb-bbc7-47c0-ae02-61474a747715 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:57:41.109599 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bff4a528-c1ae-4448-ac7f-01cb3c174226 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1494 microversion: 2.1 time: 1.309738 Nov 02 12:57:41.111530 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3015/5971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:39 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1494 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:41.395295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:41.407281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:41.419965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2e008e22fa7462a95ce520572f328cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5957125d21c343feb9af4095b5279c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:41.426515 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae1fd8b6-7e00-416f-a3c3-ff6c56db68fc tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715" status: 200 len: 1368 microversion: 2.47 time: 0.428781 Nov 02 12:57:41.427731 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2957/5972] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:40 2022] GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715 => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:57:42.006121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:42.007803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:42.056323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:42.059090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:42.060085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:42.061347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:42.069683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:42.071109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:42.134615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:42.135749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:42.156878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:42.158298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:42.161119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:42.162704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:42.165243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:42.168836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:42.948695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:42.958000 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02e39c5b-b4d2-495e-bce2-ed7099a9a9c6 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1515 microversion: 2.1 time: 0.827806 Nov 02 12:57:42.974246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2958/5973] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:42 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1515 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:42.974246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:42.974246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] [instance: 3a6fcfeb-bbc7-47c0-ae02-61474a747715] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:42.993693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:42.994252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:42.994805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:42.995532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:42.996025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:42.996501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:43.031928 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] HTTP exception thrown: Instance 3a6fcfeb-bbc7-47c0-ae02-61474a747715 could not be found. Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Request method failure captured: Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715 HTTP/1.1 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmkDL7U9HqfmtMoTuS7yIMPFAPx0UwmhL4ADF_O192szyi2JvdvSwAquSYiT0sSzfuFkM03CbD_FbluL9SIuQtCkI7_UbQIWlpAd4iCXAaWiBP_t9FPgqWqwX8iEPZyBTpXvrKkbgT7PoXld4osjdX6YcvdCO4rsuUsHJSj-C6kWebE Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5957125d21c343feb9af4095b5279c10 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerShowV247Test-984432096 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5957125d21c343feb9af4095b5279c10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5957125d21c343feb9af4095b5279c10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5957125d21c343feb9af4095b5279c10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5957125d21c343feb9af4095b5279c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerShowV247Test-984432096 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5957125d21c343feb9af4095b5279c10 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerShowV247Test-984432096 Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerShowV247Test-984432096-project Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f2e008e22fa7462a95ce520572f328cb Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerShowV247Test-984432096-project Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 3a6fcfeb-bbc7-47c0-ae02-61474a747715 could not be found. Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3a6fcfeb-bbc7-47c0-ae02-61474a747715'} Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a6fcfeb-bbc7-47c0-ae02-61474a747715 could not be found. Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a6fcfeb-bbc7-47c0-ae02-61474a747715 could not be found. Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:57:43.033673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:43.040402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:57:43.040402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:57:43.040402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:57:43.040402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:57:43.040402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:57:43.040402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a6fcfeb-bbc7-47c0-ae02-61474a747715 could not be found. Nov 02 12:57:43.040402 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:57:43.047875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] Returning 404 to user: Instance 3a6fcfeb-bbc7-47c0-ae02-61474a747715 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:57:43.049931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4b9857e4-4fe5-47ca-bebb-c822efab8bf6 tempest-ServerShowV247Test-984432096 tempest-ServerShowV247Test-984432096-project] 10.222.0.45 "GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715" status: 404 len: 111 microversion: 2.47 time: 0.081665 Nov 02 12:57:43.058440 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2959/5974] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 12:57:42 2022] GET /compute/v2.1/servers/3a6fcfeb-bbc7-47c0-ae02-61474a747715 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:57:43.203993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:43.219979 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c9fc8939-c7ea-444e-88e0-833263884e75 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 1.222594 Nov 02 12:57:43.220983 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3016/5975] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:41 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:43.994382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:43.996569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:44.011792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:44.012917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:44.013922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:44.014955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:44.027019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:44.027875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:44.251082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:44.264909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:44.299382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:44.305631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:44.306482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:44.308230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:44.314021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:44.314987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:45.535349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:45.547236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:45.562371 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db301fe5-a0d8-4600-b404-831b696c35c9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1515 microversion: 2.1 time: 1.578272 Nov 02 12:57:45.578483 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2960/5976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:43 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1515 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:45.631848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:45.649598 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c3fe9510-6989-4289-8a62-ec1b8354de91 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 1.406369 Nov 02 12:57:45.670639 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3017/5977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:44 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:46.339384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1714419064", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "a20a4274-85ba-4a55-a738-76c00841e0a1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1336517644", "security_groups": [{"name": "tempest-secgroup-smoke-560068808"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:46.588836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:46.590759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:46.616676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:46.618448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:46.619448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:46.620709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:46.622573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:46.624637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:46.788381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] validate_networks() for [('a20a4274-85ba-4a55-a738-76c00841e0a1', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:57:48.758532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:48.770893 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bdf39264-5056-4171-8aa1-b791c2dfe4cb tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 2.185954 Nov 02 12:57:48.790109 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3018/5978] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:46 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:48.790109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:48.790109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:48.815468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:48.816176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:48.820848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:48.822077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:48.831991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:48.832658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:50.879364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:57:50.882039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:57:50.883031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:57:50.883847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:57:50.884678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:57:50.899483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:50.900479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:50.901917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:50.903230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:50.904005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:50.904903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:50.941414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for project 8b8298d308cf40d6adfae4b378b13281. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:57:50.966544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for user 04b040caac0349ffbe7e23b18769bad1 and project 8b8298d308cf40d6adfae4b378b13281. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:57:51.001498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:57:51.013149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:57:51.095366 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56327b69-982d-42e5-a2c5-d530c5144349 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.763014 Nov 02 12:57:51.096875 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2961/5979] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:57:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 4766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:57:51.102964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-62253a22-4d79-4d94-9b0c-494a53abab2c req-0c601553-04d7-4fae-8fa5-e51a8b75e289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82257d09-9947-424b-b651-25b882181bb1", "name": "network-vif-plugged", "status": "completed", "tag": "2377dc63-8d42-4225-8a2e-f89bd9551dc1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:51.119002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62253a22-4d79-4d94-9b0c-494a53abab2c req-0c601553-04d7-4fae-8fa5-e51a8b75e289 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:51.119774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62253a22-4d79-4d94-9b0c-494a53abab2c req-0c601553-04d7-4fae-8fa5-e51a8b75e289 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:51.120471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-62253a22-4d79-4d94-9b0c-494a53abab2c req-0c601553-04d7-4fae-8fa5-e51a8b75e289 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:51.141900 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-62253a22-4d79-4d94-9b0c-494a53abab2c req-0c601553-04d7-4fae-8fa5-e51a8b75e289 service nova] Creating event network-vif-plugged:2377dc63-8d42-4225-8a2e-f89bd9551dc1 for instance 82257d09-9947-424b-b651-25b882181bb1 on n-h1-855650-5 Nov 02 12:57:51.152209 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-62253a22-4d79-4d94-9b0c-494a53abab2c req-0c601553-04d7-4fae-8fa5-e51a8b75e289 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053765 Nov 02 12:57:51.153877 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2962/5980] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:51.160159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:51.161306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:51.169328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:51.170352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:51.171252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:51.172349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:51.176147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:51.177784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:51.516447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:51.533769 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.372811 Nov 02 12:57:51.539906 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2963/5981] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:51 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:51.541423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:51.542708 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-459a1e87-35ef-4de0-8ccc-6a6dc00a53bf tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001694 Nov 02 12:57:51.544466 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2964/5982] 10.222.0.45 () {56 vars in 886 bytes} [Wed Nov 2 12:57:51 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:57:51.554802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c28892f3-53e7-401f-948b-4894552028b6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:51.555865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c28892f3-53e7-401f-948b-4894552028b6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:51.578811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:51.629075 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 2.824855 Nov 02 12:57:51.661577 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3019/5983] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:48 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:51.663370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:51.675071 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.012027 Nov 02 12:57:51.685419 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3020/5984] 10.222.0.45 () {54 vars in 1035 bytes} [Wed Nov 2 12:57:51 2022] GET /compute/v2/ => generated 379 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 02 12:57:51.692812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:51.700548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.008219 Nov 02 12:57:51.704170 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3021/5985] 10.222.0.45 () {54 vars in 1041 bytes} [Wed Nov 2 12:57:51 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:51.731297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:51.735128 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ff11310d-b69d-4717-989d-343a49a95fa0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001343 Nov 02 12:57:51.735128 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3022/5986] 10.222.0.45 () {56 vars in 886 bytes} [Wed Nov 2 12:57:51 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:57:51.964055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c28892f3-53e7-401f-948b-4894552028b6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:51.978215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c28892f3-53e7-401f-948b-4894552028b6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1267 microversion: 2.1 time: 0.432391 Nov 02 12:57:51.986383 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2965/5987] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:51 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1267 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:52.606299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:52.610058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:52.634993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:52.637705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:52.640399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:52.642812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:52.644185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:52.648343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:52.649210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:52.669068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:52.669819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:52.673725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:52.697597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:52.699216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:52.699985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:52.702882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:52.706616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:52.707424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:53.128838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:53.137829 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d39bc4df-b3cd-4161-b4b4-aa07b9f2274d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.553388 Nov 02 12:57:53.158720 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3023/5988] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:52 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:53.171332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abe2bef4-be0e-422e-8d49-b332ef61301e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:53.172191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-abe2bef4-be0e-422e-8d49-b332ef61301e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:53.232913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:53.244504 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-61aa35fe-4363-4a62-9f3e-0dbf790b19aa tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 0.579831 Nov 02 12:57:53.255968 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2966/5989] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:52 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:53.314616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-abe2bef4-be0e-422e-8d49-b332ef61301e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:53.357132 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-abe2bef4-be0e-422e-8d49-b332ef61301e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1267 microversion: 2.1 time: 0.196548 Nov 02 12:57:53.371411 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3024/5990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:53 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:54.170194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:54.182495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:54.228333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:54.234979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:54.235858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:54.237253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:54.238189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:54.239589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:54.281923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:54.285390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:54.363043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:54.363963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:54.365319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:54.383480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:54.384739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:54.387134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:54.562909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:55.609427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:55.622293 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5bd44473-b94c-4934-a033-9c2a008f9fb5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 1.460010 Nov 02 12:57:55.646045 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2967/5991] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:54 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:55.657949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:55.658976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:55.677453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:55.678371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:55.680150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:55.685449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:55.686062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:55.686653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:55.852401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:55.869871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-88a07057-9359-40ac-869a-2ba1928dd8f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 1.596159 Nov 02 12:57:55.880630 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3025/5992] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:54 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:55.982616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:56.025496 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db466cca-4c97-49b9-8a2a-e4502633e2c4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1325 microversion: 2.1 time: 0.358373 Nov 02 12:57:56.038367 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2968/5993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:55 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1325 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:56.655880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:56.656864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:56.677913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:56.683320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:56.685436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:56.686853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:56.691968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:56.703193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:57.047736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4b96a52-95ab-4c83-9823-c5b11665b18d tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:57.050653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4b96a52-95ab-4c83-9823-c5b11665b18d tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.053466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4b96a52-95ab-4c83-9823-c5b11665b18d tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.054252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4b96a52-95ab-4c83-9823-c5b11665b18d tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:57.055328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4b96a52-95ab-4c83-9823-c5b11665b18d tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.062568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4b96a52-95ab-4c83-9823-c5b11665b18d tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.063579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4b96a52-95ab-4c83-9823-c5b11665b18d tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:57.130681 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f4b96a52-95ab-4c83-9823-c5b11665b18d tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.435796 Nov 02 12:57:57.137673 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2969/5994] 10.222.0.45 () {58 vars in 1185 bytes} [Wed Nov 2 12:57:56 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:57:57.171878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:57.175871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:57.195659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.204814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.205476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:57.206456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.212066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.215479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:57.367298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:57.379873 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-014aa67f-acd5-4666-956e-dded22fb0be9 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.728443 Nov 02 12:57:57.382728 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3026/5995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:56 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:57.400432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:57.405768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:57.418979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.419496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.419952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:57.426645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.427436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.428360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:57.783647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:57.828785 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-88d7e01a-92bf-4205-b7e8-7bd225de70dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1325 microversion: 2.1 time: 0.438941 Nov 02 12:57:57.834293 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3027/5996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:57 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:57.863559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1374565685", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "availability_zone": "nova:n-h1-855650-5", "networks": [{"uuid": "b3b5b005-2232-4fb0-8703-e54a4b9bbecd"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:57.899841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:57.908516 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-027f2639-edc8-43bc-8d18-ab212e743597 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 0.769157 Nov 02 12:57:57.909106 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2970/5997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:57 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:57.951161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d9f684f5-e92f-4854-a0c4-8c3cdcc1395b req-86d654c2-cfd0-4d22-b20b-63c9e2584dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad77bf34-a88d-44d9-9b70-091c284ba1ea", "name": "network-vif-plugged", "status": "completed", "tag": "ee74aff2-967a-4fed-bd38-a8d893001a31"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:57.987693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9f684f5-e92f-4854-a0c4-8c3cdcc1395b req-86d654c2-cfd0-4d22-b20b-63c9e2584dc3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.988196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9f684f5-e92f-4854-a0c4-8c3cdcc1395b req-86d654c2-cfd0-4d22-b20b-63c9e2584dc3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.988647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9f684f5-e92f-4854-a0c4-8c3cdcc1395b req-86d654c2-cfd0-4d22-b20b-63c9e2584dc3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:58.033189 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d9f684f5-e92f-4854-a0c4-8c3cdcc1395b req-86d654c2-cfd0-4d22-b20b-63c9e2584dc3 service nova] Creating event network-vif-plugged:ee74aff2-967a-4fed-bd38-a8d893001a31 for instance ad77bf34-a88d-44d9-9b70-091c284ba1ea on n-h2-855650-5 Nov 02 12:57:58.048435 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d9f684f5-e92f-4854-a0c4-8c3cdcc1395b req-86d654c2-cfd0-4d22-b20b-63c9e2584dc3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101982 Nov 02 12:57:58.051855 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2971/5998] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:58.096261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] validate_networks() for [('b3b5b005-2232-4fb0-8703-e54a4b9bbecd', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:57:58.440099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:58.450565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:58.485169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:58.488736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:58.493705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:58.500300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:58.504438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:58.505581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:59.167072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:59.193837 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-527ec94b-30f6-46b0-87a4-f66efbbe334b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.756464 Nov 02 12:57:59.195878 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2972/5999] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:58 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:59.215164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:59.218838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:59.240243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:59.244458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:59.245331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:59.247537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:59.252676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:59.253757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:00.216922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:58:00.217404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:58:00.217740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:58:00.218280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:58:00.221249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:58:00.258760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:00.259392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:00.259850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:00.260677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:00.261137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:00.261568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:00.314986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Getting quotas for project 52cc6f9de3b04d71925357bb39e8d0a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:58:00.359830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Getting quotas for user 96bb109aeef845dc98155430809a42a0 and project 52cc6f9de3b04d71925357bb39e8d0a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:58:00.409761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:58:00.416053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:58:00.477243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:00.495419 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4711fd7e-8781-4fa4-9a43-cf75a2d7ac4e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 1.298147 Nov 02 12:58:00.496032 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2973/6000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:59 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:00.520913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:00.521826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:00.536730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:00.539085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:00.540483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:00.541624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:00.542629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:00.543461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:00.579241 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30a14793-d44c-4f1e-9ef4-77ef74cbee95 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.743632 Nov 02 12:58:00.594423 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3028/6001] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:58:00.604081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:00.604740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:00.628237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:00.628745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:00.629194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:00.630684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:00.631765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:00.632442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:01.276025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:01.309668 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb5f8344-4048-4c49-be2b-f8d1d2488083 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1375 microversion: 2.1 time: 0.803568 Nov 02 12:58:01.324931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:01.341357 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2974/6002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:00 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1375 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:01.343221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-16165e8d-a9e7-4330-aeb4-28d5b389a846 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.747375 Nov 02 12:58:01.346909 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3029/6003] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:00 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:01.363942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6aa1f76-47a7-4f4c-baf5-2593e7a6353c tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:01.372230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e6aa1f76-47a7-4f4c-baf5-2593e7a6353c tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:01.537332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:01.539006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:01.559644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:01.568521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:01.571030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:01.571311 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6aa1f76-47a7-4f4c-baf5-2593e7a6353c tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1329 microversion: 2.1 time: 0.228737 Nov 02 12:58:01.573151 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2975/6004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:01 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1329 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:01.600742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:01.602164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:01.603797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:02.078750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:02.094718 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2628527-6463-4bf6-b7fb-016c50a74502 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.561534 Nov 02 12:58:02.101701 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3030/6005] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:01 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:02.375045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:02.376480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:02.384227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:02.384582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:02.415076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:02.417503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:02.420608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:02.429213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:02.430859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:02.432816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:02.440771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:02.445373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:02.446248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:02.452421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:02.454634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:02.459772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:03.575861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:03.593139 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8aad50df-65c0-4b29-a83a-36bd48569078 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1561 microversion: 2.1 time: 1.220376 Nov 02 12:58:03.594148 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2976/6006] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:02 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1561 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:03.605471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:03.617891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:03.629061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:03.630766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f34b1b29-5225-416e-b5f5-da11d704f6b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 1.259365 Nov 02 12:58:03.644313 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3031/6007] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:02 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:03.671315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:03.681163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:03.681937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:03.685514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:03.686076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:03.690824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:03.691588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:03.694367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:03.704697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:03.712027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:03.719760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:03.723025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:03.730855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:03.735838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:04.110545 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2c9025bb-e75e-44aa-8c3c-11b48a640acc tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1416 microversion: 2.1 time: 0.514306 Nov 02 12:58:04.116594 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2977/6008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:03 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1416 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:04.140413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:04.157648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:04.201158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:04.202362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:04.205688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:04.212170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:04.216215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:04.218381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:04.771618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:04.780619 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3a427744-a5c7-4258-86fe-fb4a5ae4018f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 1.134941 Nov 02 12:58:04.790922 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3032/6009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:03 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:04.796090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-53093ee4-5a6b-4945-a2f1-c3a50f0038c8 req-37ab1db3-312a-421d-9f4a-7aad1497bcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828458af-cb07-4ccc-a4cd-98b1d85aed05", "tag": "63484f33-b31a-4c62-8b55-95dce3962dca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:04.827413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-53093ee4-5a6b-4945-a2f1-c3a50f0038c8 req-37ab1db3-312a-421d-9f4a-7aad1497bcae service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:04.831898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-53093ee4-5a6b-4945-a2f1-c3a50f0038c8 req-37ab1db3-312a-421d-9f4a-7aad1497bcae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:04.832500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-53093ee4-5a6b-4945-a2f1-c3a50f0038c8 req-37ab1db3-312a-421d-9f4a-7aad1497bcae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:04.856897 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-53093ee4-5a6b-4945-a2f1-c3a50f0038c8 req-37ab1db3-312a-421d-9f4a-7aad1497bcae service nova] Creating event network-changed:63484f33-b31a-4c62-8b55-95dce3962dca for instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 on n-h1-855650-5 Nov 02 12:58:04.870286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:04.886302 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-53093ee4-5a6b-4945-a2f1-c3a50f0038c8 req-37ab1db3-312a-421d-9f4a-7aad1497bcae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093044 Nov 02 12:58:04.886925 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e8ee84a-6a0f-44d9-aaec-d7ad2a904c35 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1561 microversion: 2.1 time: 0.761869 Nov 02 12:58:04.888949 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3033/6010] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:04.890993 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2978/6011] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:04 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1561 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:04.896209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6cd848ae-0eba-408e-8ade-fa85306cd6dc tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228e7a1430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:04.900479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:04.907132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:04.941036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:04.946618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:04.949511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:04.950510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:04.953024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:04.957101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.045763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6cd848ae-0eba-408e-8ade-fa85306cd6dc tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/efde582e-4080-4608-990d-52ff22597079" status: 200 len: 349 microversion: 2.1 time: 0.153245 Nov 02 12:58:05.046506 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2979/6012] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:58:04 2022] GET /compute/v2.1/os-volumes/efde582e-4080-4608-990d-52ff22597079 => generated 349 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:05.057136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:05.057875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:05.083974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.084513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.084982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.085721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.093747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.094605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.164060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:58:05.323569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:05.353860 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0c26ab55-77e8-40d3-9f99-cc7ecb2114a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.463326 Nov 02 12:58:05.366326 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3034/6013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:04 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:05.391338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:05.391982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:05.419378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.419890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.420052 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-23911ba2-061f-4480-91a2-a33d89cd32ce tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 204 len: 0 microversion: 2.1 time: 0.366917 Nov 02 12:58:05.420344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.421737 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2980/6014] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:05 2022] DELETE /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:58:05.436376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:05.437118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.437631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.438338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.439282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:05.450951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.451871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.452560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.457604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.459496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.460287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.779682 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3bdf8ad3-75cb-4c9b-bd5c-354952a61a3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1422 microversion: 2.1 time: 0.411404 Nov 02 12:58:05.798008 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3035/6015] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:05 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1422 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:05.818814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:05.819982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:05.841001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.846443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.850919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.857771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.860608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.866105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:06.073192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:06.084156 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c81a4d14-7bc4-4b23-9eee-616e40954af3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1567 microversion: 2.1 time: 0.656491 Nov 02 12:58:06.090445 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2981/6016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:05 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1567 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:06.319629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:06.345258 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b8617c4d-8e68-4a34-bc7a-662af76fb42c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.530164 Nov 02 12:58:06.352354 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3036/6017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:05 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:06.398400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:06.399217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:06.423585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:06.424234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:06.424719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:06.425556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:06.437755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:06.439357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:06.501842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:06.814568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:06.815576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:06.831675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:06.832204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:06.832699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:06.833444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:06.833916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:06.842927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:06.893390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:06.906877 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ace9faa2-e9a7-43b1-a504-e7eb23a5d3a7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.513321 Nov 02 12:58:06.908076 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2982/6018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:06 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:07.119346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:07.120146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:07.132505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:07.137441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:07.139280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:07.139777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:07.141763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:07.142293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:07.142749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:07.216164 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ccfb4554-b7b6-4cd6-a67c-d2c3df25d133 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.403303 Nov 02 12:58:07.216793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3037/6019] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:06 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:07.375852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:07.376895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:07.386403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:07.389154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:07.389888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:07.390852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:07.393221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:07.393883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:07.427897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:07.437570 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab5d7449-3200-4720-a794-a432e692ba7b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1567 microversion: 2.1 time: 0.323618 Nov 02 12:58:07.439770 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2983/6020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:07 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1567 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:07.934238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:07.934238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:07.946663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:07.947263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:07.952459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:07.954842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:07.955707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:07.956255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:07.956773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:07.993895 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9d678a23-1640-417c-bbdf-b5e2ee5717fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.616183 Nov 02 12:58:07.995784 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3038/6021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:07 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:08.083682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-973367f0-e109-4c15-ab46-20653b0e6770 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228eff53a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:08.228336 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-973367f0-e109-4c15-ab46-20653b0e6770 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/28e63e50-312c-4d02-a7e0-148fd4dd23c0" status: 200 len: 350 microversion: 2.1 time: 0.148943 Nov 02 12:58:08.230554 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3039/6022] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:58:08 2022] GET /compute/v2.1/os-volumes/28e63e50-312c-4d02-a7e0-148fd4dd23c0 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:08.260227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:08.262881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:08.293235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:08.297019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:08.299292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:08.302829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:08.305572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:08.306422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:08.943851 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5f70887-ddb6-43ba-825b-9a9a8b3af0e0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.692238 Nov 02 12:58:08.955645 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3040/6023] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:08 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:08.955645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:08.955645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:08.970361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:08.972044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:08.974314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:08.975447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:08.978845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:08.980106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:09.038265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:09.070006 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d5f221e-1826-4d9d-8178-c5547154df2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 1.138967 Nov 02 12:58:09.073112 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2984/6024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:07 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:09.085576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:09.089275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:09.124476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:09.131179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:09.132318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:09.142777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:09.143887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:09.145565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:09.202997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:09.222343 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1419e11a-d352-41b9-bf65-e135b2439f90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1525 microversion: 2.1 time: 0.273017 Nov 02 12:58:09.223728 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3041/6025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:08 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1525 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:09.244897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c029a5fc-9430-4506-9d40-44a51c447810 req-854df55a-6715-4c42-a065-99dad434e0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad77bf34-a88d-44d9-9b70-091c284ba1ea", "name": "network-vif-deleted", "tag": "ee74aff2-967a-4fed-bd38-a8d893001a31"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:09.281208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c029a5fc-9430-4506-9d40-44a51c447810 req-854df55a-6715-4c42-a065-99dad434e0cb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:09.282342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c029a5fc-9430-4506-9d40-44a51c447810 req-854df55a-6715-4c42-a065-99dad434e0cb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:09.284057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c029a5fc-9430-4506-9d40-44a51c447810 req-854df55a-6715-4c42-a065-99dad434e0cb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:09.331883 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c029a5fc-9430-4506-9d40-44a51c447810 req-854df55a-6715-4c42-a065-99dad434e0cb service nova] Creating event network-vif-deleted:ee74aff2-967a-4fed-bd38-a8d893001a31 for instance ad77bf34-a88d-44d9-9b70-091c284ba1ea on n-h2-855650-5 Nov 02 12:58:09.527728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c029a5fc-9430-4506-9d40-44a51c447810 req-854df55a-6715-4c42-a065-99dad434e0cb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299807 Nov 02 12:58:09.528975 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3042/6026] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:09.571271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:09.585079 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3bd184e8-f077-448b-b765-1d36db70d289 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.509188 Nov 02 12:58:09.610028 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2985/6027] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:09 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:09.977535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:09.980371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:09.994241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:09.995083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:09.996069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:10.002008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:10.010264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:10.011165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:10.100129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:10.101617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:10.108684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:10.109524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:10.110590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:10.111569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:10.112222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:10.112849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:10.290098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:10.388691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:10.735697 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b596372-7403-4744-ab91-96ab2cf26738 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.760379 Nov 02 12:58:10.739048 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3043/6028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:09 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:10.747736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:10.754729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:10.761308 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ffbaef70-c547-4a9d-a129-6ed7dc8deffa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.665565 Nov 02 12:58:10.761786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:10.770563 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2986/6029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:10 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:10.786439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:10.787432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:10.791510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:10.792118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:10.792560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:10.800923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:10.801665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:10.803615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:10.809617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:10.810512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:10.811196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:10.812425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:10.813066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:10.813731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:11.089626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:11.096906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:11.112157 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6519a18-8b87-4b72-a789-0437c72ce7d8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1360 microversion: 2.1 time: 0.371238 Nov 02 12:58:11.126892 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3044/6030] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:10 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1360 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:11.155384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-452c3883-2afc-4358-a680-4b42de43b9b8 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228e1df040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:11.281318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:11.293857 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-452c3883-2afc-4358-a680-4b42de43b9b8 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7f2a0b89-a4ec-4df8-91ee-a0d952ba3be9" status: 200 len: 350 microversion: 2.1 time: 0.165481 Nov 02 12:58:11.294722 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3045/6031] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 12:58:11 2022] GET /compute/v2.1/os-volumes/7f2a0b89-a4ec-4df8-91ee-a0d952ba3be9 => generated 350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:11.296277 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3de204fd-4ddc-417a-a697-656643190d2c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.528140 Nov 02 12:58:11.297005 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2987/6032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:10 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:11.308301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6eb632a6-c678-480f-a913-2afe23c910c1 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228ea4d040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:11.506810 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6eb632a6-c678-480f-a913-2afe23c910c1 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.202213 Nov 02 12:58:11.507558 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3046/6033] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Nov 2 12:58:11 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:11.525740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92d90b09-28e8-4837-99f9-9578db37db70 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228dc799d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:11.565710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=10 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:11.761952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:11.762694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:11.779921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92d90b09-28e8-4837-99f9-9578db37db70 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.260358 Nov 02 12:58:11.781799 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2988/6034] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Nov 2 12:58:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:11.787742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9c3aa734-002e-4941-8222-e7dda10931ed req-6c0555bf-42e6-4d5e-adb1-e263149f2bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "badca2c1-0010-45f4-8b5d-ef5e45f91f2c", "tag": "3cff016f-a041-4303-ae87-efe1ccab1820"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:11.788092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:11.789304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:11.789941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:11.791458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:11.792181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:11.792880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:11.832211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9c3aa734-002e-4941-8222-e7dda10931ed req-6c0555bf-42e6-4d5e-adb1-e263149f2bf6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:11.834215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9c3aa734-002e-4941-8222-e7dda10931ed req-6c0555bf-42e6-4d5e-adb1-e263149f2bf6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:11.835693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9c3aa734-002e-4941-8222-e7dda10931ed req-6c0555bf-42e6-4d5e-adb1-e263149f2bf6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:11.868076 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9c3aa734-002e-4941-8222-e7dda10931ed req-6c0555bf-42e6-4d5e-adb1-e263149f2bf6 service nova] Creating event network-changed:3cff016f-a041-4303-ae87-efe1ccab1820 for instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c on n-h1-855650-5 Nov 02 12:58:11.882629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9c3aa734-002e-4941-8222-e7dda10931ed req-6c0555bf-42e6-4d5e-adb1-e263149f2bf6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096147 Nov 02 12:58:11.885189 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2989/6035] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:11.905807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:11.907302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:11.922065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:11.923776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:11.925380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:11.927872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:11.930709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:11.931507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:12.224995 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-73b47e62-a8b6-43e4-8dd8-ea6ca38f6b3a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.464393 Nov 02 12:58:12.229154 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3047/6036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:11 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:12.252439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-06faced2-7c2b-426e-b394-99cc886627b4 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228e88c310>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:12.336107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:12.359466 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-52f95822-c545-49f0-8f52-90a3f2322852 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.460752 Nov 02 12:58:12.360183 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2990/6037] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:11 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:12.377467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:12.378166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:12.415350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:12.416085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:12.422093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:12.425548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:12.426346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:12.428100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:12.436326 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-06faced2-7c2b-426e-b394-99cc886627b4 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.205945 Nov 02 12:58:12.437152 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3048/6038] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Nov 2 12:58:12 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:12.450988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:12.452012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:12.470835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:12.474475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:12.474704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:12.475392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:12.475888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:12.476328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:12.578052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:12.593482 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89e4c47b-9f06-4d27-8ef9-61efeb4dc06b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1360 microversion: 2.1 time: 0.232097 Nov 02 12:58:12.594267 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2991/6039] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:12 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:12.606167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-47cebad2-594d-4883-9e03-d5cef736d870 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228e7a1700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:12.797279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:12.817842 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32f7950d-f14d-4fb2-9799-a2a8fd11e926 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.379314 Nov 02 12:58:12.818026 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-47cebad2-594d-4883-9e03-d5cef736d870 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.222471 Nov 02 12:58:12.818576 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3049/6040] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:12 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:12.819115 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2992/6041] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Nov 2 12:58:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:12.837829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-174250ed-b95e-4a61-aa9a-00cc13f967f0 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228e995940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.071729 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-174250ed-b95e-4a61-aa9a-00cc13f967f0 tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.237718 Nov 02 12:58:13.072617 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3050/6042] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Nov 2 12:58:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:13.090524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de4e332a-1a27-4d85-a171-febce6a48abd tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f22929f03a0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.255218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.256412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:13.272012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:13.272514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:13.272957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:13.273672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:13.274231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:13.274663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:13.365381 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de4e332a-1a27-4d85-a171-febce6a48abd tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.280813 Nov 02 12:58:13.366231 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2993/6043] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:13.381211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31cc0c37-72a9-47a8-ba58-5e08cddcde2f tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f22929f0700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.624725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31cc0c37-72a9-47a8-ba58-5e08cddcde2f tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.248313 Nov 02 12:58:13.626092 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2994/6044] 10.222.0.45 () {58 vars in 1188 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:13.631927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.634803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:13.638765 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-acdd956f-8d98-4320-8034-b294f068ccc6 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.387515 Nov 02 12:58:13.652549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3051/6045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:13.663450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.664440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:13.667228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:13.667881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:13.672054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:13.675275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:13.678497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:13.681686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:13.682660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:13.683995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:13.684295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:13.685270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:13.688334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:13.689380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:13.875440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:13.888866 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-532965c4-43b5-4a76-86d1-05a0627af438 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1360 microversion: 2.1 time: 0.234831 Nov 02 12:58:13.889762 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3052/6046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:13.906555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02786cd4-5b32-4013-8b7b-a7d01a29f94c tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] Calling method '.version_select at 0x7f228e2904c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:14.102762 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02786cd4-5b32-4013-8b7b-a7d01a29f94c tempest-VolumesTestJSON-1262754474 tempest-VolumesTestJSON-1262754474-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.210310 Nov 02 12:58:14.114999 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3053/6047] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:14.120391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:14.121318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:14.140225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.141627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.142614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:14.143731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.144453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.145348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:14.292763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:14.306774 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3ce54cb-c247-413c-be34-97952f5129a5 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.677432 Nov 02 12:58:14.307760 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2995/6048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:14.452697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:14.465845 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2c4a904-8703-4819-bc01-8c32f2e916e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.347433 Nov 02 12:58:14.479480 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3054/6049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:14 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:14.669640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:14.670467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:14.689131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.689649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.694501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:14.695424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.695956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.696424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:14.806282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e38ecd5a-a8fa-48c5-bc99-e40727888a70 req-e6cf8b5b-3d05-4e92-a959-26b08a7075ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828458af-cb07-4ccc-a4cd-98b1d85aed05", "name": "network-vif-plugged", "status": "completed", "tag": "63484f33-b31a-4c62-8b55-95dce3962dca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:14.829126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e38ecd5a-a8fa-48c5-bc99-e40727888a70 req-e6cf8b5b-3d05-4e92-a959-26b08a7075ce service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.829492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e38ecd5a-a8fa-48c5-bc99-e40727888a70 req-e6cf8b5b-3d05-4e92-a959-26b08a7075ce service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.829933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e38ecd5a-a8fa-48c5-bc99-e40727888a70 req-e6cf8b5b-3d05-4e92-a959-26b08a7075ce service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:14.859724 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e38ecd5a-a8fa-48c5-bc99-e40727888a70 req-e6cf8b5b-3d05-4e92-a959-26b08a7075ce service nova] Creating event network-vif-plugged:63484f33-b31a-4c62-8b55-95dce3962dca for instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 on n-h1-855650-5 Nov 02 12:58:14.872640 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e38ecd5a-a8fa-48c5-bc99-e40727888a70 req-e6cf8b5b-3d05-4e92-a959-26b08a7075ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070651 Nov 02 12:58:14.875793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3055/6050] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:14.913797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:14.914974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:14.931208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.936944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.939413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:14.944954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.947874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.948650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:15.166208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:15.180119 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8ab9f8b8-82bf-49af-b74d-2c37ac3c048f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1360 microversion: 2.1 time: 0.271033 Nov 02 12:58:15.183493 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3056/6051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:14 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1360 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:15.253062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-73c89a7c-384f-4e56-80de-a4eb40ba4796 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.587177 Nov 02 12:58:15.253720 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2996/6052] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:14 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:15.336468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:15.337419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:15.352360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:15.356243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:15.359113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:15.360793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:15.364832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:15.365643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:15.493631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:15.496704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:15.511020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:15.511956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:15.512696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:15.513804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:15.514589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:15.515275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:16.331062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:16.351521 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c29344b0-023e-45eb-b1f5-20340f8502d3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 1.014279 Nov 02 12:58:16.352536 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3057/6053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:15 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:16.371426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:16.378406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:16.396943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:16.397885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:16.401467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:16.403478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:16.408972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:16.412203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:16.416583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:16.419504 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b887c556-b9c4-4a48-a591-4160e05f5628 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.930428 Nov 02 12:58:16.421051 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2997/6054] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:15 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:16.448781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:16.451927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:16.467942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:16.470435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:16.472809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:16.473807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:16.476040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:16.476682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:16.765578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:16.782203 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-438012cd-fa88-4579-aa5e-443e31c708ab tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1360 microversion: 2.1 time: 0.425147 Nov 02 12:58:16.806849 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3058/6055] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:16 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1360 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:16.871156 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7faf4b57-1c04-42eb-9a70-6c2b3dceb195 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.448062 Nov 02 12:58:16.876505 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2998/6056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:16 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:17.397446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:17.412710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:17.463535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:17.464039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:17.469871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:17.471567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:17.474868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:17.475641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:17.486160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:17.503118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:17.557296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:17.563682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:17.566756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:17.570760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:17.572886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:17.575525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:18.161889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:18.181720 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d26ad1e-680b-48da-b8d1-7ed117beb695 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.796151 Nov 02 12:58:18.192223 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3059/6057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:17 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:18.211878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:18.212540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:18.236111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:18.236706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:18.237042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:18.237779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:18.238810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:18.239300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:18.318497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:18.346061 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0b2cb3e-e4f2-4fa2-b1a6-a4cbfdddfbd4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1392 microversion: 2.1 time: 0.897856 Nov 02 12:58:18.347408 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2999/6058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:17 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1392 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:18.365555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:18.366765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:18.376867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:18.378282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:18.379282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:18.381218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:18.382174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:18.382854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:18.392622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:18.392622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:18.392622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:18.392622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lazy-loading 'fault' on Instance uuid ad77bf34-a88d-44d9-9b70-091c284ba1ea {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:58:18.652164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:18.666510 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bdc6a7ab-63a0-4f0b-b75a-7a41b8b3e667 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 200 len: 1365 microversion: 2.1 time: 0.473034 Nov 02 12:58:18.678324 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3060/6059] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:18 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 1365 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:18.955750 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d649af8-8114-4085-b409-870ca34c4253 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.605340 Nov 02 12:58:18.974123 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3000/6060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:18 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:19.217896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:19.219027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:19.249526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:19.254549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:19.255332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:19.256712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:19.257416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:19.258123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:19.374193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:19.375242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:19.411707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:19.417086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:19.422645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:19.423859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:19.431920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:19.437054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:19.949199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:19.965385 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8fbef236-93da-453b-b010-5905ed540491 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 0.751991 Nov 02 12:58:19.991338 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3061/6061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:19 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:20.018582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:20.019345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:20.049645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:20.050244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:20.050807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:20.061147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:20.066012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:20.066550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:20.067016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:20.073194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa6e30d4-423e-44bd-be37-936b2447bf26 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1563 microversion: 2.1 time: 0.703390 Nov 02 12:58:20.084820 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3001/6062] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:19 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1563 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:20.098758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:20.106168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:20.122651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:20.128035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:20.132028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:20.133195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:20.133913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:20.136949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:20.143393 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea HTTP/1.1 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'ad77bf34-a88d-44d9-9b70-091c284ba1ea'} Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:20.145612 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:20.152495 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-46bdf0ef-7877-4a3d-9bd4-6aaf1be949e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 404 len: 111 microversion: 2.1 time: 0.153791 Nov 02 12:58:20.158352 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3062/6063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:19 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:20.169245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:20.169866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:20.191212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:20.193394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:20.194680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:20.204822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:20.205547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:20.206231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:20.882869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:20.906280 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f02ed672-4f1f-47c3-a85a-ba24578e20b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1563 microversion: 2.1 time: 0.736883 Nov 02 12:58:20.910396 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3063/6064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:20 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1563 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:20.947463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f172056-6d75-4201-ab56-fc2e84959444 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.861080 Nov 02 12:58:20.950431 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3002/6065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:20 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:20.997441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:20.998025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:21.025391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:21.026924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:21.051399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:21.060426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:21.072189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:21.074207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:21.981534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:21.982765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:22.029372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:22.029499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:22.029860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:22.041197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:22.041699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:22.042188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:22.685944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:22.724812 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab5b1dfe-b633-41f4-b812-6374b361ee50 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1510 microversion: 2.1 time: 1.728529 Nov 02 12:58:22.729604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:22.732833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1f92a06-508c-4ed7-b017-dad729d91ba9 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.759583 Nov 02 12:58:22.741150 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3064/6066] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:20 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1510 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:22.759512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3003/6067] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:21 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:23.144955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7e30c2f5-a5a9-442d-8f34-80a71d0ef25b req-2176657e-aedd-4089-b74c-179383402cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "badca2c1-0010-45f4-8b5d-ef5e45f91f2c", "name": "network-vif-plugged", "status": "completed", "tag": "3cff016f-a041-4303-ae87-efe1ccab1820"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:23.165947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:23.168441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7e30c2f5-a5a9-442d-8f34-80a71d0ef25b req-2176657e-aedd-4089-b74c-179383402cbf service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:23.168940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7e30c2f5-a5a9-442d-8f34-80a71d0ef25b req-2176657e-aedd-4089-b74c-179383402cbf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:23.172056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7e30c2f5-a5a9-442d-8f34-80a71d0ef25b req-2176657e-aedd-4089-b74c-179383402cbf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:23.209885 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7e30c2f5-a5a9-442d-8f34-80a71d0ef25b req-2176657e-aedd-4089-b74c-179383402cbf service nova] Creating event network-vif-plugged:3cff016f-a041-4303-ae87-efe1ccab1820 for instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c on n-h1-855650-5 Nov 02 12:58:23.229908 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7e30c2f5-a5a9-442d-8f34-80a71d0ef25b req-2176657e-aedd-4089-b74c-179383402cbf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091424 Nov 02 12:58:23.237399 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3065/6068] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:23.754922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:23.755873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:23.769125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:23.770448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:23.781483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:23.787715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:23.788743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:23.789255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:23.789709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:23.790480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:23.792565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:23.796994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:23.799661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:23.801804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:23.803244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:23.810761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:23.811499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:24.596045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:24.605050 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6ab29d36-d19a-44fc-a876-61541cf27656 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1507 microversion: 2.1 time: 0.854754 Nov 02 12:58:24.615580 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3004/6069] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:23 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1507 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:24.652545 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb85e1f1-6240-4c7a-a8f0-657718a681c2 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.888948 Nov 02 12:58:24.653157 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3066/6070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:23 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:25.647061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:25.649753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:25.679388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:25.680001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:25.680188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:25.680803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:25.684451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:25.685644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:25.686738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:25.687422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:25.707526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:25.708035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:25.708482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:25.709213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:25.718278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:25.720405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:26.189945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:26.209456 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b6cabff-869d-4d70-af9f-7bf44fdfc62e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1507 microversion: 2.1 time: 0.569124 Nov 02 12:58:26.210138 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3005/6071] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:25 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:26.262892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:26.268074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:26.286665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:26.291793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:26.295906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:26.298879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:26.300304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:26.304995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:26.311401 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e72387e0-0d4d-47f4-b646-2a8971a5ab72 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1464 microversion: 2.1 time: 0.628012 Nov 02 12:58:26.330875 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3067/6072] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:25 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1464 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:26.344712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ad51b142-bad4-4fb1-aa9a-b4a5ae061d77 req-bca27413-5674-43c4-a381-16ce3a7a4ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828458af-cb07-4ccc-a4cd-98b1d85aed05", "tag": "63484f33-b31a-4c62-8b55-95dce3962dca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:26.396193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ad51b142-bad4-4fb1-aa9a-b4a5ae061d77 req-bca27413-5674-43c4-a381-16ce3a7a4ea0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:26.400094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ad51b142-bad4-4fb1-aa9a-b4a5ae061d77 req-bca27413-5674-43c4-a381-16ce3a7a4ea0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:26.402507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ad51b142-bad4-4fb1-aa9a-b4a5ae061d77 req-bca27413-5674-43c4-a381-16ce3a7a4ea0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:26.428523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:26.458198 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ad51b142-bad4-4fb1-aa9a-b4a5ae061d77 req-bca27413-5674-43c4-a381-16ce3a7a4ea0 service nova] Creating event network-changed:63484f33-b31a-4c62-8b55-95dce3962dca for instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 on n-h1-855650-5 Nov 02 12:58:26.488583 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ad51b142-bad4-4fb1-aa9a-b4a5ae061d77 req-bca27413-5674-43c4-a381-16ce3a7a4ea0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143846 Nov 02 12:58:26.489548 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3068/6073] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:26.750305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:26.758841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91c72656-358a-4f82-bfbb-890c606862ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1563 microversion: 2.1 time: 0.505403 Nov 02 12:58:26.759435 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3006/6074] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:26 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1563 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:27.215033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c32ce2f1-9df9-4eb7-9228-75910dfb9e92 req-0659c016-b8ca-41db-aa45-a1a8f270c1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82257d09-9947-424b-b651-25b882181bb1", "name": "network-vif-unplugged", "status": "completed", "tag": "2377dc63-8d42-4225-8a2e-f89bd9551dc1"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:27.236890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:27.237514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:27.247539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.254436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c32ce2f1-9df9-4eb7-9228-75910dfb9e92 req-0659c016-b8ca-41db-aa45-a1a8f270c1fa service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.254925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c32ce2f1-9df9-4eb7-9228-75910dfb9e92 req-0659c016-b8ca-41db-aa45-a1a8f270c1fa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.255359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c32ce2f1-9df9-4eb7-9228-75910dfb9e92 req-0659c016-b8ca-41db-aa45-a1a8f270c1fa service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:27.258349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.258937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:27.259685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.260162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.260599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:27.303368 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c32ce2f1-9df9-4eb7-9228-75910dfb9e92 req-0659c016-b8ca-41db-aa45-a1a8f270c1fa service nova] Creating event network-vif-unplugged:2377dc63-8d42-4225-8a2e-f89bd9551dc1 for instance 82257d09-9947-424b-b651-25b882181bb1 on n-h1-855650-5 Nov 02 12:58:27.310406 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c32ce2f1-9df9-4eb7-9228-75910dfb9e92 req-0659c016-b8ca-41db-aa45-a1a8f270c1fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101280 Nov 02 12:58:27.313517 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3069/6075] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:27.352607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:27.353792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:27.365377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.367800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.368630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:27.369581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.371674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.374469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:27.840358 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63c6ceb2-f9c4-45cb-b1a7-9a2b02fdf48f tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1649 microversion: 2.1 time: 0.495376 Nov 02 12:58:27.842017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:27.854771 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3070/6076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:27 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1649 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:27.866047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:27.866370 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5603475e-6975-401d-8f69-efe5454b9e96 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1507 microversion: 2.1 time: 0.632215 Nov 02 12:58:27.867005 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3007/6077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:27 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:27.867399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:27.874320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.875122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.875738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:27.876639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.877281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.877871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:28.294852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-92749234-cf0f-43e6-bd1a-06493ca1729a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1649 microversion: 2.1 time: 0.433368 Nov 02 12:58:28.315029 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3071/6078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:27 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1649 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:28.324625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:28.325268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:28.331961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:28.332695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:28.333338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:28.334405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:28.335096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:28.335719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:28.899725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aee538a6-3247-4ec9-8d3a-378dc097aef5 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1649 microversion: 2.1 time: 0.578753 Nov 02 12:58:28.900345 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3008/6079] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:28 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1649 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:28.910336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:28.911962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:28.919335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:28.919848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:28.920536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:28.921668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:28.922403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:28.923074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:29.126103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1268967729", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "availability_zone": "nova:n-h2-855650-5", "networks": [{"uuid": "b3b5b005-2232-4fb0-8703-e54a4b9bbecd"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:29.274709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] validate_networks() for [('b3b5b005-2232-4fb0-8703-e54a4b9bbecd', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:58:29.669863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:29.683907 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6ff9eb6-3571-4af9-9140-c2bbfdb05417 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1507 microversion: 2.1 time: 0.791341 Nov 02 12:58:29.685404 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3072/6080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:28 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1507 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:29.705188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-10bfcf37-fdb4-4626-9d94-e9a90064c298 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'create', calling method: .version_select at 0x7f228f015310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-901532192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyUmEwLNgeS4UBOpMRGkxEAsBMMJWgNhGgNVcYv2nfqjPpPxXBMvBFF0JB2ebPsyIAu3o5uJY00jMlS0CI+Ux4NExUICQSwgk8CgKA62sXnU2U8vddReNTErMYOUy6YfA=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:29.752361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-10bfcf37-fdb4-4626-9d94-e9a90064c298 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for project c9764cefb5494bc9abb1518bd0b30681. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:58:29.761515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-10bfcf37-fdb4-4626-9d94-e9a90064c298 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for user 01745029847d4f7eba5ed111fd14d395 and project c9764cefb5494bc9abb1518bd0b30681. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:58:29.810445 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-10bfcf37-fdb4-4626-9d94-e9a90064c298 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.122437 Nov 02 12:58:29.811266 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3073/6081] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:58:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:30.305634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:30.306584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:30.342583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.344239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.344994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.346558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.348529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.350275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.401093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:58:30.622226 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd0c5f75-661d-4d56-85fc-a8f3cf007b22 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 204 len: 0 microversion: 2.1 time: 0.322753 Nov 02 12:58:30.623136 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3074/6082] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:30 2022] DELETE /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:58:30.637945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:30.638612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:30.648327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:58:30.649811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:58:30.650566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:58:30.651167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:58:30.651868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:58:30.661107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.661617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.662083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.665239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.665739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.666319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.691276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.698705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.699443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.703130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.704093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.704843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.785089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Getting quotas for project 52cc6f9de3b04d71925357bb39e8d0a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:58:30.795316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Getting quotas for user 96bb109aeef845dc98155430809a42a0 and project 52cc6f9de3b04d71925357bb39e8d0a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:58:30.821924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:58:30.826130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:58:30.911970 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-54850223-bf9c-4053-bcfb-8c3f037dcdfa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.788519 Nov 02 12:58:30.915807 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3009/6083] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:58:30.923836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:30.924344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:30.944732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.945250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.945705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.946457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.946924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.947360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:31.162774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:31.171239 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64b2ca48-242a-4b0e-9901-a315f123524d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1410 microversion: 2.1 time: 0.543150 Nov 02 12:58:31.192111 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3075/6084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:30 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1410 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:31.202154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1930703e-7fb4-47d2-b905-8fe509b29de4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:31.206155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1930703e-7fb4-47d2-b905-8fe509b29de4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:31.226324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:31.235201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b57b489-65b6-4e70-83a3-ed92eacfe472 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 200 len: 1450 microversion: 2.1 time: 0.318234 Nov 02 12:58:31.253477 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3010/6085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:30 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 1450 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:31.269076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:31.269774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:31.298263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:31.299685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:31.302449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:31.303713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:31.304627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:31.305265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:31.453308 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1930703e-7fb4-47d2-b905-8fe509b29de4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1329 microversion: 2.1 time: 0.258977 Nov 02 12:58:31.456475 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3076/6086] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:31 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1329 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:31.667789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:31.694676 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a42d7b62-6316-4421-b135-a65c5be22f67 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.429369 Nov 02 12:58:31.711907 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3011/6087] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:31 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:31.732680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:31.733845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:31.748121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:31.763360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:31.766214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:31.786657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:31.787259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:31.791767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.118598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:32.129800 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dd18f0c1-a379-4653-99da-e9ca0c8bd08b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.402038 Nov 02 12:58:32.134125 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3077/6088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:31 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:32.155971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:32.157092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:32.201027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.202809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:32.203441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:32.203970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.204659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.205954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.207387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.208081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.213645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.214106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.214560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.215280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.215742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.216174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.741670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:32.759620 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe293853-f754-447c-9f05-2f8982944ce2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1410 microversion: 2.1 time: 0.560661 Nov 02 12:58:32.760234 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3078/6089] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:32 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1410 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:32.783391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:32.784025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:32.801609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.803195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.806749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.808096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.808756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.810213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:33.391676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:33.404279 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1f795ce-ebff-4725-90de-c50bc0d2938c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 1.250280 Nov 02 12:58:33.406598 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3012/6090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:32 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:33.428285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:33.429425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:33.436824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:33.439428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:33.440012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:33.441386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:33.446797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:33.447394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:33.492703 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8939bef-c4dd-40bd-bff2-78a284295298 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1416 microversion: 2.1 time: 0.724993 Nov 02 12:58:33.496404 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3079/6091] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:32 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1416 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:33.785805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:33.786723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:33.793716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:33.794630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:33.795556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:33.797212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:33.798047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:33.799416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:33.822381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:33.840579 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dec229e5-eec7-46f6-866f-329e4e3d6e25 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.414169 Nov 02 12:58:33.841613 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3013/6092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:33 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:33.868039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b70bc14c-e870-4986-92a2-93742b00d09c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:33.876707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b70bc14c-e870-4986-92a2-93742b00d09c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:33.877569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b70bc14c-e870-4986-92a2-93742b00d09c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:33.878247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b70bc14c-e870-4986-92a2-93742b00d09c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:33.922444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b70bc14c-e870-4986-92a2-93742b00d09c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Going to try to stop instance {{(pid=120722) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:58:34.017344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b70bc14c-e870-4986-92a2-93742b00d09c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.154050 Nov 02 12:58:34.022387 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3014/6093] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:58:33 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:58:34.030130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:34.030865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:34.041450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:34.043374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:34.044722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:34.049516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:34.050934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:34.056567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:34.059245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:34.103457 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7577a520-50a7-4043-91c6-4a856286178a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1410 microversion: 2.1 time: 0.319839 Nov 02 12:58:34.104366 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3080/6094] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:33 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1410 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:34.261118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f32df60f-fb3e-4e47-a066-2175be259bf9 req-7bede1d4-ca6e-4654-b88a-5a559309244b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9addd4f4-648b-49c9-a39c-be40c7f1fb85", "name": "network-vif-deleted", "tag": "a2289616-b13c-4d57-b795-2b3fe52b301a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:34.279164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f32df60f-fb3e-4e47-a066-2175be259bf9 req-7bede1d4-ca6e-4654-b88a-5a559309244b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:34.279993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f32df60f-fb3e-4e47-a066-2175be259bf9 req-7bede1d4-ca6e-4654-b88a-5a559309244b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:34.281214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f32df60f-fb3e-4e47-a066-2175be259bf9 req-7bede1d4-ca6e-4654-b88a-5a559309244b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:34.304109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f32df60f-fb3e-4e47-a066-2175be259bf9 req-7bede1d4-ca6e-4654-b88a-5a559309244b service nova] Creating event network-vif-deleted:a2289616-b13c-4d57-b795-2b3fe52b301a for instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 on n-h2-855650-5 Nov 02 12:58:34.311974 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f32df60f-fb3e-4e47-a066-2175be259bf9 req-7bede1d4-ca6e-4654-b88a-5a559309244b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053830 Nov 02 12:58:34.313580 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3081/6095] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:34.340312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:34.350977 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f9997ee-01d6-4c28-9367-92c7ccbfb642 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.326553 Nov 02 12:58:34.354423 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3015/6096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:34 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:34.507758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1425142476", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "ac4aac3e-a97f-470f-b5b9-86599673cecb"}], "key_name": "tempest-TestNetworkBasicOps-901532192", "security_groups": [{"name": "tempest-secgroup-smoke-1468813818"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:34.525418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:34.526903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:34.538561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:34.545624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:34.546575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:34.547633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:34.551480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:34.552239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:34.723339 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-203d0682-9e8e-463b-a1f4-78c652ca5640 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1422 microversion: 2.1 time: 0.206577 Nov 02 12:58:34.723943 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3016/6097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:34 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1422 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:34.927256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] validate_networks() for [('ac4aac3e-a97f-470f-b5b9-86599673cecb', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:58:35.132218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:35.132862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:35.159530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.160143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.160602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.161334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.169843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.170449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.412362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:35.421395 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07d09512-0d5d-4510-8195-09b77f17eeb8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1202 microversion: 2.1 time: 0.294182 Nov 02 12:58:35.442601 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3017/6098] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:35 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1202 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:35.452337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:35.453211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:35.474686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.476713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.477648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.480312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.481127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.483207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.026696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:36.035352 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78beeb53-bf97-4fb1-af7e-6a6671dd01aa tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.591194 Nov 02 12:58:36.043089 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3018/6099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:35 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:36.061869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:36.063394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:36.082422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:36.083520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:36.085071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.086866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:36.089902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:36.092688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.291459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:58:36.292217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:58:36.292613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:58:36.293107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:58:36.293636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:58:36.341872 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84693eae-70eb-4053-80b5-6cdb48d560d4 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.295822 Nov 02 12:58:36.343404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:36.343910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:36.344363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.345602 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3019/6100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:36 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:36.349987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:36.350496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:36.354398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.413860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for project c9764cefb5494bc9abb1518bd0b30681. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:58:36.422301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for user 01745029847d4f7eba5ed111fd14d395 and project c9764cefb5494bc9abb1518bd0b30681. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:58:36.447560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:58:36.450721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:58:36.457269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:36.458280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:36.475191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:36.476793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:36.477521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.480854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:36.481824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:36.482585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.488956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:36.586031 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3fda667d-c626-4492-b3dc-9262592ac881 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.083787 Nov 02 12:58:36.589389 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3082/6101] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:58:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:58:36.603343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b3a36033-10b1-4c04-a06c-ed10d31ff9b8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:36.604426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b3a36033-10b1-4c04-a06c-ed10d31ff9b8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:36.605205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:36.628416 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6c62237d-1646-4074-b198-bd867f43452c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1202 microversion: 2.1 time: 0.175359 Nov 02 12:58:36.645995 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3020/6102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:36 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:36.801429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b3a36033-10b1-4c04-a06c-ed10d31ff9b8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:36.815057 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b3a36033-10b1-4c04-a06c-ed10d31ff9b8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1248 microversion: 2.1 time: 0.216303 Nov 02 12:58:36.826032 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3083/6103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:36 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1248 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:36.945347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9df35717-ccbd-4046-83e5-b15477f33df2 req-29d09368-f5e3-4161-887d-52cfb51514b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39262ad3-d6a9-46b4-923c-1e4858b66e8f", "tag": "6375de5d-1b52-43f9-bcf0-6126b186e5d6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:36.963254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9df35717-ccbd-4046-83e5-b15477f33df2 req-29d09368-f5e3-4161-887d-52cfb51514b2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:36.964917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9df35717-ccbd-4046-83e5-b15477f33df2 req-29d09368-f5e3-4161-887d-52cfb51514b2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:36.967360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9df35717-ccbd-4046-83e5-b15477f33df2 req-29d09368-f5e3-4161-887d-52cfb51514b2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.999901 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9df35717-ccbd-4046-83e5-b15477f33df2 req-29d09368-f5e3-4161-887d-52cfb51514b2 service nova] Creating event network-changed:6375de5d-1b52-43f9-bcf0-6126b186e5d6 for instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f on n-h2-855650-5 Nov 02 12:58:37.008478 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9df35717-ccbd-4046-83e5-b15477f33df2 req-29d09368-f5e3-4161-887d-52cfb51514b2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066252 Nov 02 12:58:37.018211 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3021/6104] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:37.073198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:37.074205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:37.092054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.099114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.100511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.101510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.102020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.102473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.351620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:37.361026 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-728d468a-8ebc-4c29-86cc-68cb2b7d0d8c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.292699 Nov 02 12:58:37.377777 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3084/6105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:37 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:37.381019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:37.382001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:37.389478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.390515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.390967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.391866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.392553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.393231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.591478 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e51f7c68-36ad-45eb-85d7-0dd28111a098 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.226259 Nov 02 12:58:37.592803 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3022/6106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:37 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:37.657643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:37.658300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:37.670253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.670985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.672429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.673201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.673671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.674145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.804684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:37.827290 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-add34064-03f6-44c2-ae6f-6a4bb3f29dbb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1202 microversion: 2.1 time: 0.172579 Nov 02 12:58:37.830651 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3085/6107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:37 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:37.852890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:37.854902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:37.868604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.870349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.871447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.873241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.875917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.877515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.029171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:38.038646 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ee9b0ab-59e1-4c31-9bfa-c2ebffe62807 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1300 microversion: 2.1 time: 0.194377 Nov 02 12:58:38.039683 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3023/6108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:37 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1300 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:38.386056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:38.386695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:38.400714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.403348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.404022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.405122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.405909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.406599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.618399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:38.618967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:38.625712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:38.645012 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eca2b2a3-ff7e-4155-a3f9-d70fa8209d53 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.263276 Nov 02 12:58:38.648888 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3086/6109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:38 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:38.662416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.662416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.662416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.662416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.662416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.662416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.844042 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b33e0021-f3d1-43a9-b1e1-06eb5ff21039 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.231488 Nov 02 12:58:38.845944 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3024/6110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:38 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:38.856040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:38.856579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:38.866269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.867050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.867673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.868609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.869251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.869886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.963787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:38.974115 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4fa73a40-56d4-4165-b6dd-c92af54cedd9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1202 microversion: 2.1 time: 0.122317 Nov 02 12:58:38.975175 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3087/6111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:38 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1202 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:39.067559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:39.067559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:39.073455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:39.074080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:39.074546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:39.075505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:39.075983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:39.076484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:39.182240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:39.200665 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4c874a6-18ec-4410-b86d-be9ae8bf7c14 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1306 microversion: 2.1 time: 0.141349 Nov 02 12:58:39.216036 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3025/6112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:39 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:39.677658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:39.678850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:39.693650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:39.694468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:39.695211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:39.700276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:39.701006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:39.701754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:39.869178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:39.869812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:39.885072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:39.886030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:39.886717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:39.887674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:39.888709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:39.889396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:39.953947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:39.957250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:39.967852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dfd08dac-7d7b-4ec3-99b4-7b70fc305322 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.294526 Nov 02 12:58:39.968997 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3088/6113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:39 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:39.999023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:40.000012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:40.010962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:40.011543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:40.012094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:40.012927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:40.013495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:40.013939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:40.132991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:40.146834 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe0af74b-3033-4ed8-b7e5-ead925e34ed7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1202 microversion: 2.1 time: 0.151617 Nov 02 12:58:40.147623 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3089/6114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:39 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:40.211108 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eff9f2ff-42d7-4632-984c-44c344be6ad0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.345948 Nov 02 12:58:40.217133 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3026/6115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:39 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:40.248226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:40.249324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:40.267308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:40.267866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:40.268356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:40.276463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:40.278835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:40.279533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:40.646879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:40.679589 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d17f766-50e7-46a6-9fd3-8b149386d199 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.438004 Nov 02 12:58:40.681948 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3090/6116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:40 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:40.994416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:40.995211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:41.000021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:41.000797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:41.008289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.009132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.009763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.010732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.011396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.012336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.178863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:41.178863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:41.188754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.189247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.189896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.190911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.191555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.192155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.216142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:41.227413 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d3ad56c-5deb-47b9-a57d-0a240b189ff7 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.233730 Nov 02 12:58:41.228990 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3027/6117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:40 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:41.250622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:41.251563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:41.265938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.268586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.270741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.273614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.276661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.277506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.309917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:41.329055 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b28fd7e7-3aad-435a-a797-1202ffb7fad7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1202 microversion: 2.1 time: 0.158445 Nov 02 12:58:41.329632 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3091/6118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:41 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:41.542829 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85dcaa8c-e7a0-4b76-97e8-a39368cb77d0 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.298401 Nov 02 12:58:41.544826 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3028/6119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:41 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:41.670516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-49bfbcca-c96e-4ef9-9a82-7e4b5e1a3dc1 req-6ffb5c51-75fa-4c2c-a0d0-b226a1951692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffc9ccc-7c02-484a-8cdc-87aaba4479bf", "tag": "f86f3706-0e6d-4478-be65-576b9d06b430"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:41.695444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-49bfbcca-c96e-4ef9-9a82-7e4b5e1a3dc1 req-6ffb5c51-75fa-4c2c-a0d0-b226a1951692 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.696223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-49bfbcca-c96e-4ef9-9a82-7e4b5e1a3dc1 req-6ffb5c51-75fa-4c2c-a0d0-b226a1951692 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.699730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-49bfbcca-c96e-4ef9-9a82-7e4b5e1a3dc1 req-6ffb5c51-75fa-4c2c-a0d0-b226a1951692 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.711181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:41.712135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:41.724722 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-49bfbcca-c96e-4ef9-9a82-7e4b5e1a3dc1 req-6ffb5c51-75fa-4c2c-a0d0-b226a1951692 service nova] Creating event network-changed:f86f3706-0e6d-4478-be65-576b9d06b430 for instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf on n-h1-855650-5 Nov 02 12:58:41.725435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.726267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.726909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.727920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.736273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.736862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.756996 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-49bfbcca-c96e-4ef9-9a82-7e4b5e1a3dc1 req-6ffb5c51-75fa-4c2c-a0d0-b226a1951692 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091210 Nov 02 12:58:41.757551 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3092/6120] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:41.997113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:42.011681 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-21a02a04-944c-42cf-97f2-5c141919bce9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.304302 Nov 02 12:58:42.026370 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3029/6121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:41 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:42.274683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:42.275939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:42.313948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.344453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.345284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:42.347307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.347602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.348441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:42.375151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:42.376602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:42.386544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.387700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.389188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:42.391870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.394431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.395929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:42.457683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.458237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.465184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:42.465868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lazy-loading 'fault' on Instance uuid 9addd4f4-648b-49c9-a39c-be40c7f1fb85 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:58:42.598732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:42.616395 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f10bfa90-cb0d-4bf4-8819-a38fa0f836c9 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1207 microversion: 2.1 time: 0.246645 Nov 02 12:58:42.626035 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3030/6122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:42 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1207 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:42.641942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:42.643577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:42.662556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.663522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.664085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:42.664914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.665491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.666250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:42.834387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:42.848871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3f9647b-942f-4056-b787-072f279b7cb3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.580631 Nov 02 12:58:42.852836 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3093/6123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:42 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:43.011330 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0abd9c92-6540-49ee-8d05-9cbd231c3e23 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.382798 Nov 02 12:58:43.012751 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3031/6124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:42 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:43.047713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:43.050872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:43.073814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:43.076575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:43.077825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:43.080867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:43.084525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:43.087694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:43.309222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:43.322675 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bf94ff8b-199e-4745-acb9-729fa89b0600 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.286330 Nov 02 12:58:43.325129 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3094/6125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:43 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:43.667480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:43.668743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:43.689506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:43.694561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:43.695756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:43.698823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:43.700152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:43.702613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:43.806067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:43.807359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:43.809663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:43.812662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lazy-loading 'fault' on Instance uuid 9addd4f4-648b-49c9-a39c-be40c7f1fb85 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:58:43.879956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:43.880607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:43.896733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:43.897309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:43.897759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:43.898657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:43.902836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:43.903769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:43.918223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:43.937027 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99fd69f8-467b-4520-9b51-b966cea4a41b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 200 len: 1161 microversion: 2.1 time: 0.286442 Nov 02 12:58:43.939589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3032/6126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:43 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 1161 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:44.042199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:44.042821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:44.054061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.054718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.055188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.055936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.061708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.062607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.130100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:44.152344 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce39eb64-d8ca-4322-b407-909d7cd8cc0a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.278128 Nov 02 12:58:44.153014 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3095/6127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:43 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:44.295966 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-361d6380-a9c0-47db-9240-467a4984db71 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.257279 Nov 02 12:58:44.297289 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3033/6128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:44 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:44.353945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:44.355701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:44.372267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.372768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.373204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.374298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.375066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.375656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.574936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:44.585640 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c6c85b5-5372-4ea1-9c73-cd870756ec20 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.240973 Nov 02 12:58:44.598785 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3096/6129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:44 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:44.902925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7801c1af-1bc3-4880-908a-cc0aed3e8a5f req-8f1aed1f-9412-4260-a89f-81c41077148b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39262ad3-d6a9-46b4-923c-1e4858b66e8f", "name": "network-vif-plugged", "status": "completed", "tag": "6375de5d-1b52-43f9-bcf0-6126b186e5d6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:44.921921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7801c1af-1bc3-4880-908a-cc0aed3e8a5f req-8f1aed1f-9412-4260-a89f-81c41077148b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.922802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7801c1af-1bc3-4880-908a-cc0aed3e8a5f req-8f1aed1f-9412-4260-a89f-81c41077148b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.923442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7801c1af-1bc3-4880-908a-cc0aed3e8a5f req-8f1aed1f-9412-4260-a89f-81c41077148b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.941379 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7801c1af-1bc3-4880-908a-cc0aed3e8a5f req-8f1aed1f-9412-4260-a89f-81c41077148b service nova] Creating event network-vif-plugged:6375de5d-1b52-43f9-bcf0-6126b186e5d6 for instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f on n-h2-855650-5 Nov 02 12:58:44.949836 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7801c1af-1bc3-4880-908a-cc0aed3e8a5f req-8f1aed1f-9412-4260-a89f-81c41077148b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051302 Nov 02 12:58:44.952658 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3034/6130] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:44.965941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:44.966861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:44.969282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:44.980894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.982838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.984042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.985652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.986823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.989891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.016148 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 HTTP/1.1 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '9addd4f4-648b-49c9-a39c-be40c7f1fb85'} Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:45.036030 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.042809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:45.042809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:45.042809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:45.042809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:45.042809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:45.042809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:45.042809 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.045363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:45.047151 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d08b96b-6111-48c9-a8bc-3944807faa7d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 404 len: 111 microversion: 2.1 time: 0.085508 Nov 02 12:58:45.048245 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3097/6131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:44 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:45.184986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:45.185707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:45.215996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:45.216515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:45.216975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.217708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:45.218212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:45.218650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.333774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:45.338705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:45.393375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:45.396984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:45.397549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.404696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:45.405240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:45.406526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.482639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:45.499061 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f0d70ba9-1ae5-400f-ac1f-1ea1e80143ba tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.321440 Nov 02 12:58:45.503287 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3035/6132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:45 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:45.610565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:45.611618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:45.625300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:45.626141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:45.629031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.631443 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f04ef188-6431-4cd8-8b3c-a8942a0155aa tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.312933 Nov 02 12:58:45.632482 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3098/6133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:45 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:45.632666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:45.633281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:45.633769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.863534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:45.875508 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38bea8a8-7503-4a95-a277-50127329def7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.269733 Nov 02 12:58:45.878693 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3036/6134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:45 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:46.165628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:46.166466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:46.172703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:46.173268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:46.174250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:46.175256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:46.175933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:46.176576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:46.193112 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea HTTP/1.1 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'ad77bf34-a88d-44d9-9b70-091c284ba1ea'} Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:46.195235 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-82e56b56-a688-453f-8d5a-03648d429dcc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 404 len: 111 microversion: 2.1 time: 0.035192 Nov 02 12:58:46.203672 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3099/6135] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:46 2022] DELETE /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:46.210095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:46.210960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: ad77bf34-a88d-44d9-9b70-091c284ba1ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:46.218695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:46.219382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:46.219978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:46.220811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:46.221420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:46.221914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:46.238019 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea HTTP/1.1 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'ad77bf34-a88d-44d9-9b70-091c284ba1ea'} Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:46.239946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.244715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:46.244715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:46.244715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:46.244715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:46.244715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:46.244715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. Nov 02 12:58:46.244715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:46.247191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance ad77bf34-a88d-44d9-9b70-091c284ba1ea could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:46.248336 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30113249-47e1-40e6-bc1b-0883519cfd6d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea" status: 404 len: 111 microversion: 2.1 time: 0.044474 Nov 02 12:58:46.249147 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3037/6136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:46 2022] GET /compute/v2.1/servers/ad77bf34-a88d-44d9-9b70-091c284ba1ea => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:46.536621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:46.537250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:46.543056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:46.553909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:46.555010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:46.556583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:46.558475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:46.559649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:46.560661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:46.660420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:46.662917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:46.687325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:46.688714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:46.690176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:46.691804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:46.693022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:46.695103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:46.713699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:46.806109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=14 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:47.134001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:47.144839 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-deff59a0-1c5e-4a08-97b4-f9ca31c0075a tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.613157 Nov 02 12:58:47.148733 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3100/6137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:46 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:47.175739 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c1089b5-ac9b-4067-a6ed-5a8f80df6943 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1464 microversion: 2.1 time: 0.523253 Nov 02 12:58:47.176863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:47.179756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:47.182799 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3038/6138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:46 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1464 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:47.188408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:47.189986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:47.191454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:47.192460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:47.193168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:47.194472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:47.620595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:47.639710 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dfa506ac-1820-4023-a1dd-c4556696d25a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.487178 Nov 02 12:58:47.640293 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3101/6139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:47 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:47.642917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:47.643541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:47.656139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:47.656742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:47.657240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:47.658317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:47.663579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:47.664406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:47.681688 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 HTTP/1.1 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '9addd4f4-648b-49c9-a39c-be40c7f1fb85'} Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:47.683406 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.688013 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.690483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:47.691573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8bdf8e76-b55e-49d5-88cb-1a2d843fa1c2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 404 len: 111 microversion: 2.1 time: 0.053341 Nov 02 12:58:47.692321 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3039/6140] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:47 2022] DELETE /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:47.703357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:47.704239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 9addd4f4-648b-49c9-a39c-be40c7f1fb85] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:47.712159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:47.712751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:47.713292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:47.714363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:47.715118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:47.717518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:47.742880 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 HTTP/1.1 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '9addd4f4-648b-49c9-a39c-be40c7f1fb85'} Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:47.745667 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.753659 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.753659 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:47.753659 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:47.753659 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:47.753659 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:47.753659 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. Nov 02 12:58:47.753659 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.756546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 9addd4f4-648b-49c9-a39c-be40c7f1fb85 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:47.757764 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ed9b93ee-c646-4b40-a7a7-2e1edd40a512 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85" status: 404 len: 111 microversion: 2.1 time: 0.059663 Nov 02 12:58:47.758876 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3102/6141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:47 2022] GET /compute/v2.1/servers/9addd4f4-648b-49c9-a39c-be40c7f1fb85 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:47.862378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e52bde02-25e5-429e-be89-d51fd4ea9cf7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: .version_select at 0x7f228dcd1310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1952071615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdEB5KsS/owWI//vLx20wbDg8m7qmd1PEHdPOtl3j9CrnCLgSdUkOT2PtJwci/7e/LjG2As0IoSoots2GmnvxWNTdMSAMSgnxooV/p3zlnDZpnmaxBJn5pT0GSS213N5w=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:47.902691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-e52bde02-25e5-429e-be89-d51fd4ea9cf7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for project d3790495df8340788ecc233838a1545d. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:58:47.918243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-e52bde02-25e5-429e-be89-d51fd4ea9cf7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for user 15b6ee9295464444a626601b16db2574 and project d3790495df8340788ecc233838a1545d. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:58:47.939295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:47.958295 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e52bde02-25e5-429e-be89-d51fd4ea9cf7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.100109 Nov 02 12:58:47.965821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3040/6142] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 12:58:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:48.172198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:48.173057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:48.182995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.185169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.185895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.187459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.188282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.189093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.212281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:48.212989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:48.239064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.241860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.243266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.244098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.244616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.245043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.503735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:48.523837 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ec22d1f2-61d2-46d1-87eb-72e61c0cdba3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.355553 Nov 02 12:58:48.524542 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3103/6143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:48 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:48.564632 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1aea2963-3856-4a71-af6a-e6156a23e2fb tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1649 microversion: 2.1 time: 0.356765 Nov 02 12:58:48.586513 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3041/6144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:48 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1649 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:48.596327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:48.598091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:48.607399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.607972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.608513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.609485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.610806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.611350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.663097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:48.663872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:48.672913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.673499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.674018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.674841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.675437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.675895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.894705 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49b9206f-93a9-40f5-9a94-9f47eb4e3848 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1649 microversion: 2.1 time: 0.305419 Nov 02 12:58:48.895524 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3104/6145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:48 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1649 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:48.919292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:48.920498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:48.925191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:48.935764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.935764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.935764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.935764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:48.935764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:48.935764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:48.944620 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-57227a3f-8b7e-452e-a043-5262bdfb15b7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.286457 Nov 02 12:58:48.946157 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3042/6146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:48 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:49.147459 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78d1c8bf-d071-4f4b-a320-3a3cb3f56c62 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1649 microversion: 2.1 time: 0.233650 Nov 02 12:58:49.148797 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3105/6147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:48 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1649 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:49.181424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:49.182434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:49.193224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.194992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.206410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:49.211839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.214154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.214862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:49.279610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:58:49.458963 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b4da61d0-b7c4-421d-952a-ced4326c8b4b tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "DELETE /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 204 len: 0 microversion: 2.1 time: 0.284423 Nov 02 12:58:49.459896 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3043/6148] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:49 2022] DELETE /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:58:49.466545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-726ac2ae-03dd-48b8-a956-1fe87bdb91b0 req-01a9e208-632c-40a1-8ef4-d0479ef7c4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffc9ccc-7c02-484a-8cdc-87aaba4479bf", "name": "network-vif-plugged", "status": "completed", "tag": "f86f3706-0e6d-4478-be65-576b9d06b430"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:49.469446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:49.471199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:49.481830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.483064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.483758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:49.484850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.485569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.486324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:49.499366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-726ac2ae-03dd-48b8-a956-1fe87bdb91b0 req-01a9e208-632c-40a1-8ef4-d0479ef7c4f5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.502629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-726ac2ae-03dd-48b8-a956-1fe87bdb91b0 req-01a9e208-632c-40a1-8ef4-d0479ef7c4f5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.503886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-726ac2ae-03dd-48b8-a956-1fe87bdb91b0 req-01a9e208-632c-40a1-8ef4-d0479ef7c4f5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:49.544207 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-726ac2ae-03dd-48b8-a956-1fe87bdb91b0 req-01a9e208-632c-40a1-8ef4-d0479ef7c4f5 service nova] Creating event network-vif-plugged:f86f3706-0e6d-4478-be65-576b9d06b430 for instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf on n-h1-855650-5 Nov 02 12:58:49.560849 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-726ac2ae-03dd-48b8-a956-1fe87bdb91b0 req-01a9e208-632c-40a1-8ef4-d0479ef7c4f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111619 Nov 02 12:58:49.561596 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3106/6149] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:49.578459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:49.579181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:49.596263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.605286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.605920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:49.606922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.607587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.608266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:49.886413 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb5bcace-c2cc-4a0b-85da-82ce5a616092 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1655 microversion: 2.1 time: 0.421761 Nov 02 12:58:49.899714 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3044/6150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:49 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1655 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:49.914069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:49.924402 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2d808b7-e4d1-4e51-bbb5-c046899d3f3b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.350772 Nov 02 12:58:49.944995 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3107/6151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:49 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:49.972345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:49.973264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:49.981666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.982559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.983306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:49.984229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:49.984890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:49.986082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:50.249038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:50.259290 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d2d029d9-86b0-4f08-8787-687c01791ea5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.294915 Nov 02 12:58:50.260973 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3045/6152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:49 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:50.919363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:50.921308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:50.936729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:50.937767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:50.938630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:50.939917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:50.941335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:50.942149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:50.957106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:50.962884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:50.995228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:50.998476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:50.999301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:51.000764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:51.001747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:51.002441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:51.277875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:51.294494 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91220128-f545-4733-bc66-ecb2aca68a07 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1655 microversion: 2.1 time: 0.383157 Nov 02 12:58:51.297395 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3108/6153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:50 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1655 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:51.305221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:51.307004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:51.332850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:51.333448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:51.334160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:51.335025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:51.335570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:51.336075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:51.553580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:51.569851 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf82aa00-ae67-417c-a5d2-a41eadc59057 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1680 microversion: 2.1 time: 0.622206 Nov 02 12:58:51.571380 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3046/6154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:50 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1680 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:51.644450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:51.655766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-62826e37-bc49-41bb-82be-02e4b82305b9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1374 microversion: 2.1 time: 0.356711 Nov 02 12:58:51.657057 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3109/6155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:51 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1374 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:52.335741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-031508f6-1de4-47e3-ba9e-ac82e1f9138d req-faea25d6-57c5-4a92-a0a7-189c17d5cf41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39262ad3-d6a9-46b4-923c-1e4858b66e8f", "name": "network-vif-deleted", "tag": "6375de5d-1b52-43f9-bcf0-6126b186e5d6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:52.337113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:52.342077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:52.386638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.387252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.387703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.388816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.399970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-031508f6-1de4-47e3-ba9e-ac82e1f9138d req-faea25d6-57c5-4a92-a0a7-189c17d5cf41 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.400806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-031508f6-1de4-47e3-ba9e-ac82e1f9138d req-faea25d6-57c5-4a92-a0a7-189c17d5cf41 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.401487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-031508f6-1de4-47e3-ba9e-ac82e1f9138d req-faea25d6-57c5-4a92-a0a7-189c17d5cf41 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.402588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.403444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.463812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-031508f6-1de4-47e3-ba9e-ac82e1f9138d req-faea25d6-57c5-4a92-a0a7-189c17d5cf41 service nova] Creating event network-vif-deleted:6375de5d-1b52-43f9-bcf0-6126b186e5d6 for instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f on n-h2-855650-5 Nov 02 12:58:52.482551 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-031508f6-1de4-47e3-ba9e-ac82e1f9138d req-faea25d6-57c5-4a92-a0a7-189c17d5cf41 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163966 Nov 02 12:58:52.484094 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3047/6156] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:52.603164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:52.610704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:52.660726 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3a0a2494-0571-482e-9fca-96df72196c27 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 200 len: 1449 microversion: 2.1 time: 0.342684 Nov 02 12:58:52.680057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.683161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.686135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.689630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.690230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.691449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.701663 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3110/6157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:52 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 1449 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:52.729109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:52.729910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:52.746680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.747493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.748694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.750192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.751435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.752088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.988576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:53.005078 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9e8f383-2de0-4da9-8d52-f895c1ed200e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1657 microversion: 2.1 time: 0.411609 Nov 02 12:58:53.006337 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3048/6158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:52 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1657 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:53.038306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c064c405-a7c1-4c5f-96bf-31fc9f31031b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:53.047820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c064c405-a7c1-4c5f-96bf-31fc9f31031b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.052098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c064c405-a7c1-4c5f-96bf-31fc9f31031b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.055471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c064c405-a7c1-4c5f-96bf-31fc9f31031b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.072330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:53.087202 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30264a0a-5d2f-4539-85f5-0b0f2a860d3d tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1546 microversion: 2.1 time: 0.370888 Nov 02 12:58:53.088520 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3111/6159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:52 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1546 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:53.108154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c064c405-a7c1-4c5f-96bf-31fc9f31031b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Going to try to start instance {{(pid=120722) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:58:53.114009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:53.118184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:53.126548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.127432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.128204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.129135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.129777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.130414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.194258 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c064c405-a7c1-4c5f-96bf-31fc9f31031b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.157745 Nov 02 12:58:53.195355 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3049/6160] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:58:53 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:58:53.211803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:53.216666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:53.240156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.241752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.246033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.256914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.257601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.258125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.404751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:53.428261 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6283535e-f053-4c84-8a53-ce49648277e5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1546 microversion: 2.1 time: 0.319195 Nov 02 12:58:53.428886 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3112/6161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:53 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1546 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:53.724861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:53.726412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: 39262ad3-d6a9-46b4-923c-1e4858b66e8f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:53.751811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.753206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.753930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.754873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.755698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.756139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.768088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:53.778585 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec05e3eb-e123-4fca-890e-e0a0d175760d tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1666 microversion: 2.1 time: 0.575341 Nov 02 12:58:53.781835 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3050/6162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:53 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1666 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:53.801464 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] HTTP exception thrown: Instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f could not be found. Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Request method failure captured: Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f HTTP/1.1 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmlUMjOcsyRyjNW_qPvQtJx4ehM9R8hpI3dKTIOLVk09xJ2OnOH-Vw9hjlXQrcmRqwoM6khBgVZ1M4dRuy8Tchc0P6taJQ-Kqnjup1M-5ChLni3tOjjaodGwvAFKlmt8SYgo7r9dIn-aOsMMCbGKh4B0YQOVGKL21n_vD2mj5IXp-v8 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 52cc6f9de3b04d71925357bb39e8d0a9 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestServerMultinode-1081547761 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader,admin Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader,admin Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/52cc6f9de3b04d71925357bb39e8d0a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/52cc6f9de3b04d71925357bb39e8d0a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/52cc6f9de3b04d71925357bb39e8d0a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_52cc6f9de3b04d71925357bb39e8d0a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestServerMultinode-1081547761 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 52cc6f9de3b04d71925357bb39e8d0a9 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestServerMultinode-1081547761 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestServerMultinode-1081547761-project-admin Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 96bb109aeef845dc98155430809a42a0 Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestServerMultinode-1081547761-project-admin Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f could not be found. Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '39262ad3-d6a9-46b4-923c-1e4858b66e8f'} Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f could not be found. Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f could not be found. Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:53.811916 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:53.818325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:53.818325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:53.818325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:53.818325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:53.818325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:53.818325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f could not be found. Nov 02 12:58:53.818325 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:58:53.818325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Returning 404 to user: Instance 39262ad3-d6a9-46b4-923c-1e4858b66e8f could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:53.820981 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dc6ad544-fbd0-4f71-8e91-ef796939a2ce tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f" status: 404 len: 111 microversion: 2.1 time: 0.100749 Nov 02 12:58:53.823463 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3113/6163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:53 2022] GET /compute/v2.1/servers/39262ad3-d6a9-46b4-923c-1e4858b66e8f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:58:53.843513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:53.844215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:53.854734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.856127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.858148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.860062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.862088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.866565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.930743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:58:54.114177 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c547f330-adb0-486c-acd5-d4e43db8679a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "DELETE /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 204 len: 0 microversion: 2.1 time: 0.282764 Nov 02 12:58:54.117925 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3051/6164] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:53 2022] DELETE /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:58:54.134137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:54.135542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:54.146072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:54.147476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:54.148316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:54.150158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:54.151062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:54.151747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:54.465839 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-440b932f-539c-407d-8bcb-88c9c0ffd12e tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1655 microversion: 2.1 time: 0.341143 Nov 02 12:58:54.467386 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3114/6165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:54 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1655 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:54.811408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:54.812141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:54.831138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:54.831704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:54.833841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:54.834605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:54.835110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:54.840914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:55.508422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:55.512933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:55.535585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:55.537555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:55.538226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:55.540368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:55.542353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:55.544374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:55.951932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:55.957002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:55.989882 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5efe4eac-3b3a-46f3-bd20-56a206a03329 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1666 microversion: 2.1 time: 1.185505 Nov 02 12:58:56.003313 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3052/6166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:54 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1666 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:56.082486 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cedf086e-efdf-45dc-a0b6-cda3cf60355a tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1655 microversion: 2.1 time: 0.589948 Nov 02 12:58:56.099639 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3115/6167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:55 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1655 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:56.868221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-38aa0edd-8665-4550-b6e2-12aee8b26525 req-a771766a-1bb4-43a4-8c1b-0f6c3b606341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "badca2c1-0010-45f4-8b5d-ef5e45f91f2c", "name": "network-vif-deleted", "tag": "3cff016f-a041-4303-ae87-efe1ccab1820"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:56.917460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-38aa0edd-8665-4550-b6e2-12aee8b26525 req-a771766a-1bb4-43a4-8c1b-0f6c3b606341 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:56.918816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-38aa0edd-8665-4550-b6e2-12aee8b26525 req-a771766a-1bb4-43a4-8c1b-0f6c3b606341 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:56.920700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-38aa0edd-8665-4550-b6e2-12aee8b26525 req-a771766a-1bb4-43a4-8c1b-0f6c3b606341 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:56.953854 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-38aa0edd-8665-4550-b6e2-12aee8b26525 req-a771766a-1bb4-43a4-8c1b-0f6c3b606341 service nova] Creating event network-vif-deleted:3cff016f-a041-4303-ae87-efe1ccab1820 for instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c on n-h1-855650-5 Nov 02 12:58:56.974738 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-38aa0edd-8665-4550-b6e2-12aee8b26525 req-a771766a-1bb4-43a4-8c1b-0f6c3b606341 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110153 Nov 02 12:58:56.975836 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3053/6168] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:57.029813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:57.040311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:57.056561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.057072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.058334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.059728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.061193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.062080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.126717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:57.128825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:57.145917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.146278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.149229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.152085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.154810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.157036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.220986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.222801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.224274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.225390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lazy-loading 'fault' on Instance uuid badca2c1-0010-45f4-8b5d-ef5e45f91f2c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:58:57.394259 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89d4c286-5735-4ffa-a3f3-08f7aed6cf88 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 200 len: 1454 microversion: 2.1 time: 0.272626 Nov 02 12:58:57.410868 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3054/6169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:57 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 1454 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:57.533443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:57.549248 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-079e829c-8826-440f-b8c7-0cfe080211d2 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.524102 Nov 02 12:58:57.552018 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3116/6170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:57 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:57.582491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:57.586388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:57.600449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.602495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.603604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.604947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.605862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.606545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.791433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5615b406-2f21-46fc-8858-fc6255f0d2aa req-22756eb7-648b-40d5-b270-4daa6dd0ab50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffc9ccc-7c02-484a-8cdc-87aaba4479bf", "tag": "f86f3706-0e6d-4478-be65-576b9d06b430"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:57.819993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5615b406-2f21-46fc-8858-fc6255f0d2aa req-22756eb7-648b-40d5-b270-4daa6dd0ab50 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.825567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5615b406-2f21-46fc-8858-fc6255f0d2aa req-22756eb7-648b-40d5-b270-4daa6dd0ab50 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.826262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5615b406-2f21-46fc-8858-fc6255f0d2aa req-22756eb7-648b-40d5-b270-4daa6dd0ab50 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.857256 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5615b406-2f21-46fc-8858-fc6255f0d2aa req-22756eb7-648b-40d5-b270-4daa6dd0ab50 service nova] Creating event network-changed:f86f3706-0e6d-4478-be65-576b9d06b430 for instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf on n-h1-855650-5 Nov 02 12:58:57.868901 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5615b406-2f21-46fc-8858-fc6255f0d2aa req-22756eb7-648b-40d5-b270-4daa6dd0ab50 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081752 Nov 02 12:58:57.870805 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3117/6171] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:57.935840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:57.975825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:57.990067 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-244efb65-a072-497e-8e23-717c8d012eb0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.416076 Nov 02 12:58:57.990695 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3055/6172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:57 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:58.029162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:58.030061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:58.063744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:58.069820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:58.070469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:58.071265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:58.071754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:58.073734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:58.425743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:58.426482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] [instance: badca2c1-0010-45f4-8b5d-ef5e45f91f2c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:58.440975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:58.442354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:58.444818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:58.447038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:58.449507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:58.450454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:58.493248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] HTTP exception thrown: Instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c could not be found. Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Request method failure captured: Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c HTTP/1.1 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmlUMjOcsyRyjNW_qPvQtJx4ehM9R8hpI3dKTIOLVk09xJ2OnOH-Vw9hjlXQrcmRqwoM6khBgVZ1M4dRuy8Tchc0P6taJQ-Kqnjup1M-5ChLni3tOjjaodGwvAFKlmt8SYgo7r9dIn-aOsMMCbGKh4B0YQOVGKL21n_vD2mj5IXp-v8 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 52cc6f9de3b04d71925357bb39e8d0a9 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestServerMultinode-1081547761 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/52cc6f9de3b04d71925357bb39e8d0a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/52cc6f9de3b04d71925357bb39e8d0a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/52cc6f9de3b04d71925357bb39e8d0a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_52cc6f9de3b04d71925357bb39e8d0a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestServerMultinode-1081547761 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 52cc6f9de3b04d71925357bb39e8d0a9 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestServerMultinode-1081547761 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestServerMultinode-1081547761-project-admin Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 96bb109aeef845dc98155430809a42a0 Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestServerMultinode-1081547761-project-admin Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c could not be found. Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'badca2c1-0010-45f4-8b5d-ef5e45f91f2c'} Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c could not be found. Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c could not be found. Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:58.501468 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:58.507715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:58.507715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:58.507715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:58.507715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:58.507715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:58.507715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c could not be found. Nov 02 12:58:58.507715 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:58:58.511792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] Returning 404 to user: Instance badca2c1-0010-45f4-8b5d-ef5e45f91f2c could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:58.513084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04952eca-f130-4612-b52a-6a64383eda46 tempest-TestServerMultinode-1081547761 tempest-TestServerMultinode-1081547761-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c" status: 404 len: 111 microversion: 2.1 time: 0.092067 Nov 02 12:58:58.519105 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3056/6173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:58 2022] GET /compute/v2.1/servers/badca2c1-0010-45f4-8b5d-ef5e45f91f2c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:58.526748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:58.537835 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6852814-3ffc-40e9-8ba8-ca017c6b68f3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.513636 Nov 02 12:58:58.538468 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3118/6174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:58 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:58.591168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:58.591851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:58.608245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:58.611906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:58.613761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:58.615767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:58.618926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:58.620453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.014906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:59.038538 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f42f57f2-125f-45c0-a940-0fa24860598b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.454818 Nov 02 12:58:59.062905 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3057/6175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:58 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:59.070686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:59.071210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:59.085662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.086864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.086864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.087429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.088302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.088302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.470202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:59.489109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98c7d22a-097b-4298-bf06-fd3c65e3d7b8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.423892 Nov 02 12:58:59.490956 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3119/6176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:59 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:59.537454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:59.550535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:59.561869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.575290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.576516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.578208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.579531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.582112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.600167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:59.603244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:59.621862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.623957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.625735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.626987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.630189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.631732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.703304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lazy-loading 'flavor' on Instance uuid 248aeed7-1bf5-458f-91f2-0ba79e600a16 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:58:59.761944 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-56f3bb25-ed0e-4530-b914-c9fb0999427c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action" status: 200 len: 24565 microversion: 2.1 time: 0.166395 Nov 02 12:58:59.763640 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3120/6177] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:58:59 2022] POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action => generated 24565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:58:59.947644 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dcc15616-3268-4770-921e-9452e50937c3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.418795 Nov 02 12:58:59.955228 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3058/6178] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:58:59 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:58:59.966273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:59.967302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:59.991871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.994739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.997106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.998345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:00.000420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:00.002203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:00.647333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:00.663766 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65545c8b-3afe-4786-8389-3da13819fb2b tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1678 microversion: 2.1 time: 0.707785 Nov 02 12:59:00.667693 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3121/6179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:59 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1678 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:01.721003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:01.735298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:01.763251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:01.764858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:01.765700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:01.767310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:01.768982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:01.770141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:02.629745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:02.644861 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-06d63017-8495-4fb1-b624-e96a8f53082c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1661 microversion: 2.1 time: 0.934750 Nov 02 12:59:02.649212 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3059/6180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:01 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1661 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:02.707105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:02.708187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:02.731015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:02.732399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:02.733486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:02.735581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:02.736746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:02.737668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:02.926133 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c057d9f9-df68-4ba9-b6d7-3b213d1fb19c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action" status: 202 len: 0 microversion: 2.1 time: 0.233107 Nov 02 12:59:02.938059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:02.939460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:02.945907 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3122/6181] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:59:02 2022] POST /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:59:02.949686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:02.950498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:02.951137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:02.952543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:02.953500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:02.954209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:03.579012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:03.593064 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-45f52d7f-df92-4708-8395-0b211d2919ef tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1667 microversion: 2.1 time: 0.660016 Nov 02 12:59:03.596830 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3060/6182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:02 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1667 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:03.959710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:03.965549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:04.001162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:04.023545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:04.024754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:04.027001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:04.034211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:04.036781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:04.135728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-14227ccf-fba8-4a3e-b138-9bd756dffc25 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/ips" status: 200 len: 145 microversion: 2.1 time: 0.185322 Nov 02 12:59:04.146788 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3123/6183] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 12:59:03 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/ips => generated 145 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:04.648355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:04.653238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:04.679878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:04.685493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:04.690311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:04.695438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:04.698254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:04.701283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:05.101564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:05.123625 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c6f3081-fc3b-4fe1-bf81-c95348c1cc9e tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1667 microversion: 2.1 time: 0.504897 Nov 02 12:59:05.128063 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3061/6184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:04 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1667 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:06.161889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:06.163074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:06.196467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:06.199937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:06.203352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:06.206677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:06.207943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:06.209036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:06.761935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:06.772723 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-43bb9158-9536-439a-947a-b3475f063366 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.621120 Nov 02 12:59:06.773935 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3124/6185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:06 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:06.798620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:06.800230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:06.814274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:06.816507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:06.817945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:06.820169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:06.824174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:06.825008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:07.270237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:07.299084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a0738ce-b6f1-476c-8a1a-fe10df80b876 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1670 microversion: 2.1 time: 0.504845 Nov 02 12:59:07.301001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3062/6186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:06 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1670 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:07.352313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:07.356160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:07.377706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:07.378404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:07.378864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:07.379637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:07.380897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:07.381354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:07.393788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7615fcd9-25d7-4615-b495-88768028c0d2"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:07.396317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:07.402872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:07.403571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:07.404038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:07.405049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:07.405705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:07.407233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:07.432254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:59:07.445424 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.compute.api [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Working on deleting snapshot e952b71c-5a0f-4ab3-b890-ee17a98cad1b from shelved instance... Nov 02 12:59:08.000651 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30da44ff-d73a-47d2-93b9-1cfada59067b tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613582 Nov 02 12:59:08.010038 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3063/6187] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:59:07 2022] POST /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:59:09.607240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:09.674127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Doing local delete in cell 65f1d099-06e8-4a99-9e09-ba8e4a1a8185(cell1) {{(pid=120723) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 12:59:09.677531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:09.678346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:09.678800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:09.679676 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.compute.api [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 12:59:09.684053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] deallocate_for_instance() {{(pid=120723) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 12:59:10.929056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Updating instance_info_cache with network_info: [] {{(pid=120723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:59:10.949092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f45564fb-7d18-466c-83c1-865af1e3f0c4 req-5b1bce1c-1107-4ca8-9c74-f175fa5efea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82257d09-9947-424b-b651-25b882181bb1", "name": "network-vif-deleted", "tag": "2377dc63-8d42-4225-8a2e-f89bd9551dc1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:10.984006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f45564fb-7d18-466c-83c1-865af1e3f0c4 req-5b1bce1c-1107-4ca8-9c74-f175fa5efea8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:10.988321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f45564fb-7d18-466c-83c1-865af1e3f0c4 req-5b1bce1c-1107-4ca8-9c74-f175fa5efea8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:10.989756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f45564fb-7d18-466c-83c1-865af1e3f0c4 req-5b1bce1c-1107-4ca8-9c74-f175fa5efea8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:11.034480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.server_external_events [req-f45564fb-7d18-466c-83c1-865af1e3f0c4 req-5b1bce1c-1107-4ca8-9c74-f175fa5efea8 service nova] Unable to find a host for instance 82257d09-9947-424b-b651-25b882181bb1. Dropping event network-vif-deleted {{(pid=120722) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:59:11.038010 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f45564fb-7d18-466c-83c1-865af1e3f0c4 req-5b1bce1c-1107-4ca8-9c74-f175fa5efea8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.100716 Nov 02 12:59:11.041281 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3064/6188] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 107 msecs (HTTP/1.1 207) 9 headers in 367 bytes (3 switches on core 0) Nov 02 12:59:12.112679 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8e380c74-d3d5-4014-b3ea-5003165bea04 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 204 len: 0 microversion: 2.1 time: 4.787872 Nov 02 12:59:12.113299 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3125/6189] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:59:07 2022] DELETE /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 0 bytes in 4790 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:59:12.127988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:12.128875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 82257d09-9947-424b-b651-25b882181bb1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:12.141978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:12.146597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:12.149045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:12.150101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:12.153921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:12.154807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:12.197255 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] HTTP exception thrown: Instance 82257d09-9947-424b-b651-25b882181bb1 could not be found. Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Request method failure captured: Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 HTTP/1.1 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmbwqPdXAjwHRx2HHyO7P8SY40490kvF4jFGHmSsdCX8AyHr6MK24NXoU0Q_GjisdO8__QjnB2uaKPS64a69dQH2TLAACEqwIuJcwP-nbzwIULG_KxQ8xPT3aO33oDoq-XRlvI7I9BSIHcf41UbofEWpgX_XPonCaY5LR_RfPkxAh_Q Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 856c99b2530442b9bfb9d795a2d1d079 Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 82257d09-9947-424b-b651-25b882181bb1 could not be found. Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '82257d09-9947-424b-b651-25b882181bb1'} Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82257d09-9947-424b-b651-25b882181bb1 could not be found. Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82257d09-9947-424b-b651-25b882181bb1 could not be found. Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:12.208794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82257d09-9947-424b-b651-25b882181bb1 could not be found. Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Returning 404 to user: Instance 82257d09-9947-424b-b651-25b882181bb1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:12.215312 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6beb5e95-e21c-4103-a9c8-295672da40cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1" status: 404 len: 111 microversion: 2.1 time: 0.095287 Nov 02 12:59:12.223238 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3065/6190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:12 2022] GET /compute/v2.1/servers/82257d09-9947-424b-b651-25b882181bb1 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:12.226405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:12.226973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:12.262348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:12.262603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:12.275478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:12.276595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:12.277253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:12.277809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:12.373143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:59:12.723683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ae011314-a518-4482-9115-f7cc2c814fe1 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 204 len: 0 microversion: 2.1 time: 0.502558 Nov 02 12:59:12.724294 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3126/6191] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:59:12 2022] DELETE /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:59:12.745058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:12.746217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:12.758787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:12.759729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:12.760656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:12.761847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:12.762672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:12.763401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:12.964737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:12.994757 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d565120-aa3f-4dc4-8785-66427911307c tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1467 microversion: 2.1 time: 0.244755 Nov 02 12:59:12.995745 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3066/6192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:12 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1467 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:14.032111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:14.032959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:14.051258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:14.054252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:14.056926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:14.058591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:14.061430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:14.062206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:14.348928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:14.371288 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5cf53bc8-dd10-493f-92b2-16e42a154279 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1467 microversion: 2.1 time: 0.345556 Nov 02 12:59:14.374597 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3127/6193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:14 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1467 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:15.402405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:15.403041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:15.415609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:15.416125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:15.416582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:15.417403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:15.418002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:15.426505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:15.634366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:15.648776 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-967272a9-9fd8-4b5b-8998-c0a54806a0cd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1467 microversion: 2.1 time: 0.247365 Nov 02 12:59:15.649412 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3067/6194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:15 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1467 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:16.426082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-57b5ac77-bfe4-4168-be4c-c30acf51c8ba req-8afd5d38-60b9-4089-985d-cd0b3026bc42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1daa9d64-e336-489e-aeda-cee2a1a03d8c", "name": "network-vif-deleted", "tag": "826bcce9-e6d1-407a-932f-a6a49c1c389a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:16.449293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:16.452842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-57b5ac77-bfe4-4168-be4c-c30acf51c8ba req-8afd5d38-60b9-4089-985d-cd0b3026bc42 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:16.455201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-57b5ac77-bfe4-4168-be4c-c30acf51c8ba req-8afd5d38-60b9-4089-985d-cd0b3026bc42 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:16.455859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-57b5ac77-bfe4-4168-be4c-c30acf51c8ba req-8afd5d38-60b9-4089-985d-cd0b3026bc42 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:16.500676 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-57b5ac77-bfe4-4168-be4c-c30acf51c8ba req-8afd5d38-60b9-4089-985d-cd0b3026bc42 service nova] Creating event network-vif-deleted:826bcce9-e6d1-407a-932f-a6a49c1c389a for instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c on n-h2-855650-5 Nov 02 12:59:16.508919 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-57b5ac77-bfe4-4168-be4c-c30acf51c8ba req-8afd5d38-60b9-4089-985d-cd0b3026bc42 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090217 Nov 02 12:59:16.513135 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3128/6195] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:16.673280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:16.675438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:16.689479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:16.690388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:16.691577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:16.693706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:16.695397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:16.696369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:16.783615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:16.786551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:16.787229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:16.788284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lazy-loading 'fault' on Instance uuid 1daa9d64-e336-489e-aeda-cee2a1a03d8c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:59:16.800542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:17.524409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:17.534843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-628fa7d8-7280-4634-aee3-d5eeca9681f8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 200 len: 1305 microversion: 2.1 time: 0.865815 Nov 02 12:59:17.536340 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3068/6196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:16 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 1305 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:18.572456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:18.573755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 1daa9d64-e336-489e-aeda-cee2a1a03d8c] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:18.622641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:18.624468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:18.629285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:18.631187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:18.631998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:18.632751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:18.688946 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] HTTP exception thrown: Instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c could not be found. Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Request method failure captured: Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c HTTP/1.1 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmbwqPdXAjwHRx2HHyO7P8SY40490kvF4jFGHmSsdCX8AyHr6MK24NXoU0Q_GjisdO8__QjnB2uaKPS64a69dQH2TLAACEqwIuJcwP-nbzwIULG_KxQ8xPT3aO33oDoq-XRlvI7I9BSIHcf41UbofEWpgX_XPonCaY5LR_RfPkxAh_Q Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 856c99b2530442b9bfb9d795a2d1d079 Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c could not be found. Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1daa9d64-e336-489e-aeda-cee2a1a03d8c'} Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c could not be found. Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c could not be found. Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:18.695630 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c could not be found. Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Returning 404 to user: Instance 1daa9d64-e336-489e-aeda-cee2a1a03d8c could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:18.704053 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b8b7a9f-9ef0-45d8-ac23-206b0da3c1d0 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c" status: 404 len: 111 microversion: 2.1 time: 0.138158 Nov 02 12:59:18.715166 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3129/6197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:18 2022] GET /compute/v2.1/servers/1daa9d64-e336-489e-aeda-cee2a1a03d8c => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:18.722571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:18.723501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:18.732884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:18.751627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:18.753033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:18.753841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:18.762767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:18.763919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:18.764520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:18.807572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:59:18.975299 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f7a7054-1b6d-46fa-bae1-e526feed1b61 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 204 len: 0 microversion: 2.1 time: 0.258620 Nov 02 12:59:18.978819 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3069/6198] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:59:18 2022] DELETE /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:59:18.988185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:18.988832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:18.996693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:18.997760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:18.998598 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:18.999696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:19.000423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:19.001139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:19.375662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:19.386540 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2f8a3c0d-ad64-43ed-8d03-03eb5c9d4539 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1509 microversion: 2.1 time: 0.403146 Nov 02 12:59:19.399037 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3130/6199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:18 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:20.426427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:20.427162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:20.437355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:20.438694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:20.440544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:20.441355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:20.441950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:20.442751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:20.685617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:20.698513 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f09fb57d-10ff-47b8-8bcb-81aff0d95f5f tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 200 len: 1509 microversion: 2.1 time: 0.277817 Nov 02 12:59:20.699418 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3070/6200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:20 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:20.775736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-907c6749-1b97-4570-ba7c-2823e32aec84 req-8969b740-af88-44c0-a59d-da9679e9ea36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b52bde3-d835-41b1-99e2-70b6c90800cc", "name": "network-vif-deleted", "tag": "e4c7b6eb-1916-42fa-b70a-d00f038ebca8"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:20.801525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-907c6749-1b97-4570-ba7c-2823e32aec84 req-8969b740-af88-44c0-a59d-da9679e9ea36 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:20.802106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-907c6749-1b97-4570-ba7c-2823e32aec84 req-8969b740-af88-44c0-a59d-da9679e9ea36 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:20.802784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-907c6749-1b97-4570-ba7c-2823e32aec84 req-8969b740-af88-44c0-a59d-da9679e9ea36 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:20.816311 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-907c6749-1b97-4570-ba7c-2823e32aec84 req-8969b740-af88-44c0-a59d-da9679e9ea36 service nova] Creating event network-vif-deleted:e4c7b6eb-1916-42fa-b70a-d00f038ebca8 for instance 2b52bde3-d835-41b1-99e2-70b6c90800cc on n-h1-855650-5 Nov 02 12:59:20.822525 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-907c6749-1b97-4570-ba7c-2823e32aec84 req-8969b740-af88-44c0-a59d-da9679e9ea36 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056276 Nov 02 12:59:20.823902 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3131/6201] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:21.724451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:21.725912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 2b52bde3-d835-41b1-99e2-70b6c90800cc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:21.735792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:21.736942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:21.737666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:21.738681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:21.739407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:21.740087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:21.755791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] HTTP exception thrown: Instance 2b52bde3-d835-41b1-99e2-70b6c90800cc could not be found. Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Request method failure captured: Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc HTTP/1.1 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmbwqPdXAjwHRx2HHyO7P8SY40490kvF4jFGHmSsdCX8AyHr6MK24NXoU0Q_GjisdO8__QjnB2uaKPS64a69dQH2TLAACEqwIuJcwP-nbzwIULG_KxQ8xPT3aO33oDoq-XRlvI7I9BSIHcf41UbofEWpgX_XPonCaY5LR_RfPkxAh_Q Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 856c99b2530442b9bfb9d795a2d1d079 Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 2b52bde3-d835-41b1-99e2-70b6c90800cc could not be found. Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2b52bde3-d835-41b1-99e2-70b6c90800cc'} Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b52bde3-d835-41b1-99e2-70b6c90800cc could not be found. Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b52bde3-d835-41b1-99e2-70b6c90800cc could not be found. Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:21.757805 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:21.762711 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:21.762711 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:21.762711 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:21.762711 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:21.762711 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:21.762711 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b52bde3-d835-41b1-99e2-70b6c90800cc could not be found. Nov 02 12:59:21.762711 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:21.765420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Returning 404 to user: Instance 2b52bde3-d835-41b1-99e2-70b6c90800cc could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:21.766652 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab41d804-75e5-49f0-b974-50126a801512 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc" status: 404 len: 111 microversion: 2.1 time: 0.046794 Nov 02 12:59:21.768378 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3071/6202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:21 2022] GET /compute/v2.1/servers/2b52bde3-d835-41b1-99e2-70b6c90800cc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:21.777188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:21.778526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:21.786730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:21.791850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:21.791850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:21.791850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:21.791850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:21.791850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:21.854098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:59:21.980567 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5c35976-03f6-4105-b2f0-b78d222c1ebd tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 204 len: 0 microversion: 2.1 time: 0.207589 Nov 02 12:59:21.986154 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3132/6203] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:59:21 2022] DELETE /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:59:21.994047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:21.994969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:22.005073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:22.005664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:22.006227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:22.007498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:22.008641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:22.009216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:22.263262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:22.276170 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7419de82-85c1-4a09-9749-e7367eed7207 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1494 microversion: 2.1 time: 0.289363 Nov 02 12:59:22.277469 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3072/6204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:21 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1494 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:23.305216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-06f03eaf-f084-44b4-81e6-21561b21182b req-83b229f8-766d-40ca-87eb-6bef387ce2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb39c862-0ce7-4225-94d8-b0c0769c67d8", "name": "network-vif-deleted", "tag": "0d126042-0f5d-4895-9144-cfede503f910"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:23.311789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:23.314725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:23.342438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:23.344184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:23.344653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:23.348884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:23.349582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-06f03eaf-f084-44b4-81e6-21561b21182b req-83b229f8-766d-40ca-87eb-6bef387ce2bd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:23.349896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:23.350371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:23.350783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-06f03eaf-f084-44b4-81e6-21561b21182b req-83b229f8-766d-40ca-87eb-6bef387ce2bd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:23.351786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-06f03eaf-f084-44b4-81e6-21561b21182b req-83b229f8-766d-40ca-87eb-6bef387ce2bd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:23.392423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-06f03eaf-f084-44b4-81e6-21561b21182b req-83b229f8-766d-40ca-87eb-6bef387ce2bd service nova] Creating event network-vif-deleted:0d126042-0f5d-4895-9144-cfede503f910 for instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 on n-h1-855650-5 Nov 02 12:59:23.420838 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-06f03eaf-f084-44b4-81e6-21561b21182b req-83b229f8-766d-40ca-87eb-6bef387ce2bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121522 Nov 02 12:59:23.422142 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3073/6205] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:23.806466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:23.816137 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b285eb7b-a702-4a15-9c11-853c63c59ec8 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 200 len: 1452 microversion: 2.1 time: 0.518618 Nov 02 12:59:23.824917 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3133/6206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:23 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 1452 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:24.842975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:24.844587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: fb39c862-0ce7-4225-94d8-b0c0769c67d8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:24.854854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:24.855663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:24.856372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:24.857390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:24.858027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:24.858423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:24.876959 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] HTTP exception thrown: Instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 could not be found. Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Request method failure captured: Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 HTTP/1.1 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmbwqPdXAjwHRx2HHyO7P8SY40490kvF4jFGHmSsdCX8AyHr6MK24NXoU0Q_GjisdO8__QjnB2uaKPS64a69dQH2TLAACEqwIuJcwP-nbzwIULG_KxQ8xPT3aO33oDoq-XRlvI7I9BSIHcf41UbofEWpgX_XPonCaY5LR_RfPkxAh_Q Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 856c99b2530442b9bfb9d795a2d1d079 Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 could not be found. Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'fb39c862-0ce7-4225-94d8-b0c0769c67d8'} Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 could not be found. Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 could not be found. Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:24.878659 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:24.885293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:24.885293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:24.885293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:24.885293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:24.885293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:24.885293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 could not be found. Nov 02 12:59:24.885293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 12:59:24.887469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Returning 404 to user: Instance fb39c862-0ce7-4225-94d8-b0c0769c67d8 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:24.889957 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8cfc7033-3d4c-41f8-9e8a-64c2a3c3cff3 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8" status: 404 len: 111 microversion: 2.1 time: 0.050938 Nov 02 12:59:24.894193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3074/6207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:24 2022] GET /compute/v2.1/servers/fb39c862-0ce7-4225-94d8-b0c0769c67d8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:24.899785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:24.900316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:24.909354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:24.909859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:24.910953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:24.912231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:24.912961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:24.913612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:24.945745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:59:24.977552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:25.037218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-46356741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1952071615", "security_groups": [{"name": "tempest-secgroup-smoke-151727032"}], "block_device_mapping_v2": [{"uuid": "2a07fb36-f40d-46f3-a86b-454bf45914fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c2de958-5bb8-43d5-9f50-0267f3814230"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:25.065555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a577d648-0ae8-4332-83de-25f8d1040908 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "DELETE /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 204 len: 0 microversion: 2.1 time: 0.169770 Nov 02 12:59:25.067810 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3134/6208] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 12:59:24 2022] DELETE /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:59:25.080507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:25.081882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:25.091467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:25.092174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:25.093160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:25.093999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:25.096057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:25.096898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:25.229825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] validate_networks() for [('5c2de958-5bb8-43d5-9f50-0267f3814230', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:59:25.426499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:25.437554 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b570e1a8-3d56-48a2-9c31-93cfff465a28 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1676 microversion: 2.1 time: 0.365341 Nov 02 12:59:25.439300 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3135/6209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:25 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1676 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:25.445739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:25.449992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:25.459156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:25.459899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:25.460427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:25.461253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:25.461883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:25.462348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:25.500294 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0252ecef-a597-4787-a956-c96b35b3a489 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059172 Nov 02 12:59:25.509170 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3136/6210] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:59:25 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:25.519368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:25.520039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:25.532370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:25.532905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:25.533353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:25.534153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:25.535057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:25.535503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:25.576379 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3b9a9352-b29c-49b1-b90b-d19c8481ce30 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/7615fcd9-25d7-4615-b495-88768028c0d2" status: 200 len: 194 microversion: 2.1 time: 0.065792 Nov 02 12:59:25.576906 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3137/6211] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Nov 2 12:59:25 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/7615fcd9-25d7-4615-b495-88768028c0d2 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:25.858974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:59:25.860018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:59:25.861471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:59:25.862130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:59:25.862669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:59:25.882009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:25.882788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:25.883503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:25.884891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:25.885989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:25.886709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:25.914765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:59:25.920846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for user 15b6ee9295464444a626601b16db2574 and project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:59:25.999207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:59:26.002308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a07fb36-f40d-46f3-a86b-454bf45914fe',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:59:26.286163 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c0e6a4b0-085c-4328-9cea-6942cea85dcb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.259494 Nov 02 12:59:26.287296 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3075/6212] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:59:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:59:26.317042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b19a10a-dc5d-4290-89c8-89a01c51f1cb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:26.317042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b19a10a-dc5d-4290-89c8-89a01c51f1cb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:26.400232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b19a10a-dc5d-4290-89c8-89a01c51f1cb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:26.414696 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b19a10a-dc5d-4290-89c8-89a01c51f1cb tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1093 microversion: 2.1 time: 0.110868 Nov 02 12:59:26.435867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3138/6213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:26 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1093 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:26.462864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:26.463614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:26.476034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:26.478063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:26.481430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:26.484550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:26.484550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:26.487065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:26.719130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:26.728668 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2fa4fba4-6452-4f12-b8bd-88047e96e418 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1676 microversion: 2.1 time: 0.270497 Nov 02 12:59:26.729262 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3076/6214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:26 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1676 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:27.441603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:27.445050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:27.465397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:27.465755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:27.466231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:27.471419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:27.472024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:27.472477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:27.639873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:27.652469 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d4a8db6-76d2-4f2d-a240-a948c6c5ab5d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1191 microversion: 2.1 time: 0.215104 Nov 02 12:59:27.656513 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3139/6215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:27 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1191 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:27.757033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:27.757649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:27.769784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:27.770319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:27.771059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:27.771990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:27.772504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:27.772944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:27.835600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:27.840264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:27.849811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:27.851518 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:27.852300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:27.853813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:27.854591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:27.855857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:27.894864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:27.904731 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9638f85-4e0f-42a5-b299-17543f30dd86 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1609 microversion: 2.1 time: 0.153361 Nov 02 12:59:27.905905 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3077/6216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:27 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1609 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:27.943452 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa97b0f1-cf67-40bb-a868-31ca46489f83 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf/action" status: 200 len: 24575 microversion: 2.1 time: 0.114870 Nov 02 12:59:27.944396 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3140/6217] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:59:27 2022] POST /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf/action => generated 24575 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:59:28.071744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-765846da-dbaa-440c-a3bf-348aaddb00ab req-3d38f5c2-db1d-4c41-ac6f-cf3dc269bbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248aeed7-1bf5-458f-91f2-0ba79e600a16", "name": "network-vif-deleted", "tag": "0225eb6a-fdd2-41fa-9a9d-48689e7fec48"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:28.094225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-765846da-dbaa-440c-a3bf-348aaddb00ab req-3d38f5c2-db1d-4c41-ac6f-cf3dc269bbfd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:28.094743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-765846da-dbaa-440c-a3bf-348aaddb00ab req-3d38f5c2-db1d-4c41-ac6f-cf3dc269bbfd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:28.095228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-765846da-dbaa-440c-a3bf-348aaddb00ab req-3d38f5c2-db1d-4c41-ac6f-cf3dc269bbfd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:28.122217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-765846da-dbaa-440c-a3bf-348aaddb00ab req-3d38f5c2-db1d-4c41-ac6f-cf3dc269bbfd service nova] Creating event network-vif-deleted:0225eb6a-fdd2-41fa-9a9d-48689e7fec48 for instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 on n-h2-855650-5 Nov 02 12:59:28.135944 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-765846da-dbaa-440c-a3bf-348aaddb00ab req-3d38f5c2-db1d-4c41-ac6f-cf3dc269bbfd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068227 Nov 02 12:59:28.136564 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3078/6218] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:28.293943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "442fe8ac-18a4-4bf6-b6d6-4fc8beb19f8d"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:28.297003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:28.307246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:28.308275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:28.309235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:28.310194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:28.310826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:28.311721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:28.682459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:28.683201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:28.693776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:28.694310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:28.694768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:28.700815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:28.701345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:28.704170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:28.833408 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c7652802-11f8-49c4-bde7-92b80eeb4b4f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "POST /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544104 Nov 02 12:59:28.835449 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3141/6219] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 12:59:28 2022] POST /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:28.875070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:28.901297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-75a606e5-a337-445c-931f-f3b2bea68255 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1209 microversion: 2.1 time: 0.223763 Nov 02 12:59:28.904720 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3079/6220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:28 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1209 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:28.941945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:28.942856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:28.970774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:28.971335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:28.971800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:28.972540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:28.973007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:28.973442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:29.072854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:29.073355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:29.075766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:29.076809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lazy-loading 'fault' on Instance uuid 248aeed7-1bf5-458f-91f2-0ba79e600a16 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:59:29.144637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '856c99b2530442b9bfb9d795a2d1d079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb48511f5e1a4059911bac1d3e183ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:29.159559 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-377670a1-b280-49c4-a405-36f09d1b4198 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 200 len: 1329 microversion: 2.1 time: 0.232357 Nov 02 12:59:29.162756 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3142/6221] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:28 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 1329 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:29.928264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:29.928886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:29.963152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:29.968658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:29.969202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:29.969992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:29.976844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:29.977402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:30.192600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:30.193396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] [instance: 248aeed7-1bf5-458f-91f2-0ba79e600a16] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:30.222001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:30.222748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:30.223351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:30.224357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:30.224899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:30.225551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:30.270414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:30.276703 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] HTTP exception thrown: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 could not be found. Nov 02 12:59:30.281999 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83812994-7d00-42ef-93a4-a96ca4c00220 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1276 microversion: 2.1 time: 0.357881 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Request method failure captured: Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 HTTP/1.1 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmbwqPdXAjwHRx2HHyO7P8SY40490kvF4jFGHmSsdCX8AyHr6MK24NXoU0Q_GjisdO8__QjnB2uaKPS64a69dQH2TLAACEqwIuJcwP-nbzwIULG_KxQ8xPT3aO33oDoq-XRlvI7I9BSIHcf41UbofEWpgX_XPonCaY5LR_RfPkxAh_Q Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb48511f5e1a4059911bac1d3e183ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: bb48511f5e1a4059911bac1d3e183ff7 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1488664046 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 856c99b2530442b9bfb9d795a2d1d079 Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1488664046-project Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 could not be found. Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '248aeed7-1bf5-458f-91f2-0ba79e600a16'} Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 could not be found. Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 could not be found. Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:30.297402 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:30.303355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:30.303355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:30.303355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:30.303355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:30.303355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:30.303355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 could not be found. Nov 02 12:59:30.303355 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 12:59:30.303982 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3080/6222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:29 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1276 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:30.304814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Returning 404 to user: Instance 248aeed7-1bf5-458f-91f2-0ba79e600a16 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:30.305874 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c66fd563-68cd-413d-ac3b-85919e8dc176 tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16" status: 404 len: 111 microversion: 2.1 time: 0.118520 Nov 02 12:59:30.311030 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3143/6223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:30 2022] GET /compute/v2.1/servers/248aeed7-1bf5-458f-91f2-0ba79e600a16 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:30.319407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32abf022-8a15-41e8-b688-3b3030898cad tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] Calling method '.version_select at 0x7f228e6b7f70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:30.357762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-32abf022-8a15-41e8-b688-3b3030898cad tempest-ServerActionsTestJSON-1488664046 tempest-ServerActionsTestJSON-1488664046-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630767197" status: 202 len: 0 microversion: 2.1 time: 0.041971 Nov 02 12:59:30.358988 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3081/6224] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 12:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630767197 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:59:31.308084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:31.308883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:31.323941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:31.324645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:31.325220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:31.328115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:31.328856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:31.332411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:31.380028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f9324bc7-1767-4156-9c49-87d3a10fa3ac req-8245a15e-3af8-4b28-8d70-f3a430247632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8499cff2-0f59-4ee5-9aba-41e0f102af35", "tag": "8bd66afc-c781-450a-8fbc-6b3bd052c37d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:31.403058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9324bc7-1767-4156-9c49-87d3a10fa3ac req-8245a15e-3af8-4b28-8d70-f3a430247632 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:31.404239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9324bc7-1767-4156-9c49-87d3a10fa3ac req-8245a15e-3af8-4b28-8d70-f3a430247632 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:31.404998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9324bc7-1767-4156-9c49-87d3a10fa3ac req-8245a15e-3af8-4b28-8d70-f3a430247632 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:31.440260 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f9324bc7-1767-4156-9c49-87d3a10fa3ac req-8245a15e-3af8-4b28-8d70-f3a430247632 service nova] Creating event network-changed:8bd66afc-c781-450a-8fbc-6b3bd052c37d for instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 on n-h2-855650-5 Nov 02 12:59:31.446498 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f9324bc7-1767-4156-9c49-87d3a10fa3ac req-8245a15e-3af8-4b28-8d70-f3a430247632 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073682 Nov 02 12:59:31.447834 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3082/6225] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:31.641349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:31.650726 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8dfdce8-1e32-4c4c-b82a-8ec7fda12cb6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1276 microversion: 2.1 time: 0.346850 Nov 02 12:59:31.651325 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3144/6226] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:31 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:32.675899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:32.676560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:32.691745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:32.699340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:32.700540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:32.701580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:32.702172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:32.702691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:33.054129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:33.072961 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83805646-824b-44a5-b515-0ec5f6891764 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1276 microversion: 2.1 time: 0.400132 Nov 02 12:59:33.074798 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3083/6227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:32 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1276 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:34.098265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:34.098877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:34.116809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:34.117675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:34.118661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:34.119580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:34.120235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:34.120861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:34.546408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:34.556482 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36b76745-67bc-4550-8498-84ebaaca3a43 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1276 microversion: 2.1 time: 0.462502 Nov 02 12:59:34.560686 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3145/6228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:34 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1276 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:35.587424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:35.588054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:35.595791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:35.596697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:35.597461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:35.598695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:35.599180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:35.599960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:35.895677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:35.928946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:35.964953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:35.978530 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-661df86e-fd35-4427-85aa-9efd401ef503 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1276 microversion: 2.1 time: 0.394549 Nov 02 12:59:35.979869 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3084/6229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:35 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1276 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:37.004696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:37.005324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:37.016241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:37.020043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:37.020818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:37.023409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:37.024619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:37.025320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:37.026034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:37.238951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:37.249751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8cc6181b-3653-4b40-9830-edabda09e4ff tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1276 microversion: 2.1 time: 0.248163 Nov 02 12:59:37.252224 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3146/6230] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:36 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:38.399860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:38.400504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:38.408380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:38.408900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:38.409447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:38.410133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:38.410612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:38.411061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:38.514855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:38.514855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:38.531894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:38.532347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:38.533015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:38.533919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:38.534580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:38.535188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:38.979506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:38.994466 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38150891-ed79-48a1-b378-6fbb1e498ca1 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1276 microversion: 2.1 time: 0.597501 Nov 02 12:59:39.013137 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3085/6231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:38 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1276 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:39.348297 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e94856d-85a9-48e0-9c9a-eafc2434810f tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1832 microversion: 2.1 time: 0.837797 Nov 02 12:59:39.370609 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3147/6232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:38 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1832 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:39.382304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:39.383027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:39.393558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:39.397503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:39.400104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:39.402167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:39.403456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:39.405746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:39.849642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:39.858986 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef82a4b4-5ca2-44ce-862d-7b666ecd1591 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1681 microversion: 2.1 time: 0.482522 Nov 02 12:59:39.874302 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3086/6233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:39 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1681 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:40.000893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:40.005582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:40.024329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:40.025080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:40.036836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:40.037781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:40.038537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:40.040275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:40.041675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:40.042305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:40.042878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:40.043348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:40.043781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:40.045218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:40.046497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:40.048818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:40.165078 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5800842-7718-4f7c-9bcb-6c2f69e3ed86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action" status: 200 len: 32640 microversion: 2.1 time: 0.170305 Nov 02 12:59:40.167073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3148/6234] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:59:39 2022] POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action => generated 32640 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:59:40.312853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:40.313672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:40.332342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:40.335730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:40.336782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:40.341397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:40.346655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:40.347356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:40.471053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:40.511259 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af49a01f-fede-4513-b390-bdce33bfd4fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 0.493276 Nov 02 12:59:40.527977 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3087/6235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:40 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:40.621402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6168bdda906745bdab1f804ca9a3e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cbe3e64cf4f56aa9aba6dd4e55cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:40.622566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] flavor_id is None. Assuming migration. {{(pid=120723) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 12:59:40.624601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120723) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:59:40.961521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:41.039499 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5f32fa6-436f-4c12-a224-9e42d65d4fd3 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action" status: 202 len: 0 microversion: 2.1 time: 0.732999 Nov 02 12:59:41.043291 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3149/6236] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 12:59:40 2022] POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:59:41.051960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:41.057003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:41.091624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:41.099230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:41.106208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:41.110549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:41.111171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:41.113287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:41.218557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:41.543834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:41.544650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:41.557484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:41.558418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:41.562116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:41.566382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:41.568991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:41.569537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:42.462592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:42.493833 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e6088036-ccd6-4093-95c5-717588b20db5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 0.953792 Nov 02 12:59:42.515869 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3150/6237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:41 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:42.537357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:42.559763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca070ad6-4e80-4d82-80bf-c78ffa88dabb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1690 microversion: 2.1 time: 1.512084 Nov 02 12:59:42.576083 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3088/6238] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:41 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1690 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:43.520292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:43.522583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:43.548700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:43.549201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:43.549649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:43.550402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:43.550854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:43.551280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:43.588991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:43.590354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:43.610531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:43.612716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:43.614814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:43.621582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:43.622731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:43.624192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:44.505450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:44.510372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:44.514595 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6689815-e4f0-4797-812d-4274a021f7b4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1690 microversion: 2.1 time: 0.929424 Nov 02 12:59:44.520734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1cf19abb-4a41-452e-bf47-e3d95920f351 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 1.006029 Nov 02 12:59:44.537625 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3151/6239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:43 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:44.538142 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3089/6240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:43 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1690 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:45.552532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:45.553647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:45.554949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:45.555436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:45.600862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:45.601425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:45.607017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:45.607549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:45.608016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:45.608759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:45.609235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:45.609685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:45.610903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:45.611803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:45.615465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:45.618728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:46.458777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:46.487512 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20b50708-6c8a-40dc-bc85-97ea673163f4 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 0.944963 Nov 02 12:59:46.492832 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3090/6241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:45 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:46.522958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:46.535641 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4a2c8cad-de94-4621-999c-d0042437ab35 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1690 microversion: 2.1 time: 0.995208 Nov 02 12:59:46.536806 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3152/6242] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:45 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1690 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:47.521331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:47.523027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:47.540766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:47.543364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:47.546699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:47.547755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:47.548869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:47.550692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:47.563982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:47.566191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:47.591261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:47.593601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:47.604218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:47.606978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:47.607802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:47.608293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:47.608742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:48.050853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:48.081843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d577bca7-ddb2-4065-be14-09b1ca7e4b6f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 0.545239 Nov 02 12:59:48.089644 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3091/6243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:47 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:48.133120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:48.143011 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4e5723c1-04c7-42e2-98be-9d933c4d329c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1695 microversion: 2.1 time: 0.583170 Nov 02 12:59:48.152600 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3153/6244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:47 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1695 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:48.741444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:48.744571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:48.764066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:48.764593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:48.769586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:48.772748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:48.773265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:48.773729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:48.868543 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-925750e6-ecfc-4fe6-beb4-e68d796dbcdd tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.134789 Nov 02 12:59:48.877559 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3092/6245] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 12:59:48 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:49.026648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:49.027871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:49.042027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.048540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.049225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.051161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.054082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.056894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.118231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:49.119231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:49.134312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:49.142996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.143882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.147957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.152346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.154781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.160223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.178253 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e4fd382-59b5-4f48-8a38-0f0dda16b7e7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/7615fcd9-25d7-4615-b495-88768028c0d2" status: 200 len: 194 microversion: 2.1 time: 0.149766 Nov 02 12:59:49.189507 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3154/6246] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Nov 2 12:59:49 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/7615fcd9-25d7-4615-b495-88768028c0d2 => generated 194 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:49.208183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:49.209896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:49.234144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.235708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.237838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.239742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.242551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.243327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.633522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:49.641827 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-264457f7-1780-4e1c-9f63-9408ae30a6e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 0.528137 Nov 02 12:59:49.658198 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3093/6247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:49 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:49.662805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:49.663893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:49.671453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.672479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.673963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.676175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.677221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.678184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.754720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:49.775066 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3bd0725f-517f-4e60-8517-9e5cfee7ab67 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1695 microversion: 2.1 time: 0.581748 Nov 02 12:59:49.776732 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3155/6248] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:49 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1695 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:49.846141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lazy-loading 'services' on Instance uuid 1a63a14b-7327-4b0c-9745-e35dc397f902 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:59:50.096146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8f004d7-10fc-40f8-8d4a-9e82ba261543 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/7615fcd9-25d7-4615-b495-88768028c0d2" status: 202 len: 0 microversion: 2.1 time: 0.446279 Nov 02 12:59:50.112469 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3094/6249] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:59:49 2022] DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/7615fcd9-25d7-4615-b495-88768028c0d2 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:59:50.207606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1390181081", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "137872c0-214d-4fc9-90c3-49cea5527285"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:50.379558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] validate_networks() for [('137872c0-214d-4fc9-90c3-49cea5527285', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:59:50.668351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:50.669216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:50.686479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:50.687291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:50.687903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:50.691415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:50.692647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:50.694568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:51.070379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:51.099344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acc8cb23-7b65-4124-b036-b7f75bc87bf2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 0.435822 Nov 02 12:59:51.103008 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3095/6250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:50 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:51.123930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:51.125098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:51.143909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:51.146636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:51.148782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:51.151339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:51.153479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:51.158594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:51.477224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:59:51.478415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:59:51.479228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:59:51.479853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:59:51.480495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:59:51.490776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:51.491636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:51.492372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:51.493459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:51.494211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:51.494905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:51.518100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Getting quotas for project 4b82579b51714a00b8ae54bf0c0ffb71. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:59:51.524829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Getting quotas for user 34122cc401554f35a40f0ab35838b5d7 and project 4b82579b51714a00b8ae54bf0c0ffb71. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:59:51.535626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:51.541749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:59:51.544542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:59:51.544935 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3cf3819d-c55c-4904-b651-fd4b274bc838 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1695 microversion: 2.1 time: 0.438437 Nov 02 12:59:51.562123 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3096/6251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:51 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1695 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:51.637702 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1899cd46-0fad-4d32-b6f0-a6e8a705c025 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859528 Nov 02 12:59:51.644947 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3156/6252] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 12:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:59:51.650450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c823d532-813e-47de-ba5c-45328ffce88e tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:51.651072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c823d532-813e-47de-ba5c-45328ffce88e tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:51.761368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c823d532-813e-47de-ba5c-45328ffce88e tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:51.774249 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c823d532-813e-47de-ba5c-45328ffce88e tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1217 microversion: 2.1 time: 0.127566 Nov 02 12:59:51.775962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3097/6253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:51 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:52.118146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-723fda62-29f4-4e65-8e04-9dd4943c16ef req-3bc79bbe-e7bb-4b64-adc9-94eb379be599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8499cff2-0f59-4ee5-9aba-41e0f102af35", "name": "network-vif-plugged", "status": "completed", "tag": "8bd66afc-c781-450a-8fbc-6b3bd052c37d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:52.131620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:52.133100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:52.154621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.155937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.158467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.160928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.162164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.164538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.171122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-723fda62-29f4-4e65-8e04-9dd4943c16ef req-3bc79bbe-e7bb-4b64-adc9-94eb379be599 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.174281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-723fda62-29f4-4e65-8e04-9dd4943c16ef req-3bc79bbe-e7bb-4b64-adc9-94eb379be599 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.174984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-723fda62-29f4-4e65-8e04-9dd4943c16ef req-3bc79bbe-e7bb-4b64-adc9-94eb379be599 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.221715 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-723fda62-29f4-4e65-8e04-9dd4943c16ef req-3bc79bbe-e7bb-4b64-adc9-94eb379be599 service nova] Creating event network-vif-plugged:8bd66afc-c781-450a-8fbc-6b3bd052c37d for instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 on n-h2-855650-5 Nov 02 12:59:52.264552 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-723fda62-29f4-4e65-8e04-9dd4943c16ef req-3bc79bbe-e7bb-4b64-adc9-94eb379be599 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144768 Nov 02 12:59:52.267186 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3157/6254] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:52.572051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:52.573402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:52.592587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.593328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.593928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.595376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.596023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.596637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.683502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:52.707817 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84372738-8ebc-4a78-b7c6-240c0a735ecf tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 0.578875 Nov 02 12:59:52.712672 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3098/6255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:52 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:52.803319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:52.805634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:52.821543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.826783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.827993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.831740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.834000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.835086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.896986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:52.915210 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-19aa7d93-cc07-4ddb-b1b2-176c68dc9cb2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1695 microversion: 2.1 time: 0.348314 Nov 02 12:59:52.915824 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3158/6256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:52 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1695 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:53.017096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:53.037230 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04e3f488-9bbf-4f5d-9e90-40c10084282a tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1221 microversion: 2.1 time: 0.238861 Nov 02 12:59:53.055218 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3099/6257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:52 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1221 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:53.748747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:53.749380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:53.805000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:53.806316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:53.807224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:53.808205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:53.809629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:53.811639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:53.940208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:53.940864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:53.956985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:53.963013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:53.964084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:53.968440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:53.969222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:53.970736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:54.192876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:54.213514 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fead7766-9c60-401b-9420-7506a0038ce0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1264 microversion: 2.1 time: 0.469781 Nov 02 12:59:54.214525 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3159/6258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:53 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1264 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:54.236691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:54.237679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:54.245473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:54.249799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:54.251074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:54.252044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:54.252723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:54.253441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:54.409997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:54.429308 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-83056f5c-7282-4b39-ba17-10783e516bf5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1275 microversion: 2.1 time: 0.211059 Nov 02 12:59:54.432549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3160/6259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:54 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:55.080784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Calling method '.version_select at 0x7f228d664940>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:55.082704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.083207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.083660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.123887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.124401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.124853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.167069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.167575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.168031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.189194 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ab00a3b-c0db-470d-99ac-e773851df3c0 tempest-PortsAdminExtendedAttrsTestJSON-1620260366 tempest-PortsAdminExtendedAttrsTestJSON-1620260366-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.431286 Nov 02 12:59:55.190916 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3161/6260] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 12:59:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:55.197457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:55.212248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d7c89e2-069b-407a-8c61-d4616decdf2d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1695 microversion: 2.1 time: 1.277171 Nov 02 12:59:55.213083 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3100/6261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:53 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1695 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:55.244880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:55.245690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:55.266330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.267213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.267681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.268441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.268903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.269336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.461389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:55.462520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:55.469858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.478837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.479541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.480742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.482086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.483054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.642318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:55.656163 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2efea83a-5b2f-4371-9c8b-b0d6ec693668 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1275 microversion: 2.1 time: 0.198987 Nov 02 12:59:55.660382 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3101/6262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:55 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:55.684277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:55.699663 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8f9e08a2-3b56-479d-8ad9-0efa197890db tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1450 microversion: 2.1 time: 0.458633 Nov 02 12:59:55.706742 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3162/6263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:55 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1450 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:55.728442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:55.728997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:55.742867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.743396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.743993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.744623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.745119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.753534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:56.201259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:56.218542 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7dcfa76a-5339-4362-a679-049a4a8725a7 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1450 microversion: 2.1 time: 0.496150 Nov 02 12:59:56.220170 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3102/6264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:55 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1450 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:56.242570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:56.243926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:56.282957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:56.284864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:56.285451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:56.286558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:56.289955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:56.290596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:56.607067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:56.619482 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8661d8e4-8efa-4fc6-a8e8-f7edf0339e2a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1695 microversion: 2.1 time: 0.383512 Nov 02 12:59:56.637300 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3163/6265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:56 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1695 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:56.684914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:56.687750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:56.698430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:56.699248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:56.700017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:56.700934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:56.701457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:56.701915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:56.901000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:56.924140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94fdd42c-1108-4966-bc75-6ae2adab2013 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.243254 Nov 02 12:59:56.925391 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3103/6266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:56 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:57.654488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:57.655787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:57.667817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:57.668569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:57.669990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:57.671109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:57.672206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:57.673831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:57.851307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:57.861723 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d92a44d3-d47c-4ed8-a6be-8ebb8f65e56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1695 microversion: 2.1 time: 0.213001 Nov 02 12:59:57.863025 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3164/6267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:57 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:57.961300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:57.962133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:57.976905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:57.980955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:57.981677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:57.982616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:57.984329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:57.985575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:58.184589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:58.203239 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f44a4259-b5dd-452a-a5d5-f915260c3da5 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.252491 Nov 02 12:59:58.204687 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3104/6268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:57 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:58.368640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-92f5b9cf-5ec3-41aa-8aed-ac027efd8280 req-4348faca-8b7d-4b2b-a6c7-94e93d2b05ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e8acbc-3af5-40c4-9b73-a5aff16918aa", "tag": "1e17f5be-c656-4025-92e5-7e8e53751340"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:58.399056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-92f5b9cf-5ec3-41aa-8aed-ac027efd8280 req-4348faca-8b7d-4b2b-a6c7-94e93d2b05ec service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:58.399933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-92f5b9cf-5ec3-41aa-8aed-ac027efd8280 req-4348faca-8b7d-4b2b-a6c7-94e93d2b05ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:58.400467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-92f5b9cf-5ec3-41aa-8aed-ac027efd8280 req-4348faca-8b7d-4b2b-a6c7-94e93d2b05ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:58.442364 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-92f5b9cf-5ec3-41aa-8aed-ac027efd8280 req-4348faca-8b7d-4b2b-a6c7-94e93d2b05ec service nova] Creating event network-changed:1e17f5be-c656-4025-92e5-7e8e53751340 for instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa on n-h1-855650-5 Nov 02 12:59:58.456028 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-92f5b9cf-5ec3-41aa-8aed-ac027efd8280 req-4348faca-8b7d-4b2b-a6c7-94e93d2b05ec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092356 Nov 02 12:59:58.456647 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3165/6269] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:58.896791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:58.897357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:58.910544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:58.919569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:58.920248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:58.921217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:58.921847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:58.923097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:58.957299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:59.230770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:59.232207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:59.241214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:59.241998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:59.242674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:59.243604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:59.244263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:59.244928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:59.493058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:59.502341 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a2aa11b0-ccf2-41d8-8c61-22cd55c0aeeb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1695 microversion: 2.1 time: 0.609575 Nov 02 12:59:59.503230 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3105/6270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:58 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1695 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:59.515195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:59.515956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:59.523067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:59.523897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:59.524349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:59.525089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:59.525746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:59.526353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:59.566297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a118c3f-fe44-45ee-a9f3-aed73f0466a0 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/442fe8ac-18a4-4bf6-b6d6-4fc8beb19f8d" status: 200 len: 194 microversion: 2.1 time: 0.061755 Nov 02 12:59:59.573406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3106/6271] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Nov 2 12:59:59 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/442fe8ac-18a4-4bf6-b6d6-4fc8beb19f8d => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:59.581201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:59.581201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:59.588300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:59.588821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:59.589298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:59.590038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:59.590513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:59.590986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:59.646052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:59.659987 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2b06e9c4-9e02-49d7-99ba-55f1c8b69b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.436284 Nov 02 12:59:59.675267 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3166/6272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:59 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:59.693634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lazy-loading 'services' on Instance uuid 1a63a14b-7327-4b0c-9745-e35dc397f902 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:59:59.789946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f59d4e9c-9806-452a-ac3c-25512225db4d tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/442fe8ac-18a4-4bf6-b6d6-4fc8beb19f8d" status: 202 len: 0 microversion: 2.1 time: 0.214562 Nov 02 12:59:59.791249 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3107/6273] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 12:59:59 2022] DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments/442fe8ac-18a4-4bf6-b6d6-4fc8beb19f8d => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:00:00.529943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:00.531404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:00.550578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.552336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.554806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:00.555716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.556345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.557570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:00.693100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:00.695367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:00.707456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.708646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.709664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:00.711624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.712781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.714007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:00.872700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:00.905015 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9bf4f5dc-87c7-4698-9d47-120251393232 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1694 microversion: 2.1 time: 0.379742 Nov 02 13:00:00.908013 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3167/6274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:00 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1694 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:00.927054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1c5c38a8-4509-4cd9-828a-6e4b917ea133 req-dcfcfaa3-3dc9-4dd5-9c2c-c4857dfa4f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828458af-cb07-4ccc-a4cd-98b1d85aed05", "name": "network-vif-unplugged", "status": "completed", "tag": "63484f33-b31a-4c62-8b55-95dce3962dca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:00.968772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1c5c38a8-4509-4cd9-828a-6e4b917ea133 req-dcfcfaa3-3dc9-4dd5-9c2c-c4857dfa4f2a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.971214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1c5c38a8-4509-4cd9-828a-6e4b917ea133 req-dcfcfaa3-3dc9-4dd5-9c2c-c4857dfa4f2a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.972899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1c5c38a8-4509-4cd9-828a-6e4b917ea133 req-dcfcfaa3-3dc9-4dd5-9c2c-c4857dfa4f2a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:01.003934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:01.012192 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1c5c38a8-4509-4cd9-828a-6e4b917ea133 req-dcfcfaa3-3dc9-4dd5-9c2c-c4857dfa4f2a service nova] Creating event network-vif-unplugged:63484f33-b31a-4c62-8b55-95dce3962dca for instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 on n-h2-855650-5 Nov 02 13:00:01.035087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-1c5c38a8-4509-4cd9-828a-6e4b917ea133 req-dcfcfaa3-3dc9-4dd5-9c2c-c4857dfa4f2a service nova] Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:00:01.073270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1c5c38a8-4509-4cd9-828a-6e4b917ea133 req-dcfcfaa3-3dc9-4dd5-9c2c-c4857dfa4f2a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162528 Nov 02 13:00:01.076831 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3168/6275] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:01.155760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:01.170482 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f68b4bc-080d-42a2-8565-4d5bdc714304 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.488498 Nov 02 13:00:01.171738 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3108/6276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:00 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:01.932388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:01.933632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:01.939472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:01.943812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:01.954028 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:01.954922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:01.955472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:01.959238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:01.959888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:01.961236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:02.195025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:02.196345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:02.200554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:02.220518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:02.221865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:02.222843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:02.223776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:02.224444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:02.226431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:02.584337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:02.623165 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bf5a28d3-b486-4377-89bf-c396666aabc3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1694 microversion: 2.1 time: 0.675953 Nov 02 13:00:02.623851 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3169/6277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:01 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1694 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:02.704388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:02.722619 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-090e451b-9551-4634-a4b5-73c0c2dbb015 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.531078 Nov 02 13:00:02.746801 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3109/6278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:02 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:03.170127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c2bd314c-c715-45bd-a6f9-abf8be671a38 req-0bbc213b-1b22-4f61-a3e8-a7de0b80ab9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8499cff2-0f59-4ee5-9aba-41e0f102af35", "tag": "8bd66afc-c781-450a-8fbc-6b3bd052c37d"}, {"name": "network-changed", "server_uuid": "828458af-cb07-4ccc-a4cd-98b1d85aed05", "tag": "63484f33-b31a-4c62-8b55-95dce3962dca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:03.185236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c2bd314c-c715-45bd-a6f9-abf8be671a38 req-0bbc213b-1b22-4f61-a3e8-a7de0b80ab9e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:03.195042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c2bd314c-c715-45bd-a6f9-abf8be671a38 req-0bbc213b-1b22-4f61-a3e8-a7de0b80ab9e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:03.195950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c2bd314c-c715-45bd-a6f9-abf8be671a38 req-0bbc213b-1b22-4f61-a3e8-a7de0b80ab9e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:03.220033 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c2bd314c-c715-45bd-a6f9-abf8be671a38 req-0bbc213b-1b22-4f61-a3e8-a7de0b80ab9e service nova] Creating event network-changed:8bd66afc-c781-450a-8fbc-6b3bd052c37d for instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 on n-h2-855650-5 Nov 02 13:00:03.220877 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c2bd314c-c715-45bd-a6f9-abf8be671a38 req-0bbc213b-1b22-4f61-a3e8-a7de0b80ab9e service nova] Creating event network-changed:63484f33-b31a-4c62-8b55-95dce3962dca for instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 on n-h2-855650-5 Nov 02 13:00:03.239407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-c2bd314c-c715-45bd-a6f9-abf8be671a38 req-0bbc213b-1b22-4f61-a3e8-a7de0b80ab9e service nova] Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:00:03.271849 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c2bd314c-c715-45bd-a6f9-abf8be671a38 req-0bbc213b-1b22-4f61-a3e8-a7de0b80ab9e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109174 Nov 02 13:00:03.272474 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3170/6279] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:00:03.651298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:03.651939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:03.664269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:03.665034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:03.668187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:03.670780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:03.671451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:03.673085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:03.754847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:03.755803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:03.764542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:03.768110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:03.768838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:03.769735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:03.771287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:03.772216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:04.040074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:04.052648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-93f8aa46-52b0-4e31-8fc4-031c05a5fc3b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1694 microversion: 2.1 time: 0.405999 Nov 02 13:00:04.053524 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3110/6280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:03 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1694 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:04.079435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:04.097652 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba712e41-fc4f-4ca1-93ec-bd1dbdf32fdf tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.348131 Nov 02 13:00:04.099239 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3171/6281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:03 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:05.076812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:05.077509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:05.085368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:05.085887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:05.086472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:05.087117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:05.087595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:05.088047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:05.126440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:05.126962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:05.134306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:05.135871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:05.136619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:05.137570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:05.138306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:05.138932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:05.452429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:05.452868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:05.467985 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c82a57e6-1e26-4917-a7a2-35fbb12d9b19 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.345268 Nov 02 13:00:05.469334 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3172/6282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:05 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:05.471887 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3674f28a-15f7-4054-90b6-d149d882d7d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1692 microversion: 2.1 time: 0.398977 Nov 02 13:00:05.473139 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3111/6283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:05 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1692 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:06.499280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:06.502018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:06.502909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:06.503698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:06.513617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:06.514222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:06.514921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:06.516251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:06.517154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:06.517826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:06.522878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:06.524349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:06.525269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:06.527245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:06.528678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:06.530011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:06.817613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:06.828392 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f88a0a7-18c7-4386-9988-0e14a101dd9a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1692 microversion: 2.1 time: 0.330124 Nov 02 13:00:06.845688 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3112/6284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:06 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1692 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:06.879466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:06.892637 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c2cd4be6-e053-4c43-bd8e-d5cb71c9ebad tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.403057 Nov 02 13:00:06.893234 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3173/6285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:06 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:07.269802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:07.272671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:07.280091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:07.280876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:07.281814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:07.282966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:07.283589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:07.284190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:07.362207 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d4e2b12a-e6d5-46d5-8e54-4eb1eff237a3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092551 Nov 02 13:00:07.373158 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3113/6286] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:00:07 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:00:07.533085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:07.535450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:07.554885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:07.557116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:07.558224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:07.560151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:07.560635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:07.561074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:07.627039 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4d15b466-3a60-46c9-a101-3824560c84ef tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098218 Nov 02 13:00:07.628534 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3174/6287] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:00:07 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:00:07.821988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:07.824728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:07.840821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:07.843483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:07.847559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:07.850485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:07.853573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:07.856629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:07.870470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:07.871688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:07.883107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:07.892962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:07.893703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:07.896825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:07.901243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:07.903444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:07.919321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:00:08.061023 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-febb225c-1835-4058-a1e7-2072e2f547b7 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 204 len: 0 microversion: 2.1 time: 0.242786 Nov 02 13:00:08.061795 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3114/6288] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:00:07 2022] DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:00:08.075346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:08.076467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:08.083892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.084723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.085370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.086321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.087020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.087810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.291715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:08.302808 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dfeb8917-59e6-4b1a-ba44-d90fd9f99643 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1689 microversion: 2.1 time: 0.441474 Nov 02 13:00:08.304269 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3175/6289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:07 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1689 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:08.307505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:08.310324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:08.311447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:08.316707 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-166d61b8-b1ad-4232-a8e5-d1e210d0dc5c tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.248634 Nov 02 13:00:08.317540 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3115/6290] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:08 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:08.323578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7f0e2fa9-6cc3-4252-9808-7d207f13c839 req-fdaf5eba-d565-4010-b041-328acbb37954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e8acbc-3af5-40c4-9b73-a5aff16918aa", "name": "network-vif-plugged", "status": "completed", "tag": "1e17f5be-c656-4025-92e5-7e8e53751340"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:08.334846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f0e2fa9-6cc3-4252-9808-7d207f13c839 req-fdaf5eba-d565-4010-b041-328acbb37954 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.335628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f0e2fa9-6cc3-4252-9808-7d207f13c839 req-fdaf5eba-d565-4010-b041-328acbb37954 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.336326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f0e2fa9-6cc3-4252-9808-7d207f13c839 req-fdaf5eba-d565-4010-b041-328acbb37954 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.339573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.340468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.341526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.342348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.344416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.344866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.350779 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7f0e2fa9-6cc3-4252-9808-7d207f13c839 req-fdaf5eba-d565-4010-b041-328acbb37954 service nova] Creating event network-vif-plugged:1e17f5be-c656-4025-92e5-7e8e53751340 for instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa on n-h1-855650-5 Nov 02 13:00:08.356169 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7f0e2fa9-6cc3-4252-9808-7d207f13c839 req-fdaf5eba-d565-4010-b041-328acbb37954 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036515 Nov 02 13:00:08.357213 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3116/6291] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:08.364051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:08.364702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:08.371117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.371709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.372332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.373059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.373600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.374601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.453142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9fee2de2-3280-4162-b165-d0c5bc6c6ef1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action" status: 204 len: 0 microversion: 2.1 time: 0.094136 Nov 02 13:00:08.454454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3117/6292] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:00:08 2022] POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:00:08.465923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:08.467085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:08.496625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.497155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.497617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.498455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:08.498938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:08.499432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:08.537134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:08.550728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0cda1933-cc3e-47e6-89dc-9b09e23f3d86 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1672 microversion: 2.1 time: 0.244830 Nov 02 13:00:08.551435 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3176/6293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:08 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1672 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:08.704797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:08.714986 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ead2ba70-ba4c-44c5-8273-cb4cf2ed5f32 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1689 microversion: 2.1 time: 0.254685 Nov 02 13:00:08.715903 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3118/6294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:08 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:09.343703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:09.345254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:09.352150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:09.352928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:09.353636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:09.354432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:09.354968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:09.355546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:09.514503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:09.523217 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9ea2f77-7b82-456b-8541-b251cdba124f tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1317 microversion: 2.1 time: 0.183369 Nov 02 13:00:09.526009 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3177/6295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:09 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:09.576141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:09.576836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:09.585795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:09.586681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:09.587251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:09.588364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:09.589208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:09.589593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:09.641594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:09.740891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:09.742690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:09.768075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:09.768579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:09.769026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:09.769740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:09.773568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:09.774127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:09.947592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:09.965347 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e49bfd5-7709-4a11-8359-38540c4b2012 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1672 microversion: 2.1 time: 0.393512 Nov 02 13:00:09.979454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3119/6296] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:09 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1672 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:10.102349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:10.120342 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-671f2d95-8336-4805-8baf-d3570c66097c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1689 microversion: 2.1 time: 0.383664 Nov 02 13:00:10.122640 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3178/6297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:09 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1689 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:10.386523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2eae6c20-9db5-489f-9876-3c2ce3ed6948 req-9f6202f1-008e-4abc-9071-d2df4c9a2c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828458af-cb07-4ccc-a4cd-98b1d85aed05", "name": "network-vif-plugged", "status": "completed", "tag": "63484f33-b31a-4c62-8b55-95dce3962dca"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:10.405801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2eae6c20-9db5-489f-9876-3c2ce3ed6948 req-9f6202f1-008e-4abc-9071-d2df4c9a2c9e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:10.406660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2eae6c20-9db5-489f-9876-3c2ce3ed6948 req-9f6202f1-008e-4abc-9071-d2df4c9a2c9e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:10.407472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2eae6c20-9db5-489f-9876-3c2ce3ed6948 req-9f6202f1-008e-4abc-9071-d2df4c9a2c9e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:10.427665 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2eae6c20-9db5-489f-9876-3c2ce3ed6948 req-9f6202f1-008e-4abc-9071-d2df4c9a2c9e service nova] Creating event network-vif-plugged:63484f33-b31a-4c62-8b55-95dce3962dca for instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 on n-h2-855650-5 Nov 02 13:00:10.435309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-2eae6c20-9db5-489f-9876-3c2ce3ed6948 req-9f6202f1-008e-4abc-9071-d2df4c9a2c9e service nova] Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:00:10.460055 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2eae6c20-9db5-489f-9876-3c2ce3ed6948 req-9f6202f1-008e-4abc-9071-d2df4c9a2c9e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079886 Nov 02 13:00:10.461530 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3120/6298] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:10.550398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:10.551092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:10.562998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:10.563502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:10.563949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:10.566754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:10.567234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:10.567678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:10.886368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:10.896082 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b8f76de2-7760-4a78-9736-8b970c2edaa7 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1506 microversion: 2.1 time: 0.352219 Nov 02 13:00:10.896779 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3179/6299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:10 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:10.921469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:10.925660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:10.933936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:10.935131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:10.935837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:10.936775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:10.937536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:10.938724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:10.967933 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff426f76-92f1-4c35-a7c7-a1b30484d484 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa/ips" status: 200 len: 109 microversion: 2.1 time: 0.051648 Nov 02 13:00:10.969303 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3121/6300] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 13:00:10 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa/ips => generated 109 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:10.983916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:10.985232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:10.992482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:10.993361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:10.994064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:10.994830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:10.995262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:10.995473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:10.996141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:10.996785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.009032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.009557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.010045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.011084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.011619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.012100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.030871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-111e70b3-df2a-40bf-9667-c846fd0e815b tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa/ips" status: 200 len: 109 microversion: 2.1 time: 0.051995 Nov 02 13:00:11.038257 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3180/6301] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 13:00:10 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa/ips => generated 109 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:11.043823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:11.044632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:11.063097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.070307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.071363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.072345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.073107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.073854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.129278 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5eca498e-b1d4-4014-8ece-9cf57e56e021 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa/ips/tempest-ServerAddressesTestJSON-187977107-network" status: 200 len: 94 microversion: 2.1 time: 0.089300 Nov 02 13:00:11.142922 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3181/6302] 10.222.0.45 () {58 vars in 1398 bytes} [Wed Nov 2 13:00:11 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa/ips/tempest-ServerAddressesTestJSON-187977107-network => generated 94 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:00:11.148444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:11.149335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:11.156588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.157537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.158367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.159913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.160730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.161529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.192554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:00:11.310188 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9648a87-d029-4fb3-887a-08e4691046d2 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 204 len: 0 microversion: 2.1 time: 0.165309 Nov 02 13:00:11.312070 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3182/6303] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:00:11 2022] DELETE /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:00:11.327288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:11.340113 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ee52232a-66e1-4ddb-94bf-c301b5081a6f tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1672 microversion: 2.1 time: 0.352486 Nov 02 13:00:11.341315 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3122/6304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:10 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1672 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:11.346989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:11.362396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:11.365911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:11.366201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:11.371657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.372400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.373008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.373956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.374551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.375052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.375775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.376149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.376264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.376927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.377294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.383605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:12.037127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:12.049460 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bc2f4f97-a121-45ad-8378-6d4bd28b785d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1689 microversion: 2.1 time: 0.733539 Nov 02 13:00:12.050097 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3183/6305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:11 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1689 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:12.273378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:12.289267 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7097a104-82e9-4cad-8b44-602643fabbfc tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1512 microversion: 2.1 time: 0.946486 Nov 02 13:00:12.294423 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3123/6306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:11 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1512 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:12.374246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:12.374767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:12.385502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:12.386757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:12.389739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:12.391311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:12.393451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:12.394137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:12.442369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:12.705313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:12.713938 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84372a41-9414-4a6d-b372-009c5c8fd6f3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1672 microversion: 2.1 time: 0.344186 Nov 02 13:00:12.714565 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3184/6307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:12 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1672 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:13.079070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:13.080027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:13.099531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:13.100063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:13.100619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:13.101391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:13.101872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:13.102354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:13.323052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:13.324512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:13.364156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:13.369520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:13.370013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:13.370780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:13.371273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:13.371698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:14.401944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:14.428297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1e27507-ffc8-4294-bcaa-c3d53423bc6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1689 microversion: 2.1 time: 1.337334 Nov 02 13:00:14.443479 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3124/6308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:13 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1689 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:14.468315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:14.469778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:14.486459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:14.487328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:14.488064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:14.489068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:14.492744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:14.494730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:14.591287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:14.594589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:14.595470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:14.602935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lazy-loading 'fault' on Instance uuid 1a63a14b-7327-4b0c-9745-e35dc397f902 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:00:14.914643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01eeb1d7c0c64c11a84c57906221efb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1efa37c130b4c5e9403e55baab92ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:14.932534 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7f07ff74-5090-4b95-89fe-7e7280a26cf2 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 200 len: 1327 microversion: 2.1 time: 0.470731 Nov 02 13:00:14.933544 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3125/6309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:14 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 1327 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:14.951030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d2d9bd9c-d908-4d8b-b164-8ea53051282f req-6869e3e1-ac1e-46b3-9ead-ce6bec30edee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a63a14b-7327-4b0c-9745-e35dc397f902", "name": "network-vif-deleted", "tag": "03886e18-8931-4750-a2a9-2ffc7d0efde5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:14.964000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34122cc401554f35a40f0ab35838b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b82579b51714a00b8ae54bf0c0ffb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:14.971218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2d9bd9c-d908-4d8b-b164-8ea53051282f req-6869e3e1-ac1e-46b3-9ead-ce6bec30edee service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:14.972198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2d9bd9c-d908-4d8b-b164-8ea53051282f req-6869e3e1-ac1e-46b3-9ead-ce6bec30edee service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:14.972615 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1cbb515e-d92a-4020-87e3-fde1189e5324 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 200 len: 1512 microversion: 2.1 time: 1.655679 Nov 02 13:00:14.973216 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3185/6310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:13 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 1512 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:14.973605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2d9bd9c-d908-4d8b-b164-8ea53051282f req-6869e3e1-ac1e-46b3-9ead-ce6bec30edee service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:14.991155 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d2d9bd9c-d908-4d8b-b164-8ea53051282f req-6869e3e1-ac1e-46b3-9ead-ce6bec30edee service nova] Creating event network-vif-deleted:03886e18-8931-4750-a2a9-2ffc7d0efde5 for instance 1a63a14b-7327-4b0c-9745-e35dc397f902 on n-h2-855650-5 Nov 02 13:00:14.997429 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d2d9bd9c-d908-4d8b-b164-8ea53051282f req-6869e3e1-ac1e-46b3-9ead-ce6bec30edee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061720 Nov 02 13:00:14.998357 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3126/6311] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:15.369161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bbd8ba40-bede-45fa-a7e2-c9de36c97d94 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'create', calling method: .version_select at 0x7f228e874280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-894651676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNGyNYl6ZGPsD+Pi6cQf3mVGgSEwCI664pHSaSmXBa7wPw4WtiT9GzBK/L+QXRZm6UiIPJY7zwOO+9HuyaxO6lsxo61QIGF4gCwzKNraUiBYSG6rWQIJBAHVVgFc7E92w=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:15.434789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bbd8ba40-bede-45fa-a7e2-c9de36c97d94 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for project c9764cefb5494bc9abb1518bd0b30681. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:00:15.449713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bbd8ba40-bede-45fa-a7e2-c9de36c97d94 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for user 01745029847d4f7eba5ed111fd14d395 and project c9764cefb5494bc9abb1518bd0b30681. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:00:15.463063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:15.466060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:15.484196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:15.484768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:15.485239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:15.490248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:15.491023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:15.491680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:15.530198 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bbd8ba40-bede-45fa-a7e2-c9de36c97d94 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.165474 Nov 02 13:00:15.532616 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3186/6312] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:00:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:15.837540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:15.849746 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b181007-a33c-4375-957e-d03d91bae58c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1681 microversion: 2.1 time: 0.393862 Nov 02 13:00:15.867674 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3127/6313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:15 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1681 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:15.958919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:15.959846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:15.962394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:15.985712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:15.989258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:15.990054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:15.990938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:15.995233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:15.996044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:15.997520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:15.998217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] [instance: a5e8acbc-3af5-40c4-9b73-a5aff16918aa] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:16.012081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:16.012844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:16.013652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:16.014688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:16.015533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:16.016273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:16.032639 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] HTTP exception thrown: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Request method failure captured: Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 HTTP/1.1 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmd9uqgMflY7nElRk7cGm0Fw4JTvdUV95oCh_BxlKUt6HePk6WG5jod0R4CjIsRuoJzXp3TTaeEmHuF3pIqSuLrC1j4q-HR3ihk-TIeqloEHLdXLbi_iepcnV4IhisACl3oyKxhnYDrbyQUqiwNipyw603EAq1M_MSbF5oO2SyikvCk Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 01eeb1d7c0c64c11a84c57906221efb2 Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1a63a14b-7327-4b0c-9745-e35dc397f902'} Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:16.039866 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.045285 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:16.045285 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:16.045285 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:16.045285 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:00:16.045285 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:00:16.045285 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:16.045285 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.050270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Returning 404 to user: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:00:16.051925 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-856b080a-19da-4263-8de3-20ca2741bfe3 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 404 len: 111 microversion: 2.1 time: 0.098179 Nov 02 13:00:16.057057 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3187/6314] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:15 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:00:16.065146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] HTTP exception thrown: Instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa could not be found. Nov 02 13:00:16.069915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59188935-96d7-4506-ae6f-bd9b59751104 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '.version_select at 0x7f228d7260d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Request method failure captured: Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa HTTP/1.1 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmnFyq08PN0YoMtrEjRw5Im2dnDY9OChc65d1RLgSobIGMAxpSFvPGSEZBNoKwwv3pB172T38bHiP6XnSY6bI81KrzzWtJi7PJw0VUzNU8O53__ZM3wffihUd5i9kjOjGBXIpueYt4Bv_m_g7RrHgK0fYT78Ne533VuKUNkIWAwuHes Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 4b82579b51714a00b8ae54bf0c0ffb71 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerAddressesTestJSON-1460290545 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4b82579b51714a00b8ae54bf0c0ffb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4b82579b51714a00b8ae54bf0c0ffb71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4b82579b51714a00b8ae54bf0c0ffb71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4b82579b51714a00b8ae54bf0c0ffb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerAddressesTestJSON-1460290545 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 4b82579b51714a00b8ae54bf0c0ffb71 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1460290545 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerAddressesTestJSON-1460290545-project Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 34122cc401554f35a40f0ab35838b5d7 Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerAddressesTestJSON-1460290545-project Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa could not be found. Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a5e8acbc-3af5-40c4-9b73-a5aff16918aa'} Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa could not be found. Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa could not be found. Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:16.073673 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.081636 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:16.081636 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:16.081636 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:16.081636 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:00:16.081636 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:00:16.081636 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa could not be found. Nov 02 13:00:16.081636 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:16.081636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] Returning 404 to user: Instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:00:16.085626 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bff03186-20f2-4c52-8a7d-5e83cb488139 tempest-ServerAddressesTestJSON-1460290545 tempest-ServerAddressesTestJSON-1460290545-project] 10.222.0.45 "GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa" status: 404 len: 111 microversion: 2.1 time: 0.083990 Nov 02 13:00:16.090603 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3128/6315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:15 2022] GET /compute/v2.1/servers/a5e8acbc-3af5-40c4-9b73-a5aff16918aa => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:00:16.126607 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59188935-96d7-4506-ae6f-bd9b59751104 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932762540" status: 202 len: 0 microversion: 2.1 time: 0.064437 Nov 02 13:00:16.130111 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3188/6316] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Nov 2 13:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932762540 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:00:17.038484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f8324279-8259-4d08-bdc8-b07af5af5a6f req-5a4456a0-9e92-4ca8-bf32-27b541b46307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e8acbc-3af5-40c4-9b73-a5aff16918aa", "name": "network-vif-deleted", "tag": "1e17f5be-c656-4025-92e5-7e8e53751340"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:17.064986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f8324279-8259-4d08-bdc8-b07af5af5a6f req-5a4456a0-9e92-4ca8-bf32-27b541b46307 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:17.065958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f8324279-8259-4d08-bdc8-b07af5af5a6f req-5a4456a0-9e92-4ca8-bf32-27b541b46307 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:17.066635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f8324279-8259-4d08-bdc8-b07af5af5a6f req-5a4456a0-9e92-4ca8-bf32-27b541b46307 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:17.098381 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f8324279-8259-4d08-bdc8-b07af5af5a6f req-5a4456a0-9e92-4ca8-bf32-27b541b46307 service nova] Creating event network-vif-deleted:1e17f5be-c656-4025-92e5-7e8e53751340 for instance a5e8acbc-3af5-40c4-9b73-a5aff16918aa on n-h1-855650-5 Nov 02 13:00:17.105549 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f8324279-8259-4d08-bdc8-b07af5af5a6f req-5a4456a0-9e92-4ca8-bf32-27b541b46307 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070756 Nov 02 13:00:17.111824 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3129/6317] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:18.931819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-33281698", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "f7ec1bb3-fa6f-4ea4-b21b-8b052ba841be"}], "key_name": "tempest-TestNetworkBasicOps-894651676", "security_groups": [{"name": "tempest-secgroup-smoke-836759076"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:19.303717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] validate_networks() for [('f7ec1bb3-fa6f-4ea4-b21b-8b052ba841be', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:00:19.994540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:00:19.995104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:00:19.995443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:00:19.995861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:00:19.996568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:00:20.021721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:20.023421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:20.026209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:20.027833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:20.029393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:20.032070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:20.079020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for project c9764cefb5494bc9abb1518bd0b30681. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:00:20.089323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for user 01745029847d4f7eba5ed111fd14d395 and project c9764cefb5494bc9abb1518bd0b30681. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:00:20.110624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:00:20.113426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:00:20.179036 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-433e0947-c3a6-450d-a796-0eb228349dc8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.252180 Nov 02 13:00:20.188967 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3189/6318] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:00:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:00:20.195513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92f9cb0d-7382-4e2f-a25b-bd274dbedf34 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:20.196792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92f9cb0d-7382-4e2f-a25b-bd274dbedf34 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:20.206321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:20.363237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92f9cb0d-7382-4e2f-a25b-bd274dbedf34 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:20.371572 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92f9cb0d-7382-4e2f-a25b-bd274dbedf34 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1246 microversion: 2.1 time: 0.181426 Nov 02 13:00:20.372119 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3130/6319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:20 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1246 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:21.400232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:21.400908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:21.408966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:21.409817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:21.411988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:21.412950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:21.425437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:21.426183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:21.610117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:21.625514 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5106654e-0535-46ec-93fc-6d2db8d72979 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1250 microversion: 2.1 time: 0.225556 Nov 02 13:00:21.630465 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3190/6320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:21 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1250 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:22.653172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:22.653804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:22.665086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:22.673853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:22.675681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:22.681327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:22.682329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:22.683051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:22.965053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:22.979031 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-026102b7-fcb1-4a83-8ac7-b879b95f2eea tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1306 microversion: 2.1 time: 0.328321 Nov 02 13:00:22.999254 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3131/6321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:22 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1306 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:24.007355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:24.008726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:24.023892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:24.027154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:24.027796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:24.028721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:24.034913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:24.035763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:24.186515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:24.205203 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6107d8f-af66-413e-ae91-e907faeb190e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1304 microversion: 2.1 time: 0.202046 Nov 02 13:00:24.218000 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3191/6322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:24 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:25.233115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:25.234402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:25.259940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:25.260720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:25.261372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:25.263700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:25.265869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:25.271091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:26.000821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:26.019820 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fb9a21d-fc5c-4748-bd8a-46a45583fc49 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1371 microversion: 2.1 time: 0.790737 Nov 02 13:00:26.021725 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3132/6323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:25 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1371 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:27.044961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:27.046368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:27.054005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:27.054879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:27.055547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:27.057227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:27.058080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:27.058726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:27.143288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d47ec82f-b877-48e7-bb2f-711fdbe1605a req-49d7358b-d709-4c67-b887-4f8bdc9d3eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0deb170-bd40-4343-b123-699cf113681f", "tag": "6ea04f10-9945-491c-b26b-bdea15187c76"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:27.161104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d47ec82f-b877-48e7-bb2f-711fdbe1605a req-49d7358b-d709-4c67-b887-4f8bdc9d3eb4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:27.161621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d47ec82f-b877-48e7-bb2f-711fdbe1605a req-49d7358b-d709-4c67-b887-4f8bdc9d3eb4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:27.162114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d47ec82f-b877-48e7-bb2f-711fdbe1605a req-49d7358b-d709-4c67-b887-4f8bdc9d3eb4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:27.195774 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d47ec82f-b877-48e7-bb2f-711fdbe1605a req-49d7358b-d709-4c67-b887-4f8bdc9d3eb4 service nova] Creating event network-changed:6ea04f10-9945-491c-b26b-bdea15187c76 for instance f0deb170-bd40-4343-b123-699cf113681f on n-h1-855650-5 Nov 02 13:00:27.205708 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d47ec82f-b877-48e7-bb2f-711fdbe1605a req-49d7358b-d709-4c67-b887-4f8bdc9d3eb4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065739 Nov 02 13:00:27.206818 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3133/6324] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:27.271640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:27.281673 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e772164b-2c75-4f8e-b21b-1507d383baec tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1371 microversion: 2.1 time: 0.240469 Nov 02 13:00:27.283118 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3192/6325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:27 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:28.306984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:28.307740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:28.342529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:28.343297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:28.343614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:28.344544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:28.345133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:28.346023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:28.579254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:28.597508 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ff9aa53-4552-4838-86f2-1edaf9665642 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1371 microversion: 2.1 time: 0.295880 Nov 02 13:00:28.598986 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3134/6326] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:28 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:29.483790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:29.485036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:29.496018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:29.497054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:29.497871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:29.499912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:29.500834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:29.501812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:29.520144 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] HTTP exception thrown: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Request method failure captured: Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 HTTP/1.1 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmd9uqgMflY7nElRk7cGm0Fw4JTvdUV95oCh_BxlKUt6HePk6WG5jod0R4CjIsRuoJzXp3TTaeEmHuF3pIqSuLrC1j4q-HR3ihk-TIeqloEHLdXLbi_iepcnV4IhisACl3oyKxhnYDrbyQUqiwNipyw603EAq1M_MSbF5oO2SyikvCk Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 01eeb1d7c0c64c11a84c57906221efb2 Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1a63a14b-7327-4b0c-9745-e35dc397f902'} Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:00:29.522595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.525842 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.528866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Returning 404 to user: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:00:29.530177 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-74e7220e-a536-4bde-95a0-c2fe98a697bf tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 404 len: 111 microversion: 2.1 time: 0.051543 Nov 02 13:00:29.532175 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3193/6327] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:00:29 2022] DELETE /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:00:29.542348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:29.543087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 1a63a14b-7327-4b0c-9745-e35dc397f902] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:29.556909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:29.557812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:29.558481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:29.559677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:29.560309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:29.561027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:29.581434 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] HTTP exception thrown: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Request method failure captured: Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 HTTP/1.1 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmd9uqgMflY7nElRk7cGm0Fw4JTvdUV95oCh_BxlKUt6HePk6WG5jod0R4CjIsRuoJzXp3TTaeEmHuF3pIqSuLrC1j4q-HR3ihk-TIeqloEHLdXLbi_iepcnV4IhisACl3oyKxhnYDrbyQUqiwNipyw603EAq1M_MSbF5oO2SyikvCk Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 01eeb1d7c0c64c11a84c57906221efb2 Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1a63a14b-7327-4b0c-9745-e35dc397f902'} Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:29.583759 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.588160 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:29.588160 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:29.588160 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:29.588160 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:00:29.588160 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:00:29.588160 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. Nov 02 13:00:29.588160 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:29.589652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Returning 404 to user: Instance 1a63a14b-7327-4b0c-9745-e35dc397f902 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:00:29.590788 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1264d5bb-8210-466b-bbe8-3477c0e78cf9 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902" status: 404 len: 111 microversion: 2.1 time: 0.053992 Nov 02 13:00:29.595572 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3135/6328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:29 2022] GET /compute/v2.1/servers/1a63a14b-7327-4b0c-9745-e35dc397f902 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:00:29.630240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:29.630896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:29.644981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:29.647326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:29.647860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:29.650018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:29.650752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:29.652204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:30.054119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:30.099484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:30.395902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:30.415745 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-61aed061-d0d8-4f4d-8d3a-a1d1d1e548f3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1371 microversion: 2.1 time: 0.791928 Nov 02 13:00:30.437218 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3194/6329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:29 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1371 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:31.464952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:31.466286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:31.470949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:31.493848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:31.495164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:31.495927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:31.497140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:31.498428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:31.499283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:32.253509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:32.267617 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da006ff7-e9f6-4efa-8dcb-6cf62f1f427f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1371 microversion: 2.1 time: 0.819819 Nov 02 13:00:32.268707 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3136/6330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:31 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1371 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:33.295601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:33.296294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:33.305203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:33.306211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:33.307168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:33.308634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:33.309371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:33.310114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:33.743397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:33.757346 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d513bb2-dfe7-420c-8e2d-bd0d3fe8056f tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1371 microversion: 2.1 time: 0.467970 Nov 02 13:00:33.786294 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3195/6331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:33 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1371 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:34.466353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c5524561-6fdd-4995-9736-29269fe04494 req-ed3f48a0-6b0b-47cf-b990-27545844e95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0deb170-bd40-4343-b123-699cf113681f", "name": "network-vif-plugged", "status": "completed", "tag": "6ea04f10-9945-491c-b26b-bdea15187c76"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:34.489041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c5524561-6fdd-4995-9736-29269fe04494 req-ed3f48a0-6b0b-47cf-b990-27545844e95a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:34.491235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c5524561-6fdd-4995-9736-29269fe04494 req-ed3f48a0-6b0b-47cf-b990-27545844e95a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:34.491872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c5524561-6fdd-4995-9736-29269fe04494 req-ed3f48a0-6b0b-47cf-b990-27545844e95a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:34.520594 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c5524561-6fdd-4995-9736-29269fe04494 req-ed3f48a0-6b0b-47cf-b990-27545844e95a service nova] Creating event network-vif-plugged:6ea04f10-9945-491c-b26b-bdea15187c76 for instance f0deb170-bd40-4343-b123-699cf113681f on n-h1-855650-5 Nov 02 13:00:34.537032 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c5524561-6fdd-4995-9736-29269fe04494 req-ed3f48a0-6b0b-47cf-b990-27545844e95a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075090 Nov 02 13:00:34.537947 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3137/6332] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:00:34.793474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:34.794840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:34.814593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:34.815186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:34.815644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:34.816383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:34.816847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:34.817284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:35.332221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:35.333089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:35.352202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:35.353195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:35.353812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:35.354751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:35.355390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:35.355994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:35.388936 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] HTTP exception thrown: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Request method failure captured: Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d HTTP/1.1 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmd9uqgMflY7nElRk7cGm0Fw4JTvdUV95oCh_BxlKUt6HePk6WG5jod0R4CjIsRuoJzXp3TTaeEmHuF3pIqSuLrC1j4q-HR3ihk-TIeqloEHLdXLbi_iepcnV4IhisACl3oyKxhnYDrbyQUqiwNipyw603EAq1M_MSbF5oO2SyikvCk Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 01eeb1d7c0c64c11a84c57906221efb2 Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3d6b5ad4-9ed7-469c-bd63-c9be03c4002d'} Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:00:35.390794 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Returning 404 to user: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:00:35.395176 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e1091db-00a5-4702-a553-c9e8f8e5fe81 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 404 len: 111 microversion: 2.1 time: 0.065985 Nov 02 13:00:35.407346 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3138/6333] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:00:35 2022] DELETE /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:00:35.427527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:35.428435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] [instance: 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:35.453943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:35.455286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:35.455286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:35.455670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:35.456145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:35.456833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:35.500704 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] HTTP exception thrown: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Request method failure captured: Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d HTTP/1.1 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmd9uqgMflY7nElRk7cGm0Fw4JTvdUV95oCh_BxlKUt6HePk6WG5jod0R4CjIsRuoJzXp3TTaeEmHuF3pIqSuLrC1j4q-HR3ihk-TIeqloEHLdXLbi_iepcnV4IhisACl3oyKxhnYDrbyQUqiwNipyw603EAq1M_MSbF5oO2SyikvCk Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1efa37c130b4c5e9403e55baab92ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d1efa37c130b4c5e9403e55baab92ae9 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1430805297 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 01eeb1d7c0c64c11a84c57906221efb2 Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeTestJSON-1430805297-project Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3d6b5ad4-9ed7-469c-bd63-c9be03c4002d'} Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:35.502433 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] Returning 404 to user: Instance 3d6b5ad4-9ed7-469c-bd63-c9be03c4002d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:00:35.508151 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ab9640a-bc2e-42f0-bd15-f785f478ded1 tempest-AttachVolumeTestJSON-1430805297 tempest-AttachVolumeTestJSON-1430805297-project] 10.222.0.45 "GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d" status: 404 len: 111 microversion: 2.1 time: 0.095570 Nov 02 13:00:35.512836 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3139/6334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:35 2022] GET /compute/v2.1/servers/3d6b5ad4-9ed7-469c-bd63-c9be03c4002d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:00:35.572680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:35.581549 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c7754ce3-3659-47e6-8b08-68d5fef43b0e tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1371 microversion: 2.1 time: 0.792256 Nov 02 13:00:35.586705 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3196/6335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:34 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1371 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:36.605135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:36.605768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:36.619119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:36.619639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:36.623137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:36.624135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:36.624808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:36.625665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:37.028038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:37.039684 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-12f4675d-f849-41dd-a03d-79d416df74de tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1371 microversion: 2.1 time: 0.438637 Nov 02 13:00:37.056597 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3140/6336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:36 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:38.067399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:38.068020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:38.083083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:38.083580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:38.090289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:38.091057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:38.091536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:38.092022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:38.454620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:38.479760 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d0678ca0-3211-4411-8916-712176e824c8 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1541 microversion: 2.1 time: 0.412045 Nov 02 13:00:38.486111 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3197/6337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:38 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1541 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:38.513442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:38.517287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:38.535295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:38.535829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:38.536283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:38.538541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:38.539327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:38.541805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:38.900252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:38.975854 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a50a4ddc-414f-4b25-a65d-d52e782e343a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1541 microversion: 2.1 time: 0.447336 Nov 02 13:00:38.978008 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3141/6338] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:38 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1541 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:39.934783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1033012513", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:40.111708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] validate_networks() for [('8ce3f611-70b7-4b6e-a765-062b473932dc', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:00:41.002068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:00:41.003161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:00:41.003925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:00:41.004576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:00:41.005218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:00:41.024090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:41.024933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:41.025616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:41.026983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:41.027688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:41.028345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:41.094353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Getting quotas for project 1bf1fe6cd0d04ca1b6dbd36131c5bba1. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:00:41.108406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Getting quotas for user 277cbeba4dbe4bb19efcfc1b95312321 and project 1bf1fe6cd0d04ca1b6dbd36131c5bba1. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:00:41.138112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:00:41.141703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:00:41.229061 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b62c0fbd-e0f6-4bb0-ab85-96190690136f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933456 Nov 02 13:00:41.231452 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3198/6339] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:00:41.245470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c165267-235c-471f-aa94-404842849d65 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:41.246153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c165267-235c-471f-aa94-404842849d65 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:41.441866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c165267-235c-471f-aa94-404842849d65 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:41.457884 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c165267-235c-471f-aa94-404842849d65 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1224 microversion: 2.1 time: 0.219452 Nov 02 13:00:41.485767 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3142/6340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:41 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1224 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:42.492983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:42.494215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:42.507900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:42.513121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:42.514440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:42.516122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:42.518083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:42.518544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:42.525315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=60 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:42.728779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:42.758917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-82751d13-90c0-40bb-8fcc-3ed469cc59e2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1220 microversion: 2.1 time: 0.269023 Nov 02 13:00:42.760262 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3199/6341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:42 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1220 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:43.785615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:43.786917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:43.816323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:43.820910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:43.822355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:43.825271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:43.827601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:43.830098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:43.838115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:43.981500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:43.999633 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-826debc6-1172-49e2-9543-530c3efdb604 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1282 microversion: 2.1 time: 0.219606 Nov 02 13:00:44.001255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3143/6342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:43 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:45.026609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:45.027336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:45.046308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:45.052979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:45.053944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:45.054907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:45.055674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:45.056299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:45.231646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:45.241048 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6e6f0a8-9a16-4bb0-8a78-0005f041694f tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1282 microversion: 2.1 time: 0.218396 Nov 02 13:00:45.243514 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3200/6343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:45 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:46.272459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:46.273171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:46.282388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:46.283024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:46.284666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:46.285533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:46.285991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:46.286467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:46.737158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:46.765242 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20d4894a-1850-4679-bc3a-ec0e5d5b3ce6 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.497881 Nov 02 13:00:46.766420 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3144/6344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:46 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:47.796865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:47.798786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:47.815660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:47.822073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:47.824808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:47.827474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:47.830707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:47.832079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:47.835081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:48.152508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:48.163918 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a3765b0a-4b8b-4133-aba7-59c6a8c569de tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.372993 Nov 02 13:00:48.164889 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3201/6345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:47 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:49.199731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:49.200372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:49.210099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:49.210616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:49.211623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:49.212816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:49.213861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:49.214630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:49.525104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:49.537331 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a667917e-d124-45b3-8994-476a8495d486 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.348635 Nov 02 13:00:49.538397 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3145/6346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:49 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:50.313275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a58368df-34e0-4787-8c5a-adb7f8ba88b0 req-3730483f-bf32-4263-b4f8-18c711cd9ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcd7f6c-6407-4180-ad52-b59e001712e1", "tag": "8e5720b9-4d75-4e43-9d40-cc6f599ac75f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:50.368099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a58368df-34e0-4787-8c5a-adb7f8ba88b0 req-3730483f-bf32-4263-b4f8-18c711cd9ff1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:50.368690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a58368df-34e0-4787-8c5a-adb7f8ba88b0 req-3730483f-bf32-4263-b4f8-18c711cd9ff1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:50.369129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a58368df-34e0-4787-8c5a-adb7f8ba88b0 req-3730483f-bf32-4263-b4f8-18c711cd9ff1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:50.399031 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a58368df-34e0-4787-8c5a-adb7f8ba88b0 req-3730483f-bf32-4263-b4f8-18c711cd9ff1 service nova] Creating event network-changed:8e5720b9-4d75-4e43-9d40-cc6f599ac75f for instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 on n-h1-855650-5 Nov 02 13:00:50.411572 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a58368df-34e0-4787-8c5a-adb7f8ba88b0 req-3730483f-bf32-4263-b4f8-18c711cd9ff1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105357 Nov 02 13:00:50.412205 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3202/6347] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:50.567217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:50.567852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:50.571826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=36 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:50.580502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:50.581283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:50.581908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:50.582977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:50.583599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:50.584211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:50.809109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:50.827952 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70e654a3-1b44-453d-a9dd-4c1b7b113a5e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.263572 Nov 02 13:00:50.829660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3146/6348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:50 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:51.853483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:51.855690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:51.873401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:51.877162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:51.893783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:51.895154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:51.898422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:51.902421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:51.904377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:51.906677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:52.146059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:52.158435 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69a85cb0-2f84-400b-ae96-2812775d4c4c tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.309896 Nov 02 13:00:52.160343 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3203/6349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:51 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:53.184390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:53.185160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:53.196380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:53.202724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:53.205208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:53.206631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:53.207574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:53.208989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:53.211357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:53.539698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:53.554268 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8df807de-4fde-4de0-b22e-2bc97ed231ee tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.374632 Nov 02 13:00:53.568179 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3147/6350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:53 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:54.302056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:54.306484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:54.315281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:54.315877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:54.317263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:54.318263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:54.318962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:54.319555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:54.413020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91facc09-3da3-4ce8-bfc0-e4799752158e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action" status: 200 len: 24566 microversion: 2.1 time: 0.117256 Nov 02 13:00:54.414249 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3204/6351] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:00:54 2022] POST /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05/action => generated 24566 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:00:54.588999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:54.590214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:54.611554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:54.613687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:54.614889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:54.616605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:54.617754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:54.618958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:55.267554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:55.275752 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20e0fc6d-c4a3-492e-b6dc-0888f927b579 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.695093 Nov 02 13:00:55.290220 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3148/6352] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:54 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:56.306522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:56.307237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:56.340440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:56.340831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:56.341290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:56.342148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:56.342777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:56.343506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:56.568180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:56.578263 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-abb80a03-e244-4931-8fe1-f2ea44c21425 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.275121 Nov 02 13:00:56.579374 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3205/6353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:56 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:57.628038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:57.631181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:57.643427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:57.644273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:57.644930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:57.645873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:57.646702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:57.647164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:57.917796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:57.929925 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96eb39e7-663c-40cd-b987-b44ecf965dca tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.332831 Nov 02 13:00:57.930655 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3149/6354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:57 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:58.807964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-080b2fef-fbb2-4506-8518-033b22ed9810 req-ec7ca59e-d4df-4c03-8cf1-d97752a8729d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcd7f6c-6407-4180-ad52-b59e001712e1", "name": "network-vif-plugged", "status": "completed", "tag": "8e5720b9-4d75-4e43-9d40-cc6f599ac75f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:58.826753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-080b2fef-fbb2-4506-8518-033b22ed9810 req-ec7ca59e-d4df-4c03-8cf1-d97752a8729d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:58.827158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-080b2fef-fbb2-4506-8518-033b22ed9810 req-ec7ca59e-d4df-4c03-8cf1-d97752a8729d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:58.830768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-080b2fef-fbb2-4506-8518-033b22ed9810 req-ec7ca59e-d4df-4c03-8cf1-d97752a8729d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:58.856519 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-080b2fef-fbb2-4506-8518-033b22ed9810 req-ec7ca59e-d4df-4c03-8cf1-d97752a8729d service nova] Creating event network-vif-plugged:8e5720b9-4d75-4e43-9d40-cc6f599ac75f for instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 on n-h1-855650-5 Nov 02 13:00:58.868788 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-080b2fef-fbb2-4506-8518-033b22ed9810 req-ec7ca59e-d4df-4c03-8cf1-d97752a8729d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064482 Nov 02 13:00:58.870310 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3206/6355] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:58.953876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:58.954874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:58.967757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:58.970639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:58.971263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:58.975498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:58.976234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:58.976871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:59.167377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:59.179221 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08395713-4ac0-487c-972c-bf4f37a9635b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.227604 Nov 02 13:00:59.180170 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3150/6356] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:58 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:00.209802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:00.211800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:00.224158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:00.225861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:00.227591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:00.228794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:00.229669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:00.230554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:00.602868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:00.624749 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-85e2cccd-9152-4294-84ad-06cb8ca4734b tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1324 microversion: 2.1 time: 0.420564 Nov 02 13:01:00.625754 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3207/6357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:00 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1324 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:01.649297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:01.651012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:01.668028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:01.671492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:01.673330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:01.676371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:01.678987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:01.680659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:02.026695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:02.040954 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca3772a7-6ffe-4b87-b654-f4978c4139d5 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1520 microversion: 2.1 time: 0.391272 Nov 02 13:01:02.041903 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3151/6358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:01 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:02.293759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13982a26-87df-4840-b001-e7a6d4f38a12 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1150445269", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13982a26-87df-4840-b001-e7a6d4f38a12 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Request method failure captured: Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 243 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmn2PV9I1n-D2ttfdgKrQO6Z43-FEVedb3EtTka7RVcuY7bKF4xMzOJ9aSmY8hAOnF8kdMybc9OXlCYtBrgYBQ63p3sh08u1HT0bSBSnfG8Lu4oYNH5lfb3Gi0W1CiYsCRnfv5mHv9B98INGmySga-i1N3fpoyqWVY3kDH9-9q0Kqr4 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 277cbeba4dbe4bb19efcfc1b95312321 Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1150445269", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1150445269', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8ce3f611-70b7-4b6e-a765-062b473932dc'}]}}} Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'': 'data1'} Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:02.315871 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.319439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-13982a26-87df-4840-b001-e7a6d4f38a12 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:02.324631 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-13982a26-87df-4840-b001-e7a6d4f38a12 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.027775 Nov 02 13:01:02.324631 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3208/6359] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:02 2022] POST /compute/v2.1/servers => generated 175 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:01:02.333022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-991db101-ee1e-41b6-a982-582cc3fadcbe tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:02.333565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-991db101-ee1e-41b6-a982-582cc3fadcbe tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 8b7a0a02-187d-4ab5-9488-99e6f950dbee] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:02.340321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-991db101-ee1e-41b6-a982-582cc3fadcbe tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] HTTP exception thrown: Instance 8b7a0a02-187d-4ab5-9488-99e6f950dbee could not be found. Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-991db101-ee1e-41b6-a982-582cc3fadcbe tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Request method failure captured: Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/8b7a0a02-187d-4ab5-9488-99e6f950dbee/metadata HTTP/1.1 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmn2PV9I1n-D2ttfdgKrQO6Z43-FEVedb3EtTka7RVcuY7bKF4xMzOJ9aSmY8hAOnF8kdMybc9OXlCYtBrgYBQ63p3sh08u1HT0bSBSnfG8Lu4oYNH5lfb3Gi0W1CiYsCRnfv5mHv9B98INGmySga-i1N3fpoyqWVY3kDH9-9q0Kqr4 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 277cbeba4dbe4bb19efcfc1b95312321 Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 8b7a0a02-187d-4ab5-9488-99e6f950dbee could not be found. Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': '8b7a0a02-187d-4ab5-9488-99e6f950dbee'} Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7a0a02-187d-4ab5-9488-99e6f950dbee could not be found. Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7a0a02-187d-4ab5-9488-99e6f950dbee could not be found. Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.352832 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.356373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:02.356373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:02.356373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7a0a02-187d-4ab5-9488-99e6f950dbee could not be found. Nov 02 13:01:02.356373 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.359158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-991db101-ee1e-41b6-a982-582cc3fadcbe tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Returning 404 to user: Instance 8b7a0a02-187d-4ab5-9488-99e6f950dbee could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:02.360303 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-991db101-ee1e-41b6-a982-582cc3fadcbe tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/8b7a0a02-187d-4ab5-9488-99e6f950dbee/metadata" status: 404 len: 111 microversion: 2.1 time: 0.031374 Nov 02 13:01:02.361376 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3152/6360] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 13:01:02 2022] GET /compute/v2.1/servers/8b7a0a02-187d-4ab5-9488-99e6f950dbee/metadata => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:02.440662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71f8e9c3-0965-4bee-bff8-fa09a8d3b0c2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1438836521", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71f8e9c3-0965-4bee-bff8-fa09a8d3b0c2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Request method failure captured: Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 499 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmn2PV9I1n-D2ttfdgKrQO6Z43-FEVedb3EtTka7RVcuY7bKF4xMzOJ9aSmY8hAOnF8kdMybc9OXlCYtBrgYBQ63p3sh08u1HT0bSBSnfG8Lu4oYNH5lfb3Gi0W1CiYsCRnfv5mHv9B98INGmySga-i1N3fpoyqWVY3kDH9-9q0Kqr4 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 277cbeba4dbe4bb19efcfc1b95312321 Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1438836521", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1438836521', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ce3f611-70b7-4b6e-a765-062b473932dc'}]}}} Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:01:02.445702 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.448610 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.454500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-71f8e9c3-0965-4bee-bff8-fa09a8d3b0c2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:02.455469 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-71f8e9c3-0965-4bee-bff8-fa09a8d3b0c2 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.020010 Nov 02 13:01:02.456374 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3209/6361] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:02 2022] POST /compute/v2.1/servers => generated 687 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:01:02.644160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e78d9b71-f321-493b-a02f-a64c00b8f46a tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1866619949", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e78d9b71-f321-493b-a02f-a64c00b8f46a tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Request method failure captured: Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 500 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmn2PV9I1n-D2ttfdgKrQO6Z43-FEVedb3EtTka7RVcuY7bKF4xMzOJ9aSmY8hAOnF8kdMybc9OXlCYtBrgYBQ63p3sh08u1HT0bSBSnfG8Lu4oYNH5lfb3Gi0W1CiYsCRnfv5mHv9B98INGmySga-i1N3fpoyqWVY3kDH9-9q0Kqr4 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 277cbeba4dbe4bb19efcfc1b95312321 Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1866619949", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1866619949', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ce3f611-70b7-4b6e-a765-062b473932dc'}]}}} Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:01:02.648567 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.652322 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.664504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e78d9b71-f321-493b-a02f-a64c00b8f46a tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:02.666634 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e78d9b71-f321-493b-a02f-a64c00b8f46a tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.026756 Nov 02 13:01:02.669370 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3153/6362] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:02 2022] POST /compute/v2.1/servers => generated 689 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:01:02.756529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-beeecb1e-685d-4ca2-aa19-dab7d7f915c3 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-386891977", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-beeecb1e-685d-4ca2-aa19-dab7d7f915c3 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Request method failure captured: Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 753 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmn2PV9I1n-D2ttfdgKrQO6Z43-FEVedb3EtTka7RVcuY7bKF4xMzOJ9aSmY8hAOnF8kdMybc9OXlCYtBrgYBQ63p3sh08u1HT0bSBSnfG8Lu4oYNH5lfb3Gi0W1CiYsCRnfv5mHv9B98INGmySga-i1N3fpoyqWVY3kDH9-9q0Kqr4 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 277cbeba4dbe4bb19efcfc1b95312321 Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-386891977", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-386891977', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ce3f611-70b7-4b6e-a765-062b473932dc'}]}}} Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:01:02.765525 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:01:02.767945 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:01:02.769927 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.769927 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.775153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-beeecb1e-685d-4ca2-aa19-dab7d7f915c3 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:02.776868 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-beeecb1e-685d-4ca2-aa19-dab7d7f915c3 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024527 Nov 02 13:01:02.782160 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3210/6363] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:02 2022] POST /compute/v2.1/servers => generated 1197 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 13:01:02.882699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42de3a53-cd5e-4955-8b15-ddca4c571986 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-970355352", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42de3a53-cd5e-4955-8b15-ddca4c571986 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Request method failure captured: Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 1265 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmn2PV9I1n-D2ttfdgKrQO6Z43-FEVedb3EtTka7RVcuY7bKF4xMzOJ9aSmY8hAOnF8kdMybc9OXlCYtBrgYBQ63p3sh08u1HT0bSBSnfG8Lu4oYNH5lfb3Gi0W1CiYsCRnfv5mHv9B98INGmySga-i1N3fpoyqWVY3kDH9-9q0Kqr4 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 277cbeba4dbe4bb19efcfc1b95312321 Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-970355352", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ce3f611-70b7-4b6e-a765-062b473932dc"}]}} Nov 02 13:01:02.887514 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-970355352', 'imageRef': '5a18a9e9-495a-4970-9f7b-124577e0709a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ce3f611-70b7-4b6e-a765-062b473932dc'}]}}} Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.889559 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:01:02.890604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:01:02.892139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:01:02.892139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.893033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42de3a53-cd5e-4955-8b15-ddca4c571986 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:02.894126 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42de3a53-cd5e-4955-8b15-ddca4c571986 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.017681 Nov 02 13:01:02.894585 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3154/6364] 10.222.0.45 () {60 vars in 1148 bytes} [Wed Nov 2 13:01:02 2022] POST /compute/v2.1/servers => generated 2221 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 13:01:02.905631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c0ebf317-ed38-4e4b-8372-602272ba6f58 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:02.906738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c0ebf317-ed38-4e4b-8372-602272ba6f58 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 90ca38e7-907d-4e8b-8725-759c0deec8d9] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:02.917862 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-c0ebf317-ed38-4e4b-8372-602272ba6f58 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] HTTP exception thrown: Instance 90ca38e7-907d-4e8b-8725-759c0deec8d9 could not be found. Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c0ebf317-ed38-4e4b-8372-602272ba6f58 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Request method failure captured: Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/90ca38e7-907d-4e8b-8725-759c0deec8d9/metadata/test2 HTTP/1.1 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmn2PV9I1n-D2ttfdgKrQO6Z43-FEVedb3EtTka7RVcuY7bKF4xMzOJ9aSmY8hAOnF8kdMybc9OXlCYtBrgYBQ63p3sh08u1HT0bSBSnfG8Lu4oYNH5lfb3Gi0W1CiYsCRnfv5mHv9B98INGmySga-i1N3fpoyqWVY3kDH9-9q0Kqr4 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 277cbeba4dbe4bb19efcfc1b95312321 Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 90ca38e7-907d-4e8b-8725-759c0deec8d9 could not be found. Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': '90ca38e7-907d-4e8b-8725-759c0deec8d9', 'id': 'test2'} Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ca38e7-907d-4e8b-8725-759c0deec8d9 could not be found. Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ca38e7-907d-4e8b-8725-759c0deec8d9 could not be found. Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:02.924042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:02.927931 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:02.927931 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:02.927931 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ca38e7-907d-4e8b-8725-759c0deec8d9 could not be found. Nov 02 13:01:02.927931 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:02.927931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c0ebf317-ed38-4e4b-8372-602272ba6f58 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Returning 404 to user: Instance 90ca38e7-907d-4e8b-8725-759c0deec8d9 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:02.930312 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c0ebf317-ed38-4e4b-8372-602272ba6f58 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/90ca38e7-907d-4e8b-8725-759c0deec8d9/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027013 Nov 02 13:01:02.931444 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3211/6365] 10.222.0.45 () {58 vars in 1281 bytes} [Wed Nov 2 13:01:02 2022] GET /compute/v2.1/servers/90ca38e7-907d-4e8b-8725-759c0deec8d9/metadata/test2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:02.946709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:02.947297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:02.960756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:02.963073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:02.963678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:02.966264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:02.967421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:02.969272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:03.081915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:01:03.277826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b5cb2047-5724-4b9d-826d-42cfea066d57 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 204 len: 0 microversion: 2.1 time: 0.334986 Nov 02 13:01:03.279049 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3155/6366] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:01:02 2022] DELETE /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:01:03.294439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:03.295909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:03.302799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:03.304344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:03.305565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:03.306696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:03.307346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:03.308126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:03.699368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:03.719696 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-23a82a8f-7110-4606-8109-201aa1adf7a7 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1526 microversion: 2.1 time: 0.434229 Nov 02 13:01:03.740440 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3212/6367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:03 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1526 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:04.759999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:04.761474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:04.772818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:04.777302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:04.777949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:04.778929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:04.780737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:04.786107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:05.293288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:05.308984 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-936b27e0-5242-4f61-b93a-87d70e567e0e tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1526 microversion: 2.1 time: 0.561804 Nov 02 13:01:05.311720 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3156/6368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:04 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1526 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:06.274477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-3514f29e-d51a-4f13-accc-7d762fb7e184 req-36c801a0-65ef-4a13-8ac7-374b4033c624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcd7f6c-6407-4180-ad52-b59e001712e1", "name": "network-vif-deleted", "tag": "8e5720b9-4d75-4e43-9d40-cc6f599ac75f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:06.305378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3514f29e-d51a-4f13-accc-7d762fb7e184 req-36c801a0-65ef-4a13-8ac7-374b4033c624 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:06.314587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3514f29e-d51a-4f13-accc-7d762fb7e184 req-36c801a0-65ef-4a13-8ac7-374b4033c624 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:06.315844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-3514f29e-d51a-4f13-accc-7d762fb7e184 req-36c801a0-65ef-4a13-8ac7-374b4033c624 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:06.340781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:06.342114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:06.354065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:06.358389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:06.359235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:06.360181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:06.360955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:06.361585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:06.382856 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-3514f29e-d51a-4f13-accc-7d762fb7e184 req-36c801a0-65ef-4a13-8ac7-374b4033c624 service nova] Creating event network-vif-deleted:8e5720b9-4d75-4e43-9d40-cc6f599ac75f for instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 on n-h1-855650-5 Nov 02 13:01:06.406748 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-3514f29e-d51a-4f13-accc-7d762fb7e184 req-36c801a0-65ef-4a13-8ac7-374b4033c624 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131274 Nov 02 13:01:06.414056 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3213/6369] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:06.503147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cbeba4dbe4bb19efcfc1b95312321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf1fe6cd0d04ca1b6dbd36131c5bba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:06.512397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 200 len: 1309 microversion: 2.1 time: 0.178309 Nov 02 13:01:06.518083 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3157/6370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:06 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 1309 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:01:07.542621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:07.544756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] [instance: 4bcd7f6c-6407-4180-ad52-b59e001712e1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:07.554804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:07.555540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:07.556147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:07.557035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:07.557645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:07.558268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:07.585706 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] HTTP exception thrown: Instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 could not be found. Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Request method failure captured: Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 HTTP/1.1 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmn2PV9I1n-D2ttfdgKrQO6Z43-FEVedb3EtTka7RVcuY7bKF4xMzOJ9aSmY8hAOnF8kdMybc9OXlCYtBrgYBQ63p3sh08u1HT0bSBSnfG8Lu4oYNH5lfb3Gi0W1CiYsCRnfv5mHv9B98INGmySga-i1N3fpoyqWVY3kDH9-9q0Kqr4 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1bf1fe6cd0d04ca1b6dbd36131c5bba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 1bf1fe6cd0d04ca1b6dbd36131c5bba1 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-598294741 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 277cbeba4dbe4bb19efcfc1b95312321 Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-598294741-project Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 could not be found. Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '4bcd7f6c-6407-4180-ad52-b59e001712e1'} Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 could not be found. Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 could not be found. Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:07.587840 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:07.592566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:07.592566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:07.592566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:07.592566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:07.592566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:07.592566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:07.592566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 could not be found. Nov 02 13:01:07.592566 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:07.593920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Returning 404 to user: Instance 4bcd7f6c-6407-4180-ad52-b59e001712e1 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:07.595220 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6f6afc54-736b-407e-8374-a1bd51c40d04 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1" status: 404 len: 111 microversion: 2.1 time: 0.058261 Nov 02 13:01:07.596328 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3214/6371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:07 2022] GET /compute/v2.1/servers/4bcd7f6c-6407-4180-ad52-b59e001712e1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:16.061001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:16.063090 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae7212ba-aadf-4e45-9935-590f03df4f98 tempest-ServerMetadataNegativeTestJSON-598294741 tempest-ServerMetadataNegativeTestJSON-598294741-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003288 Nov 02 13:01:16.064640 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3158/6372] 10.222.0.45 () {56 vars in 886 bytes} [Wed Nov 2 13:01:16 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 13:01:19.718814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:19.720480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:19.730798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=21 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:19.732977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=53 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:19.741731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:19.745053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:19.746827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:19.750682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:19.764427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:19.769653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:19.861108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:01:19.904790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:19.906420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:20.099669 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e091f40-a95c-435f-a76f-b8f9bae313e2 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 204 len: 0 microversion: 2.1 time: 0.384171 Nov 02 13:01:20.105290 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3215/6373] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:01:19 2022] DELETE /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:01:20.119179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:20.123998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:20.145111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:20.145625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:20.146101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:20.146842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:20.150929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:20.154150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:20.437141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:20.453721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e31b8bf8-1b27-415b-998a-8cb25c070d43 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1547 microversion: 2.1 time: 0.341887 Nov 02 13:01:20.455293 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3216/6374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:20 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1547 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:20.581583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d428ead4-be3b-4c04-b646-603f3540b4e6 tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] Calling method '.version_select at 0x7f228e540670>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:21.166708 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d428ead4-be3b-4c04-b646-603f3540b4e6 tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e/defaults" status: 200 len: 371 microversion: 2.1 time: 1.279452 Nov 02 13:01:21.167755 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3159/6375] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 13:01:19 2022] GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e/defaults => generated 371 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:21.180232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2d4585ed-e39a-495f-ba84-730354a0d0e3 tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] Calling method '.version_select at 0x7f228d5774c0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:21.466544 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2d4585ed-e39a-495f-ba84-730354a0d0e3 tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e" status: 200 len: 371 microversion: 2.1 time: 0.290522 Nov 02 13:01:21.482745 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3217/6376] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 13:01:21 2022] GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:21.491768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:21.495678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fca2a53-c9f8-4ca9-a8da-7b10bb70a5ee tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] Calling method '.version_select at 0x7f228e540e50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:21.498774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:21.512255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:21.514982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:21.518833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:21.520223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:21.525397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:21.526125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:22.061640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:22.079595 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-62225511-19f0-4f1f-8923-b6e1d1f05e4b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1547 microversion: 2.1 time: 0.594931 Nov 02 13:01:22.087379 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3218/6377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:21 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1547 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:22.358833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fca2a53-c9f8-4ca9-a8da-7b10bb70a5ee tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.878201 Nov 02 13:01:22.369712 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3160/6378] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 13:01:21 2022] GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e/defaults => generated 371 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:22.375734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-948fd450-1620-4bc4-8300-51b67b4591c5 tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] Calling method '.version_select at 0x7f228d577550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:22.901622 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-948fd450-1620-4bc4-8300-51b67b4591c5 tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e" status: 200 len: 371 microversion: 2.1 time: 0.529778 Nov 02 13:01:22.904324 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3219/6379] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 13:01:22 2022] GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e => generated 371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:22.918427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf27ab74-27b3-4609-ad22-2317c4c0dc0e tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] Calling method '.version_select at 0x7f228d577ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:23.130782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a4b92e99-d925-49a5-a64c-62ad886cf43f req-0d5ed375-5007-43f5-8b0f-199ab5fde708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0deb170-bd40-4343-b123-699cf113681f", "name": "network-vif-deleted", "tag": "6ea04f10-9945-491c-b26b-bdea15187c76"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:23.156681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4b92e99-d925-49a5-a64c-62ad886cf43f req-0d5ed375-5007-43f5-8b0f-199ab5fde708 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:23.157417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4b92e99-d925-49a5-a64c-62ad886cf43f req-0d5ed375-5007-43f5-8b0f-199ab5fde708 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:23.158069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4b92e99-d925-49a5-a64c-62ad886cf43f req-0d5ed375-5007-43f5-8b0f-199ab5fde708 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:23.184823 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a4b92e99-d925-49a5-a64c-62ad886cf43f req-0d5ed375-5007-43f5-8b0f-199ab5fde708 service nova] Creating event network-vif-deleted:6ea04f10-9945-491c-b26b-bdea15187c76 for instance f0deb170-bd40-4343-b123-699cf113681f on n-h1-855650-5 Nov 02 13:01:23.194941 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a4b92e99-d925-49a5-a64c-62ad886cf43f req-0d5ed375-5007-43f5-8b0f-199ab5fde708 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463204 Nov 02 13:01:23.202909 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3161/6380] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:23.237403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:23.239460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:23.250859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:23.251705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:23.252420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:23.253472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:23.254035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:23.254616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:23.337143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:23.338060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:23.338942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:23.339678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lazy-loading 'fault' on Instance uuid f0deb170-bd40-4343-b123-699cf113681f {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:01:23.397675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:23.426631 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-35572576-556e-4cca-bcdd-4b1cd25144f7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 200 len: 1336 microversion: 2.1 time: 0.220407 Nov 02 13:01:23.430709 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3162/6381] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:23 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 1336 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:23.664135 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf27ab74-27b3-4609-ad22-2317c4c0dc0e tempest-QuotasTestJSON-486133487 tempest-QuotasTestJSON-486133487-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e?user_id=15c35db367ab4f87a40ca3e894db0516" status: 200 len: 371 microversion: 2.1 time: 0.749433 Nov 02 13:01:23.675838 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3220/6382] 10.222.0.45 () {58 vars in 1323 bytes} [Wed Nov 2 13:01:22 2022] GET /compute/v2.1/os-quota-sets/973877b466bf4d8d9454c1711ba4be2e?user_id=15c35db367ab4f87a40ca3e894db0516 => generated 371 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:24.458121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:24.459814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: f0deb170-bd40-4343-b123-699cf113681f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:24.471203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:24.472148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:24.473425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:24.474594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:24.475438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:24.476352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:24.500916 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] HTTP exception thrown: Instance f0deb170-bd40-4343-b123-699cf113681f could not be found. Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Request method failure captured: Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f HTTP/1.1 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmle7TU0EhZfVbE7nsgnUfFZNZ-BvEkSEkRe2DHBnLF7_r2KerIpjKoE8Vh4KPOFlt4dfbJiPel2o-YEaI5GIsFG3te1Ji2LMiT4XPaAup22CEYqE_41GqyJDYng4RiVaW3LIrrTdw3nlLAvMedzEM1iSzkaAS1dpBCKikiUm4kR5e0 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: c9764cefb5494bc9abb1518bd0b30681 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: c9764cefb5494bc9abb1518bd0b30681 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestNetworkBasicOps-1973841742-project Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 01745029847d4f7eba5ed111fd14d395 Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestNetworkBasicOps-1973841742-project Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance f0deb170-bd40-4343-b123-699cf113681f could not be found. Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'f0deb170-bd40-4343-b123-699cf113681f'} Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0deb170-bd40-4343-b123-699cf113681f could not be found. Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0deb170-bd40-4343-b123-699cf113681f could not be found. Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:24.505140 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:24.508947 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:24.508947 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:24.508947 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:24.508947 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:24.508947 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:24.508947 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0deb170-bd40-4343-b123-699cf113681f could not be found. Nov 02 13:01:24.508947 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:01:24.511460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Returning 404 to user: Instance f0deb170-bd40-4343-b123-699cf113681f could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:24.514305 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83966865-b01e-4fb5-8b6b-4744ffad6775 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f" status: 404 len: 111 microversion: 2.1 time: 0.059307 Nov 02 13:01:24.516012 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3163/6383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:24 2022] GET /compute/v2.1/servers/f0deb170-bd40-4343-b123-699cf113681f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:24.939216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9589247-6e02-45bd-aa3b-823804c0d846 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '.version_select at 0x7f228d5c3550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:25.002647 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9589247-6e02-45bd-aa3b-823804c0d846 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-894651676" status: 202 len: 0 microversion: 2.1 time: 0.068064 Nov 02 13:01:25.006391 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3221/6384] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Nov 2 13:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-894651676 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:01:25.069018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:25.069707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:25.090420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:25.092358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:25.094600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:25.096805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:25.100251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:25.102766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:25.489545 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-72eaf7dc-c3d5-4362-ad7d-845fd9ea7047 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1832 microversion: 2.1 time: 0.426280 Nov 02 13:01:25.491530 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3164/6385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:25 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1832 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:27.812125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:27.812646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:27.831412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:27.831936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:27.832392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:27.833141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:27.834006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:27.834502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:27.875417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8b2b2933-f6b3-45db-929b-c60eee0f012c req-aee8f99d-a6b5-41d6-84cc-eb2e0c55630c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828458af-cb07-4ccc-a4cd-98b1d85aed05", "tag": "63484f33-b31a-4c62-8b55-95dce3962dca"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:27.884891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:01:27.889788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8b2b2933-f6b3-45db-929b-c60eee0f012c req-aee8f99d-a6b5-41d6-84cc-eb2e0c55630c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:27.890946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8b2b2933-f6b3-45db-929b-c60eee0f012c req-aee8f99d-a6b5-41d6-84cc-eb2e0c55630c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:27.891621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8b2b2933-f6b3-45db-929b-c60eee0f012c req-aee8f99d-a6b5-41d6-84cc-eb2e0c55630c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:27.909387 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8b2b2933-f6b3-45db-929b-c60eee0f012c req-aee8f99d-a6b5-41d6-84cc-eb2e0c55630c service nova] Creating event network-changed:63484f33-b31a-4c62-8b55-95dce3962dca for instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 on n-h2-855650-5 Nov 02 13:01:27.916521 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8b2b2933-f6b3-45db-929b-c60eee0f012c req-aee8f99d-a6b5-41d6-84cc-eb2e0c55630c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047023 Nov 02 13:01:27.918051 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3165/6386] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:28.088976 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c063f156-776a-4643-a5bc-1341adf5acef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "DELETE /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 204 len: 0 microversion: 2.1 time: 0.280914 Nov 02 13:01:28.089595 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3222/6387] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:01:27 2022] DELETE /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:01:28.099621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:28.100346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:28.115736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:28.116267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:28.116967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:28.117454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:28.117931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:28.123514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:28.452753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:28.461582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d4af8245-9742-4f4f-9a96-b87b8aa4a94c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1687 microversion: 2.1 time: 0.366506 Nov 02 13:01:28.468322 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3166/6388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:28 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1687 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:29.499411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:29.500789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:29.514810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:29.525700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:29.526663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:29.527550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:29.528012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:29.528966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:30.026064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:30.037273 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-73b17c3d-77cd-4bb0-9e8c-48ffe5964835 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1687 microversion: 2.1 time: 0.544790 Nov 02 13:01:30.038870 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3223/6389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:29 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1687 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:31.016524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:31.017242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:31.032112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.035678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.037323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:31.040166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.042080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.043009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:31.043996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-77899777-98ba-4679-a1c9-6efc50e51737 req-84d94fd9-82a7-4640-ba71-bd2a75ba832d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffc9ccc-7c02-484a-8cdc-87aaba4479bf", "tag": "f86f3706-0e6d-4478-be65-576b9d06b430"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:31.115735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-77899777-98ba-4679-a1c9-6efc50e51737 req-84d94fd9-82a7-4640-ba71-bd2a75ba832d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.116620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-77899777-98ba-4679-a1c9-6efc50e51737 req-84d94fd9-82a7-4640-ba71-bd2a75ba832d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.119678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-77899777-98ba-4679-a1c9-6efc50e51737 req-84d94fd9-82a7-4640-ba71-bd2a75ba832d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:31.171380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:01:31.201243 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-77899777-98ba-4679-a1c9-6efc50e51737 req-84d94fd9-82a7-4640-ba71-bd2a75ba832d service nova] Creating event network-changed:f86f3706-0e6d-4478-be65-576b9d06b430 for instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf on n-h1-855650-5 Nov 02 13:01:31.237872 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-77899777-98ba-4679-a1c9-6efc50e51737 req-84d94fd9-82a7-4640-ba71-bd2a75ba832d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200483 Nov 02 13:01:31.253334 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3224/6390] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:31.278908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:31.290584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:31.329247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.334806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.335951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:31.337808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.343103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.344412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:31.510763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-020e0c7a-45bf-4406-8de1-fdd4f188edc5 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 204 len: 0 microversion: 2.1 time: 0.499791 Nov 02 13:01:31.511518 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3167/6391] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:01:31 2022] DELETE /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:01:31.527214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:31.532845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:31.563592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.564112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.564576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:31.565322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.565806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.566298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:32.235578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:32.264510 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b04be913-b69e-4e57-81b8-cad21767e699 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1671 microversion: 2.1 time: 0.747460 Nov 02 13:01:32.266254 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3168/6392] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:31 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1671 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:32.550976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:32.562935 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be912b2d-c51d-4e05-89fd-404b38354048 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 200 len: 1687 microversion: 2.1 time: 1.306211 Nov 02 13:01:32.563546 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3225/6393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:31 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 1687 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:33.301052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:33.302911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:33.331139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:33.334494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-30f648d0-40bf-4c42-9f1a-1c4dcc43be74 req-490e295b-549e-42a4-85f5-58db441590d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828458af-cb07-4ccc-a4cd-98b1d85aed05", "name": "network-vif-deleted", "tag": "63484f33-b31a-4c62-8b55-95dce3962dca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:33.335789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:33.339319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:33.340520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:33.343518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:33.344066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:33.357672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-30f648d0-40bf-4c42-9f1a-1c4dcc43be74 req-490e295b-549e-42a4-85f5-58db441590d2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:33.360708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-30f648d0-40bf-4c42-9f1a-1c4dcc43be74 req-490e295b-549e-42a4-85f5-58db441590d2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:33.362879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-30f648d0-40bf-4c42-9f1a-1c4dcc43be74 req-490e295b-549e-42a4-85f5-58db441590d2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:33.395543 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-30f648d0-40bf-4c42-9f1a-1c4dcc43be74 req-490e295b-549e-42a4-85f5-58db441590d2 service nova] Creating event network-vif-deleted:63484f33-b31a-4c62-8b55-95dce3962dca for instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 on n-h2-855650-5 Nov 02 13:01:33.409568 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-30f648d0-40bf-4c42-9f1a-1c4dcc43be74 req-490e295b-549e-42a4-85f5-58db441590d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081528 Nov 02 13:01:33.410967 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3226/6394] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:01:33.589662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:33.592158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 828458af-cb07-4ccc-a4cd-98b1d85aed05] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:33.603979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:33.605381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:33.608197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:33.611985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:33.614083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:33.614995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:33.663096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:33.669941 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] HTTP exception thrown: Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 could not be found. Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Request method failure captured: Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 HTTP/1.1 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmka0UtFqJo2p1FuykiDL2PwMcgraY9pqGeA62hyS-KcQKxCFIPsV1EHPqy8Xx9mC5sS8GeLrRB-WIrkKZRktqGfjXQkW8-F7y5h0nkAthBHoj_HauQLaycYcEgKRwbq1hWX-gqpL_uyQPOXVYNpwgGlz5_2rN-Uxx8W2JjBjVs3a2A Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 8b8298d308cf40d6adfae4b378b13281 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 8b8298d308cf40d6adfae4b378b13281 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestNetworkAdvancedServerOps-1410606748-project Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 04b040caac0349ffbe7e23b18769bad1 Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1410606748-project Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 could not be found. Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '828458af-cb07-4ccc-a4cd-98b1d85aed05'} Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 could not be found. Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 could not be found. Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:33.675788 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:33.680550 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:33.680550 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:33.680550 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:33.680550 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:33.680550 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:33.680550 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:33.680550 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 could not be found. Nov 02 13:01:33.680550 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:33.682888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Returning 404 to user: Instance 828458af-cb07-4ccc-a4cd-98b1d85aed05 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:33.687228 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c8a74a1-7201-4d6d-b605-f8429c6b98c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05" status: 404 len: 111 microversion: 2.1 time: 0.099294 Nov 02 13:01:33.690807 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3227/6395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:33 2022] GET /compute/v2.1/servers/828458af-cb07-4ccc-a4cd-98b1d85aed05 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:01:34.658375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:34.669541 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-23e6dda8-c413-41fc-a164-38b3bdbe46f0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1671 microversion: 2.1 time: 1.380145 Nov 02 13:01:34.671562 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3169/6396] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:33 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1671 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:35.704333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:35.706690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-54fecee6-56cf-4536-a50e-43968097ff07 req-74d5580d-2b60-4ea0-bd14-780a3f6dbb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffc9ccc-7c02-484a-8cdc-87aaba4479bf", "name": "network-vif-deleted", "tag": "f86f3706-0e6d-4478-be65-576b9d06b430"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:35.710459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:35.741908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:35.746762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:35.749071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:35.755137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:35.755736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:35.756326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:35.757889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-54fecee6-56cf-4536-a50e-43968097ff07 req-74d5580d-2b60-4ea0-bd14-780a3f6dbb9c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:35.758407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-54fecee6-56cf-4536-a50e-43968097ff07 req-74d5580d-2b60-4ea0-bd14-780a3f6dbb9c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:35.758837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-54fecee6-56cf-4536-a50e-43968097ff07 req-74d5580d-2b60-4ea0-bd14-780a3f6dbb9c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:35.825747 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-54fecee6-56cf-4536-a50e-43968097ff07 req-74d5580d-2b60-4ea0-bd14-780a3f6dbb9c service nova] Creating event network-vif-deleted:f86f3706-0e6d-4478-be65-576b9d06b430 for instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf on n-h1-855650-5 Nov 02 13:01:35.877218 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-54fecee6-56cf-4536-a50e-43968097ff07 req-74d5580d-2b60-4ea0-bd14-780a3f6dbb9c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185475 Nov 02 13:01:35.884521 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3228/6397] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:36.124101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:36.142149 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ad20e9b-c599-450b-9581-4fee8c5c912c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 200 len: 1333 microversion: 2.1 time: 0.438540 Nov 02 13:01:36.142886 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3170/6398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:35 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 1333 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:01:37.173496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:37.174714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:37.202215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:37.204397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:37.208384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:37.211789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:37.213821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:37.214367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:37.277073 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] HTTP exception thrown: Instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf could not be found. Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Request method failure captured: Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf HTTP/1.1 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmle7TU0EhZfVbE7nsgnUfFZNZ-BvEkSEkRe2DHBnLF7_r2KerIpjKoE8Vh4KPOFlt4dfbJiPel2o-YEaI5GIsFG3te1Ji2LMiT4XPaAup22CEYqE_41GqyJDYng4RiVaW3LIrrTdw3nlLAvMedzEM1iSzkaAS1dpBCKikiUm4kR5e0 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c9764cefb5494bc9abb1518bd0b30681 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c9764cefb5494bc9abb1518bd0b30681 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestNetworkBasicOps-1973841742-project Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 01745029847d4f7eba5ed111fd14d395 Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestNetworkBasicOps-1973841742-project Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf could not be found. Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '0ffc9ccc-7c02-484a-8cdc-87aaba4479bf'} Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf could not be found. Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf could not be found. Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:37.282730 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:37.287352 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:37.287352 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:37.287352 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:37.287352 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:37.287352 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:37.287352 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf could not be found. Nov 02 13:01:37.287352 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:01:37.287352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Returning 404 to user: Instance 0ffc9ccc-7c02-484a-8cdc-87aaba4479bf could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:37.288425 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be1c8ebc-d923-47e4-b4bc-ca8b330559d0 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf" status: 404 len: 111 microversion: 2.1 time: 0.116740 Nov 02 13:01:37.291163 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3229/6399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:37 2022] GET /compute/v2.1/servers/0ffc9ccc-7c02-484a-8cdc-87aaba4479bf => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:38.130960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e729e163-034e-4e49-a29b-0de71dae2a91 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '.version_select at 0x7f228e520940>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:38.186422 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e729e163-034e-4e49-a29b-0de71dae2a91 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-901532192" status: 202 len: 0 microversion: 2.1 time: 0.069291 Nov 02 13:01:38.188865 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3171/6400] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Nov 2 13:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-901532192 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:01:41.947228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5dac2f74-fad7-4c8a-97fa-48eef49b6746 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'create', calling method: .version_select at 0x7f228d5bf0d0>, body: {"keypair": {"name": "tempest-keypair-1238230704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnE7Wn+8t85JN/eFLcPwgW26/5SnrfLw0LwvzxSyUtmcXXa9QxyDuzV0y8TgiYIXnkJ8IhTrwiQb5dXc5vPCkCfAYvGxRfdeN5hQg/yuhLxyRCbSvyJ5eNDsISAo6Axjw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:42.040779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-5dac2f74-fad7-4c8a-97fa-48eef49b6746 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Getting quotas for project db87a366a2344c26a6c308bdcb09fcc2. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:01:42.062983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-5dac2f74-fad7-4c8a-97fa-48eef49b6746 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Getting quotas for user 1308290b670740a5b33f056eb704da34 and project db87a366a2344c26a6c308bdcb09fcc2. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:01:42.130455 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5dac2f74-fad7-4c8a-97fa-48eef49b6746 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.525363 Nov 02 13:01:42.131061 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3230/6401] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 13:01:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 527 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:01:42.576136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b53c8eab-3f22-49e0-897e-a4a367e20f5e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '.version_select at 0x7f228e6c1dc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:42.646528 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b53c8eab-3f22-49e0-897e-a4a367e20f5e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1336517644" status: 202 len: 0 microversion: 2.1 time: 0.073547 Nov 02 13:01:42.647193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3172/6402] 10.222.0.45 () {58 vars in 1284 bytes} [Wed Nov 2 13:01:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1336517644 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:01:42.691973 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8ee8192e-3b80-43f7-a3fa-308eb4b3c279 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'create', calling method: .version_select at 0x7f228d726d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1569064744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcrY3PE9NxgUhpo6BOXadXbvibGr94Wiyg28VSbRO1+jjUSSR4d5fxRzHpvHNP/P4ols15YHdCzllWGeXa0GA4GLj7Z0Ms8qaTkNuxkfzwPkwYMcnq5az2S1KSt+HEW/w=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:42.732885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8ee8192e-3b80-43f7-a3fa-308eb4b3c279 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for project 8b8298d308cf40d6adfae4b378b13281. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:01:42.745840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-8ee8192e-3b80-43f7-a3fa-308eb4b3c279 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for user 04b040caac0349ffbe7e23b18769bad1 and project 8b8298d308cf40d6adfae4b378b13281. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:01:42.805438 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8ee8192e-3b80-43f7-a3fa-308eb4b3c279 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.118069 Nov 02 13:01:42.810045 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3231/6403] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:01:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:46.718171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-151351903", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de99c087-a45a-4579-82b6-5a57b54c2cab"}], "security_groups": [{"name": "tempest-securitygroup--268505173"}], "key_name": "tempest-keypair-1238230704", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:46.747541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:46.999108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] validate_networks() for [('de99c087-a45a-4579-82b6-5a57b54c2cab', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:01:49.034095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:01:49.034828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:01:49.035561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:01:49.036188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:01:49.037158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:01:49.052363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:49.053787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:49.054454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:49.055646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:49.056220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:49.056834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:49.083541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Getting quotas for project db87a366a2344c26a6c308bdcb09fcc2. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:01:49.091729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Getting quotas for user 1308290b670740a5b33f056eb704da34 and project db87a366a2344c26a6c308bdcb09fcc2. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:01:49.108784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:01:49.112083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:01:49.169367 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fef73ca1-7580-41c5-948b-c738d1e4ca06 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.458607 Nov 02 13:01:49.171010 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3173/6404] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 13:01:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:01:49.182876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:49.188018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2c01f8c7-a1d1-4c69-b647-fc82954fb679 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:49.189100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2c01f8c7-a1d1-4c69-b647-fc82954fb679 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:49.364982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c01f8c7-a1d1-4c69-b647-fc82954fb679 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:49.379173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c01f8c7-a1d1-4c69-b647-fc82954fb679 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:49.381164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2c01f8c7-a1d1-4c69-b647-fc82954fb679 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:49.382928 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2c01f8c7-a1d1-4c69-b647-fc82954fb679 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1281 microversion: 2.20 time: 0.201855 Nov 02 13:01:49.384439 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3232/6405] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:49 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1281 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:50.416184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:50.417021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:50.421172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:50.436035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:50.438575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:50.439111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:50.440105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:50.440747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:50.441355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:50.531783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:50.541442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:50.543165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:50.544415 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef61b87d-5c01-44e4-a1f9-ce4c697e5697 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1333 microversion: 2.20 time: 0.133464 Nov 02 13:01:50.550142 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3174/6406] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:50 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1333 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:51.576713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:51.578929 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:51.583868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:51.593022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:51.594121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:51.595176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:51.596392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:51.598166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:51.598898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:51.705857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:51.719429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:51.723072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:51.725588 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49ba5945-cc4e-4c28-82a1-ddd6d98394b6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1339 microversion: 2.20 time: 0.156847 Nov 02 13:01:51.727151 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3233/6407] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:51 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:52.755932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:52.756858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:52.771310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:52.775299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:52.777174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:52.778606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:52.780600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:52.782529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:53.107102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:53.119397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:53.125189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:53.131461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9582038-a002-48de-9891-0497250c7bd2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 0.380104 Nov 02 13:01:53.134814 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3175/6408] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:52 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:54.167201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:54.171042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:54.179076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:54.181521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:54.182740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:54.184428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:54.185059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:54.185874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:55.018711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:55.031888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:55.033465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:55.047794 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-45e4f0de-1f01-4bca-ac15-5ed28af39ca7 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 0.889293 Nov 02 13:01:55.059188 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3234/6409] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:54 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:55.260158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f2d05d39-c5d9-4a90-949d-81c0a792b0ce req-a0fe4a4a-a51b-4921-baa8-095763f08d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad3a63e-391c-42f6-bc91-7d20cfd463bc", "tag": "c254ced1-e0d3-4599-86fb-a61c7b4c210e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:55.289263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f2d05d39-c5d9-4a90-949d-81c0a792b0ce req-a0fe4a4a-a51b-4921-baa8-095763f08d86 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:55.296465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f2d05d39-c5d9-4a90-949d-81c0a792b0ce req-a0fe4a4a-a51b-4921-baa8-095763f08d86 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:55.297333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f2d05d39-c5d9-4a90-949d-81c0a792b0ce req-a0fe4a4a-a51b-4921-baa8-095763f08d86 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:55.326220 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f2d05d39-c5d9-4a90-949d-81c0a792b0ce req-a0fe4a4a-a51b-4921-baa8-095763f08d86 service nova] Creating event network-changed:c254ced1-e0d3-4599-86fb-a61c7b4c210e for instance fad3a63e-391c-42f6-bc91-7d20cfd463bc on n-h1-855650-5 Nov 02 13:01:55.337533 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f2d05d39-c5d9-4a90-949d-81c0a792b0ce req-a0fe4a4a-a51b-4921-baa8-095763f08d86 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082038 Nov 02 13:01:55.341128 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3176/6410] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:01:56.075751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:56.076365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:56.091859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:56.092254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:56.092905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:56.093703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:56.094469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:56.095596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:56.554381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:56.567468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:56.569140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:56.576179 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce433d59-3342-4bca-9e4c-c9c033035e9a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 0.504329 Nov 02 13:01:56.578216 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3235/6411] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:56 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:57.617253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:57.618221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:57.626408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:57.626928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:57.627524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:57.628360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:57.628834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:57.629383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:58.713537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:58.739300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:58.753775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:58.757844 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0589e5e3-f48d-4089-b548-71e64816304b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 1.156960 Nov 02 13:01:58.760578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3177/6412] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:57 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:59.791553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:59.794153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:59.797385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:59.818260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:59.819227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:59.820054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:59.823507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:59.824307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:59.825013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:00.122381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-218578364", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "dfd46b5f-2acf-441c-aa3f-0b2720aa2f7a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1569064744", "security_groups": [{"name": "tempest-secgroup-smoke-1126674088"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:00.160254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:00.163465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:00.206629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:00.239067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:00.243237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:00.248763 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6288dd2-0980-488b-b2bf-642e0e2599af tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 0.464510 Nov 02 13:02:00.251762 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3236/6413] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:59 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:00.387773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] validate_networks() for [('dfd46b5f-2acf-441c-aa3f-0b2720aa2f7a', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:02:01.278262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:01.279042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:01.295370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:01.295897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:01.296615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:01.297338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:01.298260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:01.299586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:02.200649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:02:02.202218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:02:02.202865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:02:02.203641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:02:02.204313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:02:02.232835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:02.233499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:02.234065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:02.235392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:02.236086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:02.238771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:02.299912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for project 8b8298d308cf40d6adfae4b378b13281. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:02:02.319878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for user 04b040caac0349ffbe7e23b18769bad1 and project 8b8298d308cf40d6adfae4b378b13281. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:02:02.356103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:02:02.359111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:02:02.458186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:02.471767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:02.477395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:02.477636 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1479a101-7393-4507-935f-5197a3efe0fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.356694 Nov 02 13:02:02.478418 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3178/6414] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:02:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:02:02.482319 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-78c46075-38dd-4546-8728-710ac34b10bf tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 1.209255 Nov 02 13:02:02.500466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-192d8cd8-ae66-4f21-9325-b1d67c47da71 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:02.501113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-192d8cd8-ae66-4f21-9325-b1d67c47da71 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:02.520081 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3237/6415] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:01 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:02:02.695436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-192d8cd8-ae66-4f21-9325-b1d67c47da71 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:02.715744 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-192d8cd8-ae66-4f21-9325-b1d67c47da71 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1266 microversion: 2.1 time: 0.223784 Nov 02 13:02:02.718161 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3179/6416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:02 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:03.251328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a4d9346a-1f43-40d1-a452-a828a073cb2c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'create', calling method: .version_select at 0x7f228d5bfee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1532556660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX9RjXWVXPZotPZiMAUXtNbQoQkM6IGBK7f4VBUFJ8nMdbJWVl1AEY7Ie8qhgwzvbWCOSXZrcAwECB8gm/r6s3OPPUd35N29FzX4sqbCZ3wLDlk07mkKiVTwFGiVWB1LQ=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:03.280586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a4d9346a-1f43-40d1-a452-a828a073cb2c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for project c9764cefb5494bc9abb1518bd0b30681. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:02:03.295068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a4d9346a-1f43-40d1-a452-a828a073cb2c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for user 01745029847d4f7eba5ed111fd14d395 and project c9764cefb5494bc9abb1518bd0b30681. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:02:03.337017 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a4d9346a-1f43-40d1-a452-a828a073cb2c tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.098098 Nov 02 13:02:03.338646 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3238/6417] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:02:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:03.516902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:03.517526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:03.531221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:03.532306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:03.533999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:03.535441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:03.536237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:03.537281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:03.983740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:03.999702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:04.007171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:04.017572 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-148d280f-e216-450f-a572-12e8aba354e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 0.506049 Nov 02 13:02:04.018229 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3180/6418] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:03 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:04.227594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:04.228228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:04.248189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:04.249724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:04.252430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:04.255684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:04.257480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:04.259857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:04.416224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:04.430405 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-261f9482-93ef-45f8-ba74-acdd86f98471 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1318 microversion: 2.1 time: 0.689111 Nov 02 13:02:04.431188 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3239/6419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:03 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:05.047322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:05.049003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:05.070389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:05.071173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:05.073427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:05.075086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:05.077691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:05.078483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:05.460371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:05.461105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:05.497596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:05.503375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:05.519025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:05.540364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:05.541717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:05.546955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:05.717622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:05.736751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1b49abef-7630-45ed-9a4c-ae15dfd0ebbb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1324 microversion: 2.1 time: 0.275386 Nov 02 13:02:05.740211 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3240/6420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:05 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:05.785134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:05.810604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:05.812746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:05.820872 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b69d6c3b-fd60-4c5a-bf15-df2787660d7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 0.780685 Nov 02 13:02:05.834133 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3181/6421] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:05 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:06.143045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1490201931", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "59052f23-0a62-4ecd-b7fd-d1cf6fb7e27a"}], "key_name": "tempest-TestNetworkBasicOps-1532556660", "security_groups": [{"name": "tempest-secgroup-smoke-212502121"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:06.439685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] validate_networks() for [('59052f23-0a62-4ecd-b7fd-d1cf6fb7e27a', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:02:06.680910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:06.681491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:06.696828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:06.697334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:06.697786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:06.698556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:06.699546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:06.742234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:06.852510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:02:07.045952 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3b9a4064-e07c-47ec-a3ea-e8ccd389941c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 204 len: 0 microversion: 2.1 time: 0.943029 Nov 02 13:02:07.048120 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3241/6422] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:02:06 2022] DELETE /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:02:07.191175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-bc4e5fae-b5ff-4416-91f3-acd2a40ca83a req-f62414e5-71a3-491b-9d92-9e1a4c44a58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad3a63e-391c-42f6-bc91-7d20cfd463bc", "name": "network-vif-plugged", "status": "completed", "tag": "c254ced1-e0d3-4599-86fb-a61c7b4c210e"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:07.210701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bc4e5fae-b5ff-4416-91f3-acd2a40ca83a req-f62414e5-71a3-491b-9d92-9e1a4c44a58c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:07.211244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bc4e5fae-b5ff-4416-91f3-acd2a40ca83a req-f62414e5-71a3-491b-9d92-9e1a4c44a58c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:07.211707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bc4e5fae-b5ff-4416-91f3-acd2a40ca83a req-f62414e5-71a3-491b-9d92-9e1a4c44a58c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:07.239589 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-bc4e5fae-b5ff-4416-91f3-acd2a40ca83a req-f62414e5-71a3-491b-9d92-9e1a4c44a58c service nova] Creating event network-vif-plugged:c254ced1-e0d3-4599-86fb-a61c7b4c210e for instance fad3a63e-391c-42f6-bc91-7d20cfd463bc on n-h1-855650-5 Nov 02 13:02:07.256623 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-bc4e5fae-b5ff-4416-91f3-acd2a40ca83a req-f62414e5-71a3-491b-9d92-9e1a4c44a58c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206631 Nov 02 13:02:07.260506 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3242/6423] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:07.271828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:07.272550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:07.285397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:07.291295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:07.292104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:07.293420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:07.293904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:07.294377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:07.725878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:02:07.726458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:02:07.726973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:02:07.727499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:02:07.728111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:02:07.752030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:07.753244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:07.754091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:07.755288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:07.756060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:07.757168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:07.800312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:07.804283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for project c9764cefb5494bc9abb1518bd0b30681. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:02:07.812806 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a50ff01d-1427-4e3b-aa36-6918080c5d5d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 0.550804 Nov 02 13:02:07.814038 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3243/6424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:07 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:07.821628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:07.827084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:07.838371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Getting quotas for user 01745029847d4f7eba5ed111fd14d395 and project c9764cefb5494bc9abb1518bd0b30681. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:02:07.840997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:07.843442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:07.846487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:07.847569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:07.848279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:07.852186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:07.877063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:02:07.879634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:02:08.015216 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1058e8cd-cc42-41f1-966e-7b1d43746211 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.879117 Nov 02 13:02:08.017256 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3182/6425] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:02:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:02:08.042448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:08.043787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:08.091590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:08.092009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:08.092475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:08.093223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:08.112562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:08.113240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:08.321539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:08.339343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:08.344305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:08.349790 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8b075b1-7c16-4a97-b06a-c6d4eeb6022a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1406 microversion: 2.20 time: 0.534399 Nov 02 13:02:08.359231 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3244/6426] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:07 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1406 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:08.391975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-595bc251-9685-49b0-89f4-baafd770a4ce tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:08.399242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-595bc251-9685-49b0-89f4-baafd770a4ce tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:08.529401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:08.553816 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c4fe9f54-d355-4f3e-87da-dd1446b1b981 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1575 microversion: 2.1 time: 0.528736 Nov 02 13:02:08.554671 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3183/6427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:08 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1575 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:08.589061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-595bc251-9685-49b0-89f4-baafd770a4ce tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:08.600329 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-595bc251-9685-49b0-89f4-baafd770a4ce tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1249 microversion: 2.1 time: 0.237086 Nov 02 13:02:08.602013 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3245/6428] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:08 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1249 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:08.841874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:08.842691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:08.863035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:08.863687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:08.868099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:08.874186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:08.874775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:08.890743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:09.021359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-76c602e0-2fb4-45cb-9eb3-b8e798c79013 req-2394e505-7f78-4242-87bc-5c8649226a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:09.064519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-76c602e0-2fb4-45cb-9eb3-b8e798c79013 req-2394e505-7f78-4242-87bc-5c8649226a8e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:09.065253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-76c602e0-2fb4-45cb-9eb3-b8e798c79013 req-2394e505-7f78-4242-87bc-5c8649226a8e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:09.065740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-76c602e0-2fb4-45cb-9eb3-b8e798c79013 req-2394e505-7f78-4242-87bc-5c8649226a8e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:09.133951 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-76c602e0-2fb4-45cb-9eb3-b8e798c79013 req-2394e505-7f78-4242-87bc-5c8649226a8e service nova] Creating event network-changed:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h2-855650-5 Nov 02 13:02:09.161256 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-76c602e0-2fb4-45cb-9eb3-b8e798c79013 req-2394e505-7f78-4242-87bc-5c8649226a8e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144292 Nov 02 13:02:09.165953 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3246/6429] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:02:09.224447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:09.238547 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42a044e5-a4ab-4552-8c51-a4c3d85423b9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 0.400891 Nov 02 13:02:09.240104 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3184/6430] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:08 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:09.389652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:09.390090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:09.399797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:09.400305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:09.402923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:09.407547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:09.409071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:09.410642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:09.585615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:09.586584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:09.598224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:09.600001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:09.600637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:09.602852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:09.609864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:09.610654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:09.768188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:09.783832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:09.787863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:09.790838 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9339b9a0-2fd3-49d4-96f4-02d4c48e493e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1597 microversion: 2.20 time: 0.405952 Nov 02 13:02:09.817102 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3247/6431] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:09 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1597 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:09.826489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:09.827528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:09.843113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:09.844054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:09.845740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:09.848554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:09.850358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:09.852639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:09.928107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:09.938236 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aaa8a7ff-3179-49a4-b895-8ebc2750bd32 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1575 microversion: 2.1 time: 0.357250 Nov 02 13:02:09.946582 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3185/6432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:09 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1575 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:09.966708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:09.974141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:09.998351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:10.001292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:10.001292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:10.001292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:10.003596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:10.004084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:10.007481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:10.028012 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3729dd2d-6b89-42df-b93b-0f9f6c3deba7 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1301 microversion: 2.1 time: 0.206704 Nov 02 13:02:10.029533 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3248/6433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:09 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1301 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:10.215773 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfd74c5a-e4e0-4925-8a5a-a2d12d97945a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.265696 Nov 02 13:02:10.216712 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3186/6434] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Nov 2 13:02:09 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-interface => generated 284 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:02:10.269118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:10.269739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:10.280824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:10.281570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:10.284091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:10.285307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:10.289420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:10.290221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:10.748240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:10.764330 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-04b6917e-35c6-4da3-bde5-8f1e7000770f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 0.499460 Nov 02 13:02:10.765126 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3249/6435] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:10 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:10.978229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:10.978863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:10.990907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:10.992057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:10.996775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:11.001177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:11.002095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:11.007016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:11.068331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:11.068925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:11.079342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:11.089492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:11.090360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:11.091495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:11.092316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:11.092957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:11.186158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:11.219729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-305c167e-8ae4-4f45-b1a8-1107746f41f5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1508 microversion: 2.1 time: 0.245200 Nov 02 13:02:11.222252 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3187/6436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:10 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:11.301247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:11.314699 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5c0a7d34-2a8f-40ec-bd16-f7bf4241bbf9 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1307 microversion: 2.1 time: 0.251658 Nov 02 13:02:11.327437 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3250/6437] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:11 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:11.794512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:11.794512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:11.805153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:11.807664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:11.808364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:11.809274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:11.811784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:11.812805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:12.153043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-78b853c8-8b96-4e16-a26e-23095843de71 req-e70e0949-fa10-44dd-a1b2-855a2018f1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8499cff2-0f59-4ee5-9aba-41e0f102af35", "name": "network-vif-deleted", "tag": "8bd66afc-c781-450a-8fbc-6b3bd052c37d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:12.189830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-78b853c8-8b96-4e16-a26e-23095843de71 req-e70e0949-fa10-44dd-a1b2-855a2018f1a6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:12.190813 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-78b853c8-8b96-4e16-a26e-23095843de71 req-e70e0949-fa10-44dd-a1b2-855a2018f1a6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:12.191807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-78b853c8-8b96-4e16-a26e-23095843de71 req-e70e0949-fa10-44dd-a1b2-855a2018f1a6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:12.209848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:12.236323 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-78b853c8-8b96-4e16-a26e-23095843de71 req-e70e0949-fa10-44dd-a1b2-855a2018f1a6 service nova] Creating event network-vif-deleted:8bd66afc-c781-450a-8fbc-6b3bd052c37d for instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 on n-h2-855650-5 Nov 02 13:02:12.254531 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-78b853c8-8b96-4e16-a26e-23095843de71 req-e70e0949-fa10-44dd-a1b2-855a2018f1a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103693 Nov 02 13:02:12.256255 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3251/6438] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:12.276990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:12.277977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:12.290957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:12.294671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:12.295329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:12.297584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:12.298277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:12.303036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:12.561019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:12.591357 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e54583f7-99ed-4103-945f-7278037e2b10 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1508 microversion: 2.1 time: 0.321368 Nov 02 13:02:12.591872 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3252/6439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:12 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:12.674930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:12.675358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:12.728633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:12.729502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:12.730880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:12.732131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:12.748204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:12.748991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:12.945933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:12.985476 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e488dc07-baa7-4a19-9071-7e5bc956a932 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 1.196991 Nov 02 13:02:12.989542 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3188/6440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:11 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:13.362890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:13.383446 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2a6e8223-f48a-4db0-ac47-27c52965ba71 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.773187 Nov 02 13:02:13.414239 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3253/6441] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:12 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:13.621909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:13.622896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:13.642800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:13.646912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:13.649109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:13.653831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:13.656562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:13.659476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:13.895701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:13.910750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-17534dfa-f0a8-469e-b46a-1c23970f4833 req-f344ae2c-73ee-4e92-9e68-a269a9f282c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad3a63e-391c-42f6-bc91-7d20cfd463bc", "tag": "c254ced1-e0d3-4599-86fb-a61c7b4c210e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:13.932648 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32424f01-49c4-401f-bd81-96b0ee8b961d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1224 microversion: 2.1 time: 0.315228 Nov 02 13:02:13.956056 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3254/6442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:13 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1224 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:13.969484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-17534dfa-f0a8-469e-b46a-1c23970f4833 req-f344ae2c-73ee-4e92-9e68-a269a9f282c8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:13.970791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-17534dfa-f0a8-469e-b46a-1c23970f4833 req-f344ae2c-73ee-4e92-9e68-a269a9f282c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:13.971484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-17534dfa-f0a8-469e-b46a-1c23970f4833 req-f344ae2c-73ee-4e92-9e68-a269a9f282c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:14.012229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:14.012950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:14.023948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:14.034645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:14.038980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:14.041320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:14.043878 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-17534dfa-f0a8-469e-b46a-1c23970f4833 req-f344ae2c-73ee-4e92-9e68-a269a9f282c8 service nova] Creating event network-changed:c254ced1-e0d3-4599-86fb-a61c7b4c210e for instance fad3a63e-391c-42f6-bc91-7d20cfd463bc on n-h1-855650-5 Nov 02 13:02:14.046975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:14.048548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:14.077576 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-17534dfa-f0a8-469e-b46a-1c23970f4833 req-f344ae2c-73ee-4e92-9e68-a269a9f282c8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.632342 Nov 02 13:02:14.096415 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3189/6443] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:14.416988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:14.418647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:14.430790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:14.434494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:14.435301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:14.437289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:14.447170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:14.447858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:14.663769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:14.676687 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9e21bad5-5e54-4418-ab6b-9ec8d903b0e5 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 0.668924 Nov 02 13:02:14.699517 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3255/6444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:14 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:14.839232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:14.896496 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1428d9f-902b-4db1-99bb-ec914ccb97e4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.478360 Nov 02 13:02:14.897998 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3190/6445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:14 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:14.964137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:14.965371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:14.980281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:14.980997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:14.981535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:14.982451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:14.983015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:14.983532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:15.107652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:15.115391 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e41cc44f-21d1-4215-a86d-b72d5a7fe77f tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1224 microversion: 2.1 time: 0.156344 Nov 02 13:02:15.134181 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3256/6446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:14 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1224 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:15.700682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:15.701318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:15.713166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:15.713627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:15.719511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:15.720485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:15.721172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:15.721825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:15.931025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:15.931645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:15.950736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:15.951601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:15.952237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:15.953159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:15.954794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:15.955543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:16.540883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:16.557882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:16.566794 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1028c541-1331-494d-b2a7-7777ee6049cc tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.641235 Nov 02 13:02:16.571908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3257/6447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:15 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:16.575621 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-45612cff-f98d-4587-9ade-0b491c5cea86 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 0.878597 Nov 02 13:02:16.590000 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3191/6448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:15 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:16.599387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:16.600347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:16.617099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:16.618262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:16.618720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:16.619446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:16.621098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:16.622564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:16.871666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:16.884097 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-11989fa1-39a2-4aba-b024-7c264050b133 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1224 microversion: 2.1 time: 0.309916 Nov 02 13:02:16.886865 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3258/6449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:16 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1224 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:17.290990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e2cce00b-7996-4cc5-b8a9-3228e40003fe req-d5f6455d-a1e7-477a-a5e3-226d1cf8acb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae0f511-dab2-4178-9881-0dc3e273f358", "tag": "2dc5f580-2cb9-44ef-9415-48ef979b1ba7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:17.332891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2cce00b-7996-4cc5-b8a9-3228e40003fe req-d5f6455d-a1e7-477a-a5e3-226d1cf8acb4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:17.333475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2cce00b-7996-4cc5-b8a9-3228e40003fe req-d5f6455d-a1e7-477a-a5e3-226d1cf8acb4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:17.334337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2cce00b-7996-4cc5-b8a9-3228e40003fe req-d5f6455d-a1e7-477a-a5e3-226d1cf8acb4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:17.338924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=87 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:17.355746 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e2cce00b-7996-4cc5-b8a9-3228e40003fe req-d5f6455d-a1e7-477a-a5e3-226d1cf8acb4 service nova] Creating event network-changed:2dc5f580-2cb9-44ef-9415-48ef979b1ba7 for instance 9ae0f511-dab2-4178-9881-0dc3e273f358 on n-h1-855650-5 Nov 02 13:02:17.392077 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e2cce00b-7996-4cc5-b8a9-3228e40003fe req-d5f6455d-a1e7-477a-a5e3-226d1cf8acb4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105435 Nov 02 13:02:17.394959 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3192/6450] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:17.595573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:17.596306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:17.608832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:17.609725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:17.611856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:17.612461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:17.613146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:17.614152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:17.614831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:17.619761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:17.621205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:17.621729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:17.622232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:17.622975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:17.625107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:17.629786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:17.781424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:17.857774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:17.864936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=14 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:17.869138 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1fa67679-e003-492e-bb9f-94eb878e5108 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 0.266572 Nov 02 13:02:17.870884 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3193/6451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:17 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:17.894527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:17.905548 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5276aff8-42fc-40c7-a5cb-3c0e9d1b51e3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.313779 Nov 02 13:02:17.906468 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3259/6452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:17 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:17.909366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:17.910061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:17.918435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:17.919373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:17.919994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:17.921197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:17.922149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:17.922948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:18.001117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:18.010333 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0b90444-cf59-4873-8260-081dabf98a1e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1224 microversion: 2.1 time: 0.105024 Nov 02 13:02:18.011858 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3194/6453] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:17 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:18.874754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-8417e235-f9c8-4288-a6cf-78badff547fc req-a338c8a4-fe11-4309-bd00-98a0c04fc457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "name": "network-vif-plugged", "status": "completed", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:18.885628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:18.893469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:18.894321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:18.904749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:18.908495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8417e235-f9c8-4288-a6cf-78badff547fc req-a338c8a4-fe11-4309-bd00-98a0c04fc457 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:18.908994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8417e235-f9c8-4288-a6cf-78badff547fc req-a338c8a4-fe11-4309-bd00-98a0c04fc457 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:18.909449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8417e235-f9c8-4288-a6cf-78badff547fc req-a338c8a4-fe11-4309-bd00-98a0c04fc457 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:18.910502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:18.910973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:18.911778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:18.912248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:18.912697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:18.932080 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-8417e235-f9c8-4288-a6cf-78badff547fc req-a338c8a4-fe11-4309-bd00-98a0c04fc457 service nova] Creating event network-vif-plugged:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h2-855650-5 Nov 02 13:02:18.945887 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-8417e235-f9c8-4288-a6cf-78badff547fc req-a338c8a4-fe11-4309-bd00-98a0c04fc457 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074933 Nov 02 13:02:18.950071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3260/6454] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:18.960408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:18.961142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:18.974609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:18.975121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:18.975570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:18.982064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:18.982917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:18.983604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:19.647520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:19.657116 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-087daa44-bf7e-49c9-bb08-5861ae305435 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 0.767009 Nov 02 13:02:19.657512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3195/6455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:18 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:19.674940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:19.676394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:19.683731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:19.684350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:19.684915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:19.685708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:19.686287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:19.686965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:19.691412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:19.702131 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1a067ac4-5ca6-4c47-839a-11d031ab138b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.750388 Nov 02 13:02:19.707514 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3261/6456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:18 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:19.794887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:19.805198 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c5ff739-d1ec-4075-b6ce-c51cc9c73c9b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1224 microversion: 2.1 time: 0.146190 Nov 02 13:02:19.806164 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3196/6457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:19 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1224 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:20.687634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:20.688260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:20.697499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:20.698790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:20.700233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:20.701558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:20.702587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:20.703216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:20.732280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:20.733658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:20.744889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:20.750393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:20.750908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:20.751357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:20.753404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:20.756552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:20.762401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:21.049401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:21.060065 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e338fa3-f52c-4482-ada2-59ad2e8cb9ca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1392 microversion: 2.1 time: 0.382695 Nov 02 13:02:21.084353 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3262/6458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:20 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:21.090930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:21.091487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:21.103102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:21.103821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:21.104311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:21.105846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:21.106515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:21.107456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:21.141820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:21.155145 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b48132ef-edcd-45f8-bb06-9cb919128f30 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.427505 Nov 02 13:02:21.155365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:21.155826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:21.156374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:21.157585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lazy-loading 'fault' on Instance uuid 8499cff2-0f59-4ee5-9aba-41e0f102af35 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:02:21.183933 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3197/6459] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:20 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:21.223033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:21.232502 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9940057-57f7-4ad7-a2ef-abe4041b78c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 200 len: 1183 microversion: 2.1 time: 0.146616 Nov 02 13:02:21.244219 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3263/6460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:21 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 1183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:22.088532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:22.089410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:22.097822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:22.098604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:22.099092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:22.099817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:22.100280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:22.100893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:22.209091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:22.209704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:22.217281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:22.219218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:22.222153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:22.223692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:22.225279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:22.226139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:22.226583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:22.261027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:22.275451 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0c1e10e-fb2b-47fd-aa9d-7a7e1617f8e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1564 microversion: 2.1 time: 0.191912 Nov 02 13:02:22.277540 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3198/6461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:22 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1564 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:22.291003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:22.291909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:22.300277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:22.301062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:22.301741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:22.302666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:22.303559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:22.304167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:22.324053 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 HTTP/1.1 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '8499cff2-0f59-4ee5-9aba-41e0f102af35'} Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:02:22.326880 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:02:22.331986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:22.331986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:02:22.331986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:02:22.331986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:02:22.331986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:02:22.331986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:02:22.331986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:02:22.349710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:02:22.350827 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bcda7f2f-d619-47e0-9a48-f6c93b3f25fc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 404 len: 111 microversion: 2.1 time: 0.071826 Nov 02 13:02:22.354104 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3199/6462] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:22 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:02:22.368552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:22.369444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:22.385196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:22.385762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:22.388373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:22.390800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:22.392988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:22.393459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:22.465604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:22.476706 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-062001fd-ca0d-44ae-ad12-80be7c9e1d12 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.271359 Nov 02 13:02:22.477901 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3264/6463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:22 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:22.537911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1724134155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1952071615", "security_groups": [{"name": "tempest-secgroup-smoke-151727032"}], "block_device_mapping_v2": [{"uuid": "2a07fb36-f40d-46f3-a86b-454bf45914fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c2de958-5bb8-43d5-9f50-0267f3814230"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:22.584575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:22.595082 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5325dda2-3098-44a4-ab21-b375bdf65d50 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1564 microversion: 2.1 time: 0.238638 Nov 02 13:02:22.596168 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3200/6464] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:22 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1564 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:22.804419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] validate_networks() for [('5c2de958-5bb8-43d5-9f50-0267f3814230', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:02:23.415118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:02:23.415907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:02:23.416647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:02:23.417763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:02:23.418453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:02:23.428150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:23.429024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:23.429737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:23.430778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:23.431546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:23.432216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:23.452891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:02:23.460604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Getting quotas for user 15b6ee9295464444a626601b16db2574 and project d3790495df8340788ecc233838a1545d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:02:23.505761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:23.506482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:23.512871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:23.513383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:23.513845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:23.514597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:23.515077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:23.515522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:23.536363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:02:23.538706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a07fb36-f40d-46f3-a86b-454bf45914fe',volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:02:23.685467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:23.694488 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3bd3170f-383f-4aa7-8240-d67968f32cc4 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.193446 Nov 02 13:02:23.695344 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3201/6465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:23 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:23.739353 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-87ae699e-661b-4760-88a1-8542342a0c31 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.206181 Nov 02 13:02:23.740654 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3265/6466] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:02:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:02:23.755099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-52662ea6-af0f-46c7-95c6-6fd4a32eaf25 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:23.755833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-52662ea6-af0f-46c7-95c6-6fd4a32eaf25 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:23.869149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-52662ea6-af0f-46c7-95c6-6fd4a32eaf25 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:23.880426 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-52662ea6-af0f-46c7-95c6-6fd4a32eaf25 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1095 microversion: 2.1 time: 0.131276 Nov 02 13:02:23.882227 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3202/6467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:23 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1095 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:24.720224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:24.721798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:24.730469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:24.731322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:24.731993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:24.732835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:24.733405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:24.733958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:24.896808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:24.906569 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb1a0bee-7f0d-4a59-9ab2-bd28a684ea18 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.190251 Nov 02 13:02:24.907466 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3266/6468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:24 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:24.908841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:24.909481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:24.918386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:24.919157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:24.919848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:24.920789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:24.921418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:24.922085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:24.997239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:25.014828 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d462f9b0-3133-43e7-91ab-499f8553c9af tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1193 microversion: 2.1 time: 0.109283 Nov 02 13:02:25.016024 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3203/6469] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:24 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:25.264569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-fef7a245-4d52-496d-ad63-40e2b9674b42 req-83abe4cb-92dd-4796-b0d7-50c406c90d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae0f511-dab2-4178-9881-0dc3e273f358", "name": "network-vif-plugged", "status": "completed", "tag": "2dc5f580-2cb9-44ef-9415-48ef979b1ba7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:25.275728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fef7a245-4d52-496d-ad63-40e2b9674b42 req-83abe4cb-92dd-4796-b0d7-50c406c90d41 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:25.277751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fef7a245-4d52-496d-ad63-40e2b9674b42 req-83abe4cb-92dd-4796-b0d7-50c406c90d41 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:25.278633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-fef7a245-4d52-496d-ad63-40e2b9674b42 req-83abe4cb-92dd-4796-b0d7-50c406c90d41 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:25.295151 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-fef7a245-4d52-496d-ad63-40e2b9674b42 req-83abe4cb-92dd-4796-b0d7-50c406c90d41 service nova] Creating event network-vif-plugged:2dc5f580-2cb9-44ef-9415-48ef979b1ba7 for instance 9ae0f511-dab2-4178-9881-0dc3e273f358 on n-h1-855650-5 Nov 02 13:02:25.304512 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-fef7a245-4d52-496d-ad63-40e2b9674b42 req-83abe4cb-92dd-4796-b0d7-50c406c90d41 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044559 Nov 02 13:02:25.305586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3267/6470] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:25.934223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:25.934927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:25.953840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:25.955767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:25.956403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:25.957180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:25.957662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:25.958144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:26.042846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:26.043681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:26.051237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:26.051770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:26.052219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:26.052996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:26.053715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:26.054177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:26.170856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:26.191074 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be28a101-0987-4996-88bd-493040c89307 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1211 microversion: 2.1 time: 0.154222 Nov 02 13:02:26.192926 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3268/6471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:26 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:26.253817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:26.265461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-992a24f5-9dba-4772-bb63-b2fa5d729541 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.337673 Nov 02 13:02:26.268240 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3204/6472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:25 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:26.751976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:26.753020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:26.760239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:26.765428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:26.766164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:26.767099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:26.770463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:26.771103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:26.788440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e75ec63d-733e-47e0-9bb0-34cb352ef5d9 req-b0bb1418-94ee-4246-b223-1cc047f51813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:26.816310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e75ec63d-733e-47e0-9bb0-34cb352ef5d9 req-b0bb1418-94ee-4246-b223-1cc047f51813 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:26.816837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e75ec63d-733e-47e0-9bb0-34cb352ef5d9 req-b0bb1418-94ee-4246-b223-1cc047f51813 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:26.817295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e75ec63d-733e-47e0-9bb0-34cb352ef5d9 req-b0bb1418-94ee-4246-b223-1cc047f51813 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:26.844710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e75ec63d-733e-47e0-9bb0-34cb352ef5d9 req-b0bb1418-94ee-4246-b223-1cc047f51813 service nova] Creating event network-changed:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h2-855650-5 Nov 02 13:02:26.862567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e75ec63d-733e-47e0-9bb0-34cb352ef5d9 req-b0bb1418-94ee-4246-b223-1cc047f51813 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078827 Nov 02 13:02:26.864693 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3205/6473] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 13:02:27.217019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:27.217749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:27.226274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:27.227198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:27.227880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:27.228869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:27.230152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:27.230823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:27.258263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:27.287894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-aa8dcca5-bbe0-44e1-9169-402424b72589 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1564 microversion: 2.1 time: 0.536463 Nov 02 13:02:27.290146 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3269/6474] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:26 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1564 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:27.313657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:27.317036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:27.351831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:27.355050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:27.359499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:27.360573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:27.363646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:27.369088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:27.383382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:27.852079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:27.861787 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a00a13ae-6b89-482c-9ad6-90f1301a4e77 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1278 microversion: 2.1 time: 0.649610 Nov 02 13:02:27.872097 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3206/6475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:27 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1278 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:27.992819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:28.003263 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a9bd43e-f312-485c-a094-492803835cfd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1374 microversion: 2.1 time: 0.705734 Nov 02 13:02:28.006503 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3270/6476] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:27 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1374 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:28.896988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:28.903827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:28.911516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:28.912549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:28.913217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:28.914293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:28.917347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:28.917884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:28.966767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-52ec0382-956c-42b8-9635-497f81811334 req-aa22c1b0-e72d-42fb-bc66-8aa865f13517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3ee477-9978-4c11-9f1d-df958615130d", "tag": "3d527c31-d3e9-4b60-bb2d-fd856daf790a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:29.020410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-52ec0382-956c-42b8-9635-497f81811334 req-aa22c1b0-e72d-42fb-bc66-8aa865f13517 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:29.034087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-52ec0382-956c-42b8-9635-497f81811334 req-aa22c1b0-e72d-42fb-bc66-8aa865f13517 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:29.034687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-52ec0382-956c-42b8-9635-497f81811334 req-aa22c1b0-e72d-42fb-bc66-8aa865f13517 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:29.074845 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-52ec0382-956c-42b8-9635-497f81811334 req-aa22c1b0-e72d-42fb-bc66-8aa865f13517 service nova] Creating event network-changed:3d527c31-d3e9-4b60-bb2d-fd856daf790a for instance 2d3ee477-9978-4c11-9f1d-df958615130d on n-h2-855650-5 Nov 02 13:02:29.094561 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-52ec0382-956c-42b8-9635-497f81811334 req-aa22c1b0-e72d-42fb-bc66-8aa865f13517 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132398 Nov 02 13:02:29.096555 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3271/6477] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:29.109923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:29.113655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:29.122963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:29.123812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:29.124508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:29.128499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:29.130163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:29.131828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:29.236975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:29.247305 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e279df62-c4b9-418a-b474-43161dc785ea tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1278 microversion: 2.1 time: 0.354312 Nov 02 13:02:29.250126 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3207/6478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:28 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1278 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:29.420056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:29.435837 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52084a9a-645b-4a38-84cd-09a826cc7cc6 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1546 microversion: 2.1 time: 0.336324 Nov 02 13:02:29.437138 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3272/6479] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:29 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1546 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:29.460435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:29.461316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:29.470672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:29.473632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:29.476506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:29.477457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:29.478090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:29.478418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:29.734579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:29.744323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c253069-1c61-430c-98f5-862fb4f63b96 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1546 microversion: 2.1 time: 0.287781 Nov 02 13:02:29.771057 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3208/6480] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:29 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1546 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:30.274746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:30.278253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:30.296332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:30.298538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:30.300414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:30.301429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:30.308496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:30.309545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:30.692332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:30.706685 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-01383ceb-dafc-4e05-b43c-f5d5f9baa9bc tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1278 microversion: 2.1 time: 0.435625 Nov 02 13:02:30.723723 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3273/6481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:30 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1278 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:31.736756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:31.736756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:31.752785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:31.753309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:31.753776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:31.754544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:31.755058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:31.755531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:32.329982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:32.346586 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-16c43e3c-c886-4c7b-92d0-6b08acc6d5c8 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1278 microversion: 2.1 time: 0.615653 Nov 02 13:02:32.351222 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3209/6482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:31 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1278 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:33.185950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e905cab9-0b3b-4686-a724-c84ae5eea573 req-dc37b7ad-7200-4dd7-807d-231e2b2ef23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae0f511-dab2-4178-9881-0dc3e273f358", "tag": "2dc5f580-2cb9-44ef-9415-48ef979b1ba7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:33.203224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e905cab9-0b3b-4686-a724-c84ae5eea573 req-dc37b7ad-7200-4dd7-807d-231e2b2ef23c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:33.204255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e905cab9-0b3b-4686-a724-c84ae5eea573 req-dc37b7ad-7200-4dd7-807d-231e2b2ef23c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:33.205113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e905cab9-0b3b-4686-a724-c84ae5eea573 req-dc37b7ad-7200-4dd7-807d-231e2b2ef23c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:33.220319 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e905cab9-0b3b-4686-a724-c84ae5eea573 req-dc37b7ad-7200-4dd7-807d-231e2b2ef23c service nova] Creating event network-changed:2dc5f580-2cb9-44ef-9415-48ef979b1ba7 for instance 9ae0f511-dab2-4178-9881-0dc3e273f358 on n-h1-855650-5 Nov 02 13:02:33.227071 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e905cab9-0b3b-4686-a724-c84ae5eea573 req-dc37b7ad-7200-4dd7-807d-231e2b2ef23c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045532 Nov 02 13:02:33.228906 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3274/6483] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:33.380703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:33.383140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:33.404273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:33.405195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:33.409359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:33.412155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:33.413739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:33.414393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:33.673950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:33.688920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cef44f2c-9f06-4559-aa76-c977db22af3d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.314086 Nov 02 13:02:33.701998 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3210/6484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:33 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:34.715914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:34.717362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:34.724733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:34.726187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:34.735436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:34.735946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:34.736394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:34.737113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:34.737575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:34.738030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:34.983613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:34.996271 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60ed8da8-9ebd-4379-b0d7-928e1785748a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.282041 Nov 02 13:02:34.997492 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3275/6485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:34 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:36.021183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:36.022504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:36.026361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:36.033304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:36.034077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:36.035676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:36.036958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:36.037443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:36.038083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:36.189202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:36.191512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:36.199790 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfccae8c-df1c-47c9-ba5f-03df2b95cb90 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.182324 Nov 02 13:02:36.200638 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3211/6486] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:36 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:37.224119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:37.224767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:37.232204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:37.232628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:37.233076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:37.233802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:37.234648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:37.234774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:37.415060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:37.428483 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-35014fd7-9c96-43a4-a669-ddc92ffbf253 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.208259 Nov 02 13:02:37.443683 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3276/6487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:37 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:38.452832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:38.453461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:38.466946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:38.467763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:38.468380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:38.469278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:38.469757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:38.470228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:38.685646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:38.695675 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b4f76a1-739a-422c-9bb5-8b6a1a2329e2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.247173 Nov 02 13:02:38.710860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3212/6488] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:38 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:39.721050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:39.721676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:39.730663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:39.731179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:39.731608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:39.732505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:39.732981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:39.733391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:39.903218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:39.911474 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d3681d37-d482-4918-8393-e7e48e6d3296 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.194276 Nov 02 13:02:39.912071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3277/6489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:39 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:40.936783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:40.937423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:40.957715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:40.958295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:40.958733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:40.959458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:40.959919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:40.960358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:41.164082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:41.180018 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8414a0b3-2ef7-4c20-b47b-2d82ca0c5e0d tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.247658 Nov 02 13:02:41.180921 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3213/6490] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:40 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:42.208285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:42.219895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:42.232884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:42.233793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:42.234726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:42.235436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:42.235991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:42.236784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:42.484528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:42.497270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9e5e169a-600e-4ac3-a6ee-963ba06dc691 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.291887 Nov 02 13:02:42.511634 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3278/6491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:42 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:42.831176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4b80ec54-c222-4a20-a18c-66af44ea2952 req-cb58e21a-3e79-4bba-a778-ef89ce0266db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ee477-9978-4c11-9f1d-df958615130d", "name": "network-vif-plugged", "status": "completed", "tag": "3d527c31-d3e9-4b60-bb2d-fd856daf790a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:42.856648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4b80ec54-c222-4a20-a18c-66af44ea2952 req-cb58e21a-3e79-4bba-a778-ef89ce0266db service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:42.858515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4b80ec54-c222-4a20-a18c-66af44ea2952 req-cb58e21a-3e79-4bba-a778-ef89ce0266db service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:42.859280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4b80ec54-c222-4a20-a18c-66af44ea2952 req-cb58e21a-3e79-4bba-a778-ef89ce0266db service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:42.873645 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4b80ec54-c222-4a20-a18c-66af44ea2952 req-cb58e21a-3e79-4bba-a778-ef89ce0266db service nova] Creating event network-vif-plugged:3d527c31-d3e9-4b60-bb2d-fd856daf790a for instance 2d3ee477-9978-4c11-9f1d-df958615130d on n-h2-855650-5 Nov 02 13:02:42.881400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4b80ec54-c222-4a20-a18c-66af44ea2952 req-cb58e21a-3e79-4bba-a778-ef89ce0266db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054061 Nov 02 13:02:42.882402 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3214/6492] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:43.529110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:43.532193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:43.545530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:43.546740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:43.547612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:43.548948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:43.549891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:43.550791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:43.833225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:43.844628 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7f9606e7-b8f3-4459-934c-e9b03909c4e5 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1266 microversion: 2.1 time: 0.324287 Nov 02 13:02:43.845899 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3279/6493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:43 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:44.874829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:44.875950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:44.897567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:44.898744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:44.899459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:44.900694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:44.901373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:44.902079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:45.144753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:45.154441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a16fa944-2e67-4437-9147-d40feb87e3d0 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1452 microversion: 2.1 time: 0.284812 Nov 02 13:02:45.155177 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3215/6494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:44 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1452 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:45.180570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:45.181292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:45.188859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:45.189443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:45.189957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:45.190773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:45.191319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:45.191817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:45.386114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:45.394889 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c2e7068-adfb-4534-a0c2-02997b67824e tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1452 microversion: 2.1 time: 0.219671 Nov 02 13:02:45.395490 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3280/6495] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:45 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1452 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:48.254597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c011e3fe-30a2-471c-9a90-711b39e109f3 req-151b6972-d0bd-437f-a515-3e7304574793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3ee477-9978-4c11-9f1d-df958615130d", "tag": "3d527c31-d3e9-4b60-bb2d-fd856daf790a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:48.265009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c011e3fe-30a2-471c-9a90-711b39e109f3 req-151b6972-d0bd-437f-a515-3e7304574793 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:48.265735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c011e3fe-30a2-471c-9a90-711b39e109f3 req-151b6972-d0bd-437f-a515-3e7304574793 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:48.266403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c011e3fe-30a2-471c-9a90-711b39e109f3 req-151b6972-d0bd-437f-a515-3e7304574793 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:48.280574 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c011e3fe-30a2-471c-9a90-711b39e109f3 req-151b6972-d0bd-437f-a515-3e7304574793 service nova] Creating event network-changed:3d527c31-d3e9-4b60-bb2d-fd856daf790a for instance 2d3ee477-9978-4c11-9f1d-df958615130d on n-h2-855650-5 Nov 02 13:02:48.289152 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c011e3fe-30a2-471c-9a90-711b39e109f3 req-151b6972-d0bd-437f-a515-3e7304574793 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038293 Nov 02 13:02:48.290115 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3216/6496] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:04.429308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:04.431562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:04.434090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:04.434954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=56 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:04.442890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:04.443472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:04.444285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:04.445029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:04.445491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:04.445954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:04.536470 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08dedfa7-5906-4a40-9410-bbfead432087 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action" status: 200 len: 24565 microversion: 2.1 time: 0.112258 Nov 02 13:03:04.538471 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3281/6497] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:03:04 2022] POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action => generated 24565 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:03:05.645833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=41 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:05.647150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=23 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:05.652983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:05.655989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:05.665444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:05.666538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:05.667262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:05.668287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:05.669045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:05.669760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:05.746454 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f193b61d-ac3e-4352-b38a-59c9171524cd tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358/action" status: 200 len: 24570 microversion: 2.1 time: 0.102584 Nov 02 13:03:05.747913 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3217/6498] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:03:05 2022] POST /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358/action => generated 24570 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:03:28.380373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:28.381009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:28.385256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:28.385948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:28.396853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:28.397721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:28.398216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:28.399201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:28.400475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:28.400941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:28.428581 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8389aed6-eb11-4e61-bb80-58c71413b21c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/ips" status: 200 len: 150 microversion: 2.20 time: 0.052481 Nov 02 13:03:28.429792 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3282/6499] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Nov 2 13:03:28 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:03:31.457885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:31.459024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:31.465014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:31.466080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:31.479012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:31.479912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:31.480720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:31.482033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:31.482909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:31.483712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:31.526294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lazy-loading 'flavor' on Instance uuid fad3a63e-391c-42f6-bc91-7d20cfd463bc {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:03:31.829419 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b29550e1-3406-4943-b0ad-3737bb07e754 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/action" status: 202 len: 0 microversion: 2.20 time: 0.380634 Nov 02 13:03:31.830215 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3218/6500] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 13:03:31 2022] POST /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:03:31.840814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:31.843538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:31.854976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:31.855854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:31.856910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:31.858549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:31.859582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:31.860593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:32.121461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:32.139383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:32.141375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:32.142944 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fdb0dc57-d38c-4cff-9f0b-a3bbde84f0cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.308074 Nov 02 13:03:32.144165 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3283/6501] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:31 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:33.170540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:33.171432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:33.184181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:33.185004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:33.185467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:33.186238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:33.186884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:33.187527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:33.416805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:33.427618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:33.429475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:33.430949 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2cc621e7-0f0e-4523-8c91-22a31de89232 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.265008 Nov 02 13:03:33.431814 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3219/6502] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:33 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:34.459275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:34.460013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:34.476965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:34.477600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:34.481102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:34.484809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:34.485490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:34.486270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:34.701032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:34.726559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:34.730691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:34.732477 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b51de9c0-b8fa-4bf5-8c8f-ce599aa03e97 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.277212 Nov 02 13:03:34.733534 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3284/6503] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:34 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:35.765979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:35.767115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:35.775317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:35.776284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:35.777132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:35.778481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:35.779174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:35.779914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:36.051199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:36.074426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:36.076413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:36.077940 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1bdabea-8d9b-40d4-937c-5bf640ca10e8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.318018 Nov 02 13:03:36.078691 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3220/6504] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:35 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:37.114154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:37.114779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:37.124722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:37.125337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:37.125756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:37.127071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:37.127539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:37.127968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:37.331478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:37.345469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:37.347119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:37.349052 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2266155-60c1-4545-853e-892b1cf5d2dd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.239103 Nov 02 13:03:37.359849 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3285/6505] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:37 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:38.380663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:38.381511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:38.388649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:38.389432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:38.389891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:38.391104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:38.391236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:38.391611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:38.595594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:38.608309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:38.611250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:38.613418 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5819e3e1-14f7-4817-9625-a25fdf3a2993 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.236762 Nov 02 13:03:38.614736 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3221/6506] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:38 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:39.639992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:39.640737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:39.648611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:39.650469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:39.650949 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:39.652142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:39.652597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:39.653488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:39.809789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:39.820974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:39.822442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:39.824281 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4632d525-038d-4dac-a255-fc44711baba4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.188358 Nov 02 13:03:39.825103 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3286/6507] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:39 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:40.853219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:40.853924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:40.861340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:40.861913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:40.862420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:40.863153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:40.863622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:40.864059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:41.020418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:41.031527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:41.033280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:41.034646 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66b59e77-16da-4a7c-bba9-3c0c400e16c0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.186431 Nov 02 13:03:41.035259 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3222/6508] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:40 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:42.066435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:42.067384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:42.074974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:42.075594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:42.076047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:42.076761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:42.077299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:42.077732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:42.488032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:42.497135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:42.498609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:42.499787 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-331c345f-1b9d-45df-81f8-e8ccddb15168 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.437698 Nov 02 13:03:42.500349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3287/6509] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:42 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:43.532225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:43.532875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:43.549045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:43.551249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:43.551249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:43.551870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:43.552352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:43.552805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:43.776077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:43.793641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:43.796475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:43.798677 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b16c4a13-2a95-471f-8511-c9696e1636e4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1742 microversion: 2.20 time: 0.273046 Nov 02 13:03:43.799669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3223/6510] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:43 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1742 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:44.826996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:44.827831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:44.835708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:44.836343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:44.837013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:44.837765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:44.838328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:44.838767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:45.014069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:45.025896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:45.028270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:45.030741 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-18d15de2-b1d2-4e1f-9e90-40892561bb7c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1742 microversion: 2.20 time: 0.207848 Nov 02 13:03:45.031316 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3288/6511] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:44 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1742 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:45.195391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:45.197841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:45.205326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:45.205834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:45.206394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:45.208812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:45.209328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:45.209742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:45.294089 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6db24e40-4fdc-4ec4-b4f3-f8dd6a7bec61 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "POST /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358/action" status: 200 len: 32642 microversion: 2.1 time: 0.102676 Nov 02 13:03:45.294974 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3224/6512] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:03:45 2022] POST /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358/action => generated 32642 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:03:46.064347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:46.065150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:46.076861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:46.077765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:46.078588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:46.079627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:46.080385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:46.081025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:46.680281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:46.692494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:46.694385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:46.696944 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98ff25bf-3b1d-4ece-a0ba-afac40a8f271 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1742 microversion: 2.20 time: 0.636255 Nov 02 13:03:46.711769 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3289/6513] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:46 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1742 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:47.145626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:47.146778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:47.147819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-0937a1e0-c869-4275-99c6-ee1fd035bbe9 req-3dfb1565-0c49-4eb0-94df-1e885a45dda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae0f511-dab2-4178-9881-0dc3e273f358", "tag": "2dc5f580-2cb9-44ef-9415-48ef979b1ba7"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:47.162397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0937a1e0-c869-4275-99c6-ee1fd035bbe9 req-3dfb1565-0c49-4eb0-94df-1e885a45dda2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:47.163388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0937a1e0-c869-4275-99c6-ee1fd035bbe9 req-3dfb1565-0c49-4eb0-94df-1e885a45dda2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:47.163941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-0937a1e0-c869-4275-99c6-ee1fd035bbe9 req-3dfb1565-0c49-4eb0-94df-1e885a45dda2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:47.166727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:47.167664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:47.168149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:47.169856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:47.170488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:47.170958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:47.179100 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-0937a1e0-c869-4275-99c6-ee1fd035bbe9 req-3dfb1565-0c49-4eb0-94df-1e885a45dda2 service nova] Creating event network-changed:2dc5f580-2cb9-44ef-9415-48ef979b1ba7 for instance 9ae0f511-dab2-4178-9881-0dc3e273f358 on n-h1-855650-5 Nov 02 13:03:47.188179 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-0937a1e0-c869-4275-99c6-ee1fd035bbe9 req-3dfb1565-0c49-4eb0-94df-1e885a45dda2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044504 Nov 02 13:03:47.189336 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3290/6514] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:03:47.206831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:03:47.395208 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c4589b9-2a4a-4aba-9e13-aa765e373bb3 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 204 len: 0 microversion: 2.1 time: 0.254022 Nov 02 13:03:47.406012 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3225/6515] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:03:47 2022] DELETE /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:03:47.419655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:47.421639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:47.447223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:47.450764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:47.451570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:47.452961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:47.456670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:47.458087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:47.721840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.732254 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-528b479b-0eba-4522-aaff-61817b779d5a tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1671 microversion: 2.1 time: 0.321023 Nov 02 13:03:47.733004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:47.739967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:47.746717 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3291/6516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:47 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1671 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:47.758678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:47.759555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:47.760299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:47.761936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:47.762622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:47.763446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:47.946075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e817d3f7-2947-4bf9-b1b8-c9d1b9af1a3b req-217fd671-2b29-4c99-bb4e-35e31b43cee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad3a63e-391c-42f6-bc91-7d20cfd463bc", "name": "network-vif-plugged", "status": "completed", "tag": "c254ced1-e0d3-4599-86fb-a61c7b4c210e"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:47.971337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.978803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e817d3f7-2947-4bf9-b1b8-c9d1b9af1a3b req-217fd671-2b29-4c99-bb4e-35e31b43cee5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:47.981218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e817d3f7-2947-4bf9-b1b8-c9d1b9af1a3b req-217fd671-2b29-4c99-bb4e-35e31b43cee5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:47.983446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e817d3f7-2947-4bf9-b1b8-c9d1b9af1a3b req-217fd671-2b29-4c99-bb4e-35e31b43cee5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:47.987015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.989004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.994799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c121789-c136-4d46-bc36-2e1ccf8488d6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1742 microversion: 2.20 time: 0.268357 Nov 02 13:03:48.010041 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3226/6517] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:47 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1742 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:48.026862 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e817d3f7-2947-4bf9-b1b8-c9d1b9af1a3b req-217fd671-2b29-4c99-bb4e-35e31b43cee5 service nova] Creating event network-vif-plugged:c254ced1-e0d3-4599-86fb-a61c7b4c210e for instance fad3a63e-391c-42f6-bc91-7d20cfd463bc on n-h1-855650-5 Nov 02 13:03:48.034463 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e817d3f7-2947-4bf9-b1b8-c9d1b9af1a3b req-217fd671-2b29-4c99-bb4e-35e31b43cee5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095379 Nov 02 13:03:48.035180 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3292/6518] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:48.773436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:48.775000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:48.783583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:48.784615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:48.785661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:48.786894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:48.787901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:48.788691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:49.028016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:49.029617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:49.030592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:49.036884 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b82a4451-c409-4e8c-ab40-896e1f8ef54b tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1671 microversion: 2.1 time: 0.281457 Nov 02 13:03:49.037476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3227/6519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:48 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1671 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:49.043965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:49.044467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:49.044912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:49.045679 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:49.046177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:49.046802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:49.310690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:49.334015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:49.336739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:49.339085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-517811a8-0cdc-4177-9a2d-de83df20400f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1742 microversion: 2.20 time: 0.315699 Nov 02 13:03:49.348530 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3293/6520] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:49 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1742 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:49.982391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-bd0600cb-527d-4d22-8335-689fb42ae4b5 req-952d19f9-804d-4352-aeb4-25115ea6be1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae0f511-dab2-4178-9881-0dc3e273f358", "name": "network-vif-deleted", "tag": "2dc5f580-2cb9-44ef-9415-48ef979b1ba7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:49.995438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bd0600cb-527d-4d22-8335-689fb42ae4b5 req-952d19f9-804d-4352-aeb4-25115ea6be1e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:50.002671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bd0600cb-527d-4d22-8335-689fb42ae4b5 req-952d19f9-804d-4352-aeb4-25115ea6be1e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:50.003196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bd0600cb-527d-4d22-8335-689fb42ae4b5 req-952d19f9-804d-4352-aeb4-25115ea6be1e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:50.024821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-bd0600cb-527d-4d22-8335-689fb42ae4b5 req-952d19f9-804d-4352-aeb4-25115ea6be1e service nova] Creating event network-vif-deleted:2dc5f580-2cb9-44ef-9415-48ef979b1ba7 for instance 9ae0f511-dab2-4178-9881-0dc3e273f358 on n-h1-855650-5 Nov 02 13:03:50.031170 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-bd0600cb-527d-4d22-8335-689fb42ae4b5 req-952d19f9-804d-4352-aeb4-25115ea6be1e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053457 Nov 02 13:03:50.035909 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3228/6521] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:50.070745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:50.073468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:50.094896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:50.095685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:50.096316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:50.097850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:50.099639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:50.100208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:50.152350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:50.153355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:50.154129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:50.154883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lazy-loading 'fault' on Instance uuid 9ae0f511-dab2-4178-9881-0dc3e273f358 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:03:50.244510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01745029847d4f7eba5ed111fd14d395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9764cefb5494bc9abb1518bd0b30681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:50.258173 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df8e0e30-c009-4023-b60f-4c9747320794 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 200 len: 1339 microversion: 2.1 time: 0.197289 Nov 02 13:03:50.276050 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3294/6522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:50 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 1339 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:50.374106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:50.375979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:50.385103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:50.386050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:50.386768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:50.388497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:50.389302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:50.390018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:50.622526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:50.634021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:50.636015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:50.638016 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3250d102-b310-44c3-a00c-9136f3a62228 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.268769 Nov 02 13:03:50.639398 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3229/6523] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:50 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:51.286415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:51.288102 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] [instance: 9ae0f511-dab2-4178-9881-0dc3e273f358] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:51.295589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:51.296529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:51.297166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:51.298274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:51.298899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:51.299477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:51.343751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] HTTP exception thrown: Instance 9ae0f511-dab2-4178-9881-0dc3e273f358 could not be found. Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Request method failure captured: Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 HTTP/1.1 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYmle7TU0EhZfVbE7nsgnUfFZNZ-BvEkSEkRe2DHBnLF7_r2KerIpjKoE8Vh4KPOFlt4dfbJiPel2o-YEaI5GIsFG3te1Ji2LMiT4XPaAup22CEYqE_41GqyJDYng4RiVaW3LIrrTdw3nlLAvMedzEM1iSzkaAS1dpBCKikiUm4kR5e0 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: c9764cefb5494bc9abb1518bd0b30681 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c9764cefb5494bc9abb1518bd0b30681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: c9764cefb5494bc9abb1518bd0b30681 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestNetworkBasicOps-1973841742 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestNetworkBasicOps-1973841742-project Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 01745029847d4f7eba5ed111fd14d395 Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestNetworkBasicOps-1973841742-project Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 9ae0f511-dab2-4178-9881-0dc3e273f358 could not be found. Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '9ae0f511-dab2-4178-9881-0dc3e273f358'} Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae0f511-dab2-4178-9881-0dc3e273f358 could not be found. Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae0f511-dab2-4178-9881-0dc3e273f358 could not be found. Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:03:51.349042 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:03:51.354578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:03:51.354578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:03:51.354578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:03:51.354578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:03:51.354578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:03:51.354578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae0f511-dab2-4178-9881-0dc3e273f358 could not be found. Nov 02 13:03:51.354578 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:03:51.357734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Returning 404 to user: Instance 9ae0f511-dab2-4178-9881-0dc3e273f358 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:03:51.360361 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d16d6c03-3551-4f56-9cef-4069da0c9236 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358" status: 404 len: 111 microversion: 2.1 time: 0.077956 Nov 02 13:03:51.365367 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3295/6524] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:51 2022] GET /compute/v2.1/servers/9ae0f511-dab2-4178-9881-0dc3e273f358 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:03:51.659914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09ec3beb-13fa-457e-9f5b-0d6793a42354 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] Calling method '.version_select at 0x7f228ec78550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:51.673278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:51.676303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:51.699785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:51.701488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:51.704647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:51.709530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:51.713223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:51.713817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:51.735752 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-09ec3beb-13fa-457e-9f5b-0d6793a42354 tempest-TestNetworkBasicOps-1973841742 tempest-TestNetworkBasicOps-1973841742-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1532556660" status: 202 len: 0 microversion: 2.1 time: 0.080927 Nov 02 13:03:51.736660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3230/6525] 10.222.0.45 () {58 vars in 1257 bytes} [Wed Nov 2 13:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1532556660 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:03:51.943874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:51.962314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:51.971766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:51.977304 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-60c3fe52-f79b-4188-8726-56bf3b274118 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.312112 Nov 02 13:03:51.978543 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3296/6526] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:51 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:53.010294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:53.012513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:53.025683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:53.026751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:53.027407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:53.028456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:53.029357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:53.029852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:53.341382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:53.360953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:53.370608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:53.374808 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4404f56f-de8f-46c0-9f45-9c3df8234727 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.373462 Nov 02 13:03:53.380096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3231/6527] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:53 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:53.604088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:53.605868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:53.615433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:53.616587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:53.617572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:53.618661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:53.619366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:53.620019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:53.874578 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e5b1216b-9ed4-4278-8173-f8299b3d9772 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1834 microversion: 2.1 time: 0.783303 Nov 02 13:03:53.887173 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3297/6528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:53 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1834 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:53.906417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:53.907360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:53.924224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:53.925345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:53.926146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:53.930789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:53.932050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:53.935572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:54.329003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:54.339782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:54.361049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fdde1048-f233-4b2b-85f1-2c98a03b1e02 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1683 microversion: 2.1 time: 0.459653 Nov 02 13:03:54.374223 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3232/6529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:53 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1683 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:54.432133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:54.433019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:54.460490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:54.468495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:54.475309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:54.480226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:54.481491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:54.482604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:54.621724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:54.624246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:54.653779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:54.654597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:54.662854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:54.675337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:54.676215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:54.677021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:54.780857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:54.793491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:54.795216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:54.796691 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-065ac477-7b9f-4f54-a7ad-b2ba74ba344a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.369892 Nov 02 13:03:54.820989 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3298/6530] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:54 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:54.848511 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dafbea7c-4fa7-4e6d-bd1d-02fadbda5340 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action" status: 200 len: 32638 microversion: 2.1 time: 0.230984 Nov 02 13:03:54.850042 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3233/6531] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:03:54 2022] POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action => generated 32638 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:03:55.008472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:55.009135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:55.018630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.022291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:55.022894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:55.023767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.030478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:55.031092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:55.144587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6168bdda906745bdab1f804ca9a3e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cbe3e64cf4f56aa9aba6dd4e55cc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:55.146361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] flavor_id is None. Assuming migration. {{(pid=120723) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 13:03:55.147508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120723) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:03:55.315806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=100 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:55.437013 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-21d4fcd5-f201-4a79-bdec-df00f9251781 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action" status: 202 len: 0 microversion: 2.1 time: 0.433427 Nov 02 13:03:55.444146 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3299/6532] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:03:55 2022] POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:03:55.453941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:55.455083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:55.473821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.475010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:55.476678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:55.477900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.480669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:55.482210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:55.826010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:55.827433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:55.849368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.852680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:55.857098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:55.857941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.858452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:55.858896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:56.102997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:56.122673 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e7b65a9-5c94-4b16-9ca0-43490f79a4ef tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1692 microversion: 2.1 time: 0.663914 Nov 02 13:03:56.128446 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3234/6533] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:55 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1692 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:56.433242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:56.442875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:56.445221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:56.446492 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d60cce2-ffa2-4cc8-aa46-8cc02a0cef5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.625092 Nov 02 13:03:56.447631 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3300/6534] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:55 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:57.160237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:57.161706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:57.177835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:57.182299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:57.182902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:57.183741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:57.188587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:57.189271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:57.477211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:57.478608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:57.497672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:57.498209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:57.498655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:57.499493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:57.499951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:57.500384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:57.665375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:57.680161 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cebbce8a-6a89-48f8-a24a-05b7e2e05455 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1692 microversion: 2.1 time: 0.523687 Nov 02 13:03:57.681585 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3235/6535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:57 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1692 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:58.077836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:58.112913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:58.118364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:58.135900 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c77341f3-ab4c-42c7-8d8f-b49e1b2b968e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.662870 Nov 02 13:03:58.136494 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3301/6536] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:57 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:58.709713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:58.711452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:58.732103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:58.734091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:58.737761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:58.744350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:58.752421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:58.761402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:59.168053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:59.186487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:59.199071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=45 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:59.202905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:59.203645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:59.206383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:59.207707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:59.208555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:59.213248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:59.289191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:59.301146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c14ceb16-04a0-49e3-bffb-5387601353e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1692 microversion: 2.1 time: 0.597879 Nov 02 13:03:59.344383 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3236/6537] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:58 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1692 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:00.013389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:00.024345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:00.026259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:00.027787 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce87e000-48c2-40fc-a146-50e94230cb6a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.865724 Nov 02 13:04:00.041928 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3302/6538] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:59 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:00.351629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:00.352447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:00.369744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:00.371793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:00.372617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:00.377655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:00.378515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:00.384247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:00.643879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:00.655161 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92edd4a2-39bc-4a11-a430-325b205bcd95 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.314432 Nov 02 13:04:00.658256 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3237/6539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:00 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:01.058613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:01.059986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:01.090639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:01.091408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:01.091859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:01.092585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:01.093308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:01.093833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:01.328855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:01.346278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:01.352675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:01.354871 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c441269-76d5-46b8-8008-31a9f263884c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.303154 Nov 02 13:04:01.372449 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3303/6540] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:01 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:01.687168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:01.688853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:01.700058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:01.714054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:01.717247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:01.718006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:01.720564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:01.721999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:01.723247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:01.988144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:02.000605 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a32d057-34cc-4712-a6b6-054c8b2dc694 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.321941 Nov 02 13:04:02.014784 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3238/6541] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:01 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:02.399128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:02.402410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:02.420005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:02.422853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:02.423596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:02.425212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:02.425913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:02.426603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:02.654424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:02.672060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:02.672060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:02.674440 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e1aac62b-de50-4399-a0d0-b30a6fb0d3ea tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.292976 Nov 02 13:04:02.696827 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3304/6542] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:02 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:03.032238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:03.033780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:03.042333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:03.043170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:03.043881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:03.045093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:03.045820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:03.047231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:03.329216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:03.378644 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36f2409c-1b9f-453d-955c-0b929ecfcaa9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.346992 Nov 02 13:04:03.379632 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3239/6543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:03 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:03.707339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:03.708660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:03.727675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:03.728473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:03.729114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:03.731221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:03.733127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:03.733867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:04.083656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:04.095299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:04.096765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:04.108515 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-25cc7e5b-5825-400a-a2a9-770161c0a48a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.396173 Nov 02 13:04:04.109181 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3305/6544] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:03 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:04.407049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:04.408885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:04.442170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:04.444171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:04.446606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:04.450463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:04.452246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:04.453091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:04.686007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:04.700745 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5af70862-2c2b-4e6c-b0d1-79399cff82e0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.297609 Nov 02 13:04:04.702180 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3240/6545] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:04 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:05.136770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:05.137440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:05.152090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:05.152613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:05.156017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:05.158724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:05.159718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:05.161477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:05.404043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:05.417738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:05.419800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:05.421925 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49aa6d6d-458e-41e6-8001-bd1ab1d1421b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.289408 Nov 02 13:04:05.423113 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3306/6546] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:05 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:05.727961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:05.728767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:05.743099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:05.745064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:05.745429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:05.747728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:05.751209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:05.752092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:06.063412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:06.069891 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-310a9a26-c520-45f0-9ca6-906aefd08194 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.347114 Nov 02 13:04:06.074532 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3241/6547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:05 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:06.453347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:06.456012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:06.484377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:06.485095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:06.488719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:06.494236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:06.501577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:06.503252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:07.107661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:07.108341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:07.163741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:07.167314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:07.167868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:07.173001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:07.173682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:07.174269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:07.573124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:07.592772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:07.595460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:07.597240 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7dd6fcf1-af99-4472-994b-bdb5218789db tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 1.149807 Nov 02 13:04:07.610724 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3307/6548] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:06 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:07.771154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:07.791626 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0fb47356-063a-47c1-979e-ab02090c7856 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.701080 Nov 02 13:04:07.792894 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3242/6549] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:07 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:08.643967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:08.644694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:08.662653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:08.663197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:08.664258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:08.664943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:08.666186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:08.666186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:08.822211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:08.822866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:08.834165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:08.835153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:08.835623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:08.836364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:08.836842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:08.837288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:09.190443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:09.219152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:09.220728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:09.232125 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-112813cb-211b-4ba3-a30b-88b717bffd1e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.582173 Nov 02 13:04:09.233520 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3308/6550] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:08 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:09.382484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:09.402115 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba1d754d-4e63-482d-98a9-748ce3c12cca tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.576777 Nov 02 13:04:09.403046 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3243/6551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:08 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:10.263018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:10.263989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:10.276731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:10.277349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:10.284442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:10.289892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:10.292107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:10.295404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:10.428540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:10.429883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:10.446237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:10.459836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:10.465669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:10.480356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:10.491376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:10.494800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:10.902404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:10.920783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:10.936713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:10.942406 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c32d1714-2a91-4cd4-8a92-bc4be5300f21 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.684011 Nov 02 13:04:10.943211 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3309/6552] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:10 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:11.067212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:11.077420 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5cd8e54d-5ad9-4657-a326-b8c8255909fb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.653352 Nov 02 13:04:11.078077 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3244/6553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:10 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:11.988134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:11.988772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:12.020228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:12.027048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:12.028758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:12.030440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:12.036262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:12.037146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:12.106364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:12.107015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:12.122057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:12.122879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:12.123534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:12.124510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:12.125188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:12.125837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:12.607962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:12.622580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:12.627606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:12.637936 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a8bdda6-0e3f-40d8-aa63-f41e89d61500 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1737 microversion: 2.20 time: 0.660494 Nov 02 13:04:12.642755 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3310/6554] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:11 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1737 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:12.769577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:12.783196 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1512cbb9-cd23-46f4-a8fa-8f4d9d05226d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.680686 Nov 02 13:04:12.784640 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3245/6555] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:12 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:13.673592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:13.674910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:13.684718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:13.695062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:13.695886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:13.697068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:13.697699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:13.705364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:13.811020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:13.812306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:13.816449 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:04:13.821225 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:04:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b (ip 10.222.0.45) !!! Nov 02 13:04:13.839524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:13.840093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:13.840872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:13.843866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:13.845030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:13.846298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:14.226260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:14.247645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:14.249727 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:14.250486 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4a7ce1e0-e3fa-4d63-9e3e-09aa562c0ebd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1719 microversion: 2.20 time: 0.581401 Nov 02 13:04:14.251073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3311/6556] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:13 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1719 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:14.435956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:14.450697 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-982dca09-723b-4b42-8bc8-b5fdcc39dc4d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.642488 Nov 02 13:04:14.451794 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3246/6557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:13 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:15.285377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:15.286687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:15.299187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:15.317316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:15.318330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:15.323656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:15.324390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:15.325005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:15.474581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:15.475395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:15.493670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:15.494350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:15.494831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:15.497300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:15.497817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:15.498302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:16.001505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:16.016792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2eb5c17d-44dc-4e81-9732-e41b4c352d6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.546505 Nov 02 13:04:16.026557 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3247/6558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:15 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:16.031474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:16.052614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:16.055622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:16.057555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f5d316e-bb51-4323-b7ef-3b6fd009faf5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1719 microversion: 2.20 time: 0.780418 Nov 02 13:04:16.058393 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3312/6559] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:15 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1719 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:17.046474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:17.047115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:17.064041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:17.064564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:17.066044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:17.066827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:17.067962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:17.068422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:17.092355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:17.092963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:17.114312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:17.114965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:17.115429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:17.116848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:17.117309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:17.117740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:17.562738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:17.578222 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07eccbe3-a6ce-4631-9c26-2970bac03169 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1697 microversion: 2.1 time: 0.533482 Nov 02 13:04:17.598118 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3248/6560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:17 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1697 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:17.631289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:17.657697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:17.663435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:17.667971 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2822ae1-0368-4d5f-92e2-01afb16c5bec tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1662 microversion: 2.20 time: 0.579339 Nov 02 13:04:17.672047 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3313/6561] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:17 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1662 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:17.698737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67370c17-e4cf-45ac-ae92-0ffc5a16d4ef"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:17.702358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:17.726071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:17.727835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:17.729619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:17.731107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:17.731814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:17.732485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:18.240917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:18.622764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:18.624880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:18.633520 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02a37548-2e05-4372-ac72-fe5e94ed1957 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.930094 Nov 02 13:04:18.644861 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3249/6562] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Nov 2 13:04:17 2022] POST /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments => generated 188 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:18.665839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:18.672994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:18.674106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:18.680007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:18.684051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:18.688166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:18.971183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-db8e18fe-7b57-4417-afde-e14dcd659e66 req-c3147665-bd43-4fb3-8408-5fff8a7bc116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad3a63e-391c-42f6-bc91-7d20cfd463bc", "name": "network-vif-unplugged", "status": "completed", "tag": "c254ced1-e0d3-4599-86fb-a61c7b4c210e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:19.010789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-db8e18fe-7b57-4417-afde-e14dcd659e66 req-c3147665-bd43-4fb3-8408-5fff8a7bc116 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:19.011360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-db8e18fe-7b57-4417-afde-e14dcd659e66 req-c3147665-bd43-4fb3-8408-5fff8a7bc116 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:19.011864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-db8e18fe-7b57-4417-afde-e14dcd659e66 req-c3147665-bd43-4fb3-8408-5fff8a7bc116 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:19.027697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.compute.server_external_events [req-db8e18fe-7b57-4417-afde-e14dcd659e66 req-c3147665-bd43-4fb3-8408-5fff8a7bc116 service nova] Unable to find a host for instance fad3a63e-391c-42f6-bc91-7d20cfd463bc. Dropping event network-vif-unplugged {{(pid=120722) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 13:04:19.028983 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-db8e18fe-7b57-4417-afde-e14dcd659e66 req-c3147665-bd43-4fb3-8408-5fff8a7bc116 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.073600 Nov 02 13:04:19.030278 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3250/6563] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 13:04:19.045489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:19.046101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:19.107126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:19.109249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:19.109811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:19.112154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:19.112733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:19.113755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:19.223506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 13:04:19.275634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:19.294154 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ca550953-c5e1-453e-9fea-465bd775dded tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1696 microversion: 2.1 time: 0.682208 Nov 02 13:04:19.294799 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3314/6564] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:18 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1696 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:19.311142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-8d1f82ed-6c11-46a4-a5f0-d08cd1357d58 req-a114da73-97a4-4741-b57b-b8d9aa22f92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "name": "network-vif-unplugged", "status": "completed", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:19.345366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8d1f82ed-6c11-46a4-a5f0-d08cd1357d58 req-a114da73-97a4-4741-b57b-b8d9aa22f92d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:19.345878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8d1f82ed-6c11-46a4-a5f0-d08cd1357d58 req-a114da73-97a4-4741-b57b-b8d9aa22f92d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:19.346360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8d1f82ed-6c11-46a4-a5f0-d08cd1357d58 req-a114da73-97a4-4741-b57b-b8d9aa22f92d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:19.381020 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-8d1f82ed-6c11-46a4-a5f0-d08cd1357d58 req-a114da73-97a4-4741-b57b-b8d9aa22f92d service nova] Creating event network-vif-unplugged:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h1-855650-5 Nov 02 13:04:19.391231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:19.408157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-8d1f82ed-6c11-46a4-a5f0-d08cd1357d58 req-a114da73-97a4-4741-b57b-b8d9aa22f92d service nova] Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:04:19.425240 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fceee606-2f78-4b74-b82b-d8b82dbdb602 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/action" status: 202 len: 0 microversion: 2.20 time: 0.392987 Nov 02 13:04:19.426863 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3251/6565] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 13:04:19 2022] POST /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:04:19.435969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:19.441360 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-8d1f82ed-6c11-46a4-a5f0-d08cd1357d58 req-a114da73-97a4-4741-b57b-b8d9aa22f92d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143878 Nov 02 13:04:19.443242 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3315/6566] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:19.447059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:19.460906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:19.461703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:19.462372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:19.463303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:19.470847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:19.471676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:20.326005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:20.328303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:20.373568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:20.379568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:20.380611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:20.383552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:20.385608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:20.389612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:20.628419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:20.657208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:20.658869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:20.665683 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e86e1fb5-627f-4cd2-b7dd-24f5215bd900 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1748 microversion: 2.20 time: 1.233578 Nov 02 13:04:20.666860 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3252/6567] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:19 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1748 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:21.219370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:21.244461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-add3880b-e96b-4155-be1e-08296ad300bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1696 microversion: 2.1 time: 0.921750 Nov 02 13:04:21.248455 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3316/6568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:20 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1696 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:21.693171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:21.694636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:21.711190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:21.716877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:21.717872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:21.730013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:21.731442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:21.735638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:21.744047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-79f20dfe-30dc-4161-aa54-728ed2b13dcf req-92660a0d-253e-4b1c-b142-06003cc33ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:21.789511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-79f20dfe-30dc-4161-aa54-728ed2b13dcf req-92660a0d-253e-4b1c-b142-06003cc33ed0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:21.790450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-79f20dfe-30dc-4161-aa54-728ed2b13dcf req-92660a0d-253e-4b1c-b142-06003cc33ed0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:21.791144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-79f20dfe-30dc-4161-aa54-728ed2b13dcf req-92660a0d-253e-4b1c-b142-06003cc33ed0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:21.830026 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-79f20dfe-30dc-4161-aa54-728ed2b13dcf req-92660a0d-253e-4b1c-b142-06003cc33ed0 service nova] Creating event network-changed:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h1-855650-5 Nov 02 13:04:21.857634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-79f20dfe-30dc-4161-aa54-728ed2b13dcf req-92660a0d-253e-4b1c-b142-06003cc33ed0 service nova] Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:04:21.904175 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-79f20dfe-30dc-4161-aa54-728ed2b13dcf req-92660a0d-253e-4b1c-b142-06003cc33ed0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168599 Nov 02 13:04:21.909690 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3317/6569] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:22.281334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:22.282079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:22.301586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:22.302343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:22.302989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:22.304378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:22.308798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:22.309504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:23.152969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:23.169409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:23.171268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:23.183240 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2c811f1-b431-43d3-b6f3-807721d21b24 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1748 microversion: 2.20 time: 1.494127 Nov 02 13:04:23.214991 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3253/6570] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:21 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1748 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:23.879217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:23.920443 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39b3b32b-3b1e-46e1-8202-478bfc20b4a2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1696 microversion: 2.1 time: 1.642021 Nov 02 13:04:23.922034 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3318/6571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:22 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1696 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:24.228884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:24.230152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:24.243110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:24.243895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:24.244541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:24.245664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:24.246433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:24.247175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:24.527131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:24.539929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:24.544045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:24.549947 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85729b99-f110-4005-9af5-4fea54268cf9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1750 microversion: 2.20 time: 0.325003 Nov 02 13:04:24.550882 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3254/6572] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:24 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1750 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:24.949519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:24.950288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:24.968983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:24.969507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:24.969996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:24.970737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:24.971877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:24.977834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:25.578575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:25.581663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:25.590899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:25.609344 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2778f504-a158-4c70-8859-200c1a93d13e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1694 microversion: 2.1 time: 0.665089 Nov 02 13:04:25.613659 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3319/6573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:24 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1694 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:25.634036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:25.634482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:25.634939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:25.635671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:25.636550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:25.636550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:26.048190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:26.073045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:26.074602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:26.075863 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f5fc2d72-6582-4c8d-b4e4-aeac19958122 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1750 microversion: 2.20 time: 0.502534 Nov 02 13:04:26.076447 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3255/6574] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:25 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1750 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:26.641078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:26.641725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:26.654969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:26.664110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:26.674716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:26.675767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:26.676403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:26.677007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:27.094696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:27.105016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:27.109998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:27.127957 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8b7b8be-f2ba-48aa-941b-eb5f6e502cfa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1691 microversion: 2.1 time: 0.489468 Nov 02 13:04:27.142829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:27.144137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:27.144817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:27.145946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:27.146735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:27.147531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:27.147861 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3320/6575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:26 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1691 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:27.164898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:27.181556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:27.189224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:27.189943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:27.191112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:27.192011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:27.193188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:27.193847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:27.575222 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69eb5a2c-21a4-4656-8ca1-99f2ee1a9a36 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action" status: 202 len: 0 microversion: 2.1 time: 0.419481 Nov 02 13:04:27.581363 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3321/6576] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:04:27 2022] POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:04:27.599239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:27.603853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:27.623093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:27.623812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:27.632490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:27.633417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:27.633899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:27.637594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:27.796842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:27.810596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:27.812821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:27.818670 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07af692c-81fd-46a7-939d-003c68334238 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1750 microversion: 2.20 time: 0.721426 Nov 02 13:04:27.820228 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3256/6577] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:27 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1750 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:28.123105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:28.135473 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2357769c-cdd0-422b-a619-3fd8ab115a21 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 0.552043 Nov 02 13:04:28.145473 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3322/6578] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:27 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:28.859612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:28.860369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:28.880591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:28.887683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:28.891282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:28.895317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:28.899192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:28.900999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:29.176857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:29.177479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:29.197754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:29.198288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:29.198740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:29.199480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:29.199941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:29.200374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:29.289697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:29.308816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:29.310979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:29.318618 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-875323ea-3e70-4080-8ee8-765c8ce2ea44 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1750 microversion: 2.20 time: 0.463027 Nov 02 13:04:29.320886 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3257/6579] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:28 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1750 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:29.654534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:29.679247 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-abe2bdc8-7831-44e3-b2d5-c267d6fdf5fa tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 0.506316 Nov 02 13:04:29.687033 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3323/6580] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:29 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:29.840962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-19706819-7047-4419-85a1-8353976ef630 req-c154a71c-6ddb-484c-ad9b-b5104378bd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "name": "network-vif-plugged", "status": "completed", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:29.878681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-19706819-7047-4419-85a1-8353976ef630 req-c154a71c-6ddb-484c-ad9b-b5104378bd12 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:29.879347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-19706819-7047-4419-85a1-8353976ef630 req-c154a71c-6ddb-484c-ad9b-b5104378bd12 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:29.879785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-19706819-7047-4419-85a1-8353976ef630 req-c154a71c-6ddb-484c-ad9b-b5104378bd12 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:29.909093 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-19706819-7047-4419-85a1-8353976ef630 req-c154a71c-6ddb-484c-ad9b-b5104378bd12 service nova] Creating event network-vif-plugged:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h1-855650-5 Nov 02 13:04:29.919376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-19706819-7047-4419-85a1-8353976ef630 req-c154a71c-6ddb-484c-ad9b-b5104378bd12 service nova] Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:04:29.972882 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-19706819-7047-4419-85a1-8353976ef630 req-c154a71c-6ddb-484c-ad9b-b5104378bd12 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131593 Nov 02 13:04:29.974141 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3258/6581] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:30.348153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:30.348766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:30.359681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=48 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:30.361230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:30.361737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:30.362266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:30.362997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:30.363457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:30.363886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:30.704932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:30.705664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:30.724301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:30.724824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:30.728066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:30.733274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:30.736341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:30.736572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:30.737621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:30.759082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:30.761612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:30.765507 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a6d97c8c-3a9a-4047-b1cb-159e9f3c7a46 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1750 microversion: 2.20 time: 0.421274 Nov 02 13:04:30.768060 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3324/6582] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:30 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1750 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:31.169536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:31.191710 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-990dcaff-f071-4c05-8f07-a123ffee7098 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 0.492303 Nov 02 13:04:31.198872 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3259/6583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:30 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:31.800861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:31.802203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:31.816055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:31.817002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:31.817670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:31.819380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:31.820073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:31.821036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:32.428870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24e82ff1-3e81-44bd-9b99-77a867d0d158 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Action: 'create', calling method: .version_select at 0x7f228e8d4310>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1859331194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5e1t9G5VhQFSreBYkIJXuCAp/eTWGoIzhLDYjGoe1GqfEaeV4ij/rNt1r2gp1zqM0IPwUeL3fbBV6tcc0BgJeEfbEYcH1zrCuQRu460jKYNzXuKASt4hfV+VKr33hedQ=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:32.441283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:32.475447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-24e82ff1-3e81-44bd-9b99-77a867d0d158 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Getting quotas for project 08862f98625d4bca80c271d557cd2e8a. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:04:32.493347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-24e82ff1-3e81-44bd-9b99-77a867d0d158 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Getting quotas for user c7430af4e1c441af96a63f7ddc7e70d6 and project 08862f98625d4bca80c271d557cd2e8a. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:04:32.560213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24e82ff1-3e81-44bd-9b99-77a867d0d158 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.572551 Nov 02 13:04:32.568191 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3260/6584] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:04:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:32.593700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:32.604988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:32.636040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:32.637038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:32.639664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:32.645782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:32.654149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:32.655126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:32.808913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:32.872330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:32.883489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:32.885199 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a6b315b-4720-4367-9b2a-74f00815b01c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1750 microversion: 2.20 time: 1.089401 Nov 02 13:04:32.918071 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3325/6585] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:31 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1750 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:33.377298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:33.392284 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-864b5944-0f55-40be-ab2b-cb16c78852dc tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 0.822677 Nov 02 13:04:33.392946 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3261/6586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:32 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:33.925588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:33.926252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:33.942785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:33.943303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:33.945748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:33.948772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:33.949264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:33.949923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:34.416738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:34.417371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:34.446035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:34.452491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:34.460385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:34.461187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:34.461692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:34.464411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:34.602223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:34.627121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:34.633400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:34.658012 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97787bfa-2dc2-40a1-9d57-ce94b175fd20 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1750 microversion: 2.20 time: 0.736747 Nov 02 13:04:34.680174 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3326/6587] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:33 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1750 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:34.883058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:34.886145 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4b5bca3c-8dc5-4eef-b197-cedcd48aaa44 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 0.473507 Nov 02 13:04:34.887549 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3262/6588] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:34 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:35.323537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-19dec886-c3d3-4f7b-b9af-415b0aff4401 req-fd1be7e7-1a71-4b57-a549-5c926f9ef249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "name": "network-vif-unplugged", "status": "completed", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:35.355252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-19dec886-c3d3-4f7b-b9af-415b0aff4401 req-fd1be7e7-1a71-4b57-a549-5c926f9ef249 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:35.355787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-19dec886-c3d3-4f7b-b9af-415b0aff4401 req-fd1be7e7-1a71-4b57-a549-5c926f9ef249 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:35.360237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-19dec886-c3d3-4f7b-b9af-415b0aff4401 req-fd1be7e7-1a71-4b57-a549-5c926f9ef249 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:35.408109 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-19dec886-c3d3-4f7b-b9af-415b0aff4401 req-fd1be7e7-1a71-4b57-a549-5c926f9ef249 service nova] Creating event network-vif-unplugged:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h2-855650-5 Nov 02 13:04:35.430512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-19dec886-c3d3-4f7b-b9af-415b0aff4401 req-fd1be7e7-1a71-4b57-a549-5c926f9ef249 service nova] Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:04:35.458880 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-19dec886-c3d3-4f7b-b9af-415b0aff4401 req-fd1be7e7-1a71-4b57-a549-5c926f9ef249 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139861 Nov 02 13:04:35.460666 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3327/6589] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:35.685603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:35.687187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:35.699013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:35.701706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:35.704688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:35.706062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:35.708564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:35.709290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:35.924395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:35.927621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:35.955655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:35.957445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:35.959786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:35.961881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:35.963178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:35.965047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:36.389105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:36.399658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:36.406606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:36.418920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af418c03-8bf4-467a-9430-2978132a8c12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.737816 Nov 02 13:04:36.420139 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3263/6590] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:35 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:37.190223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:37.202044 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e30b3e7-ba8a-4257-989f-f6e77db826a7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 1.288387 Nov 02 13:04:37.205604 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3328/6591] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:35 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:37.454402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:37.455664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:37.483135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:37.483655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:37.489487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:37.496229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:37.497193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:37.505778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1155220488", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1859331194", "security_groups": [{"name": "tempest-secgroup-smoke-640832977"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e748ae06-2402-48e0-aa35-6462961cd8a4"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:37.517135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:38.135639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] validate_networks() for [('e748ae06-2402-48e0-aa35-6462961cd8a4', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:04:38.259576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:38.302873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:38.308327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:38.310130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:38.311566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6357b4b1-4907-4079-833d-056b078ea1ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.861412 Nov 02 13:04:38.323400 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3264/6592] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:37 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:38.340264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8f310fab-3ff7-46e7-947f-4a0e318b31ec req-3ae517b9-c66f-43b4-81cd-c879ca00fcbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:38.430095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8f310fab-3ff7-46e7-947f-4a0e318b31ec req-3ae517b9-c66f-43b4-81cd-c879ca00fcbf service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:38.431133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8f310fab-3ff7-46e7-947f-4a0e318b31ec req-3ae517b9-c66f-43b4-81cd-c879ca00fcbf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:38.438505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8f310fab-3ff7-46e7-947f-4a0e318b31ec req-3ae517b9-c66f-43b4-81cd-c879ca00fcbf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:38.503106 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8f310fab-3ff7-46e7-947f-4a0e318b31ec req-3ae517b9-c66f-43b4-81cd-c879ca00fcbf service nova] Creating event network-changed:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h2-855650-5 Nov 02 13:04:38.520456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-8f310fab-3ff7-46e7-947f-4a0e318b31ec req-3ae517b9-c66f-43b4-81cd-c879ca00fcbf service nova] Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:04:38.550793 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8f310fab-3ff7-46e7-947f-4a0e318b31ec req-3ae517b9-c66f-43b4-81cd-c879ca00fcbf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225504 Nov 02 13:04:38.556097 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3265/6593] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:38.575899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:38.579122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:38.597463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:38.601107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:38.601863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:38.605554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:38.608969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:38.609750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:40.149146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:40.162571 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9bf1801b-9521-4e43-8db4-ba14cb1ff2a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 1.604857 Nov 02 13:04:40.186857 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3266/6594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:38 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:40.201444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:40.224864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:40.240113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:40.240693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:40.241154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:40.253423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:40.253982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:40.265124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:41.114112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:41.135034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:41.145756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:41.148933 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-580afea2-a519-4426-96de-c2fae0143269 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.959941 Nov 02 13:04:41.150277 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3267/6595] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:40 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:41.207216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:41.208283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:41.240716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:41.245346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:41.263115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:41.264661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:41.265744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:41.266749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:42.514842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:42.521015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Getting quotas for project 08862f98625d4bca80c271d557cd2e8a. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:04:42.539279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Getting quotas for user c7430af4e1c441af96a63f7ddc7e70d6 and project 08862f98625d4bca80c271d557cd2e8a. Resources: dict_keys(['metadata_items']) {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:04:42.580583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:04:42.581005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:04:42.584812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:04:42.587023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:04:42.588479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:04:42.623097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:42.633924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:42.634660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:42.637452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:42.644568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:42.648296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:42.744939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:42.796082 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6438257-14a1-4c8b-8872-2f45056961d7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 1.592966 Nov 02 13:04:42.800096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3268/6596] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:41 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:42.815074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:42.820530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:42.835103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Getting quotas for project 08862f98625d4bca80c271d557cd2e8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:04:42.835847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:42.836584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:42.837349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:42.841082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:42.854142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:42.855315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:42.860053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Getting quotas for user c7430af4e1c441af96a63f7ddc7e70d6 and project 08862f98625d4bca80c271d557cd2e8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:04:42.930970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:04:42.933517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:04:43.016543 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66b86cab-072d-4f4d-9425-0fcdca0c85cf tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.515112 Nov 02 13:04:43.021918 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3329/6597] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:04:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 5520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:04:43.038454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f5638485-8d9a-4485-abc2-24d58cc7a2b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:43.050420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f5638485-8d9a-4485-abc2-24d58cc7a2b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:43.228000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f5638485-8d9a-4485-abc2-24d58cc7a2b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:43.241053 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f5638485-8d9a-4485-abc2-24d58cc7a2b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1303 microversion: 2.1 time: 0.210596 Nov 02 13:04:43.244411 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3330/6598] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:43 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1303 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:43.832175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:43.834109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:43.873801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:43.879810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:43.885064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:43.891506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:43.896217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:43.903541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:43.958078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:44.010882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:44.032022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:44.039446 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19343537-2d2e-4530-9d1f-51aeecb049d0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 1.237481 Nov 02 13:04:44.061276 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3269/6599] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:42 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:44.284590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a51a35c9-40e9-44d2-8a2d-e8ab6d19d613 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:44.285255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a51a35c9-40e9-44d2-8a2d-e8ab6d19d613 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:44.441828 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:04:44.442653 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:04:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b (ip 10.222.0.45) !!! Nov 02 13:04:44.953643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a51a35c9-40e9-44d2-8a2d-e8ab6d19d613 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:44.980127 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a51a35c9-40e9-44d2-8a2d-e8ab6d19d613 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1303 microversion: 2.1 time: 0.702997 Nov 02 13:04:44.998822 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3270/6600] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:44 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1303 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:45.108375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:45.109638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:45.112911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:45.128298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:45.129105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:45.132355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:45.136289 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1057d40f-4364-4fd1-8e84-475646fcb965 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1690 microversion: 2.1 time: 1.309177 Nov 02 13:04:45.136654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:45.137339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:45.138654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:45.142059 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3331/6601] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:43 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1690 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:46.013387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:46.014432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:46.032639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:46.035796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:46.037941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:46.040330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:46.044494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:46.048163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:46.304550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:46.315427 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-afc7d1af-0b85-4b6e-bd2c-84470e5ce4b4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1355 microversion: 2.1 time: 0.306479 Nov 02 13:04:46.316035 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3332/6602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:46 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1355 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:46.329598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:46.365325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:46.366975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:46.375499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:46.383637 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a288213-0675-46b2-b4b6-4e641e3a21b4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 1.277772 Nov 02 13:04:46.384166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:46.386706 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3271/6603] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:45 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:46.434080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:46.434977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:46.435971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:46.436915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:46.437663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:46.438613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:46.442595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:47.120696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:47.145005 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3816e87a-dea7-436b-89bf-d0bff70ddddd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1683 microversion: 2.1 time: 0.825757 Nov 02 13:04:47.146144 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3333/6604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:46 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1683 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:47.359660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:47.369056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:47.394400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:47.394914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:47.395374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:47.417718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:47.424190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:47.431568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:47.529431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0bf9f45c-42cc-4152-9d9c-80cb05321ea4 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2059449965", "availability_zone": "foo_zone"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:47.535934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.aggregate [None req-0bf9f45c-42cc-4152-9d9c-80cb05321ea4 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Generated uuid b3090cd3-2805-43ee-8a6d-bb47adf2069b for aggregate {{(pid=120723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:04:47.616840 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0bf9f45c-42cc-4152-9d9c-80cb05321ea4 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.247549 Nov 02 13:04:47.638101 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3334/6605] 10.222.0.45 () {60 vars in 1164 bytes} [Wed Nov 2 13:04:47 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:47.643669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:47.644294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:47.724708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:47.725320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:47.746708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:47.747342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:47.748125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:47.748605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:47.749094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:47.764895 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1595590-55e7-48d9-9b19-28551088dc3b tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1361 microversion: 2.1 time: 0.409884 Nov 02 13:04:47.765568 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3272/6606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:47 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:47.873088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf14180d-afff-4038-8159-5da36ca85558 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:47.944250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf14180d-afff-4038-8159-5da36ca85558 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.118024 Nov 02 13:04:47.947030 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3273/6607] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 13:04:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:47.969583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08e8ded2-db37-42d6-8c61-c99bef2d3c11 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:47.997541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08e8ded2-db37-42d6-8c61-c99bef2d3c11 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:47.997541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08e8ded2-db37-42d6-8c61-c99bef2d3c11 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:47.997914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08e8ded2-db37-42d6-8c61-c99bef2d3c11 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:48.003616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08e8ded2-db37-42d6-8c61-c99bef2d3c11 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:48.014875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08e8ded2-db37-42d6-8c61-c99bef2d3c11 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:48.015552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08e8ded2-db37-42d6-8c61-c99bef2d3c11 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:48.171865 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08e8ded2-db37-42d6-8c61-c99bef2d3c11 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.214704 Nov 02 13:04:48.180989 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3274/6608] 10.222.0.45 () {58 vars in 1176 bytes} [Wed Nov 2 13:04:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:48.215162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89e75108-8b71-400a-a5f6-c3f43db5e2d3 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:48.238812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89e75108-8b71-400a-a5f6-c3f43db5e2d3 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.056120 Nov 02 13:04:48.250348 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3275/6609] 10.222.0.45 () {58 vars in 1143 bytes} [Wed Nov 2 13:04:48 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:48.264515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e2aeb30-4f68-4da5-aae6-3fc981d34708 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:48.330867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e2aeb30-4f68-4da5-aae6-3fc981d34708 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:48.331540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e2aeb30-4f68-4da5-aae6-3fc981d34708 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:48.332543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e2aeb30-4f68-4da5-aae6-3fc981d34708 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:48.341164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:48.359064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:48.372071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:48.373539 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-deb8b2e9-104b-4a39-b8a5-0c9d9d906b79 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.733934 Nov 02 13:04:48.386793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3335/6610] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:47 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:48.793934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:48.794673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:48.808576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:48.809075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:48.809517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:48.810261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:48.810725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:48.811154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:49.028543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:49.046432 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-83524415-b93c-4af7-9e22-3c360583225a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1361 microversion: 2.1 time: 0.257130 Nov 02 13:04:49.048345 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3336/6611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:48 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:49.141055 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e2aeb30-4f68-4da5-aae6-3fc981d34708 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.888502 Nov 02 13:04:49.141807 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3276/6612] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 13:04:48 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:49.164252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bc63a751-f810-4aed-8d60-9053b738320d tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:49.189487 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bc63a751-f810-4aed-8d60-9053b738320d tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.036470 Nov 02 13:04:49.191595 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3337/6613] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 13:04:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:49.204017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d91593fa-b777-4aae-81e2-8cf3ff581215 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2136458275", "availability_zone": "foo_zone"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:49.413522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:49.413522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:49.447246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:49.454313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:49.455121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:49.458266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:49.464999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:49.475862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:49.548514 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d91593fa-b777-4aae-81e2-8cf3ff581215 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.346250 Nov 02 13:04:49.553651 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3277/6614] 10.222.0.45 () {60 vars in 1173 bytes} [Wed Nov 2 13:04:49 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:49.567472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d35a394-6732-47ce-9099-1a715bc07528 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:49.654675 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5d35a394-6732-47ce-9099-1a715bc07528 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.096240 Nov 02 13:04:49.669001 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3278/6615] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 13:04:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:49.679812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-300f95aa-775e-4dc5-9325-7ca242bb539a tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:49.710608 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-300f95aa-775e-4dc5-9325-7ca242bb539a tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.039753 Nov 02 13:04:49.718076 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3279/6616] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Nov 2 13:04:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:49.732157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb17aed2-b707-4da8-993c-4dc21f3ea3b0 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855650-5"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:49.777927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb17aed2-b707-4da8-993c-4dc21f3ea3b0 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:49.778487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb17aed2-b707-4da8-993c-4dc21f3ea3b0 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:49.781342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb17aed2-b707-4da8-993c-4dc21f3ea3b0 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:50.323395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:50.340759 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb17aed2-b707-4da8-993c-4dc21f3ea3b0 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.614474 Nov 02 13:04:50.344212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:50.349292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:50.351471 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84c936c8-fe2b-4123-8f78-f1f8d5c44873 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1810 microversion: 2.20 time: 0.946157 Nov 02 13:04:50.353517 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3280/6617] 10.222.0.45 () {60 vars in 1194 bytes} [Wed Nov 2 13:04:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:50.358390 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3338/6618] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:49 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1810 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:50.373372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:50.377382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:50.387570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-02d08888-bab6-4762-bcac-5bf813185c67 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:50.449656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:50.454891 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-02d08888-bab6-4762-bcac-5bf813185c67 tempest-TestAggregatesBasicOps-429156965 tempest-TestAggregatesBasicOps-429156965-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.094046 Nov 02 13:04:50.457688 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3339/6619] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Nov 2 13:04:50 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:04:50.466232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:50.469300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:50.482637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:50.483683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:50.484376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:51.249168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:51.265920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-539a36de-053d-40c1-89bb-4d31645d484f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 0.910416 Nov 02 13:04:51.282876 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3281/6620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:50 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:51.406937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:51.407607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:51.435898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:51.436701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:51.437329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:51.445069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:51.445819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:51.446459 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:52.171744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:52.184561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:52.196754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:52.202691 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0463ee6e-5924-4d57-9a77-60d648d8ae7b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.801325 Nov 02 13:04:52.203339 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3340/6621] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:51 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:52.342462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0ccdcd39-e855-402e-bbf5-cbd462587342 req-57d97970-71ab-4fd1-8b85-078102ef37cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a255d25-9777-4f63-899b-62fc2403b27d", "tag": "9e457216-0442-45f5-980d-61695ea1d204"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:52.343644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:52.350376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:52.394503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:52.400868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:52.402552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:52.409630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:52.412292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:52.422065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:52.428797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0ccdcd39-e855-402e-bbf5-cbd462587342 req-57d97970-71ab-4fd1-8b85-078102ef37cb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:52.432288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0ccdcd39-e855-402e-bbf5-cbd462587342 req-57d97970-71ab-4fd1-8b85-078102ef37cb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:52.433234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0ccdcd39-e855-402e-bbf5-cbd462587342 req-57d97970-71ab-4fd1-8b85-078102ef37cb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:52.533764 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0ccdcd39-e855-402e-bbf5-cbd462587342 req-57d97970-71ab-4fd1-8b85-078102ef37cb service nova] Creating event network-changed:9e457216-0442-45f5-980d-61695ea1d204 for instance 6a255d25-9777-4f63-899b-62fc2403b27d on n-h1-855650-5 Nov 02 13:04:52.572833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0ccdcd39-e855-402e-bbf5-cbd462587342 req-57d97970-71ab-4fd1-8b85-078102ef37cb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251586 Nov 02 13:04:52.580069 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3282/6622] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:52.731422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9ec48679-590c-48fe-8acb-98554dae8319 req-4a5660a1-5c06-4d1e-9910-e9dcdccc5262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "name": "network-vif-plugged", "status": "completed", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:52.761996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:52.801134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9ec48679-590c-48fe-8acb-98554dae8319 req-4a5660a1-5c06-4d1e-9910-e9dcdccc5262 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:52.801724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9ec48679-590c-48fe-8acb-98554dae8319 req-4a5660a1-5c06-4d1e-9910-e9dcdccc5262 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:52.802258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9ec48679-590c-48fe-8acb-98554dae8319 req-4a5660a1-5c06-4d1e-9910-e9dcdccc5262 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:52.874211 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9ec48679-590c-48fe-8acb-98554dae8319 req-4a5660a1-5c06-4d1e-9910-e9dcdccc5262 service nova] Creating event network-vif-plugged:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h2-855650-5 Nov 02 13:04:52.906300 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9ec48679-590c-48fe-8acb-98554dae8319 req-4a5660a1-5c06-4d1e-9910-e9dcdccc5262 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180071 Nov 02 13:04:52.907054 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3283/6623] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:53.233718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:53.250857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:53.254791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:53.282206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:53.287432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:53.289556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:53.290733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:53.315110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:53.318838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:54.295732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:54.314014 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1b43b664-4f60-4322-a929-b118fed4f4c4 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 1.997774 Nov 02 13:04:54.318860 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3341/6624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:52 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:54.585193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:54.605159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:54.611764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:54.617228 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-611117f9-1444-4734-9164-5b7712f4f197 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 1.377553 Nov 02 13:04:54.619915 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3284/6625] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:53 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:55.346111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:55.347425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:55.361701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:55.365544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:55.369833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:55.370950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:55.371599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:55.374573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:55.652554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:55.653378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:55.655964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:55.669178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:55.669707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:55.673308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:55.674379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:55.675029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:55.677606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:55.685032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:55.695814 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-076bc969-9733-48ae-90c6-68bd8472c9e2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 0.354419 Nov 02 13:04:55.696429 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3342/6626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:55 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:56.125231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:56.139861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:56.147084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:56.151164 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eaa27864-6c67-4e64-837d-bab1a17b60e9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.502674 Nov 02 13:04:56.154051 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3285/6627] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:55 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:56.227438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-652c9c03-f780-4c96-a224-753388d297f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-418753485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1952071615", "security_groups": [{"name": "tempest-secgroup-smoke-151727032"}], "block_device_mapping_v2": [{"uuid": "7d415a0f-5301-46e1-a7d7-3422f7fee920", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c2de958-5bb8-43d5-9f50-0267f3814230"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:56.721542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:56.722851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:56.732286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:56.740969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:56.741949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:56.743968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:56.744429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:56.744988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:56.935949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:56.951769 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d56280a4-ff25-4045-a66f-022db4f61984 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 0.234718 Nov 02 13:04:56.955168 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3286/6628] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:56 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:57.183650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:57.184189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:57.190674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:57.191182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:57.191632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:57.192343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:57.192852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:57.193498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:57.448611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:57.461387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:57.466449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:57.472576 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03a272de-0a24-4c0f-980d-44a0160e40f8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.293039 Nov 02 13:04:57.480792 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3287/6629] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:57 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:57.977022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:57.977671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:57.980587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:57.990640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:57.991163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:57.991622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:57.992340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:57.992806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:58.006823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:58.069273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:58.323404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:58.334466 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-641d750f-5d06-430f-a6f6-3d78ab1a42f0 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 0.361413 Nov 02 13:04:58.350910 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3288/6630] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:57 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:58.507879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:58.508594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:58.515611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:58.516179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:58.516635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:58.517531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:58.518200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:58.518655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:58.710519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:58.724189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:58.726628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:58.728852 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d71a978e-7fc8-4762-9d1b-059c79c1ad1b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.225706 Nov 02 13:04:58.729987 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3289/6631] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:58 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:59.364045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:59.364772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:59.374655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:59.375205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:59.376169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:59.377753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:59.380324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:59.380970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:59.404359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:59.540761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:59.550387 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acefaafb-5163-4e1e-933b-04bf549c4883 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 0.191982 Nov 02 13:04:59.561203 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3290/6632] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:59 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:59.757559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:59.758114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:59.770007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:59.773048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:59.774706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:59.776380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:59.778231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:59.781243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:59.956528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:59.968123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:59.970329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:59.971598 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b2a724f-d7d2-4e71-9272-f8faae709e12 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.219374 Nov 02 13:04:59.972169 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3291/6633] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:59 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:05:00.582474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:00.583919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:00.600540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:00.601067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:00.601533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:00.603744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:00.604252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:00.604812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:00.957738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:00.967831 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b99031c-db5f-4c34-a882-aa4004cd0c20 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 0.396340 Nov 02 13:05:00.985914 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3292/6634] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:00 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:00.999850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:01.001957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:01.016330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:01.016731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:01.017200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:01.019337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:01.020464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:01.020983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:01.371338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:01.386383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:01.387884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:01.394369 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-10f97fa4-3dc5-40e5-be44-7154737616f5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.393342 Nov 02 13:05:01.418660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3293/6635] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:00 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:01.995829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:01.995829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:02.003933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:02.004452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:02.004914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:02.006207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:02.006929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:02.007377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:02.377741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:02.396509 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89f1af5c-6f4c-4d19-bff1-4706315dc614 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 0.406918 Nov 02 13:05:02.402094 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3294/6636] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:01 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:02.432796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:02.434246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:02.447032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:02.448538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:02.451360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:02.453333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:02.454360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:02.455183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:02.689759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:02.702213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:02.703699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:02.705399 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-896dab55-1140-4b7e-9e67-b155019465d1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.282293 Nov 02 13:05:02.706417 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3295/6637] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:02 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:02.712135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-31e963ec-e232-4cb3-9c61-1990b13237d9 req-b6d6f026-ee78-4fd8-8efd-ad8c78c3bd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a255d25-9777-4f63-899b-62fc2403b27d", "name": "network-vif-plugged", "status": "completed", "tag": "9e457216-0442-45f5-980d-61695ea1d204"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:02.723410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-31e963ec-e232-4cb3-9c61-1990b13237d9 req-b6d6f026-ee78-4fd8-8efd-ad8c78c3bd11 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:02.724010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-31e963ec-e232-4cb3-9c61-1990b13237d9 req-b6d6f026-ee78-4fd8-8efd-ad8c78c3bd11 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:02.724468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-31e963ec-e232-4cb3-9c61-1990b13237d9 req-b6d6f026-ee78-4fd8-8efd-ad8c78c3bd11 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:02.739153 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-31e963ec-e232-4cb3-9c61-1990b13237d9 req-b6d6f026-ee78-4fd8-8efd-ad8c78c3bd11 service nova] Creating event network-vif-plugged:9e457216-0442-45f5-980d-61695ea1d204 for instance 6a255d25-9777-4f63-899b-62fc2403b27d on n-h1-855650-5 Nov 02 13:05:02.744601 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-31e963ec-e232-4cb3-9c61-1990b13237d9 req-b6d6f026-ee78-4fd8-8efd-ad8c78c3bd11 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036987 Nov 02 13:05:02.748415 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3296/6638] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:03.435151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:03.436174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:03.444359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:03.444728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:03.445372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:03.446480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:03.447529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:03.448153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:03.668747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:03.685325 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2d13c1e2-3b54-446c-8dcd-1b2d08a3111a tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1428 microversion: 2.1 time: 0.255370 Nov 02 13:05:03.686044 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3297/6639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:03 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1428 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:03.733472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:03.734613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:03.742781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:03.743293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:03.743745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:03.744468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:03.744924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:03.745363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:03.899055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:03.909361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:03.910874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:03.912173 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-81d263c0-bd77-444f-96d8-a3b85de7e6ac tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.183219 Nov 02 13:05:03.913134 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3298/6640] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:03 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:04.712104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:04.712902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:04.723337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:04.724539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:04.725364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:04.726310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:04.727114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:04.727378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:04.897837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:04.906153 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bde0f288-e165-41db-ba37-977ef5b6c404 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1608 microversion: 2.1 time: 0.198983 Nov 02 13:05:04.906743 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3299/6641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:04 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1608 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:04.933990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:04.933990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:04.943280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:04.944185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:04.944853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:04.945602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:04.946315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:04.946863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:05.110673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:05.120082 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd9a8b1f-7f8a-42e9-8635-74311ea8d0b7 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1608 microversion: 2.1 time: 0.194739 Nov 02 13:05:05.120993 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3300/6642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:04 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1608 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:05.125940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:05.126599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:05.133123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:05.133734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:05.134088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:05.135050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:05.135662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:05.136239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:05.295051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:05.307803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:05.309317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:05.310578 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8748e90-fd80-4f94-b366-4035f4071b09 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.188347 Nov 02 13:05:05.311156 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3301/6643] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:05 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:05.316016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:05.317372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:05.324222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:05.324736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:05.325313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:05.326248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:05.327198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:05.327643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:05.490404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:05.500700 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9fa1628-074f-453d-b46c-c1341d037787 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1608 microversion: 2.1 time: 0.188262 Nov 02 13:05:05.501320 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3302/6644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:05 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1608 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:05.692848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=41 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:06.248775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:06.337587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:06.338881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:06.359520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:06.360316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:06.360955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:06.362072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:06.362711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:06.363320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:06.638547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:06.650317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:06.652760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:06.654794 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a39c0b9b-f480-4178-a299-327f31c65bf0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.321709 Nov 02 13:05:06.655495 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3303/6645] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:06 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:05:07.332347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac2c8d3e-72d9-47f8-95f9-e8904d4da67e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Action: 'create', calling method: .version_select at 0x7f2292ab85e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1966420312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwMpv1hPjzTz1sF9K/ePBu+ALivI4D6ol0lOQ72GccehmsXTGrKb9cyFqKJTCpwMXH205L49Q4Sw4xbzps3dWEqGT6Qz2qlLKFlavbi5BLCLrJFRhKVKuBJOGq8RUMn0Q=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:07.354080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ac2c8d3e-72d9-47f8-95f9-e8904d4da67e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Getting quotas for project 37416e0f4c60441cb3a00971d9e4af32. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:05:07.361361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ac2c8d3e-72d9-47f8-95f9-e8904d4da67e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Getting quotas for user 7ead8ff4246240f5b7485681faf38e93 and project 37416e0f4c60441cb3a00971d9e4af32. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:05:07.390035 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac2c8d3e-72d9-47f8-95f9-e8904d4da67e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.259999 Nov 02 13:05:07.390659 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3304/6646] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:05:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:07.682748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:07.683717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:07.694301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:07.698961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:07.699702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:07.700767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:07.701598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:07.702969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:08.058075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:08.075728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:08.077250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:08.078560 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c052f5e-1a59-471a-a2df-7cc1e05dc3b5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.401213 Nov 02 13:05:08.079928 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3305/6647] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:07 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:05:08.126917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d6f1af9e-1a02-4f22-b11e-ae30ca2ff69a req-dbffa470-dbd6-42a7-9d07-01d0e773b59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a255d25-9777-4f63-899b-62fc2403b27d", "tag": "9e457216-0442-45f5-980d-61695ea1d204"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:08.139589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d6f1af9e-1a02-4f22-b11e-ae30ca2ff69a req-dbffa470-dbd6-42a7-9d07-01d0e773b59a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:08.140102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d6f1af9e-1a02-4f22-b11e-ae30ca2ff69a req-dbffa470-dbd6-42a7-9d07-01d0e773b59a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:08.140556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d6f1af9e-1a02-4f22-b11e-ae30ca2ff69a req-dbffa470-dbd6-42a7-9d07-01d0e773b59a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:08.152948 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d6f1af9e-1a02-4f22-b11e-ae30ca2ff69a req-dbffa470-dbd6-42a7-9d07-01d0e773b59a service nova] Creating event network-changed:9e457216-0442-45f5-980d-61695ea1d204 for instance 6a255d25-9777-4f63-899b-62fc2403b27d on n-h1-855650-5 Nov 02 13:05:08.158684 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d6f1af9e-1a02-4f22-b11e-ae30ca2ff69a req-dbffa470-dbd6-42a7-9d07-01d0e773b59a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035837 Nov 02 13:05:08.162610 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3306/6648] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:09.111107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:09.111858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:09.119181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:09.119759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:09.120362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:09.126924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:09.127714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:09.128193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:09.390958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:09.410965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:09.416124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:09.418316 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea63162a-fec1-4531-8b7a-0b4db44abe39 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.312675 Nov 02 13:05:09.419204 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3307/6649] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:09 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:05:10.448735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:10.450150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:10.459451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:10.462741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:10.463219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:10.463974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:10.464449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:10.464894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:10.847769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:10.859652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:10.861338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:10.862943 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2af4836f-12fc-4955-ae66-ba1b4618e1f6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.418996 Nov 02 13:05:10.863850 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3308/6650] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:10 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:11.891739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:11.893153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:11.907616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:11.908429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:11.909057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:11.912991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:11.913765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:11.914442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:11.962502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:12.194963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:12.219152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:12.225643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:12.228985 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26765e68-5a69-4c50-8eda-e34766639572 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.343095 Nov 02 13:05:12.231249 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3309/6651] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:11 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:12.825905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7586483c-6b85-41b8-886a-2b703b71966e req-2238ced1-05f2-42f4-b0e3-a6c92123ef76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad3a63e-391c-42f6-bc91-7d20cfd463bc", "name": "network-vif-plugged", "status": "completed", "tag": "c254ced1-e0d3-4599-86fb-a61c7b4c210e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:12.853688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7586483c-6b85-41b8-886a-2b703b71966e req-2238ced1-05f2-42f4-b0e3-a6c92123ef76 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:12.861386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7586483c-6b85-41b8-886a-2b703b71966e req-2238ced1-05f2-42f4-b0e3-a6c92123ef76 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:12.863101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7586483c-6b85-41b8-886a-2b703b71966e req-2238ced1-05f2-42f4-b0e3-a6c92123ef76 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:12.902818 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7586483c-6b85-41b8-886a-2b703b71966e req-2238ced1-05f2-42f4-b0e3-a6c92123ef76 service nova] Creating event network-vif-plugged:c254ced1-e0d3-4599-86fb-a61c7b4c210e for instance fad3a63e-391c-42f6-bc91-7d20cfd463bc on n-h1-855650-5 Nov 02 13:05:12.951700 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7586483c-6b85-41b8-886a-2b703b71966e req-2238ced1-05f2-42f4-b0e3-a6c92123ef76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119033 Nov 02 13:05:12.952922 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3310/6652] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:13.263382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:13.274164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:13.295951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:13.296929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:13.297866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:13.300069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:13.302224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:13.306242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:13.645024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:13.664612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:13.682739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:13.685817 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99cdc42e-1755-4193-bfcf-d7e6f750e70f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.430556 Nov 02 13:05:13.690981 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3311/6653] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:13 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:14.731488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:14.733410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:14.742367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:14.743170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:14.743840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:14.745085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:14.745766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:14.746524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:15.213534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:15.233139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:15.242917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:15.247378 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d71c1fd9-9841-481f-bf27-93cd911b38fa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1806 microversion: 2.20 time: 0.520281 Nov 02 13:05:15.249230 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3312/6654] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:14 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1806 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:15.796595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1675136888-access_point-194032062", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "d614a263-0e69-4ea6-8b52-cc94bf453deb"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1966420312", "security_groups": [{"name": "tempest-secgroup_access--798271657"}, {"name": "tempest-secgroup_general--2048381438"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:16.085768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] validate_networks() for [('d614a263-0e69-4ea6-8b52-cc94bf453deb', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:16.584002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:05:16.584440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:05:16.585120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:05:16.585711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:05:16.586164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:05:16.596102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:16.596987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:16.597522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:16.599468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:16.600192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:16.600941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:16.623360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Getting quotas for project 37416e0f4c60441cb3a00971d9e4af32. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:05:16.630236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Getting quotas for user 7ead8ff4246240f5b7485681faf38e93 and project 37416e0f4c60441cb3a00971d9e4af32. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:05:16.645508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:05:16.647705 n-d-855650-5 devstack@n-api.service[120722]: WARNING nova.utils [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1675136888-access_point-194032062 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1675136888-ac Nov 02 13:05:16.648645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:05:16.703555 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6dcc494f-935b-41c5-bf2c-cbaa0e68e571 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.910982 Nov 02 13:05:16.704224 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3313/6655] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:15 2022] POST /compute/v2.1/servers => generated 457 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:05:16.709892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:16.710913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:16.717516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:16.718294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:16.718749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:16.719467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:16.720175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:16.720868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:16.924378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:16.937700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:16.956683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:16.959524 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-93deb1d2-a556-42b4-a823-2ac5409c1902 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1793 microversion: 2.20 time: 0.253859 Nov 02 13:05:16.960392 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3314/6656] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:16 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1793 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:16.986564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2285a168-2618-4af6-9137-7cd145e6c41e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:16.987019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2285a168-2618-4af6-9137-7cd145e6c41e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:17.067486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2285a168-2618-4af6-9137-7cd145e6c41e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:17.081112 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2285a168-2618-4af6-9137-7cd145e6c41e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1294 microversion: 2.1 time: 0.102019 Nov 02 13:05:17.084057 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3315/6657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:16 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:18.107600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:18.108278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:18.115510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:18.116023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:18.116483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:18.117208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:18.117681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:18.118161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:18.211155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:18.226760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7e7ed666-dfc9-4efc-8b55-cadf758dd038 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1346 microversion: 2.1 time: 0.123886 Nov 02 13:05:18.227600 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3316/6658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:18 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:19.252583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:19.253379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:19.263033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:19.263892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:19.264713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:19.266463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:19.267202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:19.267867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:19.513012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:19.522656 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1bc38b5-124b-45ec-a162-8539202c92fa tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.275062 Nov 02 13:05:19.523266 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3317/6659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:19 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:19.878029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-212884860", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:19.933447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:20.234245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:05:20.234670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:05:20.235173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:05:20.235603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:05:20.236110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:05:20.245681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:20.246229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:20.246683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:20.247469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:20.247968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:20.248403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:20.268261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Getting quotas for project 39c47c9c07134762840660f22b97a6d7. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:05:20.273806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Getting quotas for user 394b01964bc242cbbe4c76db2b69cb21 and project 39c47c9c07134762840660f22b97a6d7. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:05:20.287408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:05:20.289664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:05:20.300316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:20.341677 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6b60705-5dea-4022-98b3-c95f2d912a42 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.468015 Nov 02 13:05:20.343128 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3318/6660] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:05:20.348305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a94036ac-224f-4103-8124-781d5e9f108d req-39b3b723-1b0d-48a9-a18b-501ee88bb7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1544ba18-1e6f-43a2-9279-965243f1966a", "tag": "00bb386b-72bc-4513-adfa-ddff8e1b9a10"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:20.361473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a94036ac-224f-4103-8124-781d5e9f108d req-39b3b723-1b0d-48a9-a18b-501ee88bb7d5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:20.362705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a94036ac-224f-4103-8124-781d5e9f108d req-39b3b723-1b0d-48a9-a18b-501ee88bb7d5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:20.363174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a94036ac-224f-4103-8124-781d5e9f108d req-39b3b723-1b0d-48a9-a18b-501ee88bb7d5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:20.377181 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a94036ac-224f-4103-8124-781d5e9f108d req-39b3b723-1b0d-48a9-a18b-501ee88bb7d5 service nova] Creating event network-changed:00bb386b-72bc-4513-adfa-ddff8e1b9a10 for instance 1544ba18-1e6f-43a2-9279-965243f1966a on n-h2-855650-5 Nov 02 13:05:20.383985 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a94036ac-224f-4103-8124-781d5e9f108d req-39b3b723-1b0d-48a9-a18b-501ee88bb7d5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039641 Nov 02 13:05:20.384668 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3319/6661] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:20.390920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-29b7ba74-4c7f-47fd-b9bb-0a36be8f5d84 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:20.391989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-29b7ba74-4c7f-47fd-b9bb-0a36be8f5d84 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:20.452256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-29b7ba74-4c7f-47fd-b9bb-0a36be8f5d84 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:20.461424 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-29b7ba74-4c7f-47fd-b9bb-0a36be8f5d84 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1213 microversion: 2.1 time: 0.075242 Nov 02 13:05:20.462202 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3320/6662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:20 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:20.549750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:20.552473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:20.560371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:20.560891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:20.561590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:20.563394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:20.563893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:20.564342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:20.731403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:20.747445 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a86f26d9-b5d8-42e7-b25d-7869fa41a271 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.202934 Nov 02 13:05:20.748816 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3321/6663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:20 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:21.485345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:21.486023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:21.492991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:21.493498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:21.493983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:21.494700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:21.495174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:21.495618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:21.562387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:21.570920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39c23aae-3ee5-414f-92c9-41e571285b1d tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1265 microversion: 2.1 time: 0.090558 Nov 02 13:05:21.571813 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3322/6664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:21 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:21.774473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:21.775234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:21.781602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:21.782148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:21.782653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:21.783395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:21.783861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:21.784303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:21.946349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:21.954595 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c08e9256-db81-42a3-b8ce-6f2a9ca17132 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.186024 Nov 02 13:05:21.955192 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3323/6665] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:21 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:22.595350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:22.596292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:22.604420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:22.604936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:22.605400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:22.606172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:22.606672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:22.607118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:22.773772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:22.784008 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af496f2a-a23d-41e8-86fe-730effe74451 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.192707 Nov 02 13:05:22.784649 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3324/6666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:22 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:22.978190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:22.978926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:22.985585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:22.986215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:22.986673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:22.987584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:22.988053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:22.988687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:23.165086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:23.175425 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e44bada-6f85-46dc-9093-c3ccdb4de374 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.202032 Nov 02 13:05:23.176070 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3325/6667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:22 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:23.318391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-595d1002-f8c6-4ade-be7d-b7075d5c8c5c req-a940c372-6f62-481e-93cc-c598505e0bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f355c8-e203-43fe-aaa1-12919e3635e8", "tag": "1da5270a-d371-413c-99e5-9262ac3b66bc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:23.342435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-595d1002-f8c6-4ade-be7d-b7075d5c8c5c req-a940c372-6f62-481e-93cc-c598505e0bfb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:23.343002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-595d1002-f8c6-4ade-be7d-b7075d5c8c5c req-a940c372-6f62-481e-93cc-c598505e0bfb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:23.343461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-595d1002-f8c6-4ade-be7d-b7075d5c8c5c req-a940c372-6f62-481e-93cc-c598505e0bfb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:23.356396 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-595d1002-f8c6-4ade-be7d-b7075d5c8c5c req-a940c372-6f62-481e-93cc-c598505e0bfb service nova] Creating event network-changed:1da5270a-d371-413c-99e5-9262ac3b66bc for instance a9f355c8-e203-43fe-aaa1-12919e3635e8 on n-h1-855650-5 Nov 02 13:05:23.361846 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-595d1002-f8c6-4ade-be7d-b7075d5c8c5c req-a940c372-6f62-481e-93cc-c598505e0bfb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048820 Nov 02 13:05:23.362963 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3326/6668] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:23.693417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:23.696126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:23.702511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:23.703018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:23.703476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:23.704376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:23.704861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:23.705303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:23.781204 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bba79da1-db8b-4b80-b966-60c289494d14 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action" status: 200 len: 62944 microversion: 2.1 time: 0.092819 Nov 02 13:05:23.782015 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3327/6669] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:05:23 2022] POST /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b/action => generated 62944 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:05:23.810114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:23.810838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:23.818186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:23.818687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:23.819150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:23.819864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:23.820331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:23.820774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:23.965811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:23.974839 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c60d5c7c-7012-475d-9e95-401df8e03d65 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.169316 Nov 02 13:05:23.975506 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3328/6670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:23 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:24.201195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:24.201698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:24.209086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:24.209587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:24.210071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:24.210799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:24.211264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:24.211706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:24.369618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:24.377647 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f2aa36b-01e2-4577-a52a-d5bf7e5aa6bf tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.180617 Nov 02 13:05:24.378288 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3329/6671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:24 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:24.999241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:24.999943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:25.008514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:25.009060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:25.009560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:25.010396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:25.010911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:25.011415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:25.157162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:25.166201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f4713dc4-16d1-44b1-999a-46e857c77040 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.171284 Nov 02 13:05:25.166785 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3330/6672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:24 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:25.400674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:25.401301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:25.407738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:25.408175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:25.408622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:25.409332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:25.409795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:25.410257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:25.572489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:25.576572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:25.583213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96050321-31d1-4bc7-9a2b-05531b7b37e9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.185793 Nov 02 13:05:25.583825 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3331/6673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:25 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:26.191063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:26.191757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:26.199005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:26.199515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:26.199976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:26.200706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:26.201177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:26.201618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:26.344808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:26.353269 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3bd181f-8e03-405c-a77f-f6a7ebe0979f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.166365 Nov 02 13:05:26.353959 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3332/6674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:26 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:26.611498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:26.612191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:26.618981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:26.619491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:26.619954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:26.620684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:26.621155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:26.621599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:26.777477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:26.786370 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a189497b-5377-44b3-880d-234119bf2df1 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.178710 Nov 02 13:05:26.786991 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3333/6675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:26 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:27.377822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:27.378525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:27.386689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:27.387208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:27.387666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:27.388399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:27.389070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:27.389325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:27.536138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:27.546921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7b29f50-ef58-4536-946e-95e87886d382 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.173495 Nov 02 13:05:27.548276 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3334/6676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:27 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:27.555984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-61f8e44d-2393-40f2-8f61-11ed1df8ad29 req-fcdcf9dc-f388-4d82-9916-c804064e4b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1544ba18-1e6f-43a2-9279-965243f1966a", "name": "network-vif-plugged", "status": "completed", "tag": "00bb386b-72bc-4513-adfa-ddff8e1b9a10"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:27.575265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61f8e44d-2393-40f2-8f61-11ed1df8ad29 req-fcdcf9dc-f388-4d82-9916-c804064e4b3d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:27.575863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61f8e44d-2393-40f2-8f61-11ed1df8ad29 req-fcdcf9dc-f388-4d82-9916-c804064e4b3d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:27.576409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-61f8e44d-2393-40f2-8f61-11ed1df8ad29 req-fcdcf9dc-f388-4d82-9916-c804064e4b3d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:27.588556 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-61f8e44d-2393-40f2-8f61-11ed1df8ad29 req-fcdcf9dc-f388-4d82-9916-c804064e4b3d service nova] Creating event network-vif-plugged:00bb386b-72bc-4513-adfa-ddff8e1b9a10 for instance 1544ba18-1e6f-43a2-9279-965243f1966a on n-h2-855650-5 Nov 02 13:05:27.594465 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-61f8e44d-2393-40f2-8f61-11ed1df8ad29 req-fcdcf9dc-f388-4d82-9916-c804064e4b3d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042739 Nov 02 13:05:27.595082 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3335/6677] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:27.810712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:27.811437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:27.818519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:27.819030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:27.819503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:27.820239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:27.820718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:27.821164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:27.995312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:28.004590 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a52521f3-1849-43c1-8c93-234bf6515ebc tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.198223 Nov 02 13:05:28.005201 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3336/6678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:27 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:28.576518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:28.578265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:28.585055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:28.585600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:28.586177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:28.586909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:28.587385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:28.587834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:28.724084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:28.731899 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9c32ec8-d443-4621-b32a-c5a4b1567216 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.159756 Nov 02 13:05:28.732482 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3337/6679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:28 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:29.028603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:29.029611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:29.037598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:29.038153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:29.038622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:29.039388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:29.039864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:29.040321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:29.197002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:29.206044 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d4520b4-a7df-4842-8e41-15946cc95856 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1471 microversion: 2.1 time: 0.181516 Nov 02 13:05:29.206489 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3338/6680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:29 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:29.756064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:29.756776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:29.763479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:29.763984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:29.764441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:29.765160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:29.765633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:29.766112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:29.912555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:29.923154 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2c6cbd7d-8384-430c-b048-72f60df13876 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.171664 Nov 02 13:05:29.923748 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3339/6681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:29 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:30.229746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:30.230394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:30.237120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.237622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.238094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:30.239317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.239783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.240222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:30.256796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:30.397504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:30.405566 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-06a66d38-b22f-4887-a043-a22bef1bb9c4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1643 microversion: 2.1 time: 0.179819 Nov 02 13:05:30.406172 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3340/6682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:30 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1643 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:30.430903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:30.431125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:30.437553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.438124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.438592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:30.439436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.439804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.440307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:30.459512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=20 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:30.593724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:30.602650 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c5b4b571-971e-4280-bc03-153bafbab52e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1643 microversion: 2.1 time: 0.178235 Nov 02 13:05:30.603585 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3341/6683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:30 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1643 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:30.608453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-533a212e-32e7-4f67-b116-b0a0540df239 req-2b9488d1-2608-4bad-87bf-c49991d75f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f355c8-e203-43fe-aaa1-12919e3635e8", "name": "network-vif-plugged", "status": "completed", "tag": "1da5270a-d371-413c-99e5-9262ac3b66bc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:30.620190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-533a212e-32e7-4f67-b116-b0a0540df239 req-2b9488d1-2608-4bad-87bf-c49991d75f16 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.620678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-533a212e-32e7-4f67-b116-b0a0540df239 req-2b9488d1-2608-4bad-87bf-c49991d75f16 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.621133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-533a212e-32e7-4f67-b116-b0a0540df239 req-2b9488d1-2608-4bad-87bf-c49991d75f16 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:30.633270 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-533a212e-32e7-4f67-b116-b0a0540df239 req-2b9488d1-2608-4bad-87bf-c49991d75f16 service nova] Creating event network-vif-plugged:1da5270a-d371-413c-99e5-9262ac3b66bc for instance a9f355c8-e203-43fe-aaa1-12919e3635e8 on n-h1-855650-5 Nov 02 13:05:30.638209 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-533a212e-32e7-4f67-b116-b0a0540df239 req-2b9488d1-2608-4bad-87bf-c49991d75f16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033638 Nov 02 13:05:30.638822 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3342/6684] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:30.643700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:30.644418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:30.651019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.651530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.651986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:30.652702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.653174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.653617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:30.919475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0210a74f-4e50-4669-8e54-b3b794da03ff tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1794 microversion: 2.1 time: 0.279431 Nov 02 13:05:30.920078 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3343/6685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:30 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1794 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:30.946878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:30.947589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:30.954064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.954575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.955026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:30.955743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:30.956208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:30.956658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:31.176848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:31.185734 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b4dee261-4a3a-439c-b773-cb2d48e72f36 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.242571 Nov 02 13:05:31.186586 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3344/6686] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:30 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:32.210559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:32.211390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:32.218770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:32.219234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:32.219694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:32.220435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:32.220914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:32.221480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:32.710065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:32.718229 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cc3510b-03c1-4e82-93dc-dad59d94f5af tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1313 microversion: 2.1 time: 0.512449 Nov 02 13:05:32.718816 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3345/6687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:32 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:33.065811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1fb48490-f691-46b8-b21d-2d5e1c4c9066 req-3e20e101-e107-4c9d-9ce2-cb28d7c7c62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1544ba18-1e6f-43a2-9279-965243f1966a", "tag": "00bb386b-72bc-4513-adfa-ddff8e1b9a10"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:33.076452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1fb48490-f691-46b8-b21d-2d5e1c4c9066 req-3e20e101-e107-4c9d-9ce2-cb28d7c7c62c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:33.076871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1fb48490-f691-46b8-b21d-2d5e1c4c9066 req-3e20e101-e107-4c9d-9ce2-cb28d7c7c62c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:33.077183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1fb48490-f691-46b8-b21d-2d5e1c4c9066 req-3e20e101-e107-4c9d-9ce2-cb28d7c7c62c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:33.090589 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1fb48490-f691-46b8-b21d-2d5e1c4c9066 req-3e20e101-e107-4c9d-9ce2-cb28d7c7c62c service nova] Creating event network-changed:00bb386b-72bc-4513-adfa-ddff8e1b9a10 for instance 1544ba18-1e6f-43a2-9279-965243f1966a on n-h2-855650-5 Nov 02 13:05:33.096359 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1fb48490-f691-46b8-b21d-2d5e1c4c9066 req-3e20e101-e107-4c9d-9ce2-cb28d7c7c62c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034921 Nov 02 13:05:33.096983 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3346/6688] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:33.745900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:33.746657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:33.754517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:33.755345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:33.756024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:33.756778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:33.757252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:33.757872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:33.914613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:33.923049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd44e25e-a819-4fe7-babc-22278deced1f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1463 microversion: 2.1 time: 0.183001 Nov 02 13:05:33.936903 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3347/6689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:33 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1463 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:33.948106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "770fb983-9fb3-479b-9a1f-896e26007e6f", "device": "/dev/sdb"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:33.950839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:33.958417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:33.959303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:33.959981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:33.960986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:33.961893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:33.962618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:34.311179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a406332d-0fca-49a0-a122-384f7440cb0a tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "POST /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366907 Nov 02 13:05:34.312276 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3348/6690] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:05:33 2022] POST /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:46.672490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=62 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:46.673497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:46.678108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:46.679103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:46.687339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:46.687863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:46.688332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:46.689098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:46.689575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:46.690055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:46.843900 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55cc38b0-07ed-465a-80eb-2d5ae3c7d80a tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1834 microversion: 2.1 time: 0.174293 Nov 02 13:05:46.844496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3349/6691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:46 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1834 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:47.831069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:47.832532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:47.840666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:47.841169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:47.841657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:47.842427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:47.843644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:47.843644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:47.873297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:05:47.978996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53185c6e-59e2-4718-b47c-afc3b413a0ba tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 204 len: 0 microversion: 2.1 time: 0.151699 Nov 02 13:05:47.983464 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3350/6692] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:05:47 2022] DELETE /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:05:47.986673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-34bcd407-3131-4718-bcfd-554dd9ee3e32 req-97585b7d-a952-44b8-9030-7194cb5064bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:48.001046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34bcd407-3131-4718-bcfd-554dd9ee3e32 req-97585b7d-a952-44b8-9030-7194cb5064bf service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:48.001556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34bcd407-3131-4718-bcfd-554dd9ee3e32 req-97585b7d-a952-44b8-9030-7194cb5064bf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:48.002088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-34bcd407-3131-4718-bcfd-554dd9ee3e32 req-97585b7d-a952-44b8-9030-7194cb5064bf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:48.015116 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-34bcd407-3131-4718-bcfd-554dd9ee3e32 req-97585b7d-a952-44b8-9030-7194cb5064bf service nova] Creating event network-changed:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h2-855650-5 Nov 02 13:05:48.021502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-34bcd407-3131-4718-bcfd-554dd9ee3e32 req-97585b7d-a952-44b8-9030-7194cb5064bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039445 Nov 02 13:05:48.022389 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3351/6693] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:48.031792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:48.032525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:48.040399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:48.040925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:48.041402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:48.042167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:48.042646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:48.043085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:48.262417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:48.271067 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8656dffc-a7ef-41a9-9933-d29a1d9e4993 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1689 microversion: 2.1 time: 0.243582 Nov 02 13:05:48.271678 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3352/6694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:48 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1689 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:49.309265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:49.310052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:49.318928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:49.319531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:49.320044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:49.320846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:49.321510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:49.322066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:49.511247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:49.525135 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-035b2562-a081-4b92-8e38-c8f6cbcca97f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1689 microversion: 2.1 time: 0.221150 Nov 02 13:05:49.526264 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3353/6695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:49 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:50.574060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:50.575033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:50.587097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:50.588065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:50.588750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:50.589953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:50.590686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:50.591182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:50.782032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:50.792326 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-45beffb4-66d8-4036-97eb-87ccd9830bc6 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1689 microversion: 2.1 time: 0.227235 Nov 02 13:05:50.793094 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3354/6696] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:50 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:51.141851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-234f9b7e-9c1d-462b-86e0-14546f659d3d req-8e38e308-9481-42d3-b82a-cb5c17709810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b", "name": "network-vif-deleted", "tag": "0f4a31aa-80ca-460d-9ebe-837ca668c9e2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:51.153901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-234f9b7e-9c1d-462b-86e0-14546f659d3d req-8e38e308-9481-42d3-b82a-cb5c17709810 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:51.154476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-234f9b7e-9c1d-462b-86e0-14546f659d3d req-8e38e308-9481-42d3-b82a-cb5c17709810 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:51.154809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-234f9b7e-9c1d-462b-86e0-14546f659d3d req-8e38e308-9481-42d3-b82a-cb5c17709810 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:51.171798 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-234f9b7e-9c1d-462b-86e0-14546f659d3d req-8e38e308-9481-42d3-b82a-cb5c17709810 service nova] Creating event network-vif-deleted:0f4a31aa-80ca-460d-9ebe-837ca668c9e2 for instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b on n-h2-855650-5 Nov 02 13:05:51.186799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-234f9b7e-9c1d-462b-86e0-14546f659d3d req-8e38e308-9481-42d3-b82a-cb5c17709810 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048365 Nov 02 13:05:51.188734 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3355/6697] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:51.819345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:51.820038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:51.829658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:51.830664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:51.832074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:51.833012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:51.833676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:51.834178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:51.872191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:51.872978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:51.873630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:51.874299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lazy-loading 'fault' on Instance uuid f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:05:51.930168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:51.938461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ec95570-d50c-49a9-aeda-0d0e44b21f38 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 200 len: 1356 microversion: 2.1 time: 0.125228 Nov 02 13:05:51.939476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3356/6698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:51 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 1356 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:52.968913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:52.981310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:53.003895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:53.004663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:53.005263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:53.006199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:53.006976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:53.007650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:53.022924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] HTTP exception thrown: Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b could not be found. Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Request method failure captured: Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b HTTP/1.1 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmka0UtFqJo2p1FuykiDL2PwMcgraY9pqGeA62hyS-KcQKxCFIPsV1EHPqy8Xx9mC5sS8GeLrRB-WIrkKZRktqGfjXQkW8-F7y5h0nkAthBHoj_HauQLaycYcEgKRwbq1hWX-gqpL_uyQPOXVYNpwgGlz5_2rN-Uxx8W2JjBjVs3a2A Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 8b8298d308cf40d6adfae4b378b13281 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 8b8298d308cf40d6adfae4b378b13281 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestNetworkAdvancedServerOps-1410606748-project Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 04b040caac0349ffbe7e23b18769bad1 Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1410606748-project Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b could not be found. Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b'} Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b could not be found. Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b could not be found. Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:05:53.024657 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b could not be found. Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Returning 404 to user: Instance f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-87752337-d59c-49b4-9529-afc2d549a459 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b" status: 404 len: 111 microversion: 2.1 time: 0.064734 Nov 02 13:05:53.029049 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3357/6699] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:52 2022] GET /compute/v2.1/servers/f5a51d08-7bf9-4b9c-b440-5f5bf5404d3b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:05:58.055169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-10bbf2a6-3f21-4122-bf48-741e41854477 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '.version_select at 0x7f228d9be8b0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:58.089114 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-10bbf2a6-3f21-4122-bf48-741e41854477 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1569064744" status: 202 len: 0 microversion: 2.1 time: 0.038186 Nov 02 13:05:58.089690 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3358/6700] 10.222.0.45 () {58 vars in 1284 bytes} [Wed Nov 2 13:05:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1569064744 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:05:58.131394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67d2a7bb-ec32-4581-82cb-73ca5e24f366 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'create', calling method: .version_select at 0x7f228e6c0040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-8276572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODv6jYnoKYGtEqH1aYEcYxG8VBdAHcu5ZLa6wA77rnC451aXIgOVchiDLmBiQg//ZyduAqH4zBqjKNyNi5kg3elbyUuFlwrsM60i1SjWE8HkpGotWdxA0zwG0/tZlymvA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:58.149554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-67d2a7bb-ec32-4581-82cb-73ca5e24f366 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for project 8b8298d308cf40d6adfae4b378b13281. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:05:58.155891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-67d2a7bb-ec32-4581-82cb-73ca5e24f366 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for user 04b040caac0349ffbe7e23b18769bad1 and project 8b8298d308cf40d6adfae4b378b13281. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:05:58.182564 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67d2a7bb-ec32-4581-82cb-73ca5e24f366 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.055689 Nov 02 13:05:58.183144 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3359/6701] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:05:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:03.771881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:03.784101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:03.784101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:03.797780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:03.798488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:03.799056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:03.800136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:03.800835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:03.801383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:03.853057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:06:04.021449 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-798005f3-0b3e-4431-a029-3f2f9db2b5ad tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 204 len: 0 microversion: 2.1 time: 0.248884 Nov 02 13:06:04.022499 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3360/6702] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:06:03 2022] DELETE /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:06:04.031184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7578571e-e803-431a-9f65-b8ede47ab878 req-64152b9f-aa0c-42ec-abdb-c13d30e23673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3ee477-9978-4c11-9f1d-df958615130d", "tag": "3d527c31-d3e9-4b60-bb2d-fd856daf790a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:04.051644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7578571e-e803-431a-9f65-b8ede47ab878 req-64152b9f-aa0c-42ec-abdb-c13d30e23673 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:04.052617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7578571e-e803-431a-9f65-b8ede47ab878 req-64152b9f-aa0c-42ec-abdb-c13d30e23673 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:04.053232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7578571e-e803-431a-9f65-b8ede47ab878 req-64152b9f-aa0c-42ec-abdb-c13d30e23673 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:04.071923 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7578571e-e803-431a-9f65-b8ede47ab878 req-64152b9f-aa0c-42ec-abdb-c13d30e23673 service nova] Creating event network-changed:3d527c31-d3e9-4b60-bb2d-fd856daf790a for instance 2d3ee477-9978-4c11-9f1d-df958615130d on n-h2-855650-5 Nov 02 13:06:04.078307 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7578571e-e803-431a-9f65-b8ede47ab878 req-64152b9f-aa0c-42ec-abdb-c13d30e23673 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054020 Nov 02 13:06:04.079264 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3361/6703] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:04.095357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:04.096349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:04.105251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:04.106050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:04.106683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:04.107776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:04.109055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:04.110189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:04.416157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:04.440070 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1bd5f7e6-93df-4981-ae95-ace3fd3a594a tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1576 microversion: 2.1 time: 0.358962 Nov 02 13:06:04.458047 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3362/6704] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:04 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1576 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:05.466629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:05.468335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:05.481494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:05.484269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:05.485111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:05.486942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:05.488208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:05.488884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:05.686477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:05.702803 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56bff3bf-7c21-42f0-b39e-6bcf089a8b44 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1576 microversion: 2.1 time: 0.240832 Nov 02 13:06:05.703466 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3363/6705] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:05 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:06.726581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-748562016", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "1cb88973-88aa-4ac8-805a-b6291477a433"}], "key_name": "tempest-TestNetworkAdvancedServerOps-8276572", "security_groups": [{"name": "tempest-secgroup-smoke-1476496313"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:06.891734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] validate_networks() for [('1cb88973-88aa-4ac8-805a-b6291477a433', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:06:07.725288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:06:07.726277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:06:07.726999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:06:07.728105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:06:07.728815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:06:07.741430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:07.742318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:07.742988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:07.743981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:07.744640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:07.745261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:07.781842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for project 8b8298d308cf40d6adfae4b378b13281. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:06:07.789481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for user 04b040caac0349ffbe7e23b18769bad1 and project 8b8298d308cf40d6adfae4b378b13281. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:06:07.819967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:06:07.822856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:06:07.882188 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6624f6c1-f2ef-4580-adf8-76baf75ed41b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.162032 Nov 02 13:06:07.883158 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3364/6706] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:06:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:06:07.898495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:07.899509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:07.909179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:07.911034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:07.913507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:07.914782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:07.915423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:07.916043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:08.045530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:08.057510 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4c1c4e29-b853-43d3-9151-97bdbad91992 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1226 microversion: 2.1 time: 0.163794 Nov 02 13:06:08.058363 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3365/6707] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:07 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1226 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:08.088605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-015edd03-8c04-4527-9aee-4428e4b96c8f req-078be969-f3c2-41ca-bfd9-e345c38336c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ee477-9978-4c11-9f1d-df958615130d", "name": "network-vif-deleted", "tag": "3d527c31-d3e9-4b60-bb2d-fd856daf790a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:08.118380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-015edd03-8c04-4527-9aee-4428e4b96c8f req-078be969-f3c2-41ca-bfd9-e345c38336c2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:08.118897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-015edd03-8c04-4527-9aee-4428e4b96c8f req-078be969-f3c2-41ca-bfd9-e345c38336c2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:08.119353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-015edd03-8c04-4527-9aee-4428e4b96c8f req-078be969-f3c2-41ca-bfd9-e345c38336c2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:08.142668 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-015edd03-8c04-4527-9aee-4428e4b96c8f req-078be969-f3c2-41ca-bfd9-e345c38336c2 service nova] Creating event network-vif-deleted:3d527c31-d3e9-4b60-bb2d-fd856daf790a for instance 2d3ee477-9978-4c11-9f1d-df958615130d on n-h2-855650-5 Nov 02 13:06:08.149409 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-015edd03-8c04-4527-9aee-4428e4b96c8f req-078be969-f3c2-41ca-bfd9-e345c38336c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069817 Nov 02 13:06:08.150405 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3366/6708] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:08.172052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01185c8b-961c-406e-a05c-15400f46f13b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:08.172818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-01185c8b-961c-406e-a05c-15400f46f13b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:08.233958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-01185c8b-961c-406e-a05c-15400f46f13b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:08.243536 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01185c8b-961c-406e-a05c-15400f46f13b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1263 microversion: 2.1 time: 0.090604 Nov 02 13:06:08.258875 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3367/6709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:08 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1263 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:09.087066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:09.103339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:09.116625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:09.117496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:09.118020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:09.119012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:09.119650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:09.120140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:09.213485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:09.225959 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-298ca2bb-33af-4d43-9037-a63077a59217 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1226 microversion: 2.1 time: 0.145210 Nov 02 13:06:09.231535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3368/6710] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:09 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:09.268940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:09.269742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:09.280142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:09.281817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:09.285648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:09.286532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:09.287026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:09.287479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:09.384081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:09.395312 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2326bb8e-aff0-417a-8785-9605eef02e6f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1315 microversion: 2.1 time: 0.130116 Nov 02 13:06:09.406573 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3369/6711] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:09 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:10.255224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:10.256627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:10.271058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:10.274070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:10.274684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:10.276350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:10.286900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:10.288039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:10.405186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:10.417775 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8e9c3f3-756d-4459-84cd-d695e97f5ace tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1226 microversion: 2.1 time: 0.166187 Nov 02 13:06:10.418178 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3370/6712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:10 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1226 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:10.428812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:10.430184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:10.437802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:10.438599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:10.439259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:10.441157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:10.441826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:10.442533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:10.702174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:10.716362 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92dd198e-3980-450b-8ce9-ced7cfb33b68 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.295447 Nov 02 13:06:10.719994 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3371/6713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:10 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:11.462468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:11.463172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:11.492454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:11.492981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:11.493437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:11.498548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:11.499141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:11.499614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:11.625163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:11.639170 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-51817b84-2e26-4e8c-83d8-ef81bf946f29 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1226 microversion: 2.1 time: 0.189912 Nov 02 13:06:11.641543 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3372/6714] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:11 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1226 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:11.744655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:11.745722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:11.765210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:11.766168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:11.766832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:11.767776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:11.770624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:11.771332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:12.045792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:12.055294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8d1e1ad7-a597-4081-bfc5-3a4ba73d1bf4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.315470 Nov 02 13:06:12.056051 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3373/6715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:11 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:12.148442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-56d7d46f-0231-42c2-8d29-1b212b118719 req-ec600459-35d5-4384-b1c3-268d47612de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb97ed8-36ab-4116-8ee6-c4166dd11844", "tag": "c1e3a597-b838-4940-bb05-14cbc7f27ed2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:12.180039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-56d7d46f-0231-42c2-8d29-1b212b118719 req-ec600459-35d5-4384-b1c3-268d47612de7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:12.183893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-56d7d46f-0231-42c2-8d29-1b212b118719 req-ec600459-35d5-4384-b1c3-268d47612de7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:12.184621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-56d7d46f-0231-42c2-8d29-1b212b118719 req-ec600459-35d5-4384-b1c3-268d47612de7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:12.210364 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-56d7d46f-0231-42c2-8d29-1b212b118719 req-ec600459-35d5-4384-b1c3-268d47612de7 service nova] Creating event network-changed:c1e3a597-b838-4940-bb05-14cbc7f27ed2 for instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 on n-h2-855650-5 Nov 02 13:06:12.227950 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-56d7d46f-0231-42c2-8d29-1b212b118719 req-ec600459-35d5-4384-b1c3-268d47612de7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083719 Nov 02 13:06:12.228777 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3374/6716] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:12.668531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:12.669938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:12.689050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:12.689665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:12.690224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:12.694110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:12.694668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:12.695189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:12.792396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:12.803092 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77a3dac2-6f89-4c09-be0c-e4699cac727b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1226 microversion: 2.1 time: 0.139049 Nov 02 13:06:12.804409 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3375/6717] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:12 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:13.080004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:13.080645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:13.084407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:13.095705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:13.096506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:13.097568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:13.106600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:13.110601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:13.111110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:13.294630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:13.304703 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c21fd2cc-f556-492f-9473-b80190aa378f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.229014 Nov 02 13:06:13.305889 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3376/6718] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:13 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:13.828526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:13.829272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:13.836342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:13.836884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:13.837343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:13.838089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:13.838568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:13.839014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:13.902979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:13.911609 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7bfc5c20-1089-4a55-bcef-4100d99ec7f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1226 microversion: 2.1 time: 0.087475 Nov 02 13:06:13.912193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3377/6719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:13 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:14.330150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:14.330150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:14.336860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:14.337364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:14.338090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:14.338926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:14.339394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:14.340017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:14.361836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:14.501346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:14.510224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84390c81-5e3f-40d1-b00e-96572d25f9dd tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.185130 Nov 02 13:06:14.510830 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3378/6720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:14 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:14.935714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:14.936507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:14.944312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:14.944744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:14.945212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:14.945941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:14.946435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:14.946920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:15.012127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:15.020386 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77d77db6-9b6e-410d-962e-684972b85b3c tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1226 microversion: 2.1 time: 0.088690 Nov 02 13:06:15.021080 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3379/6721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:14 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:15.534882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:15.535515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:15.543293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:15.543811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:15.544278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:15.545006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:15.545476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:15.545919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:15.721596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:15.730018 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4a7207f-2ebc-49e0-9514-c22e3e7d523e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.199606 Nov 02 13:06:15.730849 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3380/6722] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:15 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:16.044043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:16.045371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:16.052858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:16.053901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:16.054542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:16.055454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:16.056128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:16.056722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:16.128294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:16.128806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:16.129261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:16.129738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lazy-loading 'fault' on Instance uuid 2d3ee477-9978-4c11-9f1d-df958615130d {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:06:16.187593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b6ee9295464444a626601b16db2574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3790495df8340788ecc233838a1545d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:16.197526 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-702b8130-d002-4eed-a970-30cb76b4e8c3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 200 len: 1185 microversion: 2.1 time: 0.157353 Nov 02 13:06:16.198823 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3381/6723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:16 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 1185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:16.753468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:16.754079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:16.760508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:16.761023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:16.761481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:16.762449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:16.762849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:16.763296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:16.914488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:16.922751 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-460026c5-9a12-4f09-a75c-4c0cfea9d4d2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.173874 Nov 02 13:06:16.923425 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3382/6724] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:16 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:17.223307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:17.223975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 2d3ee477-9978-4c11-9f1d-df958615130d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:17.231236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:17.231825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:17.232382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:17.233107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:17.233581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:17.234052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:17.248588 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 2d3ee477-9978-4c11-9f1d-df958615130d could not be found. Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d HTTP/1.1 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 2d3ee477-9978-4c11-9f1d-df958615130d could not be found. Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2d3ee477-9978-4c11-9f1d-df958615130d'} Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3ee477-9978-4c11-9f1d-df958615130d could not be found. Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3ee477-9978-4c11-9f1d-df958615130d could not be found. Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:17.250420 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3ee477-9978-4c11-9f1d-df958615130d could not be found. Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 2d3ee477-9978-4c11-9f1d-df958615130d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a7614ee-e9c0-4123-945b-1b85fbf9caa3 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d" status: 404 len: 111 microversion: 2.1 time: 0.033184 Nov 02 13:06:17.255506 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3383/6725] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:17 2022] GET /compute/v2.1/servers/2d3ee477-9978-4c11-9f1d-df958615130d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:06:17.763228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:17.763751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:17.769162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:17.770935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:17.771448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:17.771905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:17.772640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:17.773111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:17.773554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:17.789290 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 HTTP/1.1 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '8499cff2-0f59-4ee5-9aba-41e0f102af35'} Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:06:17.790986 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.795507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.797092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:06:17.798569 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94bd276c-e71b-41bf-93fc-6dbedaaf6a5b tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 404 len: 111 microversion: 2.1 time: 0.039105 Nov 02 13:06:17.799302 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3384/6726] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:06:17 2022] DELETE /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:17.808785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:17.809681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] [instance: 8499cff2-0f59-4ee5-9aba-41e0f102af35] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:17.816687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:17.817370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:17.818025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:17.818928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:17.819560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:17.820365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:17.836350 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] HTTP exception thrown: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Request method failure captured: Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 HTTP/1.1 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmdlYSBR6i7UCgUZSB9_zmRv3G3O5AwF_GXgcUSF_JJ16w7scEqp8c5y_JAnOhLf3G1jGYYDNHTx-teBBUK-2mUmNW9sselpCH1AMkTcucL4z6Qv0HSOMQVqgPs1ct6Ty0iOu10C03XCnM7SL3aoH41UBEKhNlK2pSGLN59mC825cK4 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d3790495df8340788ecc233838a1545d Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3790495df8340788ecc233838a1545d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3790495df8340788ecc233838a1545d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3790495df8340788ecc233838a1545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d3790495df8340788ecc233838a1545d Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1746756080 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1746756080-project Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 15b6ee9295464444a626601b16db2574 Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1746756080-project Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '8499cff2-0f59-4ee5-9aba-41e0f102af35'} Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:17.838517 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.843225 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:17.843225 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:17.843225 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:17.843225 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:06:17.843225 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:06:17.843225 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. Nov 02 13:06:17.843225 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:17.844365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 404 to user: Instance 8499cff2-0f59-4ee5-9aba-41e0f102af35 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:06:17.847217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d16bfcd6-7bc7-45ac-ac21-347fe4ee24c6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35" status: 404 len: 111 microversion: 2.1 time: 0.041749 Nov 02 13:06:17.848528 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3385/6727] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:17 2022] GET /compute/v2.1/servers/8499cff2-0f59-4ee5-9aba-41e0f102af35 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:17.945656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:17.947345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:17.955586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:17.956930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:17.957694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:17.958696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:17.959433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:17.960230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:18.125084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:18.133743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e819d86-2a38-4b58-a137-d3ba9c41f6c1 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.191540 Nov 02 13:06:18.150489 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3386/6728] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:17 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:19.160865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:19.161574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:19.164353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:19.170751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:19.171258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:19.171709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:19.172425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:19.172925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:19.173362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:19.337510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:19.347291 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c047c0cc-51c4-4ff8-93fb-25db62b06e49 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.190213 Nov 02 13:06:19.348063 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3387/6729] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:19 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:19.788101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-69ced3cb-f3dc-4d5c-89b2-8a7d05c1a47d req-c19164f2-034e-4e86-896e-2672ef1ba901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb97ed8-36ab-4116-8ee6-c4166dd11844", "name": "network-vif-plugged", "status": "completed", "tag": "c1e3a597-b838-4940-bb05-14cbc7f27ed2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:19.803751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-69ced3cb-f3dc-4d5c-89b2-8a7d05c1a47d req-c19164f2-034e-4e86-896e-2672ef1ba901 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:19.804373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-69ced3cb-f3dc-4d5c-89b2-8a7d05c1a47d req-c19164f2-034e-4e86-896e-2672ef1ba901 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:19.805013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-69ced3cb-f3dc-4d5c-89b2-8a7d05c1a47d req-c19164f2-034e-4e86-896e-2672ef1ba901 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:19.817487 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-69ced3cb-f3dc-4d5c-89b2-8a7d05c1a47d req-c19164f2-034e-4e86-896e-2672ef1ba901 service nova] Creating event network-vif-plugged:c1e3a597-b838-4940-bb05-14cbc7f27ed2 for instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 on n-h2-855650-5 Nov 02 13:06:19.822943 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-69ced3cb-f3dc-4d5c-89b2-8a7d05c1a47d req-c19164f2-034e-4e86-896e-2672ef1ba901 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039362 Nov 02 13:06:19.823679 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3388/6730] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:20.373081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:20.375048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:20.381637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:20.382268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:20.382788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:20.383568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:20.384103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:20.384609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:20.561258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:20.571951 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04521ab1-5330-45a9-a420-251b26934b74 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1389 microversion: 2.1 time: 0.204178 Nov 02 13:06:20.572902 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3389/6731] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:20 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1389 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:21.312571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-47875532-b4f7-4139-a49c-06c5d1bde2a6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Calling method '.version_select at 0x7f228d930af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:21.342130 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-47875532-b4f7-4139-a49c-06c5d1bde2a6 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1952071615" status: 202 len: 0 microversion: 2.1 time: 0.033209 Nov 02 13:06:21.343080 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3390/6732] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Nov 2 13:06:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1952071615 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:06:21.598797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:21.600350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:21.609451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:21.610415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:21.611089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:21.612749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:21.613536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:21.614261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:21.911687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:21.920015 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78378d33-2518-43b9-aeac-df82a3251443 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1560 microversion: 2.1 time: 0.326800 Nov 02 13:06:21.921206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3391/6733] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:21 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1560 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:21.945165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:21.945689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:21.955509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:21.956749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:21.957397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:21.958321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:21.958956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:21.959564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:22.226033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:22.234605 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1cc520b6-2dce-46e6-93bb-9a2073ac973f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1560 microversion: 2.1 time: 0.293102 Nov 02 13:06:22.247781 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3392/6734] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:21 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1560 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:24.749010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:24.750403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:24.758877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:24.759766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:24.760447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:24.761561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:24.762462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:24.763149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:24.807038 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c056c4bb-1dfd-4fbf-9533-48f85c8b6aff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments/67370c17-e4cf-45ac-ae92-0ffc5a16d4ef" status: 200 len: 194 microversion: 2.20 time: 0.062634 Nov 02 13:06:24.808754 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3393/6735] 10.222.0.45 () {60 vars in 1454 bytes} [Wed Nov 2 13:06:24 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments/67370c17-e4cf-45ac-ae92-0ffc5a16d4ef => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:06:24.933603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:24.934223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:24.949371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:24.951560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:24.954230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:24.955235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:24.957009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:24.957596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:25.095497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lazy-loading 'services' on Instance uuid fad3a63e-391c-42f6-bc91-7d20cfd463bc {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:06:25.224052 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bdad0871-d9fe-44cf-a56a-d96668c9b2cb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments/67370c17-e4cf-45ac-ae92-0ffc5a16d4ef" status: 202 len: 0 microversion: 2.20 time: 0.296819 Nov 02 13:06:25.224950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3394/6736] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Nov 2 13:06:24 2022] DELETE /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments/67370c17-e4cf-45ac-ae92-0ffc5a16d4ef => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:06:25.234746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:25.237204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:25.256179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:25.256586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:25.257593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:25.258364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:25.258839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:25.259280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:25.404381 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bca62e33-7e7f-448b-9651-94b6d7358ce8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.174293 Nov 02 13:06:25.405260 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3395/6737] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 13:06:25 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:06:25.545491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:25.545491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:25.551828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:25.552416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:25.553043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:25.554151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:25.554657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:25.555138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:25.859438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:25.869926 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f144ad3e-6e8c-4574-a454-d4bb387cf003 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1560 microversion: 2.1 time: 0.329643 Nov 02 13:06:25.872139 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3396/6738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:25 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1560 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:26.235230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-32f1accd-4b88-4609-94b0-34ed0e12ce5e req-9f85d42a-3698-4617-aba5-ce0dabea3f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb97ed8-36ab-4116-8ee6-c4166dd11844", "tag": "c1e3a597-b838-4940-bb05-14cbc7f27ed2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:26.292127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32f1accd-4b88-4609-94b0-34ed0e12ce5e req-9f85d42a-3698-4617-aba5-ce0dabea3f4a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:26.295057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32f1accd-4b88-4609-94b0-34ed0e12ce5e req-9f85d42a-3698-4617-aba5-ce0dabea3f4a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:26.300899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32f1accd-4b88-4609-94b0-34ed0e12ce5e req-9f85d42a-3698-4617-aba5-ce0dabea3f4a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:26.345596 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-32f1accd-4b88-4609-94b0-34ed0e12ce5e req-9f85d42a-3698-4617-aba5-ce0dabea3f4a service nova] Creating event network-changed:c1e3a597-b838-4940-bb05-14cbc7f27ed2 for instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 on n-h2-855650-5 Nov 02 13:06:26.360031 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-32f1accd-4b88-4609-94b0-34ed0e12ce5e req-9f85d42a-3698-4617-aba5-ce0dabea3f4a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.467142 Nov 02 13:06:26.362580 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3397/6739] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:26.420738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:26.429277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:26.445436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:26.447972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:26.448715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:26.455788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:26.456650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:26.457675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:26.505357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:26.556030 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f095517f-f6c0-45a1-a336-bf4d334b22fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.140183 Nov 02 13:06:26.564012 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3398/6740] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 13:06:26 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:06:26.583678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:26.584674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:26.594771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:26.596696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:26.597427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:26.598812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:26.599555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:26.600253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:26.679069 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-35326182-0477-4204-b0c9-fc4edee46cb2 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.102040 Nov 02 13:06:26.688176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3399/6741] 10.222.0.45 () {58 vars in 1293 bytes} [Wed Nov 2 13:06:26 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d/os-server-password => generated 116 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:27.573495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:27.579453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:27.587354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:27.588268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:27.588974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:27.589948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:27.590677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:27.591371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:27.693779 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2dede1d0-245c-48db-a007-b2ddd967ab6f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125090 Nov 02 13:06:27.700984 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3400/6742] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 13:06:27 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:06:28.712919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:28.716035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:28.723208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:28.724071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:28.724812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:28.725783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:28.726522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:28.727030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:28.765667 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-72db515e-1848-423a-88a2-6d7aa46150c2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056732 Nov 02 13:06:28.766984 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3401/6743] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 13:06:28 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:06:29.781680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:29.793734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:29.809045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:29.810994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:29.811606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:29.812463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:29.813060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:29.813606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:29.868766 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e51a030b-2cf2-4c2a-8e5a-e4ea81d6640e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093023 Nov 02 13:06:29.870299 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3402/6744] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 13:06:29 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:06:30.900480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:30.903733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:30.913680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:30.914620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:30.915511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:30.916614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:30.917511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:30.918284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:30.961193 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c0893fb-a2be-4b1e-bec8-958f0a59f975 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081287 Nov 02 13:06:30.963174 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3403/6745] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 13:06:30 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:06:31.975007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:31.977414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:31.990748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:31.991256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:31.991735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:31.992558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:31.993068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:31.993515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:32.042944 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c10bff3-3256-46d5-80d6-d40ee1c83f55 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072209 Nov 02 13:06:32.043838 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3404/6746] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 13:06:31 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:32.123245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:32.123860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:32.130652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:32.131027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:32.131508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:32.132281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:32.132988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:32.133651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:32.166496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:06:32.287140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0dbb0a53-3394-4194-babe-97c557154a7d tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 204 len: 0 microversion: 2.20 time: 0.167498 Nov 02 13:06:32.288401 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3405/6747] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 13:06:32 2022] DELETE /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:06:32.297259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:32.298251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:32.305196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:32.305846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:32.306577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:32.308106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:32.308670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:32.309344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:32.465191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:32.474687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:32.476525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:32.478575 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-87064026-511e-4f40-9b37-67537f85a5ae tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.185338 Nov 02 13:06:32.491457 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3406/6748] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:32 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:06:33.507697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:33.508431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:33.516193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:33.517025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:33.517474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:33.518919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:33.519359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:33.519695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:33.669287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:33.678932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:33.680488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:33.681789 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a702d78-7f5e-4c57-84d6-f2073240d77f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.178523 Nov 02 13:06:33.682452 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3407/6749] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:33 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:34.709554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:34.710301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:34.718026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:34.718584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:34.719050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:34.719786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:34.720366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:34.720819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:34.867522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:34.879911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:34.879911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:34.881206 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88b605ac-6f97-4808-bf19-9669ddb392b9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1721 microversion: 2.20 time: 0.176078 Nov 02 13:06:34.882669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3408/6750] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:34 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:35.287565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3065a874-8732-4c2b-ba23-bc426791d012 req-a6ac5db4-6b2d-48d6-9064-cb68ebf778bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad3a63e-391c-42f6-bc91-7d20cfd463bc", "name": "network-vif-deleted", "tag": "c254ced1-e0d3-4599-86fb-a61c7b4c210e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:35.303096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3065a874-8732-4c2b-ba23-bc426791d012 req-a6ac5db4-6b2d-48d6-9064-cb68ebf778bf service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:35.303856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3065a874-8732-4c2b-ba23-bc426791d012 req-a6ac5db4-6b2d-48d6-9064-cb68ebf778bf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:35.304356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3065a874-8732-4c2b-ba23-bc426791d012 req-a6ac5db4-6b2d-48d6-9064-cb68ebf778bf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:35.341387 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3065a874-8732-4c2b-ba23-bc426791d012 req-a6ac5db4-6b2d-48d6-9064-cb68ebf778bf service nova] Creating event network-vif-deleted:c254ced1-e0d3-4599-86fb-a61c7b4c210e for instance fad3a63e-391c-42f6-bc91-7d20cfd463bc on n-h1-855650-5 Nov 02 13:06:35.347013 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3065a874-8732-4c2b-ba23-bc426791d012 req-a6ac5db4-6b2d-48d6-9064-cb68ebf778bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065164 Nov 02 13:06:35.348087 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3409/6751] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:35.912069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:35.912787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:35.920527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:35.921271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:35.921934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:35.922919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:35.923562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:35.924773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:35.959313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:35.959816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:35.960264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:35.960939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lazy-loading 'fault' on Instance uuid fad3a63e-391c-42f6-bc91-7d20cfd463bc {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:06:36.012127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:36.023063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:36.024658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:36.025868 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-264974bf-3723-4909-a09b-19c57cf8404f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 200 len: 1371 microversion: 2.20 time: 0.118371 Nov 02 13:06:36.026473 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3410/6752] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:35 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:37.052898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:37.053920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:37.060825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:37.061336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:37.061795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:37.062542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:37.063090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:37.063534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:37.078011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] HTTP exception thrown: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Request method failure captured: Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc HTTP/1.1 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmo1pGSCte2zyg-oZIJlTS437PNfae8Ag4Aj2kjFuA5HxsVGTXiHAPuM6adzVm6M83V5vsz_BSolecSuhb8xLRgbuS2enWTVSGZbVeRYZzTiR4SS04g8PVNmAxI3ENQ-0djojrLK7WhTSypXKUAy6sb_xSJjIv0S9UaiJdU31a7cz9w Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1308290b670740a5b33f056eb704da34 Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'fad3a63e-391c-42f6-bc91-7d20cfd463bc'} Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:37.079721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Returning 404 to user: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-68ec3dd4-d8a2-4b02-8b5b-18fd5e8da857 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 404 len: 111 microversion: 2.20 time: 0.032947 Nov 02 13:06:37.084694 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3411/6753] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:37 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:06:37.090142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42262da0-b7cb-4698-9750-270325946dda tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '.version_select at 0x7f228da0e790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:37.112588 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42262da0-b7cb-4698-9750-270325946dda tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238230704" status: 204 len: 0 microversion: 2.20 time: 0.026148 Nov 02 13:06:37.113179 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3412/6754] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 13:06:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238230704 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:06:37.795097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df096e1c-a7ad-44e8-ae05-c070ba89e49b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'create', calling method: .version_select at 0x7f228d929280>, body: {"keypair": {"name": "tempest-keypair-1959880710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFEx1wQPc5MUqX3UYYE5lBWpt8qDvFQegm7K1SK5NbpaTFWdelzmThxBHdq6WvRMNaKG40igLup+4yMOd8jGNi0XmdbcwYdvsbvQa2jG55R50S1+SKnsCzZkSUhqzV5cw=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:37.818318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-df096e1c-a7ad-44e8-ae05-c070ba89e49b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Getting quotas for project db87a366a2344c26a6c308bdcb09fcc2. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:06:37.824203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-df096e1c-a7ad-44e8-ae05-c070ba89e49b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Getting quotas for user 1308290b670740a5b33f056eb704da34 and project db87a366a2344c26a6c308bdcb09fcc2. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:06:37.849920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df096e1c-a7ad-44e8-ae05-c070ba89e49b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.059047 Nov 02 13:06:37.850570 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3413/6755] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Nov 2 13:06:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:06:39.290981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-608827350", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de99c087-a45a-4579-82b6-5a57b54c2cab"}], "security_groups": [{"name": "tempest-securitygroup--122882378"}], "key_name": "tempest-keypair-1959880710", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:39.300914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:39.406363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] validate_networks() for [('de99c087-a45a-4579-82b6-5a57b54c2cab', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:06:39.822164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:06:39.822605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:06:39.823146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:06:39.823580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:06:39.824008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:06:39.839965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:39.840475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:39.840940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:39.841701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:39.848340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:39.848340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:39.862568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Getting quotas for project db87a366a2344c26a6c308bdcb09fcc2. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:06:39.868031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Getting quotas for user 1308290b670740a5b33f056eb704da34 and project db87a366a2344c26a6c308bdcb09fcc2. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:06:39.884565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:06:39.887043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:06:39.934731 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65f7c346-48bd-464d-b71a-856804336593 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.649169 Nov 02 13:06:39.935614 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3414/6756] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Nov 2 13:06:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 13:06:39.948178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb8e96a5-9aa8-4bb3-860d-ae5175b84ddd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:39.949007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb8e96a5-9aa8-4bb3-860d-ae5175b84ddd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:40.023766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb8e96a5-9aa8-4bb3-860d-ae5175b84ddd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:40.035385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb8e96a5-9aa8-4bb3-860d-ae5175b84ddd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:40.037750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb8e96a5-9aa8-4bb3-860d-ae5175b84ddd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:40.039049 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb8e96a5-9aa8-4bb3-860d-ae5175b84ddd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1281 microversion: 2.20 time: 0.095924 Nov 02 13:06:40.042165 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3415/6757] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:39 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:06:41.228918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:41.229546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:41.237998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:41.238518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:41.238983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:41.239709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:41.240175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:41.240623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:41.334990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:41.347006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:41.348958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:41.350688 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59a3c81b-a756-4f81-b710-841a2912a919 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1341 microversion: 2.20 time: 0.288780 Nov 02 13:06:41.351858 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3416/6758] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:41 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1341 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:06:42.379297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:42.380167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:42.391733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:42.393640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:42.394218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:42.399203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:42.399833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:42.400501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:42.558049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:42.567717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:42.569181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:42.570365 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-348447b5-06a6-46d4-94aa-29cf9d06cae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1406 microversion: 2.20 time: 0.197067 Nov 02 13:06:42.571119 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3417/6759] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:42 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:42.931676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-22260131-0a50-4c4b-8b0a-5ed0c2177ec4 req-14e99619-b12d-4001-9fbc-6f5351b1d662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6ca91f-535e-42e1-9343-cc0f9f516725", "tag": "ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:42.943339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-22260131-0a50-4c4b-8b0a-5ed0c2177ec4 req-14e99619-b12d-4001-9fbc-6f5351b1d662 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:42.943907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-22260131-0a50-4c4b-8b0a-5ed0c2177ec4 req-14e99619-b12d-4001-9fbc-6f5351b1d662 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:42.944361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-22260131-0a50-4c4b-8b0a-5ed0c2177ec4 req-14e99619-b12d-4001-9fbc-6f5351b1d662 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:42.958066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-22260131-0a50-4c4b-8b0a-5ed0c2177ec4 req-14e99619-b12d-4001-9fbc-6f5351b1d662 service nova] Creating event network-changed:ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5 for instance eb6ca91f-535e-42e1-9343-cc0f9f516725 on n-h1-855650-5 Nov 02 13:06:42.963176 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-22260131-0a50-4c4b-8b0a-5ed0c2177ec4 req-14e99619-b12d-4001-9fbc-6f5351b1d662 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035929 Nov 02 13:06:42.964247 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3418/6760] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:43.598240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:43.599649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:43.606739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:43.607251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:43.607713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:43.608442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:43.608948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:43.609397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:43.614610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:43.762764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:43.775891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:43.777670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:43.778873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e865a235-87fe-4820-b895-06958fccd408 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1406 microversion: 2.20 time: 0.185939 Nov 02 13:06:43.779454 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3419/6761] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:43 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:44.806160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:44.806814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:44.814680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:44.815420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:44.816137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:44.817776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:44.818307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:44.818794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:44.966542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:44.975115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:44.976596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:44.977742 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15ac4537-8d26-462d-bcbd-4e49279dca3f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1406 microversion: 2.20 time: 0.175933 Nov 02 13:06:44.990033 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3420/6762] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:44 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:46.005230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:46.006262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:46.013733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:46.014371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:46.014928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:46.015716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:46.016257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:46.016767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:46.168840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:46.180989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:46.182578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:46.183812 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aa255629-a8e9-4b12-b968-50dbed0412eb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1406 microversion: 2.20 time: 0.183683 Nov 02 13:06:46.184591 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3421/6763] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:45 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:47.210509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:47.211311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:47.219426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:47.220053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:47.220635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:47.221482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:47.222143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:47.222583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:47.395291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:47.404597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:47.406159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:47.407410 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea4c4ec0-5074-4392-8050-32dd22f74ea2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1406 microversion: 2.20 time: 0.202220 Nov 02 13:06:47.408549 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3422/6764] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:47 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:48.393071 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:06:48.393601 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:06:48.433429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:48.434484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:48.443695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:48.444265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:48.444774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:48.445525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:48.446130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:48.446607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:48.598466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:48.608001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:48.609473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:48.610964 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3bc303a-a200-45b9-9338-5bfcdc78f1fe tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1406 microversion: 2.20 time: 0.181403 Nov 02 13:06:48.612147 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3423/6765] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:48 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:06:48.958204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3c8e40d4-ac0b-4d24-92c9-ce8b6fab79aa req-a7b2c773-ee9f-4baf-819d-5c640bf3c452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ca91f-535e-42e1-9343-cc0f9f516725", "name": "network-vif-plugged", "status": "completed", "tag": "ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:48.972921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3c8e40d4-ac0b-4d24-92c9-ce8b6fab79aa req-a7b2c773-ee9f-4baf-819d-5c640bf3c452 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:48.973427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3c8e40d4-ac0b-4d24-92c9-ce8b6fab79aa req-a7b2c773-ee9f-4baf-819d-5c640bf3c452 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:48.973878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3c8e40d4-ac0b-4d24-92c9-ce8b6fab79aa req-a7b2c773-ee9f-4baf-819d-5c640bf3c452 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:48.988956 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3c8e40d4-ac0b-4d24-92c9-ce8b6fab79aa req-a7b2c773-ee9f-4baf-819d-5c640bf3c452 service nova] Creating event network-vif-plugged:ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5 for instance eb6ca91f-535e-42e1-9343-cc0f9f516725 on n-h1-855650-5 Nov 02 13:06:48.995062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3c8e40d4-ac0b-4d24-92c9-ce8b6fab79aa req-a7b2c773-ee9f-4baf-819d-5c640bf3c452 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042185 Nov 02 13:06:48.995707 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3424/6766] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:49.639354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:49.640042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:49.646879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:49.647390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:49.647868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:49.648565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:49.649032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:49.649475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:49.803902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:49.815695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:49.817231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:49.818489 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e517a04-2ea4-4431-bc0a-65f5845d1ce5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1406 microversion: 2.20 time: 0.184711 Nov 02 13:06:49.819066 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3425/6767] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:49 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:49.889226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:49.889738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:49.891769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:49.898567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:49.899085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:49.899544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:49.900268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:49.901121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:49.901408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:49.992693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lazy-loading 'services' on Instance uuid a9f355c8-e203-43fe-aaa1-12919e3635e8 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:06:50.032433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:50.069236 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f507e417-3fdb-4fb6-bec3-d3dbf87157e8 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8/os-volume_attachments/770fb983-9fb3-479b-9a1f-896e26007e6f" status: 202 len: 0 microversion: 2.1 time: 0.183799 Nov 02 13:06:50.069896 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3426/6768] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:06:49 2022] DELETE /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8/os-volume_attachments/770fb983-9fb3-479b-9a1f-896e26007e6f => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:06:50.848771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:50.849655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:50.859124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:50.859900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:50.860362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:50.861727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:50.862229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:50.862672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:51.004671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:51.016125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:51.017881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:51.019161 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f870af03-b9e0-4d9f-a639-d3c3244554ff tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1597 microversion: 2.20 time: 0.177013 Nov 02 13:06:51.020006 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3427/6769] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:06:50 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1597 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:06:51.045049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:51.045566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:51.051869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:51.052411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:51.052874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:51.053855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:51.054357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:51.054951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:51.137330 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f5a5a4f-00d0-4680-a36b-aef94d81674f tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096174 Nov 02 13:06:51.137937 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3428/6770] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Nov 2 13:06:51 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:06:52.161958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-dcb788a1-9dbd-47ab-9e05-0c755290528a req-4567620c-b173-42c9-b1c4-5acb5cb53e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6ca91f-535e-42e1-9343-cc0f9f516725", "tag": "ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:52.172051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dcb788a1-9dbd-47ab-9e05-0c755290528a req-4567620c-b173-42c9-b1c4-5acb5cb53e5d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:52.172415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dcb788a1-9dbd-47ab-9e05-0c755290528a req-4567620c-b173-42c9-b1c4-5acb5cb53e5d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:52.172873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-dcb788a1-9dbd-47ab-9e05-0c755290528a req-4567620c-b173-42c9-b1c4-5acb5cb53e5d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:52.185393 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-dcb788a1-9dbd-47ab-9e05-0c755290528a req-4567620c-b173-42c9-b1c4-5acb5cb53e5d service nova] Creating event network-changed:ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5 for instance eb6ca91f-535e-42e1-9343-cc0f9f516725 on n-h1-855650-5 Nov 02 13:06:52.191861 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-dcb788a1-9dbd-47ab-9e05-0c755290528a req-4567620c-b173-42c9-b1c4-5acb5cb53e5d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034205 Nov 02 13:06:52.192542 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3429/6771] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:55.479875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:55.480531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:55.488226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:55.488733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:55.489192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:55.489902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:55.490409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:55.490858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:55.518714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:06:55.607176 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04ad8836-bc5c-40d1-8a4e-00a6319edbae tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 204 len: 0 microversion: 2.1 time: 0.131424 Nov 02 13:06:55.608058 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3430/6772] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:06:55 2022] DELETE /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:06:55.616807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:55.617541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:55.628321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:55.628825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:55.629314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:55.630101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:55.630598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:55.631076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:55.770237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:55.778232 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82b67fdd-5926-4c39-b14b-1d8e8f271f87 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1469 microversion: 2.1 time: 0.165808 Nov 02 13:06:55.778813 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3431/6773] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:55 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:56.801442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:56.802147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:56.809268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:56.809759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:56.810235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:56.810932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:56.811392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:56.811823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:56.946182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:56.954747 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2600f4ca-4c25-4ad8-a7b7-d0c934e2a8e4 tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1469 microversion: 2.1 time: 0.157145 Nov 02 13:06:56.956280 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3432/6774] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:56 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:57.981370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:57.982071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:57.989076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:57.989580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:57.990057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:57.990777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:57.991244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:57.991678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:58.139134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394b01964bc242cbbe4c76db2b69cb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c47c9c07134762840660f22b97a6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:58.147809 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c0d32d6-e6e6-40db-a1c5-e9fe2cf2ef8f tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 200 len: 1469 microversion: 2.1 time: 0.170588 Nov 02 13:06:58.148683 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3433/6775] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:57 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:58.499760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8dbddd9c-2976-4d20-ad93-5c43c8224d92 req-4b5afdd1-eccf-4ee8-aff5-1fe757be681f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f355c8-e203-43fe-aaa1-12919e3635e8", "name": "network-vif-deleted", "tag": "1da5270a-d371-413c-99e5-9262ac3b66bc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:58.510416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8dbddd9c-2976-4d20-ad93-5c43c8224d92 req-4b5afdd1-eccf-4ee8-aff5-1fe757be681f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:58.510907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8dbddd9c-2976-4d20-ad93-5c43c8224d92 req-4b5afdd1-eccf-4ee8-aff5-1fe757be681f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:58.511350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8dbddd9c-2976-4d20-ad93-5c43c8224d92 req-4b5afdd1-eccf-4ee8-aff5-1fe757be681f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:58.526582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8dbddd9c-2976-4d20-ad93-5c43c8224d92 req-4b5afdd1-eccf-4ee8-aff5-1fe757be681f service nova] Creating event network-vif-deleted:1da5270a-d371-413c-99e5-9262ac3b66bc for instance a9f355c8-e203-43fe-aaa1-12919e3635e8 on n-h1-855650-5 Nov 02 13:06:58.531626 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8dbddd9c-2976-4d20-ad93-5c43c8224d92 req-4b5afdd1-eccf-4ee8-aff5-1fe757be681f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036109 Nov 02 13:06:58.532246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3434/6776] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:59.172797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:59.174074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] [instance: a9f355c8-e203-43fe-aaa1-12919e3635e8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:06:59.180664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:59.181181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:59.181638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:59.182448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:59.182860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:59.183304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:59.197761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] HTTP exception thrown: Instance a9f355c8-e203-43fe-aaa1-12919e3635e8 could not be found. Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Request method failure captured: Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 HTTP/1.1 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmsOEh6iJX1YnjeS_DsbKhx-OnfeVwPJ3TUeVK8xI9bEbeYr8usDLoP4Ej0BBVW4Qv2ag8sCLJOKagp7xNUhg4hl5k-0zTLOjcdD1bgRFxzjZZnlUQPkbhCfvZc6BJEqtoUW-MnSvoRADxI93IowQr27ecuL0voPcdhLKOxEbcF7ajY Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 39c47c9c07134762840660f22b97a6d7 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesBackupsTest-66359201 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39c47c9c07134762840660f22b97a6d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/39c47c9c07134762840660f22b97a6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39c47c9c07134762840660f22b97a6d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_39c47c9c07134762840660f22b97a6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesBackupsTest-66359201 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 39c47c9c07134762840660f22b97a6d7 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesBackupsTest-66359201 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesBackupsTest-66359201-project Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 394b01964bc242cbbe4c76db2b69cb21 Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesBackupsTest-66359201-project Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a9f355c8-e203-43fe-aaa1-12919e3635e8 could not be found. Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a9f355c8-e203-43fe-aaa1-12919e3635e8'} Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f355c8-e203-43fe-aaa1-12919e3635e8 could not be found. Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f355c8-e203-43fe-aaa1-12919e3635e8 could not be found. Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:59.199646 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f355c8-e203-43fe-aaa1-12919e3635e8 could not be found. Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] Returning 404 to user: Instance a9f355c8-e203-43fe-aaa1-12919e3635e8 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83ca4037-ff1a-4eb5-bc86-c6d744deb89c tempest-VolumesBackupsTest-66359201 tempest-VolumesBackupsTest-66359201-project] 10.222.0.45 "GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8" status: 404 len: 111 microversion: 2.1 time: 0.033648 Nov 02 13:06:59.208006 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3435/6777] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:59 2022] GET /compute/v2.1/servers/a9f355c8-e203-43fe-aaa1-12919e3635e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:07:06.654776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:06.657569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:06.665849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:06.666613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:06.667458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:06.668239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:06.668724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:06.669454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:06.695478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:06.769068 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40f475d7-baa9-4d8a-a1dc-e38038244d7d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844/action" status: 200 len: 24568 microversion: 2.1 time: 0.342034 Nov 02 13:07:06.770185 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3436/6778] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:07:06 2022] POST /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844/action => generated 24568 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:07:10.757101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-775005029", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "02189d14-d74a-4ce8-85a9-79f81adfc007"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1966420312", "security_groups": []}, "os:scheduler_hints": {"different_host": ["1544ba18-1e6f-43a2-9279-965243f1966a"]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:10.783525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:10.839489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] validate_networks() for [('02189d14-d74a-4ce8-85a9-79f81adfc007', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:07:11.660826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:07:11.662823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:07:11.663490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:07:11.664095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:07:11.664627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:07:11.683289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:11.684121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:11.684923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:11.686106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:11.686875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:11.687435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:11.710047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Getting quotas for project 37416e0f4c60441cb3a00971d9e4af32. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:07:11.716893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Getting quotas for user 7ead8ff4246240f5b7485681faf38e93 and project 37416e0f4c60441cb3a00971d9e4af32. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:07:11.739124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:07:11.743948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:07:11.798886 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db4adff5-7b1c-4911-b4f9-6d2c0b52658a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.046809 Nov 02 13:07:11.803657 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3437/6779] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:07:10 2022] POST /compute/v2.1/servers => generated 361 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:07:11.821929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-602ff949-387d-429f-92e4-d4dc75284c8b tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:11.823701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-602ff949-387d-429f-92e4-d4dc75284c8b tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:11.914246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-602ff949-387d-429f-92e4-d4dc75284c8b tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:11.925189 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-602ff949-387d-429f-92e4-d4dc75284c8b tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1241 microversion: 2.1 time: 0.113193 Nov 02 13:07:11.929365 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3438/6780] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:11 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:12.955121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:12.956370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:12.970591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:12.971711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:12.974354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:12.975510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:12.979684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:12.980431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:13.086506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:13.096106 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aab77909-e615-420f-af0a-e4a49f7b5562 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1293 microversion: 2.1 time: 0.144803 Nov 02 13:07:13.096825 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3439/6781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:12 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:14.130269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:14.132452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:14.154766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:14.159973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:14.161014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:14.164928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:14.168646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:14.169386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:14.286185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:14.296525 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bf5e01bd-da6f-4af6-a5a8-767555153613 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1299 microversion: 2.1 time: 0.178968 Nov 02 13:07:14.297131 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3440/6782] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:14 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:15.114558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0ece05c5-4c3e-414d-b0c0-b649251f805d req-c6f1ad46-62b1-4591-93af-973017c94c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46cd9fb5-75d4-4f02-9ccd-0244d69a5e28", "tag": "179da559-1aed-4d8d-8cca-94d2845ea13d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:15.126801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0ece05c5-4c3e-414d-b0c0-b649251f805d req-c6f1ad46-62b1-4591-93af-973017c94c52 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:15.128339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0ece05c5-4c3e-414d-b0c0-b649251f805d req-c6f1ad46-62b1-4591-93af-973017c94c52 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:15.129392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0ece05c5-4c3e-414d-b0c0-b649251f805d req-c6f1ad46-62b1-4591-93af-973017c94c52 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:15.143745 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0ece05c5-4c3e-414d-b0c0-b649251f805d req-c6f1ad46-62b1-4591-93af-973017c94c52 service nova] Creating event network-changed:179da559-1aed-4d8d-8cca-94d2845ea13d for instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 on n-h1-855650-5 Nov 02 13:07:15.150347 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0ece05c5-4c3e-414d-b0c0-b649251f805d req-c6f1ad46-62b1-4591-93af-973017c94c52 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050083 Nov 02 13:07:15.151542 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3441/6783] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:07:15.324486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:15.325780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:15.336570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:15.337458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:15.338180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:15.339187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:15.339885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:15.340560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:15.436561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:15.448191 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d72f861-975b-4d76-bf3a-a5329d3f6363 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1299 microversion: 2.1 time: 0.129053 Nov 02 13:07:15.463334 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3442/6784] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:15 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:16.475087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:16.475780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:16.482908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:16.483418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:16.483880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:16.484600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:16.485067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:16.485510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:16.571047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:16.579109 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85efb173-1152-4579-8696-286165b6af38 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1299 microversion: 2.1 time: 0.108707 Nov 02 13:07:16.579693 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3443/6785] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:16 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:17.603271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:17.603900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:17.611077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:17.612462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:17.612601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:17.613325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:17.613823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:17.614301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:17.698370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:17.707151 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-408e0fed-1e40-4040-897e-e00847025194 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1299 microversion: 2.1 time: 0.107720 Nov 02 13:07:17.707599 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3444/6786] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:17 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:18.730828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:18.731515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:18.739074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:18.739593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:18.740043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:18.740764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:18.741238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:18.741684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:18.832067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:18.840112 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8eaa7229-c0a5-4c8f-a326-74e879c0097c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1299 microversion: 2.1 time: 0.113327 Nov 02 13:07:18.840679 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3445/6787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:18 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:19.865233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:19.866432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:19.874989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:19.875597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:19.876062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:19.876801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:19.877814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:19.878305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:19.971454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:19.980324 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a5aeb4d2-422a-4542-928b-80a6ad8af0a3 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1299 microversion: 2.1 time: 0.120322 Nov 02 13:07:19.981132 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3446/6788] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:19 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:21.005377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:21.007129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:21.014933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:21.015535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:21.016071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:21.016889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:21.018270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:21.018882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:21.119382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:21.129785 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d494cf15-27d2-4be3-a5f8-b627d39b581c tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1299 microversion: 2.1 time: 0.128262 Nov 02 13:07:21.146947 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3447/6789] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:20 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:21.238773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ae428c7c-c576-423e-9129-984b916a18c2 req-6adf681f-a512-40ed-b48a-881ad9054fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cd9fb5-75d4-4f02-9ccd-0244d69a5e28", "name": "network-vif-plugged", "status": "completed", "tag": "179da559-1aed-4d8d-8cca-94d2845ea13d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:21.248567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ae428c7c-c576-423e-9129-984b916a18c2 req-6adf681f-a512-40ed-b48a-881ad9054fc7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:21.249069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ae428c7c-c576-423e-9129-984b916a18c2 req-6adf681f-a512-40ed-b48a-881ad9054fc7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:21.249521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ae428c7c-c576-423e-9129-984b916a18c2 req-6adf681f-a512-40ed-b48a-881ad9054fc7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:21.262562 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ae428c7c-c576-423e-9129-984b916a18c2 req-6adf681f-a512-40ed-b48a-881ad9054fc7 service nova] Creating event network-vif-plugged:179da559-1aed-4d8d-8cca-94d2845ea13d for instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 on n-h1-855650-5 Nov 02 13:07:21.268190 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ae428c7c-c576-423e-9129-984b916a18c2 req-6adf681f-a512-40ed-b48a-881ad9054fc7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136076 Nov 02 13:07:21.269347 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3448/6790] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:22.152505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:22.153361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:22.159581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:22.160337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:22.168442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:22.168969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:22.169430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:22.170216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:22.170681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:22.171125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:22.262722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:22.271132 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5066a2f7-cd2f-49ca-8953-6258afd2f4d9 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1299 microversion: 2.1 time: 0.119563 Nov 02 13:07:22.271834 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3449/6791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:22 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:23.296705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:23.297411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:23.305834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.306359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.306804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.307553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.308020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.308582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.414774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:23.423067 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18ed4782-4cf7-4820-8c0d-39f57ed5ce7e tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1471 microversion: 2.1 time: 0.130323 Nov 02 13:07:23.423661 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3450/6792] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:23 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1471 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:23.446756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:23.447382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:23.454383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.454383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.454820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.455593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.456066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.456503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.544107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:23.552792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24be1299-3178-4050-bc97-79bdb82b1d14 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1471 microversion: 2.1 time: 0.109828 Nov 02 13:07:23.553587 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3451/6793] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:23 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:23.575158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:23.575782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:23.582118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.582633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.583087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.583798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.584266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.584706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.669287 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-49faea91-1505-49ed-a2cd-557bab828401 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1622 microversion: 2.1 time: 0.097754 Nov 02 13:07:23.669992 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3452/6794] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:23 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1622 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:23.692140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:23.692883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:23.699367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.699951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.700412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.701125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.701595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.702268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.856826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-047d3e60-ce8f-48d7-a324-f08f6b0ae0f4 tempest-TestSecurityGroupsBasicOps-2066247491 tempest-TestSecurityGroupsBasicOps-2066247491-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1912 microversion: 2.1 time: 0.168327 Nov 02 13:07:23.857590 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3453/6795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:23 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1912 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:23.924732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:23.925250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:23.931945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.932588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.933052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.933797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:23.934297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:23.934733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:23.961395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:07:24.013889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:24.044439 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5cd6c187-f863-4eeb-a0df-5d967e2d335f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "DELETE /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 204 len: 0 microversion: 2.1 time: 0.123473 Nov 02 13:07:24.045160 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3454/6796] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:07:23 2022] DELETE /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:07:24.054622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:24.055763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:24.061617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:24.062207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:24.062614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:24.063322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:24.063782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:24.064294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:24.153701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:24.161797 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-51ce8aad-2514-4384-a244-294697885fd8 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1477 microversion: 2.1 time: 0.111764 Nov 02 13:07:24.162639 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3455/6797] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:24 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1477 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:25.186717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:25.187535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:25.197130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:25.197569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:25.198086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:25.198921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:25.199417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:25.199941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:25.292603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:25.301494 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-762c33e2-ffa8-4cc8-9d11-65c0931f4beb tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1477 microversion: 2.1 time: 0.119467 Nov 02 13:07:25.302193 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3456/6798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:25 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1477 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:26.107132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c98e6846-c214-42da-b2b2-6557980d7c5f req-d547a64c-af5d-45c4-b998-03c5555c6573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cd9fb5-75d4-4f02-9ccd-0244d69a5e28", "name": "network-vif-deleted", "tag": "179da559-1aed-4d8d-8cca-94d2845ea13d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:26.118334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c98e6846-c214-42da-b2b2-6557980d7c5f req-d547a64c-af5d-45c4-b998-03c5555c6573 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:26.118776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c98e6846-c214-42da-b2b2-6557980d7c5f req-d547a64c-af5d-45c4-b998-03c5555c6573 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:26.119221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c98e6846-c214-42da-b2b2-6557980d7c5f req-d547a64c-af5d-45c4-b998-03c5555c6573 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:26.145446 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c98e6846-c214-42da-b2b2-6557980d7c5f req-d547a64c-af5d-45c4-b998-03c5555c6573 service nova] Creating event network-vif-deleted:179da559-1aed-4d8d-8cca-94d2845ea13d for instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 on n-h1-855650-5 Nov 02 13:07:26.151874 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c98e6846-c214-42da-b2b2-6557980d7c5f req-d547a64c-af5d-45c4-b998-03c5555c6573 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048670 Nov 02 13:07:26.152870 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3457/6799] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:07:26.325277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:26.326052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:26.333924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:26.334826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:26.335753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:26.336649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:26.337470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:26.338091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:26.373764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:26.374309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:26.374974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:26.375455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lazy-loading 'fault' on Instance uuid 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:07:26.429692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:26.438348 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae035d64-bfb4-4d8f-b007-5194bcfbb129 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 200 len: 1331 microversion: 2.1 time: 0.117228 Nov 02 13:07:26.438983 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3458/6800] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:26 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:27.463203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:27.463888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:27.470840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:27.471349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:27.471804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:27.472516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:27.472986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:27.473424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:27.487654 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] HTTP exception thrown: Instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 could not be found. Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Request method failure captured: Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 HTTP/1.1 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmsBycx5B8aPTh8cZ9ljEwibyVWHtAo45p_6k0_y-24g2HxNkuW5tVH-Pu5zmvon5b6qWxWyCyriz7ltk2ed-Doy7EVEkVW9eA5Wmnc1GNzAykGyCeweH-vvXkcx4D4xVPNihPXuyMBkIV-DcRnhe8npSWx7rbVgILLxml6Khj5OhIk Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 37416e0f4c60441cb3a00971d9e4af32 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1675136888 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/37416e0f4c60441cb3a00971d9e4af32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/37416e0f4c60441cb3a00971d9e4af32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/37416e0f4c60441cb3a00971d9e4af32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_37416e0f4c60441cb3a00971d9e4af32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1675136888 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 37416e0f4c60441cb3a00971d9e4af32 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1675136888 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestSecurityGroupsBasicOps-1675136888-project Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7ead8ff4246240f5b7485681faf38e93 Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1675136888-project Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 could not be found. Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '46cd9fb5-75d4-4f02-9ccd-0244d69a5e28'} Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 could not be found. Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 could not be found. Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:27.489757 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 could not be found. Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Returning 404 to user: Instance 46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3278d9ee-5336-4ff4-a08e-4fc159794833 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28" status: 404 len: 111 microversion: 2.1 time: 0.031887 Nov 02 13:07:27.494400 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3459/6801] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:27 2022] GET /compute/v2.1/servers/46cd9fb5-75d4-4f02-9ccd-0244d69a5e28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:07:32.167769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:32.168618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:32.176995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:32.177506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:32.178004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:32.179035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:32.179518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:32.179961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:32.213884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:07:32.311346 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-309ba65e-1f00-4668-9959-30932cd056ca tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 204 len: 0 microversion: 2.1 time: 0.147722 Nov 02 13:07:32.317619 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3460/6802] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:07:32 2022] DELETE /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:07:32.318391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7a33b98b-a999-4bf0-b2e2-ee7bfbb6c9f3 req-3a59c9c0-5f94-4cda-a17a-646921205dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1544ba18-1e6f-43a2-9279-965243f1966a", "tag": "00bb386b-72bc-4513-adfa-ddff8e1b9a10"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:32.336704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7a33b98b-a999-4bf0-b2e2-ee7bfbb6c9f3 req-3a59c9c0-5f94-4cda-a17a-646921205dad service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:32.340448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7a33b98b-a999-4bf0-b2e2-ee7bfbb6c9f3 req-3a59c9c0-5f94-4cda-a17a-646921205dad service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:32.342871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7a33b98b-a999-4bf0-b2e2-ee7bfbb6c9f3 req-3a59c9c0-5f94-4cda-a17a-646921205dad service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:32.361010 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7a33b98b-a999-4bf0-b2e2-ee7bfbb6c9f3 req-3a59c9c0-5f94-4cda-a17a-646921205dad service nova] Creating event network-changed:00bb386b-72bc-4513-adfa-ddff8e1b9a10 for instance 1544ba18-1e6f-43a2-9279-965243f1966a on n-h2-855650-5 Nov 02 13:07:32.366147 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7a33b98b-a999-4bf0-b2e2-ee7bfbb6c9f3 req-3a59c9c0-5f94-4cda-a17a-646921205dad service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052295 Nov 02 13:07:32.366799 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3461/6803] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:32.372473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:32.373207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:32.380602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:32.381453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:32.381841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:32.382683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:32.383166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:32.383621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:32.555152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:32.565316 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fc56ac84-82d6-4b99-93d0-c7fba65f1e15 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1767 microversion: 2.1 time: 0.196951 Nov 02 13:07:32.570024 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3462/6804] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:32 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1767 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:33.595514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:33.596719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:33.608398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:33.609755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:33.610932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:33.612285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:33.613179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:33.613767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:33.771617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:33.780363 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7cde42da-c608-4de8-bc76-0f8bfbfdabe4 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1767 microversion: 2.1 time: 0.193424 Nov 02 13:07:33.786292 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3463/6805] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:33 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1767 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:34.806837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:34.807837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:34.833194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:34.835699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:34.835699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:34.835699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:34.835699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:34.836155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:34.931816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead8ff4246240f5b7485681faf38e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416e0f4c60441cb3a00971d9e4af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:34.941437 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cf81ce4-c261-4ede-a509-612995b5674a tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 200 len: 1530 microversion: 2.1 time: 0.140470 Nov 02 13:07:34.942061 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3464/6806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:34 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 1530 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:34.953399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a0be2c00-74cb-4793-aa22-f8f5d23c2b94 req-5c64fa24-dcfe-491d-ad0a-8192d7f6dc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1544ba18-1e6f-43a2-9279-965243f1966a", "name": "network-vif-deleted", "tag": "00bb386b-72bc-4513-adfa-ddff8e1b9a10"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:34.964710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0be2c00-74cb-4793-aa22-f8f5d23c2b94 req-5c64fa24-dcfe-491d-ad0a-8192d7f6dc15 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:34.965584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0be2c00-74cb-4793-aa22-f8f5d23c2b94 req-5c64fa24-dcfe-491d-ad0a-8192d7f6dc15 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:34.966077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a0be2c00-74cb-4793-aa22-f8f5d23c2b94 req-5c64fa24-dcfe-491d-ad0a-8192d7f6dc15 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:34.978269 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a0be2c00-74cb-4793-aa22-f8f5d23c2b94 req-5c64fa24-dcfe-491d-ad0a-8192d7f6dc15 service nova] Creating event network-vif-deleted:00bb386b-72bc-4513-adfa-ddff8e1b9a10 for instance 1544ba18-1e6f-43a2-9279-965243f1966a on n-h2-855650-5 Nov 02 13:07:34.983141 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a0be2c00-74cb-4793-aa22-f8f5d23c2b94 req-5c64fa24-dcfe-491d-ad0a-8192d7f6dc15 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034233 Nov 02 13:07:34.983746 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3465/6807] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:35.968517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:35.969317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] [instance: 1544ba18-1e6f-43a2-9279-965243f1966a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:35.976617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:35.977059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:35.977461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:35.978227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:35.978705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:35.979144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:35.993650 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] HTTP exception thrown: Instance 1544ba18-1e6f-43a2-9279-965243f1966a could not be found. Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Request method failure captured: Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a HTTP/1.1 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmsBycx5B8aPTh8cZ9ljEwibyVWHtAo45p_6k0_y-24g2HxNkuW5tVH-Pu5zmvon5b6qWxWyCyriz7ltk2ed-Doy7EVEkVW9eA5Wmnc1GNzAykGyCeweH-vvXkcx4D4xVPNihPXuyMBkIV-DcRnhe8npSWx7rbVgILLxml6Khj5OhIk Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 37416e0f4c60441cb3a00971d9e4af32 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1675136888 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/37416e0f4c60441cb3a00971d9e4af32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/37416e0f4c60441cb3a00971d9e4af32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/37416e0f4c60441cb3a00971d9e4af32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_37416e0f4c60441cb3a00971d9e4af32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1675136888 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 37416e0f4c60441cb3a00971d9e4af32 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1675136888 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestSecurityGroupsBasicOps-1675136888-project Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 7ead8ff4246240f5b7485681faf38e93 Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1675136888-project Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 1544ba18-1e6f-43a2-9279-965243f1966a could not be found. Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1544ba18-1e6f-43a2-9279-965243f1966a'} Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1544ba18-1e6f-43a2-9279-965243f1966a could not be found. Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1544ba18-1e6f-43a2-9279-965243f1966a could not be found. Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:35.995405 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1544ba18-1e6f-43a2-9279-965243f1966a could not be found. Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Returning 404 to user: Instance 1544ba18-1e6f-43a2-9279-965243f1966a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a556daf-0348-493e-9c27-2ee1b759fe57 tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a" status: 404 len: 111 microversion: 2.1 time: 0.033750 Nov 02 13:07:36.000293 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3466/6808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:35 2022] GET /compute/v2.1/servers/1544ba18-1e6f-43a2-9279-965243f1966a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:07:40.225760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30e3a223-dd97-42e8-be69-8471a2b7ae8f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] Calling method '.version_select at 0x7f228c326a60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:40.252238 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30e3a223-dd97-42e8-be69-8471a2b7ae8f tempest-TestSecurityGroupsBasicOps-1675136888 tempest-TestSecurityGroupsBasicOps-1675136888-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1966420312" status: 202 len: 0 microversion: 2.1 time: 0.035454 Nov 02 13:07:40.252837 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3467/6809] 10.222.0.45 () {58 vars in 1278 bytes} [Wed Nov 2 13:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1966420312 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:07:55.102082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:55.102905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:55.107524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:55.108238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:55.118183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:55.118666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:55.119134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:55.119883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:55.120423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:55.120896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:55.283686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:55.293324 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-718c2dc7-73d3-4602-b126-ddbd9ba5c7c3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1679 microversion: 2.1 time: 0.194249 Nov 02 13:07:55.294068 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3468/6810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:55 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:55.414435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:55.416762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:55.423638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:55.424142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:55.424714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:55.425440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:55.425909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:55.426401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:55.510203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acd2b654-5bd9-4718-91b4-8647a10663ea tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844/action" status: 200 len: 32645 microversion: 2.1 time: 0.099468 Nov 02 13:07:55.512444 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3469/6811] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:07:55 2022] POST /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844/action => generated 32645 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:07:55.670890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:55.671142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:55.678251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:55.679005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:55.679453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:55.680153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:55.680619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:55.681054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:55.820182 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-63c40622-8c61-4f23-9c1f-68683cb8d719 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1830 microversion: 2.1 time: 0.154066 Nov 02 13:07:55.820761 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3470/6812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:55 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1830 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:55.852154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:55.854741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:55.861115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:55.861685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:55.862355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:55.863288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:55.863831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:55.864312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:55.904270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lazy-loading 'flavor' on Instance uuid 1bb97ed8-36ab-4116-8ee6-c4166dd11844 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:07:55.917257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Going to try to live migrate instance to another host {{(pid=120722) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:07:57.758871 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9724a9e6-3d1f-41ba-a8f1-0a9bc781e61c tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844/action" status: 202 len: 0 microversion: 2.1 time: 1.911777 Nov 02 13:07:57.759584 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3471/6813] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:07:55 2022] POST /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844/action => generated 0 bytes in 1913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:07:57.769313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:57.769949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:57.778107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:57.778617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:57.779133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:57.779804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:57.781342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:57.781807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:57.941158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:57.949567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-93008baa-e6a9-4e96-9810-9eb9ff642873 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.184093 Nov 02 13:07:57.950460 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3472/6814] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:57 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:58.961395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9bd1583f-b7f2-4a1a-b6c4-2df40b5c03eb req-b3aba3e1-5d76-414b-b09c-99ef6e4acdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb97ed8-36ab-4116-8ee6-c4166dd11844", "name": "network-vif-unplugged", "status": "completed", "tag": "c1e3a597-b838-4940-bb05-14cbc7f27ed2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:58.974617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9bd1583f-b7f2-4a1a-b6c4-2df40b5c03eb req-b3aba3e1-5d76-414b-b09c-99ef6e4acdde service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:58.975252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9bd1583f-b7f2-4a1a-b6c4-2df40b5c03eb req-b3aba3e1-5d76-414b-b09c-99ef6e4acdde service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:58.975773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9bd1583f-b7f2-4a1a-b6c4-2df40b5c03eb req-b3aba3e1-5d76-414b-b09c-99ef6e4acdde service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:58.988071 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9bd1583f-b7f2-4a1a-b6c4-2df40b5c03eb req-b3aba3e1-5d76-414b-b09c-99ef6e4acdde service nova] Creating event network-vif-unplugged:c1e3a597-b838-4940-bb05-14cbc7f27ed2 for instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 on n-h2-855650-5 Nov 02 13:07:58.994465 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9bd1583f-b7f2-4a1a-b6c4-2df40b5c03eb req-b3aba3e1-5d76-414b-b09c-99ef6e4acdde service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036398 Nov 02 13:07:58.995471 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3473/6815] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:07:59.002964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:59.003694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:07:59.010499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:59.010945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:59.011500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:59.012417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:07:59.012890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:07:59.013396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:07:59.181103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:59.190421 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17c61776-33d3-44f7-9c6d-20e6379e5b0b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.193768 Nov 02 13:07:59.191075 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3474/6816] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:58 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:00.215834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:00.216605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:00.224386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:00.225002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:00.225691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:00.226519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:00.227105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:00.227756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:00.371109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:00.379626 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56c9a194-c743-41a8-a2cd-fb3c8e1536d4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.167751 Nov 02 13:08:00.380206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3475/6817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:00 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:01.010863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e8e34cfb-c209-47cd-8c54-6475cc7ee6d1 req-8f59e378-3c6c-47c0-a618-9dbc2b99cceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb97ed8-36ab-4116-8ee6-c4166dd11844", "tag": "c1e3a597-b838-4940-bb05-14cbc7f27ed2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:01.021628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8e34cfb-c209-47cd-8c54-6475cc7ee6d1 req-8f59e378-3c6c-47c0-a618-9dbc2b99cceb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:01.022180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8e34cfb-c209-47cd-8c54-6475cc7ee6d1 req-8f59e378-3c6c-47c0-a618-9dbc2b99cceb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:01.022628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8e34cfb-c209-47cd-8c54-6475cc7ee6d1 req-8f59e378-3c6c-47c0-a618-9dbc2b99cceb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:01.033760 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e8e34cfb-c209-47cd-8c54-6475cc7ee6d1 req-8f59e378-3c6c-47c0-a618-9dbc2b99cceb service nova] Creating event network-changed:c1e3a597-b838-4940-bb05-14cbc7f27ed2 for instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 on n-h2-855650-5 Nov 02 13:08:01.038642 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e8e34cfb-c209-47cd-8c54-6475cc7ee6d1 req-8f59e378-3c6c-47c0-a618-9dbc2b99cceb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031612 Nov 02 13:08:01.039297 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3476/6818] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:08:01.411064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:01.412472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:01.423253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:01.424901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:01.425616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:01.426664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:01.427235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:01.427922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:01.587730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:01.596752 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3020dbb7-ea8e-4c01-8d62-9dbd75903224 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.195752 Nov 02 13:08:01.597697 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3477/6819] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:01 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:02.621740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:02.622545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:02.630312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:02.630820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:02.631279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:02.632005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:02.632473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:02.632988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:02.785064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:02.793194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae9e8b2e-5541-4187-a026-c8b686a5a795 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.175640 Nov 02 13:08:02.793885 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3478/6820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:02 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:03.817692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:03.818462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:03.826142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:03.826661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:03.827130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:03.827873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:03.828359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:03.828858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:03.983978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:03.992715 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88131724-9a1c-4584-8e01-e7e790ba0d89 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.179694 Nov 02 13:08:03.993304 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3479/6821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:03 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:04.451697 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:08:04.452356 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:08:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:08:04.455519 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:08:04.455648 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:08:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:08:05.017669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:05.018379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:05.025616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:05.026162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:05.026623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:05.027341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:05.027813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:05.028255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:05.174272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:05.182469 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-067204e3-8ec9-4bae-9a91-de2f933605bb tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.169316 Nov 02 13:08:05.183047 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3480/6822] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:05 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:06.208783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:06.209527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:06.217944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:06.218470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:06.218923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:06.220254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:06.221097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:06.221591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:06.387275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:06.403471 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c343fc3b-5429-4759-ad9f-8ef1886c2b63 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.198631 Nov 02 13:08:06.404920 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3481/6823] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:06 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:07.242449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:07.243424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:07.249946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:07.250741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:07.251231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:07.251944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:07.252411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:07.252847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:07.277942 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-10fcbdfd-8ce7-4db6-882a-815e0a8fe286 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/ips" status: 200 len: 151 microversion: 2.20 time: 0.039522 Nov 02 13:08:07.278554 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3482/6824] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Nov 2 13:08:07 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:08:07.429924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:07.430790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:07.438854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:07.439380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:07.439851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:07.441034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:07.441849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:07.442338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:07.630159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:07.639983 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8d9a57f1-036a-452a-94a2-e5c5904c78df tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.216802 Nov 02 13:08:07.654516 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3483/6825] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:07 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:08.665060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:08.666059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:08.674510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:08.675181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:08.675787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:08.676642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:08.677233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:08.677890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:08.838824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:08.842810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:08.848035 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ccc489e1-65b4-49f6-be42-829f64206fad tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.186998 Nov 02 13:08:08.848634 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3484/6826] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:08 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:09.165212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:09.165897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:09.176694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:09.177338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:09.178847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:09.179673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:09.180222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:09.181546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:09.219919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lazy-loading 'flavor' on Instance uuid eb6ca91f-535e-42e1-9343-cc0f9f516725 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:08:09.509653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d948598c-b9f2-4937-8b70-5a27387bca2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/action" status: 202 len: 0 microversion: 2.20 time: 0.350371 Nov 02 13:08:09.511828 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3485/6827] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 13:08:09 2022] POST /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:08:09.526135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:09.527152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:09.535105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:09.535736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:09.536307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:09.538422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:09.539036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:09.539646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:09.710157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:09.721426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:09.723329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:09.724611 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3df02b8d-4a3a-43ba-8285-14e4259bddcb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.207267 Nov 02 13:08:09.725713 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3486/6828] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:09 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:09.874451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:09.875489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:09.883817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:09.884378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:09.884983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:09.885787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:09.886405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:09.886913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:10.077613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:10.087132 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94b02ca7-d85f-4b3b-b055-aaf361629469 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1689 microversion: 2.1 time: 0.217860 Nov 02 13:08:10.087961 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3487/6829] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:09 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:10.758675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:10.760098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:10.772842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:10.774817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:10.775631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:10.776908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:10.777748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:10.778570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:10.958635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:10.968454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:10.970418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:10.971801 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c234ce9c-a4f7-4aaf-a169-83912718fe5a tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.223228 Nov 02 13:08:10.972737 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3488/6830] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:10 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:11.118758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:11.120170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:11.138633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:11.141052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:11.141589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:11.142546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:11.142910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:11.143557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:11.301359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:11.310086 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd0a4d2d-2649-480c-8e3f-889f0ed24a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1679 microversion: 2.1 time: 0.200179 Nov 02 13:08:11.310685 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3489/6831] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:11 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:11.333840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:11.334524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:11.341627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:11.342190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:11.343079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:11.344557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:11.344919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:11.345377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:11.504397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-013f4d2e-c404-4193-a62f-27b6c0ccc887 tempest-TestNetworkAdvancedServerOps-1100987250 tempest-TestNetworkAdvancedServerOps-1100987250-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1830 microversion: 2.1 time: 0.174314 Nov 02 13:08:11.504973 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3490/6832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:11 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1830 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:11.528842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:11.529512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:11.537175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:11.537698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:11.538221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:11.539674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:11.540152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:11.540907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:11.768662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:11.785443 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e90892d5-cb55-4b5f-9f8d-a66deadc149b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1679 microversion: 2.1 time: 0.260267 Nov 02 13:08:11.786369 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3491/6833] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:11 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1679 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:11.910234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:11.916257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:11.925848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:11.926679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:11.927377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:11.928761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:11.929405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:11.930109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:12.037184 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-787cc961-4aac-4ec8-ad90-dcb06c32545f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844/action" status: 200 len: 38358 microversion: 2.1 time: 0.130341 Nov 02 13:08:12.049736 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3492/6834] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:08:11 2022] POST /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844/action => generated 38358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:08:12.059471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:12.060604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:12.069763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:12.070663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:12.071877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:12.073578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:12.073749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:12.074445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:12.372661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:12.387111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:12.388790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:12.389914 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6c545e2-6334-46ba-bdc0-61e6a778f750 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.337533 Nov 02 13:08:12.402375 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3493/6835] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:12 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:13.417922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:13.422508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:13.428082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:13.428877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:13.429392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:13.430285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:13.430896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:13.431433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:13.609065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:13.620420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:13.623806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:13.626322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-58d28f6a-cc44-439a-bcb6-fad711fb7187 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.212250 Nov 02 13:08:13.627094 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3494/6836] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:13 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:13.632552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:13.633561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:13.640750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:13.642197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:13.642922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:13.644045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:13.644963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:13.645699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:13.673843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:08:13.771065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8598e7b3-5abe-4542-99b9-3a84f22a5504 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 204 len: 0 microversion: 2.1 time: 0.142374 Nov 02 13:08:13.775373 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3495/6837] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:08:13 2022] DELETE /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:08:13.781132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-cc612a10-c678-4649-a340-41c268d374e4 req-4469b843-b410-4336-a438-b9d3ece4d076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb97ed8-36ab-4116-8ee6-c4166dd11844", "tag": "c1e3a597-b838-4940-bb05-14cbc7f27ed2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:13.791433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc612a10-c678-4649-a340-41c268d374e4 req-4469b843-b410-4336-a438-b9d3ece4d076 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:13.792308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc612a10-c678-4649-a340-41c268d374e4 req-4469b843-b410-4336-a438-b9d3ece4d076 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:13.792975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc612a10-c678-4649-a340-41c268d374e4 req-4469b843-b410-4336-a438-b9d3ece4d076 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:13.806843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-cc612a10-c678-4649-a340-41c268d374e4 req-4469b843-b410-4336-a438-b9d3ece4d076 service nova] Creating event network-changed:c1e3a597-b838-4940-bb05-14cbc7f27ed2 for instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 on n-h1-855650-5 Nov 02 13:08:13.813095 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-cc612a10-c678-4649-a340-41c268d374e4 req-4469b843-b410-4336-a438-b9d3ece4d076 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035385 Nov 02 13:08:13.814115 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3496/6838] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:13.820807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:13.821795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:13.829533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:13.830174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:13.830863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:13.831807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:13.832348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:13.833132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:13.990708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:14.000028 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a36dd16-c779-44ee-926b-7f3a02fee836 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1685 microversion: 2.1 time: 0.184198 Nov 02 13:08:14.001300 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3497/6839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:13 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:14.654083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:14.655460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:14.663280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:14.664017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:14.664499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:14.665413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:14.665896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:14.666373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:14.874893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:14.880721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:14.889682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:14.892873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:14.894701 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb6ee58f-34fd-466b-984c-2b0ba367603b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.244534 Nov 02 13:08:14.895488 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3498/6840] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:14 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:15.026131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:15.026930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:15.034446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:15.035508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:15.035755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:15.036587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:15.037119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:15.037570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:15.218882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:15.227939 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9fe5fd99-54de-444f-ab3a-2a769201f86e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 200 len: 1685 microversion: 2.1 time: 0.206754 Nov 02 13:08:15.238678 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3499/6841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:15 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 1685 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:15.828787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0fee274f-dd68-49b0-8599-4f015cdb46d2 req-5d630af3-01da-450a-bccc-cf15ed1efa35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb97ed8-36ab-4116-8ee6-c4166dd11844", "name": "network-vif-deleted", "tag": "c1e3a597-b838-4940-bb05-14cbc7f27ed2"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:15.839184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0fee274f-dd68-49b0-8599-4f015cdb46d2 req-5d630af3-01da-450a-bccc-cf15ed1efa35 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:15.839743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0fee274f-dd68-49b0-8599-4f015cdb46d2 req-5d630af3-01da-450a-bccc-cf15ed1efa35 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:15.840192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0fee274f-dd68-49b0-8599-4f015cdb46d2 req-5d630af3-01da-450a-bccc-cf15ed1efa35 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:15.855222 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0fee274f-dd68-49b0-8599-4f015cdb46d2 req-5d630af3-01da-450a-bccc-cf15ed1efa35 service nova] Creating event network-vif-deleted:c1e3a597-b838-4940-bb05-14cbc7f27ed2 for instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 on n-h1-855650-5 Nov 02 13:08:15.860656 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0fee274f-dd68-49b0-8599-4f015cdb46d2 req-5d630af3-01da-450a-bccc-cf15ed1efa35 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035185 Nov 02 13:08:15.861260 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3500/6842] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:08:15.923262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:15.924279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:15.931434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:15.931940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:15.932394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:15.933110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:15.933575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:15.934059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:16.089196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:16.098539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:16.100124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:16.101722 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b7cda48-2fc8-424a-8259-b41e15566a43 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.183344 Nov 02 13:08:16.103586 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3501/6843] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:15 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:16.252347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:16.253100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 1bb97ed8-36ab-4116-8ee6-c4166dd11844] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:16.259309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:16.259814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:16.260266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:16.260981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:16.261444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:16.262066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:16.277012 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] HTTP exception thrown: Instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 could not be found. Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Request method failure captured: Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 HTTP/1.1 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmka0UtFqJo2p1FuykiDL2PwMcgraY9pqGeA62hyS-KcQKxCFIPsV1EHPqy8Xx9mC5sS8GeLrRB-WIrkKZRktqGfjXQkW8-F7y5h0nkAthBHoj_HauQLaycYcEgKRwbq1hWX-gqpL_uyQPOXVYNpwgGlz5_2rN-Uxx8W2JjBjVs3a2A Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 8b8298d308cf40d6adfae4b378b13281 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 8b8298d308cf40d6adfae4b378b13281 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestNetworkAdvancedServerOps-1410606748-project Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 04b040caac0349ffbe7e23b18769bad1 Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1410606748-project Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 could not be found. Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1bb97ed8-36ab-4116-8ee6-c4166dd11844'} Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 could not be found. Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 could not be found. Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:08:16.278620 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 could not be found. Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Returning 404 to user: Instance 1bb97ed8-36ab-4116-8ee6-c4166dd11844 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f6ef1d4-2cc3-4327-978f-97a69cc15b87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844" status: 404 len: 111 microversion: 2.1 time: 0.032001 Nov 02 13:08:16.287624 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3502/6844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:16 2022] GET /compute/v2.1/servers/1bb97ed8-36ab-4116-8ee6-c4166dd11844 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:08:17.135060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:17.135767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:17.145887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:17.146983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:17.147911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:17.149347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:17.150489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:17.151291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:17.502594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:17.513472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:17.521659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:17.522901 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac33c78a-44b8-4b7e-ae76-87746d3bca38 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.393093 Nov 02 13:08:17.523469 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3503/6845] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:17 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:18.556728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:18.557359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:18.577386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:18.578266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:18.578915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:18.579834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:18.580308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:18.581211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:18.961096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:18.986130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:18.987780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:18.989133 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d75ab0d-aef8-4105-a2fe-4a4cbe8b8c2e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.442320 Nov 02 13:08:19.008405 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3504/6846] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:18 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:20.024260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:20.024969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:20.034575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:20.035094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:20.035558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:20.036393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:20.036875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:20.037324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:20.254828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:20.264363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:20.265915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:20.267465 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d8299c5-79d5-4fcf-bb6d-63cbf316226e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.250278 Nov 02 13:08:20.274028 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3505/6847] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:20 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:20.370344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25a2575a-ba48-4569-bdbd-37fbfc21186d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '.version_select at 0x7f228c3ba820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:20.395359 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25a2575a-ba48-4569-bdbd-37fbfc21186d tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-8276572" status: 202 len: 0 microversion: 2.1 time: 0.029081 Nov 02 13:08:20.397231 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3506/6848] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 13:08:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-8276572 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:08:20.429300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91bada6f-b9cb-471b-95c6-7c3dc4311ec0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'create', calling method: .version_select at 0x7f228c31a9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1130539494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBudeUObdle4ihi6zrC10MjyU+sp265kEPHzoG4CxDQ+0Z/FP86C0TfVkhgSGSZ4vg+1gtF1e6H7JzI0ptaW4HoHHv0TFAYVEeyOftu1CmVNhVOwKpqXtof1rUU6Jw32Q=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:20.446971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-91bada6f-b9cb-471b-95c6-7c3dc4311ec0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for project 8b8298d308cf40d6adfae4b378b13281. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:08:20.453000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-91bada6f-b9cb-471b-95c6-7c3dc4311ec0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for user 04b040caac0349ffbe7e23b18769bad1 and project 8b8298d308cf40d6adfae4b378b13281. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:08:20.472173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:20.481044 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91bada6f-b9cb-471b-95c6-7c3dc4311ec0 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055907 Nov 02 13:08:20.481855 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3507/6849] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:08:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:08:21.302897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:21.303808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:21.313464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:21.314013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:21.315360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:21.316649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:21.317360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:21.318087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:21.527100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:21.536111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:21.537719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:21.539829 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0e6e5ce-c2a5-48a6-b19d-7a20adbe7082 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1743 microversion: 2.20 time: 0.247671 Nov 02 13:08:21.540602 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3508/6850] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:21 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:22.569205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:22.570613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:22.582215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:22.582793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:22.583311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:22.584189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:22.584735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:22.585254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:22.731079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:22.740833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:22.742525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:22.744129 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-100534bd-5b14-440c-8d3c-445a3d533af5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1743 microversion: 2.20 time: 0.180682 Nov 02 13:08:22.755581 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3509/6851] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:22 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:23.366707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-b528997e-8f43-4bcb-8161-ca1f95588672 req-22f1b867-c894-428f-bb8f-7eb99e2346e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ca91f-535e-42e1-9343-cc0f9f516725", "name": "network-vif-plugged", "status": "completed", "tag": "ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:23.379305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b528997e-8f43-4bcb-8161-ca1f95588672 req-22f1b867-c894-428f-bb8f-7eb99e2346e8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:23.379768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b528997e-8f43-4bcb-8161-ca1f95588672 req-22f1b867-c894-428f-bb8f-7eb99e2346e8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:23.380231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b528997e-8f43-4bcb-8161-ca1f95588672 req-22f1b867-c894-428f-bb8f-7eb99e2346e8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:23.393355 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-b528997e-8f43-4bcb-8161-ca1f95588672 req-22f1b867-c894-428f-bb8f-7eb99e2346e8 service nova] Creating event network-vif-plugged:ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5 for instance eb6ca91f-535e-42e1-9343-cc0f9f516725 on n-h1-855650-5 Nov 02 13:08:23.401283 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-b528997e-8f43-4bcb-8161-ca1f95588672 req-22f1b867-c894-428f-bb8f-7eb99e2346e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040959 Nov 02 13:08:23.409238 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3510/6852] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:08:23.773068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:23.775391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:23.784964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:23.786173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:23.787133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:23.788124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:23.789803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:23.790547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:23.967638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:23.979734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:23.981949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:23.983541 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-10017448-d3ce-43ac-8b1e-4817fc8e48df tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1743 microversion: 2.20 time: 0.215564 Nov 02 13:08:23.984633 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3511/6853] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:23 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1743 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:25.013114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:25.014580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:25.024978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:25.026776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:25.027972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:25.028909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:25.029562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:25.030064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:25.238610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:25.251296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:25.254414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:25.260211 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34f66d64-09c9-493a-be92-e0d4f32c6594 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1743 microversion: 2.20 time: 0.249876 Nov 02 13:08:25.263252 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3512/6854] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:25 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:26.293657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:26.295875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:26.309865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:26.311765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:26.312932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:26.313812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:26.314448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:26.315161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:26.586478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:26.608621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:26.610752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:26.612050 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8d135b1f-5899-4e3e-964e-6f87397fee03 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.326718 Nov 02 13:08:26.612660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3513/6855] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:26 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:27.665107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:27.666165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:27.686505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:27.687572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:27.688088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:27.695977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:27.696485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:27.696948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:28.031825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:28.050405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:28.055622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:28.093142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c70657c-3fce-434c-bd26-33afc605dedc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.398737 Nov 02 13:08:28.105355 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3514/6856] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:27 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:29.026944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1511554701", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "57af8fe1-7854-4dae-b5e7-456fb99b040b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1130539494", "security_groups": [{"name": "tempest-secgroup-smoke-1440888481"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:29.241324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] validate_networks() for [('57af8fe1-7854-4dae-b5e7-456fb99b040b', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:08:29.991356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:08:29.992269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:08:29.992974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:08:29.993589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:08:29.994228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:08:30.020117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:30.020643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:30.021114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:30.021889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:30.022736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:30.023023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:30.055932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for project 8b8298d308cf40d6adfae4b378b13281. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:08:30.062740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Getting quotas for user 04b040caac0349ffbe7e23b18769bad1 and project 8b8298d308cf40d6adfae4b378b13281. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:08:30.083536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:08:30.086571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:08:30.146397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1308ec76-4ecc-4cf3-ab09-e343efbb257a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.123042 Nov 02 13:08:30.156053 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3515/6857] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:08:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:08:30.163726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:30.164678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:30.173593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:30.174511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:30.175162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:30.176533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:30.177232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:30.177859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:30.420952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:30.433880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:30.435679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:30.438113 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ad18606-29d7-47ed-9e7a-1e32db6142be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.280547 Nov 02 13:08:30.454591 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3516/6858] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:30 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:30.481213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da3e3a7a-0cc1-4b2d-afab-9689ceeebb4c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:30.482173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da3e3a7a-0cc1-4b2d-afab-9689ceeebb4c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:30.594739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da3e3a7a-0cc1-4b2d-afab-9689ceeebb4c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:30.604612 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da3e3a7a-0cc1-4b2d-afab-9689ceeebb4c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1267 microversion: 2.1 time: 0.148626 Nov 02 13:08:30.607168 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3517/6859] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:30 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:31.477313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:31.478671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:31.512468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:31.514835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:31.516590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:31.522425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:31.523447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:31.524239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:31.856181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:31.867088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:31.868714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:31.870323 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a43b9707-5436-44c5-b854-2afe67a7d8cd tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.404294 Nov 02 13:08:31.871809 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3518/6860] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:31 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:31.893338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:31.894392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:31.913654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:31.914416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:31.915124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:31.916062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:31.916722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:31.917342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:31.992812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:32.001511 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-694137df-acab-474e-90e2-ff7e61aeb52f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1319 microversion: 2.1 time: 0.127748 Nov 02 13:08:32.002133 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3519/6861] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:31 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1319 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:32.902115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:32.902914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:32.924129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:32.926205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:32.927113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:32.930453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:32.931181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:32.931853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:33.241762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:33.255123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:33.257338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:33.263159 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-753bc35d-9929-4e3d-8bba-77a832a84992 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.365682 Nov 02 13:08:33.264350 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3520/6862] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:32 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:33.269611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:33.270644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:33.283151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:33.284096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:33.284808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:33.286700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:33.287472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:33.288141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:33.322287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:33.424784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:33.454544 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db94b434-1387-41f6-a434-5b31d59e1b8c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1325 microversion: 2.1 time: 0.188796 Nov 02 13:08:33.459211 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3521/6863] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:33 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:34.294427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:34.295844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:34.313334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:34.313935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:34.314437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:34.327884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:34.328514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:34.330791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:34.613452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:34.627087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:34.630511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:34.632706 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-75613428-f8cf-416e-9773-9390ca9a1a6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.344158 Nov 02 13:08:34.634438 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3522/6864] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:34 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:34.643942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:34.645075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:34.654138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:34.654999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:34.656462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:34.657219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:34.657915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:34.658192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:34.871545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:34.884272 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-23db5ce1-9c07-4853-9c6c-1c34dd874b10 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1393 microversion: 2.1 time: 0.248443 Nov 02 13:08:34.885465 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3523/6865] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:34 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1393 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:35.183966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-60a7ad67-dce4-493e-9ddb-556b3a697862 req-2244c737-5963-4399-8750-629f4735fa7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6413fbc1-87c5-453b-bf1c-4668bdcdec91", "tag": "8445918c-a059-40f4-9a58-7fb446a7b66a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:35.207480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-60a7ad67-dce4-493e-9ddb-556b3a697862 req-2244c737-5963-4399-8750-629f4735fa7d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:35.208464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-60a7ad67-dce4-493e-9ddb-556b3a697862 req-2244c737-5963-4399-8750-629f4735fa7d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:35.209889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-60a7ad67-dce4-493e-9ddb-556b3a697862 req-2244c737-5963-4399-8750-629f4735fa7d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:35.269719 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-60a7ad67-dce4-493e-9ddb-556b3a697862 req-2244c737-5963-4399-8750-629f4735fa7d service nova] Creating event network-changed:8445918c-a059-40f4-9a58-7fb446a7b66a for instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 on n-h2-855650-5 Nov 02 13:08:35.280077 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-60a7ad67-dce4-493e-9ddb-556b3a697862 req-2244c737-5963-4399-8750-629f4735fa7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099827 Nov 02 13:08:35.287859 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3524/6866] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:08:35.664744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:35.667271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:35.676461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:35.677586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:35.678840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:35.679787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:35.680472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:35.681125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:35.877512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:35.894026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:35.895832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:35.897321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77c7209c-7c56-4d8b-a072-8880c0eb1ed4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.237804 Nov 02 13:08:35.915087 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3525/6867] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:35 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:35.946128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:35.947066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:35.990829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:35.991749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:35.992655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:35.994190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:35.995823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:35.996590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:36.180412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:36.193468 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19e5aa68-9a4d-4e15-aac9-90de1ce085be tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1393 microversion: 2.1 time: 0.275886 Nov 02 13:08:36.194852 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3526/6868] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:35 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1393 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:37.036357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:37.042382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:37.051852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:37.054524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:37.055014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:37.055832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:37.056359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:37.056826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:37.263329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:37.275039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:37.277018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:37.278464 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3bdceb90-700d-4092-b3c7-d2667afb71be tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.246628 Nov 02 13:08:37.279163 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3527/6869] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:37 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:37.284683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:37.285666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:37.292556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:37.293874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:37.294632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:37.295783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:37.296527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:37.297205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:37.485378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:37.497282 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24bace3a-ac1e-4db4-95bb-8a7691f9271f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1393 microversion: 2.1 time: 0.216703 Nov 02 13:08:37.509751 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3528/6870] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:37 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1393 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:38.309524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:38.310574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:38.324387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:38.325899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:38.326923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:38.328727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:38.329584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:38.330380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:38.572487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:38.584929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:38.586581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:38.587784 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4437fef6-434b-49da-8049-dbd9dd503db2 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.286217 Nov 02 13:08:38.602031 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3529/6871] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:38 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:38.602031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:38.602031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:38.602031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:38.602031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:38.602692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:38.604143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:38.604143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:38.605226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:38.779362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:38.788053 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9178d20-88a9-4f49-8c26-0d65a81deef3 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1393 microversion: 2.1 time: 0.198063 Nov 02 13:08:38.789012 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3530/6872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:38 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1393 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:39.620461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:39.622162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:39.628485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:39.629302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:39.630096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:39.630995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:39.631689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:39.632428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:39.847287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:39.860313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:39.862686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:39.864596 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9071121d-27d9-4860-9e58-20457cf761cc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.249473 Nov 02 13:08:39.865904 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3531/6873] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:39 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:39.871850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:39.872892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:39.883624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:39.884507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:39.885597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:39.886654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:39.887384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:39.888049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:40.044476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:40.097665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:40.112394 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f7d5ce8d-94af-416e-8b5f-dbe66b8d4387 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1393 microversion: 2.1 time: 0.244761 Nov 02 13:08:40.113658 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3532/6874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:39 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1393 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:40.897388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:40.898977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:40.901363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:40.910607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:40.911498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:40.912198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:40.913182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:40.913920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:40.914635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:41.085845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:41.096093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:41.097781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:41.100843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d157181-758d-4c75-aaba-e123f1affa37 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.207770 Nov 02 13:08:41.113027 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3533/6875] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:40 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:41.141574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:41.142548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:41.149084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:41.149610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:41.150086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:41.150814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:41.151288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:41.151729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:41.327646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:41.347345 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8199c409-505c-4f40-9c7e-1f316681f7de tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1393 microversion: 2.1 time: 0.209987 Nov 02 13:08:41.348761 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3534/6876] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:41 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1393 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:42.129119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:42.129813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:42.137641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:42.138200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:42.138669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:42.139407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:42.140465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:42.141177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:42.315187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:42.332138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:42.335560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:42.338412 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d53f838-159f-49de-b8a0-f6e5947f448e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1738 microversion: 2.20 time: 0.213008 Nov 02 13:08:42.339986 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3535/6877] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:42 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:42.372375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:42.373044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:42.379400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:42.379916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:42.380382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:42.381112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:42.381595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:42.382226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:42.533677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:42.542982 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6725518b-ad7d-4556-a40e-a042105b886b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1393 microversion: 2.1 time: 0.174428 Nov 02 13:08:42.550823 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3536/6878] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:42 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:42.581536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ec5eb128-a799-470f-8ea5-762dcad0e447 req-d63d1360-d9cc-4d6a-aeec-42e3e91654dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6413fbc1-87c5-453b-bf1c-4668bdcdec91", "name": "network-vif-plugged", "status": "completed", "tag": "8445918c-a059-40f4-9a58-7fb446a7b66a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:42.594430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ec5eb128-a799-470f-8ea5-762dcad0e447 req-d63d1360-d9cc-4d6a-aeec-42e3e91654dd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:42.595128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ec5eb128-a799-470f-8ea5-762dcad0e447 req-d63d1360-d9cc-4d6a-aeec-42e3e91654dd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:42.595691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ec5eb128-a799-470f-8ea5-762dcad0e447 req-d63d1360-d9cc-4d6a-aeec-42e3e91654dd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:42.612407 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ec5eb128-a799-470f-8ea5-762dcad0e447 req-d63d1360-d9cc-4d6a-aeec-42e3e91654dd service nova] Creating event network-vif-plugged:8445918c-a059-40f4-9a58-7fb446a7b66a for instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 on n-h2-855650-5 Nov 02 13:08:42.618970 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ec5eb128-a799-470f-8ea5-762dcad0e447 req-d63d1360-d9cc-4d6a-aeec-42e3e91654dd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041578 Nov 02 13:08:42.619622 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3537/6879] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:43.367014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:43.368652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:43.376221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:43.377011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:43.377671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:43.378521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:43.379060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:43.379510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:43.538005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:43.547388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:43.548867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:43.550093 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22ce9deb-dd6a-466d-aded-d4938693fbdc tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1720 microversion: 2.20 time: 0.188397 Nov 02 13:08:43.550673 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3538/6880] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:43 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:43.568119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:43.568691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:43.575558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:43.576073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:43.576538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:43.577308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:43.577784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:43.578297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:43.582919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:43.729358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:43.737807 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a0010a4-3e03-4c5c-99ce-13dec53c5b37 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1393 microversion: 2.1 time: 0.174487 Nov 02 13:08:43.750002 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3539/6881] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:43 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:44.578325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:44.579014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:44.586500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:44.586978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:44.587433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:44.588172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:44.588642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:44.589076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:44.731929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:44.741100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:44.742819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:44.744069 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91548f3d-a7e6-4320-8b64-ac99bca9c033 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1720 microversion: 2.20 time: 0.170502 Nov 02 13:08:44.744729 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3540/6882] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:44 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:44.763287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:44.763920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:44.770953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:44.771340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:44.771800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:44.772520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:44.772997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:44.773443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:44.918334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:44.929238 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cda7912a-0499-4a12-adc6-ab3fb94334bf tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1566 microversion: 2.1 time: 0.169739 Nov 02 13:08:44.930206 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3541/6883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:44 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:44.953218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:44.953898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:44.960656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:44.961531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:44.962200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:44.962941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:44.963412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:44.963857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:45.129785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:45.144366 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7b0dda9-5877-4c76-9890-f69eb77b0423 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1566 microversion: 2.1 time: 0.195870 Nov 02 13:08:45.144997 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3542/6884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:44 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:45.397956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-b79d449b-169d-4f96-84c3-fe42d2ff706d req-c08a1b20-c491-44cf-9327-1d0580ed64a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ca91f-535e-42e1-9343-cc0f9f516725", "name": "network-vif-unplugged", "status": "completed", "tag": "ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:45.409846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b79d449b-169d-4f96-84c3-fe42d2ff706d req-c08a1b20-c491-44cf-9327-1d0580ed64a7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:45.410537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b79d449b-169d-4f96-84c3-fe42d2ff706d req-c08a1b20-c491-44cf-9327-1d0580ed64a7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:45.411152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b79d449b-169d-4f96-84c3-fe42d2ff706d req-c08a1b20-c491-44cf-9327-1d0580ed64a7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:45.426269 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-b79d449b-169d-4f96-84c3-fe42d2ff706d req-c08a1b20-c491-44cf-9327-1d0580ed64a7 service nova] Creating event network-vif-unplugged:ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5 for instance eb6ca91f-535e-42e1-9343-cc0f9f516725 on n-h1-855650-5 Nov 02 13:08:45.430731 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-b79d449b-169d-4f96-84c3-fe42d2ff706d req-c08a1b20-c491-44cf-9327-1d0580ed64a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037027 Nov 02 13:08:45.431746 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3543/6885] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:08:45.772433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:45.773157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:45.781229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:45.782933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:45.783710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:45.785018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:45.785753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:45.786535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:45.946351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:45.956359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:45.957861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:45.959748 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5ab3c308-42c0-408e-bb6a-a70c6a1fccd8 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1663 microversion: 2.20 time: 0.192633 Nov 02 13:08:45.960636 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3544/6886] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:45 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1663 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:45.986164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59cd7a60-31b6-4eed-8948-8ef519feee93"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:45.989247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:45.995291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:45.995813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:45.996276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:45.997036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:45.997517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:45.997987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.370258 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cbb12cb6-d369-4338-95ad-6033673bb9a6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.387817 Nov 02 13:08:46.371143 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3545/6887] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Nov 2 13:08:45 2022] POST /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/os-volume_attachments => generated 188 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:08:46.519992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:46.520661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:46.527557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.528080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.528551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.529923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.529923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.531019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.833142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb6f5893-264a-4d5d-8bd6-5b5844f051d5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/os-volume_attachments/59cd7a60-31b6-4eed-8948-8ef519feee93" status: 202 len: 0 microversion: 2.20 time: 0.317804 Nov 02 13:08:46.833892 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3546/6888] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Nov 2 13:08:46 2022] DELETE /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/os-volume_attachments/59cd7a60-31b6-4eed-8948-8ef519feee93 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:08:46.935409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:46.936733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:46.947224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.948117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.948915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.950217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.950982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.951875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.992979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:46.996214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 13:08:47.088553 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3725160-5630-4a9a-99ce-7cc6dadcbd36 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "POST /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/action" status: 202 len: 0 microversion: 2.20 time: 0.171256 Nov 02 13:08:47.089494 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3547/6889] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Nov 2 13:08:46 2022] POST /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:08:47.102959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:47.103922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:47.114244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:47.114946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:47.115514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:47.116391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:47.117538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:47.118393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:47.387278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:47.398104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:47.400162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:47.401747 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d383aec-e1ff-4194-a916-5ef9c853a808 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1671 microversion: 2.20 time: 0.303186 Nov 02 13:08:47.407096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3548/6890] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:47 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1671 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:47.600062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:47.601993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:47.615362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:47.615880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:47.617789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:47.619885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:47.621830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:47.622694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:47.777708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:47.786761 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b4e02b0-eff1-4d31-8344-1339e570f17c tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1566 microversion: 2.1 time: 0.193804 Nov 02 13:08:47.787366 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3549/6891] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:47 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:47.792113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-240a5a58-7bc9-47ce-8c6c-55080b5e8301 req-4b377bab-a450-4ab7-bc59-b35af803356a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6413fbc1-87c5-453b-bf1c-4668bdcdec91", "tag": "8445918c-a059-40f4-9a58-7fb446a7b66a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:47.803159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-240a5a58-7bc9-47ce-8c6c-55080b5e8301 req-4b377bab-a450-4ab7-bc59-b35af803356a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:47.803922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-240a5a58-7bc9-47ce-8c6c-55080b5e8301 req-4b377bab-a450-4ab7-bc59-b35af803356a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:47.804374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-240a5a58-7bc9-47ce-8c6c-55080b5e8301 req-4b377bab-a450-4ab7-bc59-b35af803356a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:47.818199 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-240a5a58-7bc9-47ce-8c6c-55080b5e8301 req-4b377bab-a450-4ab7-bc59-b35af803356a service nova] Creating event network-changed:8445918c-a059-40f4-9a58-7fb446a7b66a for instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 on n-h2-855650-5 Nov 02 13:08:47.834161 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-240a5a58-7bc9-47ce-8c6c-55080b5e8301 req-4b377bab-a450-4ab7-bc59-b35af803356a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045495 Nov 02 13:08:47.836199 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3550/6892] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:48.437580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:48.438343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:48.451448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:48.453431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:48.454921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:48.457393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:48.460036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:48.461231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:48.488369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:48.643552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:48.653836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:48.656020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:48.657350 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fed5d1cd-5db9-40e6-9720-478be6b1bc23 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.225014 Nov 02 13:08:48.658533 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3551/6893] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:48 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:49.699447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:49.700105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:49.708507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:49.709186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:49.709712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:49.710474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:49.711295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:49.711864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:49.886071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:49.897124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:49.898835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:49.901796 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53ec71a7-aae4-48cc-aa87-13601825ba6e tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.205065 Nov 02 13:08:49.902972 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3552/6894] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:49 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:50.928946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:50.930879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:50.955196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:50.956001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:50.956470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:50.957210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:50.957692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:50.958174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:51.138713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:51.154144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:51.156887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:51.159417 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25ff6e24-0d15-4e71-9db2-4821239e4eef tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.235965 Nov 02 13:08:51.160377 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3553/6895] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:50 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:52.193000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:52.193000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:52.214765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:52.215280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:52.215879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:52.217290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:52.217994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:52.218625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:52.541590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:52.563858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:52.566210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:52.568039 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5830ab04-2744-42ac-9813-9f9b94932af9 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.383375 Nov 02 13:08:52.570296 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3554/6896] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:52 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:53.605300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:53.606756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:53.626751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:53.627264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:53.627720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:53.628466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:53.628948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:53.629388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:53.921021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:53.938556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:53.941139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:53.943067 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c390e35c-6220-4786-95b0-ad50de3c9e94 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.343909 Nov 02 13:08:53.944890 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3555/6897] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:53 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:54.975219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:54.976729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:55.000406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:55.001062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:55.001745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:55.002689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:55.012859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:55.018125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:55.267903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:55.279537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:55.282613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:55.284084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ef0f8b1-56f6-46f0-a258-00049e1478e6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.312743 Nov 02 13:08:55.291731 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3556/6898] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:54 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:56.321118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:56.322562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:56.331745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:56.332273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:56.332743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:56.333520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:56.334035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:56.334572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:56.574180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:56.585255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:56.587353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:56.588777 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37b09c9f-7d07-423b-b677-e9d0b8b1b237 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.281645 Nov 02 13:08:56.603034 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3557/6899] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:56 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:08:57.617152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:57.617891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:57.625425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:57.626258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:57.626912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:57.627834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:57.628584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:57.628994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:57.776088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:57.786936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:57.788466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:57.789822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4505b7da-a797-4af2-900d-44434040ea13 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.176723 Nov 02 13:08:57.790669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3558/6900] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:57 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:08:58.818052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:58.818705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:58.826652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:58.827171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:58.827628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:58.828560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:58.828800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:58.829345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:58.981774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:58.991507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:58.992960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:58.994175 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fad739c8-f3b4-40a5-8654-e43400d891e5 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.180217 Nov 02 13:08:58.994751 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3559/6901] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:08:58 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:00.027215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:00.028464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:00.035656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:00.036277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:00.036730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:00.037450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:00.037910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:00.038371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:00.188866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:00.206197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:00.207705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:00.208921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3eb18bdf-968c-4148-8941-b3353c9a8632 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.185744 Nov 02 13:09:00.209501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3560/6902] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:00 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:01.235110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:01.235834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:01.243496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:01.244029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:01.244486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:01.245255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:01.245722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:01.246198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:01.391253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:01.400593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:01.402267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:01.403661 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0a62226d-8487-4cd6-a1ff-3f863fb56ad0 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.172601 Nov 02 13:09:01.404244 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3561/6903] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:01 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:02.431516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:02.432452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:02.440213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:02.440984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:02.441452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:02.442330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:02.442895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:02.443346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:02.604584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:02.626378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:02.627883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:02.629125 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fc92632-01e3-4379-bcef-9aa3112a3ae6 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.202160 Nov 02 13:09:02.629680 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3562/6904] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:02 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:09:03.657295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:03.658193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:03.666802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:03.667332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:03.667826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:03.668557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:03.669027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:03.669466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:03.825169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:03.835045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:03.836533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:03.837751 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-736496e5-d841-4222-947d-bfe25c664ad3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.185385 Nov 02 13:09:03.838411 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3563/6905] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:03 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:04.865009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:04.865729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:04.873607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:04.874182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:04.874652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:04.875485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:04.875971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:04.876673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:05.335010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:05.344603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:05.346144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:05.347395 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e0b01cce-abf2-4324-a1e0-74ceab2075fb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.486752 Nov 02 13:09:05.347993 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3564/6906] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:04 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:06.382394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:06.383096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:06.390887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:06.391396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:06.391850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:06.393313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:06.393313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:06.393313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:06.596934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:06.611081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:06.612815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:06.614440 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-015d6d7c-e63a-4a98-aaf0-f08fbd341435 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.236089 Nov 02 13:09:06.615139 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3565/6907] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:06 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:07.640512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:07.642171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:07.651218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:07.652147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:07.652850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:07.653906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:07.654678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:07.655561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:07.823525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:07.832362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:07.833828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:07.835065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2efd474b-0201-4c28-9d4a-0306f243f200 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.199045 Nov 02 13:09:07.835633 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3566/6908] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:07 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:07.840719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4b875c6d-a42f-4c8c-8f71-2e80a2bd5d2e req-c51a0cae-ec14-4a90-afc3-393c49e3d897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ca91f-535e-42e1-9343-cc0f9f516725", "name": "network-vif-plugged", "status": "completed", "tag": "ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:07.853892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4b875c6d-a42f-4c8c-8f71-2e80a2bd5d2e req-c51a0cae-ec14-4a90-afc3-393c49e3d897 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:07.854645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4b875c6d-a42f-4c8c-8f71-2e80a2bd5d2e req-c51a0cae-ec14-4a90-afc3-393c49e3d897 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:07.855456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4b875c6d-a42f-4c8c-8f71-2e80a2bd5d2e req-c51a0cae-ec14-4a90-afc3-393c49e3d897 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:07.869556 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4b875c6d-a42f-4c8c-8f71-2e80a2bd5d2e req-c51a0cae-ec14-4a90-afc3-393c49e3d897 service nova] Creating event network-vif-plugged:ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5 for instance eb6ca91f-535e-42e1-9343-cc0f9f516725 on n-h1-855650-5 Nov 02 13:09:07.881076 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4b875c6d-a42f-4c8c-8f71-2e80a2bd5d2e req-c51a0cae-ec14-4a90-afc3-393c49e3d897 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043658 Nov 02 13:09:07.881598 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3567/6909] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:09:08.866171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:08.866850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:08.874797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:08.875188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:08.875651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:08.876489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:08.877305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:08.877762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:08.896323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:09.048433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:09.057460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:09.058939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:09.060145 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-613c1a40-b962-4bb2-9d1d-ca99f4d320bb tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.199424 Nov 02 13:09:09.061325 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3568/6910] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:08 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:10.094011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:10.094991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:10.109052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:10.109783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:10.110929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:10.112889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:10.113453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:10.113946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:10.337427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:10.369712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:10.372139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:10.373662 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9c98893-d763-444d-92b1-05b13c4b9784 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1729 microversion: 2.20 time: 0.288889 Nov 02 13:09:10.374397 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3569/6911] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:10 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1729 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:09:11.405932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:11.406991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:11.415685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:11.416308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:11.416790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:11.417993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:11.418465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:11.418909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:11.640864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:11.650453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:11.652795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:11.655150 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-181d25d0-d8ca-4837-8f2f-f975d86d8a02 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1716 microversion: 2.20 time: 0.255324 Nov 02 13:09:11.655845 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3570/6912] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:09:11 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1716 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:09:24.384780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:24.387293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:24.391152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:24.391986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=15 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:24.399082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:24.399601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:24.400057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:24.400790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:24.401265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:24.401718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:24.490160 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4257aca2-d8b9-4027-aee2-1760248996b2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91/action" status: 200 len: 24569 microversion: 2.1 time: 0.109254 Nov 02 13:09:24.491026 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3571/6913] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:09:24 2022] POST /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91/action => generated 24569 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:10:03.365744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:03.368881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:03.371232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:03.371944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:03.381063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:03.381574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:03.382072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:03.382827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:03.383443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:03.383896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:03.649683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:10:03.650173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:10:03.650666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:10:03.651094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:10:03.651517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:10:03.728377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:03.736225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:03.736817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:03.737262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:03.738570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:03.738816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:03.739263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:03.770067 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a95f89ae-687a-4e0b-9927-3c1c0d11de87 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91/action" status: 202 len: 1139 microversion: 2.1 time: 0.409070 Nov 02 13:10:03.782328 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3572/6914] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:10:03 2022] POST /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91/action => generated 1139 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:10:03.792700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:03.793485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:03.799992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:03.800508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:03.800966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:03.802135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:03.802947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:03.804067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:03.981224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:03.990023 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ed289e5f-ecdc-4276-87a9-240e37054260 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.201249 Nov 02 13:10:03.990622 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3573/6915] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:03 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:05.013805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:05.014613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:05.022398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:05.022919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:05.023374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:05.024115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:05.024601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:05.025051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:05.184402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:05.193310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-878ee75c-cf2d-41c1-a5b8-5b560819fc7e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.183280 Nov 02 13:10:05.193906 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3574/6916] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:05 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:06.223260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:06.224362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:06.231885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:06.232398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:06.233390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:06.234301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:06.234902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:06.235363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:06.433780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:06.443352 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de9548a7-6b72-41e4-8240-c19a0cdb1b31 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.224141 Nov 02 13:10:06.443963 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3575/6917] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:06 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:07.469205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:07.469857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:07.477047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:07.477557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:07.478108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:07.478837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:07.479307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:07.479748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:07.626268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:07.634755 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c65f9b5a-6d7c-4257-b188-615441bcb4ed tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.169681 Nov 02 13:10:07.635341 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3576/6918] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:07 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:08.406953 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:10:08.407519 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:10:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:10:08.660031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:08.660988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:08.674752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:08.675694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:08.676573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:08.678018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:08.679346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:08.680165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:08.877041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:08.890104 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ee0ce29-d76e-4250-bf63-efc6b234f8a9 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.233892 Nov 02 13:10:08.891230 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3577/6919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:08 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:09.915339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:09.916097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:09.924798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:09.925318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:09.925821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:09.926641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:09.927123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:09.927572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:10.102490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:10.113098 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9733896f-b211-4920-8a31-325773a8f867 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.201810 Nov 02 13:10:10.121540 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3578/6920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:09 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:11.157549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:11.158334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:11.164851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:11.165365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:11.165812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:11.166580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:11.167044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:11.167479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:11.360694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:11.378682 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-87357df2-2ecb-4a92-80cc-da643c931996 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.226205 Nov 02 13:10:11.379950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3579/6921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:11 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:12.423295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:12.424133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:12.432649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:12.433542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:12.434188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:12.435021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:12.435748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:12.436322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:12.618553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:12.629009 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b29d2bc0-8855-417d-932a-32543ec844e7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.211626 Nov 02 13:10:12.630216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3580/6922] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:12 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:13.655939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:13.656646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:13.663819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:13.664323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:13.664777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:13.665498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:13.665983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:13.666626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:13.853368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:13.862904 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08d18bb5-72f2-428f-a5a7-4cbbdc77ee96 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.211458 Nov 02 13:10:13.863525 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3581/6923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:13 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:14.887766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:14.888398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:14.898358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:14.899248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:14.899742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:14.900518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:14.900992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:14.901473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:15.063798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:15.072537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-68a8b478-03a5-4a4e-b9a5-c5337f0eb57e tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1694 microversion: 2.1 time: 0.189134 Nov 02 13:10:15.073521 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3582/6924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:14 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:16.098131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:16.099468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:16.107543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:16.108084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:16.109269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:16.110421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:16.110917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:16.111366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:16.290750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:16.299740 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a238262a-538b-4ada-9523-dbfde20dbed2 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1700 microversion: 2.1 time: 0.205959 Nov 02 13:10:16.300351 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3583/6925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:16 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1700 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:17.325361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:17.326829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:17.335749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:17.336538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:17.337204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:17.338188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:17.338854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:17.339422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:17.556341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:17.573217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-198ca47c-2c48-43a4-b579-63adfa0c657f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1700 microversion: 2.1 time: 0.251312 Nov 02 13:10:17.574330 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3584/6926] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:17 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1700 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:18.611608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:18.612765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:18.620374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:18.621112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:18.621592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:18.622456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:18.623479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:18.623764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:18.808056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:18.821116 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-76985b21-3ade-4a88-bdb4-d18bd3e7685a tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1700 microversion: 2.1 time: 0.214000 Nov 02 13:10:18.821916 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3585/6927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:18 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1700 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:18.828190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:18.831050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:18.838026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:18.838535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:18.839026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:18.839787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:18.840272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:18.840720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:18.867745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:18.886408 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4d653c4-66b3-4fe1-9b16-526245410f11 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062945 Nov 02 13:10:18.887121 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3586/6928] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Nov 2 13:10:18 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:18.960047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:18.960811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:18.968045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:18.968686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:18.969871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:18.970229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:18.971262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:18.971812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:19.023155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:10:19.200135 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6fe43abb-fb65-4d0e-b313-8f7d90693ef3 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 204 len: 0 microversion: 2.20 time: 0.243237 Nov 02 13:10:19.202336 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3587/6929] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 13:10:18 2022] DELETE /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:10:19.210133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-31ecba50-ede1-472a-99dc-2d53b3359df7 req-437f5a59-13c6-4f94-9fd5-44abc47a87ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6413fbc1-87c5-453b-bf1c-4668bdcdec91", "name": "network-vif-unplugged", "status": "completed", "tag": "8445918c-a059-40f4-9a58-7fb446a7b66a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:19.222496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-31ecba50-ede1-472a-99dc-2d53b3359df7 req-437f5a59-13c6-4f94-9fd5-44abc47a87ff service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:19.223002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-31ecba50-ede1-472a-99dc-2d53b3359df7 req-437f5a59-13c6-4f94-9fd5-44abc47a87ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:19.223556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-31ecba50-ede1-472a-99dc-2d53b3359df7 req-437f5a59-13c6-4f94-9fd5-44abc47a87ff service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:19.239648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-31ecba50-ede1-472a-99dc-2d53b3359df7 req-437f5a59-13c6-4f94-9fd5-44abc47a87ff service nova] Creating event network-vif-unplugged:8445918c-a059-40f4-9a58-7fb446a7b66a for instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 on n-h2-855650-5 Nov 02 13:10:19.245554 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-31ecba50-ede1-472a-99dc-2d53b3359df7 req-437f5a59-13c6-4f94-9fd5-44abc47a87ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043288 Nov 02 13:10:19.246540 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3588/6930] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:19.253842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:19.254975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:19.262408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:19.262918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:19.263449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:19.264526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:19.265284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:19.265728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:19.483391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:19.493425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:19.495063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:19.496739 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65f07b3c-122d-4184-ab3d-8d4500235dfa tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.248708 Nov 02 13:10:19.498003 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3589/6931] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:10:19 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:10:19.846325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:19.847008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:19.854967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:19.856175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:19.857016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:19.857993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:19.859255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:19.859857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:20.049876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:20.062473 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-372265ec-95f8-43e7-84d1-592475a11a78 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1700 microversion: 2.1 time: 0.221156 Nov 02 13:10:20.063167 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3590/6932] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:19 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1700 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:20.526122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:20.526901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:20.534547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:20.535136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:20.535608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:20.536343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:20.536916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:20.537379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:20.710252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:20.725347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:20.727591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:20.729118 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f3b8acc-0966-4bcd-ba17-3ed58e056e5b tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.207690 Nov 02 13:10:20.730069 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3591/6933] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:10:20 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:10:21.107495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:21.108606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:21.136162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:21.137840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:21.139265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:21.140764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:21.141533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:21.143720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:21.406774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:21.415952 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0424987e-9415-44cc-baee-9dd45c4aa938 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1685 microversion: 2.1 time: 0.315758 Nov 02 13:10:21.416743 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3592/6934] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:21 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1685 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:21.760456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:21.762383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:21.771769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:21.772988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:21.774162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:21.775869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:21.776676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:21.778480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:22.125592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:22.142448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:22.146035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:22.148297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-135f9abd-4bbd-4e93-90f9-3b427bba2eb4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1722 microversion: 2.20 time: 0.394325 Nov 02 13:10:22.149305 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3593/6935] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:10:21 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:10:22.465701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ff6f942f-fec7-4be2-8d83-8d3ada4b60f9 req-b88f811a-2713-4ace-9496-988069af522a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ca91f-535e-42e1-9343-cc0f9f516725", "name": "network-vif-deleted", "tag": "ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:22.478396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ff6f942f-fec7-4be2-8d83-8d3ada4b60f9 req-b88f811a-2713-4ace-9496-988069af522a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:22.478934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ff6f942f-fec7-4be2-8d83-8d3ada4b60f9 req-b88f811a-2713-4ace-9496-988069af522a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:22.479644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ff6f942f-fec7-4be2-8d83-8d3ada4b60f9 req-b88f811a-2713-4ace-9496-988069af522a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:22.505353 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ff6f942f-fec7-4be2-8d83-8d3ada4b60f9 req-b88f811a-2713-4ace-9496-988069af522a service nova] Creating event network-vif-deleted:ad8fa3b9-77e7-41f2-8503-50aa5fa3c4a5 for instance eb6ca91f-535e-42e1-9343-cc0f9f516725 on n-h1-855650-5 Nov 02 13:10:22.520617 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ff6f942f-fec7-4be2-8d83-8d3ada4b60f9 req-b88f811a-2713-4ace-9496-988069af522a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059769 Nov 02 13:10:22.523019 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3594/6936] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:10:23.188717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:23.197505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:23.212604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.213630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.214623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.216169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.217687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.218782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.298894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.300519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.301808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.303095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lazy-loading 'fault' on Instance uuid eb6ca91f-535e-42e1-9343-cc0f9f516725 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:10:23.414604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:23.437001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:23.441672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1308290b670740a5b33f056eb704da34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87a366a2344c26a6c308bdcb09fcc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:23.445567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ce5d5d8c-322e-4310-8aa6-f1ab94493223 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 200 len: 1371 microversion: 2.20 time: 0.267419 Nov 02 13:10:23.447996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3595/6937] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:10:23 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:10:23.459382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-87cc5159-9773-4523-9fe7-15b85654505d req-06c9fa2c-c67c-4765-81e2-1fa089b91f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6413fbc1-87c5-453b-bf1c-4668bdcdec91", "name": "network-vif-plugged", "status": "completed", "tag": "8445918c-a059-40f4-9a58-7fb446a7b66a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:23.502855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-87cc5159-9773-4523-9fe7-15b85654505d req-06c9fa2c-c67c-4765-81e2-1fa089b91f89 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.503411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-87cc5159-9773-4523-9fe7-15b85654505d req-06c9fa2c-c67c-4765-81e2-1fa089b91f89 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.503898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-87cc5159-9773-4523-9fe7-15b85654505d req-06c9fa2c-c67c-4765-81e2-1fa089b91f89 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.539330 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-87cc5159-9773-4523-9fe7-15b85654505d req-06c9fa2c-c67c-4765-81e2-1fa089b91f89 service nova] Creating event network-vif-plugged:8445918c-a059-40f4-9a58-7fb446a7b66a for instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 on n-h2-855650-5 Nov 02 13:10:23.546913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-87cc5159-9773-4523-9fe7-15b85654505d req-06c9fa2c-c67c-4765-81e2-1fa089b91f89 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096310 Nov 02 13:10:23.550345 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3596/6938] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:24.483887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:24.485074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:24.493311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:24.493827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:24.494329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:24.495222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:24.495578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:24.496006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:24.511478 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] HTTP exception thrown: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Request method failure captured: Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 HTTP/1.1 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmo1pGSCte2zyg-oZIJlTS437PNfae8Ag4Aj2kjFuA5HxsVGTXiHAPuM6adzVm6M83V5vsz_BSolecSuhb8xLRgbuS2enWTVSGZbVeRYZzTiR4SS04g8PVNmAxI3ENQ-0djojrLK7WhTSypXKUAy6sb_xSJjIv0S9UaiJdU31a7cz9w Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1308290b670740a5b33f056eb704da34 Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'eb6ca91f-535e-42e1-9343-cc0f9f516725'} Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:24.513236 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Returning 404 to user: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4bd8221-e76f-43ab-b47d-d7881d9733f4 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 404 len: 111 microversion: 2.20 time: 0.038113 Nov 02 13:10:24.523436 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3597/6939] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:10:24 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:10:24.529918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c386f82d-94b9-4866-b2d7-3b367559e6ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '.version_select at 0x7f228c2c4550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:24.564256 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c386f82d-94b9-4866-b2d7-3b367559e6ad tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959880710" status: 204 len: 0 microversion: 2.20 time: 0.040168 Nov 02 13:10:24.566343 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3598/6940] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Nov 2 13:10:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959880710 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:10:28.757991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:28.758965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:28.773146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:28.774142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:28.775009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:28.776551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:28.777429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:28.778299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:28.800250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] HTTP exception thrown: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Request method failure captured: Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 HTTP/1.1 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmo1pGSCte2zyg-oZIJlTS437PNfae8Ag4Aj2kjFuA5HxsVGTXiHAPuM6adzVm6M83V5vsz_BSolecSuhb8xLRgbuS2enWTVSGZbVeRYZzTiR4SS04g8PVNmAxI3ENQ-0djojrLK7WhTSypXKUAy6sb_xSJjIv0S9UaiJdU31a7cz9w Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1308290b670740a5b33f056eb704da34 Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'eb6ca91f-535e-42e1-9343-cc0f9f516725'} Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:28.801824 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Returning 404 to user: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd519325-d858-45ee-a304-15b5bb95a0b1 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 404 len: 111 microversion: 2.20 time: 0.055418 Nov 02 13:10:28.810791 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3599/6941] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 13:10:28 2022] DELETE /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:10:28.815650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:28.815650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: eb6ca91f-535e-42e1-9343-cc0f9f516725] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:28.823432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:28.824418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:28.824940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:28.826816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:28.827626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:28.828423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:28.848390 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] HTTP exception thrown: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Request method failure captured: Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 HTTP/1.1 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmo1pGSCte2zyg-oZIJlTS437PNfae8Ag4Aj2kjFuA5HxsVGTXiHAPuM6adzVm6M83V5vsz_BSolecSuhb8xLRgbuS2enWTVSGZbVeRYZzTiR4SS04g8PVNmAxI3ENQ-0djojrLK7WhTSypXKUAy6sb_xSJjIv0S9UaiJdU31a7cz9w Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1308290b670740a5b33f056eb704da34 Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'eb6ca91f-535e-42e1-9343-cc0f9f516725'} Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.850263 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Returning 404 to user: Instance eb6ca91f-535e-42e1-9343-cc0f9f516725 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83c22003-6e80-49ce-95ce-288d9b4ebf5c tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725" status: 404 len: 111 microversion: 2.20 time: 0.042562 Nov 02 13:10:28.859214 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3600/6942] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:10:28 2022] GET /compute/v2.1/servers/eb6ca91f-535e-42e1-9343-cc0f9f516725 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:10:30.378645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:30.379669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:30.390757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:30.391801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:30.392717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:30.394938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:30.395245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:30.396049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:30.438242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:10:30.571181 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c18811d5-2adb-41c1-869b-fc2bf5802f65 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 204 len: 0 microversion: 2.1 time: 0.356993 Nov 02 13:10:30.573281 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3601/6943] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:10:30 2022] DELETE /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:10:30.583455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:30.584205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:30.591775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:30.592197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:30.592657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:30.593593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:30.594128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:30.594541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:30.755472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:30.765270 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-76f9c9c7-ad36-4785-9d06-47c05542abb6 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1733 microversion: 2.1 time: 0.186980 Nov 02 13:10:30.765862 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3602/6944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:30 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1733 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:31.791651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:31.792693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:31.802545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:31.803084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:31.803794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:31.804530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:31.804998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:31.805525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:31.995532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:32.006048 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d70484ce-55ec-435a-ba53-ec1236d41c62 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1733 microversion: 2.1 time: 0.218263 Nov 02 13:10:32.007849 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3603/6945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:31 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:32.196198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:32.196984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:32.206871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:32.207687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:32.208349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:32.210801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:32.211415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:32.211897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:32.252033 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] HTTP exception thrown: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Request method failure captured: Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc HTTP/1.1 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmo1pGSCte2zyg-oZIJlTS437PNfae8Ag4Aj2kjFuA5HxsVGTXiHAPuM6adzVm6M83V5vsz_BSolecSuhb8xLRgbuS2enWTVSGZbVeRYZzTiR4SS04g8PVNmAxI3ENQ-0djojrLK7WhTSypXKUAy6sb_xSJjIv0S9UaiJdU31a7cz9w Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1308290b670740a5b33f056eb704da34 Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'fad3a63e-391c-42f6-bc91-7d20cfd463bc'} Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:32.259607 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.265551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Returning 404 to user: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:32.266821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-57705398-d82b-4316-8cf6-8077849f4b18 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 404 len: 111 microversion: 2.20 time: 0.075568 Nov 02 13:10:32.267263 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3604/6946] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Nov 2 13:10:32 2022] DELETE /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:10:32.275167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:32.276000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] [instance: fad3a63e-391c-42f6-bc91-7d20cfd463bc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:32.285917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:32.286852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:32.287535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:32.289174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:32.290347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:32.290826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:32.295995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:32.313073 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] HTTP exception thrown: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Request method failure captured: Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc HTTP/1.1 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmo1pGSCte2zyg-oZIJlTS437PNfae8Ag4Aj2kjFuA5HxsVGTXiHAPuM6adzVm6M83V5vsz_BSolecSuhb8xLRgbuS2enWTVSGZbVeRYZzTiR4SS04g8PVNmAxI3ENQ-0djojrLK7WhTSypXKUAy6sb_xSJjIv0S9UaiJdU31a7cz9w Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db87a366a2344c26a6c308bdcb09fcc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: db87a366a2344c26a6c308bdcb09fcc2 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-45508100 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 1308290b670740a5b33f056eb704da34 Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-45508100-project Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'fad3a63e-391c-42f6-bc91-7d20cfd463bc'} Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.316614 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:32.321590 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.321590 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:32.321590 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:32.321590 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:32.321590 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:32.321590 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:32.321590 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. Nov 02 13:10:32.321590 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:32.323926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] Returning 404 to user: Instance fad3a63e-391c-42f6-bc91-7d20cfd463bc could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:32.327342 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ae70e9f-e8da-4ee2-9dfa-161176a23d45 tempest-AttachVolumeShelveTestJSON-45508100 tempest-AttachVolumeShelveTestJSON-45508100-project] 10.222.0.45 "GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc" status: 404 len: 111 microversion: 2.20 time: 0.054004 Nov 02 13:10:32.327342 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3605/6947] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Nov 2 13:10:32 2022] GET /compute/v2.1/servers/fad3a63e-391c-42f6-bc91-7d20cfd463bc => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:10:33.032757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:33.034002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:33.053792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:33.055581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:33.061828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:33.063476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:33.064157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:33.064764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:33.383705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7430af4e1c441af96a63f7ddc7e70d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08862f98625d4bca80c271d557cd2e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:33.392519 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b3351d7c-3338-4520-8745-8778fd3c0ab9 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 200 len: 1666 microversion: 2.1 time: 0.364955 Nov 02 13:10:33.398556 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3606/6948] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:33 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 1666 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:33.411564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-cebc4517-d0e9-41b1-8ead-a1f3f5ede5f0 req-e60568e8-400b-4409-9cb0-bbaa345c9fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a255d25-9777-4f63-899b-62fc2403b27d", "name": "network-vif-deleted", "tag": "9e457216-0442-45f5-980d-61695ea1d204"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:33.428587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:33.441592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cebc4517-d0e9-41b1-8ead-a1f3f5ede5f0 req-e60568e8-400b-4409-9cb0-bbaa345c9fcd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:33.442148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cebc4517-d0e9-41b1-8ead-a1f3f5ede5f0 req-e60568e8-400b-4409-9cb0-bbaa345c9fcd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:33.442603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cebc4517-d0e9-41b1-8ead-a1f3f5ede5f0 req-e60568e8-400b-4409-9cb0-bbaa345c9fcd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:33.472041 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-cebc4517-d0e9-41b1-8ead-a1f3f5ede5f0 req-e60568e8-400b-4409-9cb0-bbaa345c9fcd service nova] Creating event network-vif-deleted:9e457216-0442-45f5-980d-61695ea1d204 for instance 6a255d25-9777-4f63-899b-62fc2403b27d on n-h1-855650-5 Nov 02 13:10:33.491415 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-cebc4517-d0e9-41b1-8ead-a1f3f5ede5f0 req-e60568e8-400b-4409-9cb0-bbaa345c9fcd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087652 Nov 02 13:10:33.493300 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3607/6949] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:34.427815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:34.428990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:34.438288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:34.438798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:34.439947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:34.441168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:34.442358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:34.443034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:34.465725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] HTTP exception thrown: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Request method failure captured: Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d HTTP/1.1 Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmrOPa38CaizQG7LyZWkFQyj-HsnLRTtOVhip5lN3gqhHG7fRLmfms61WQjJVkmU9cUb9oMNVnqiPjZ04EaoytK2YqLZ3T_fc5RHRxoxQvjYccVsjB46ZkWAPqhcevN8xNfSDM25K322km2K6wL_hxWuC0pGP1rrZeSVfb84vRn-imc Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 08862f98625d4bca80c271d557cd2e8a Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestServerBasicOps-84734160 Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestServerBasicOps-84734160 Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 08862f98625d4bca80c271d557cd2e8a Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestServerBasicOps-84734160 Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestServerBasicOps-84734160-project Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c7430af4e1c441af96a63f7ddc7e70d6 Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestServerBasicOps-84734160-project Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6a255d25-9777-4f63-899b-62fc2403b27d'} Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:34.467580 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Returning 404 to user: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1a27a1c-a02b-4c43-9c98-5fc989c8166f tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 404 len: 111 microversion: 2.1 time: 0.048093 Nov 02 13:10:34.474194 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3608/6950] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:34 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:10:35.282201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:35.283238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:35.299959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:35.300791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:35.301788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:35.305360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:35.306296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:35.307063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:35.352420 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] HTTP exception thrown: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Request method failure captured: Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d HTTP/1.1 Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmrOPa38CaizQG7LyZWkFQyj-HsnLRTtOVhip5lN3gqhHG7fRLmfms61WQjJVkmU9cUb9oMNVnqiPjZ04EaoytK2YqLZ3T_fc5RHRxoxQvjYccVsjB46ZkWAPqhcevN8xNfSDM25K322km2K6wL_hxWuC0pGP1rrZeSVfb84vRn-imc Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 08862f98625d4bca80c271d557cd2e8a Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestServerBasicOps-84734160 Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestServerBasicOps-84734160 Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 08862f98625d4bca80c271d557cd2e8a Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestServerBasicOps-84734160 Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestServerBasicOps-84734160-project Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c7430af4e1c441af96a63f7ddc7e70d6 Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestServerBasicOps-84734160-project Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6a255d25-9777-4f63-899b-62fc2403b27d'} Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:35.354106 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Returning 404 to user: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c4adf24f-cdca-46f5-8bb3-66ca40568165 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 404 len: 111 microversion: 2.1 time: 0.093919 Nov 02 13:10:35.360521 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3609/6951] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:10:35 2022] DELETE /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:10:35.367994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:35.368616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] [instance: 6a255d25-9777-4f63-899b-62fc2403b27d] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:35.375825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:35.377478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:35.378153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:35.378968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:35.380922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:35.381385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:35.405244 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] HTTP exception thrown: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Request method failure captured: Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d HTTP/1.1 Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmrOPa38CaizQG7LyZWkFQyj-HsnLRTtOVhip5lN3gqhHG7fRLmfms61WQjJVkmU9cUb9oMNVnqiPjZ04EaoytK2YqLZ3T_fc5RHRxoxQvjYccVsjB46ZkWAPqhcevN8xNfSDM25K322km2K6wL_hxWuC0pGP1rrZeSVfb84vRn-imc Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 08862f98625d4bca80c271d557cd2e8a Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestServerBasicOps-84734160 Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_08862f98625d4bca80c271d557cd2e8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestServerBasicOps-84734160 Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 08862f98625d4bca80c271d557cd2e8a Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestServerBasicOps-84734160 Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestServerBasicOps-84734160-project Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c7430af4e1c441af96a63f7ddc7e70d6 Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestServerBasicOps-84734160-project Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6a255d25-9777-4f63-899b-62fc2403b27d'} Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:35.407198 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.412787 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:35.412787 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:35.412787 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:35.412787 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:35.412787 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:35.412787 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. Nov 02 13:10:35.412787 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:35.414896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Returning 404 to user: Instance 6a255d25-9777-4f63-899b-62fc2403b27d could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:35.417431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e82affa-f817-409d-8d26-2e542468ffd8 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d" status: 404 len: 111 microversion: 2.1 time: 0.053279 Nov 02 13:10:35.419216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3610/6952] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:35 2022] GET /compute/v2.1/servers/6a255d25-9777-4f63-899b-62fc2403b27d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:10:35.710831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-91316559-ee70-4992-b8e2-4d441e878910 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] Calling method '.version_select at 0x7f228c2dc820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:35.751085 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-91316559-ee70-4992-b8e2-4d441e878910 tempest-TestServerBasicOps-84734160 tempest-TestServerBasicOps-84734160-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1859331194" status: 202 len: 0 microversion: 2.1 time: 0.044210 Nov 02 13:10:35.751678 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3611/6953] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Nov 2 13:10:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1859331194 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:10:39.916986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9036381-b826-468d-bddf-5dbaa79390f0 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Action: 'create', calling method: .version_select at 0x7f228c279b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1384694610", "metadata": {"Type": "work"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9036381-b826-468d-bddf-5dbaa79390f0 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Request method failure captured: Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 122 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmxP1RGeYxLC_uwbcWc3DXMHJIzwIlKSevzY5AsrgDucmzHhlxu_nt7SwS-oEMU3LTDEsKvN5Z9PpZYiP8HrvOrb2NfK_NM06K2xTGW4oCahmxbNthsytbYLxtH1TMF3-oXciKc658lBJ2dCGs7m4S71PfPYpUBGWbNQ2luesi8nVUE Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c6420b93ccd544e3b0794895d67cfb28 Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1384694610", "metadata": {"Type": "work"}}} Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1384694610', 'metadata': {'Type': 'work'}}}} Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:10:39.923058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9036381-b826-468d-bddf-5dbaa79390f0 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9036381-b826-468d-bddf-5dbaa79390f0 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.281353 Nov 02 13:10:39.928004 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3612/6954] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Nov 2 13:10:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 283 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:10:39.935515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5eb5423f-ae98-403c-970d-e2c85131b210 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Action: 'create', calling method: .version_select at 0x7f228c239ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1507996277", "metadata": {"Type": "work"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5eb5423f-ae98-403c-970d-e2c85131b210 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Request method failure captured: Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 120 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmxP1RGeYxLC_uwbcWc3DXMHJIzwIlKSevzY5AsrgDucmzHhlxu_nt7SwS-oEMU3LTDEsKvN5Z9PpZYiP8HrvOrb2NfK_NM06K2xTGW4oCahmxbNthsytbYLxtH1TMF3-oXciKc658lBJ2dCGs7m4S71PfPYpUBGWbNQ2luesi8nVUE Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c6420b93ccd544e3b0794895d67cfb28 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1507996277", "metadata": {"Type": "work"}}} Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1507996277', 'metadata': {'Type': 'work'}}}} Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi '0' Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:10:39.939208 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5eb5423f-ae98-403c-970d-e2c85131b210 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5eb5423f-ae98-403c-970d-e2c85131b210 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009153 Nov 02 13:10:39.946459 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3613/6955] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Nov 2 13:10:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:10:39.958244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7bef0137-0601-4ebd-a308-3ef5eaf81980 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Action: 'create', calling method: .version_select at 0x7f228c264c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1952764526", "metadata": {"Type": "work"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7bef0137-0601-4ebd-a308-3ef5eaf81980 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Request method failure captured: Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 119 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmxP1RGeYxLC_uwbcWc3DXMHJIzwIlKSevzY5AsrgDucmzHhlxu_nt7SwS-oEMU3LTDEsKvN5Z9PpZYiP8HrvOrb2NfK_NM06K2xTGW4oCahmxbNthsytbYLxtH1TMF3-oXciKc658lBJ2dCGs7m4S71PfPYpUBGWbNQ2luesi8nVUE Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c6420b93ccd544e3b0794895d67cfb28 Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1952764526", "metadata": {"Type": "work"}}} Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1952764526', 'metadata': {'Type': 'work'}}}} Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi '' Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:10:39.967700 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7bef0137-0601-4ebd-a308-3ef5eaf81980 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7bef0137-0601-4ebd-a308-3ef5eaf81980 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022589 Nov 02 13:10:39.978112 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3614/6956] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Nov 2 13:10:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:10:39.986764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19fed9ff-7d09-4ff5-a4b5-9611cf3d333f tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Calling method '.version_select at 0x7f228c3bac10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:40.058384 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-19fed9ff-7d09-4ff5-a4b5-9611cf3d333f tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] HTTP exception thrown: Volume tempest-invalid-1551460190 could not be found. Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19fed9ff-7d09-4ff5-a4b5-9611cf3d333f tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Request method failure captured: Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1551460190 HTTP/1.1 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmxP1RGeYxLC_uwbcWc3DXMHJIzwIlKSevzY5AsrgDucmzHhlxu_nt7SwS-oEMU3LTDEsKvN5Z9PpZYiP8HrvOrb2NfK_NM06K2xTGW4oCahmxbNthsytbYLxtH1TMF3-oXciKc658lBJ2dCGs7m4S71PfPYpUBGWbNQ2luesi8nVUE Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c6420b93ccd544e3b0794895d67cfb28 Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: exception: Volume tempest-invalid-1551460190 could not be found. Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'tempest-invalid-1551460190'} Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1551460190 could not be found. (HTTP 404) (Request-ID: req-a34f0895-7a8b-4760-9bdb-65cad5cf24e3) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:10:40.064495 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1551460190 could not be found. Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1551460190 could not be found. Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1551460190 could not be found. Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19fed9ff-7d09-4ff5-a4b5-9611cf3d333f tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Returning 404 to user: Volume tempest-invalid-1551460190 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19fed9ff-7d09-4ff5-a4b5-9611cf3d333f tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1551460190" status: 404 len: 99 microversion: 2.1 time: 0.089113 Nov 02 13:10:40.077821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3615/6957] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 13:10:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1551460190 => generated 99 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:10:40.089571 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bde93e54-87f9-43a6-a005-6baed37dce5a tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011774 Nov 02 13:10:40.099576 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3616/6958] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Nov 2 13:10:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 13:10:40.109719 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44486bf1-e9ba-4071-8ab7-835fd1bd99d9 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009884 Nov 02 13:10:40.118108 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3617/6959] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Nov 2 13:10:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 13:10:40.125819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-918b61b8-d9e3-463d-b575-c40737c41127 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Calling method '.version_select at 0x7f228c2dcaf0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:40.193879 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-918b61b8-d9e3-463d-b575-c40737c41127 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] HTTP exception thrown: Volume b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 could not be found. Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-918b61b8-d9e3-463d-b575-c40737c41127 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Request method failure captured: Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-volumes/b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 HTTP/1.1 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmxP1RGeYxLC_uwbcWc3DXMHJIzwIlKSevzY5AsrgDucmzHhlxu_nt7SwS-oEMU3LTDEsKvN5Z9PpZYiP8HrvOrb2NfK_NM06K2xTGW4oCahmxbNthsytbYLxtH1TMF3-oXciKc658lBJ2dCGs7m4S71PfPYpUBGWbNQ2luesi8nVUE Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c6420b93ccd544e3b0794895d67cfb28 Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: exception: Volume b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 could not be found. Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'b943c0c4-ded1-41bd-8d0f-9aff5e5512a7'} Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 could not be found. (HTTP 404) (Request-ID: req-f9e8d39d-a617-46aa-b2f9-e265a223a1cb) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:10:40.196297 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 could not be found. Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 could not be found. Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 could not be found. Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-918b61b8-d9e3-463d-b575-c40737c41127 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Returning 404 to user: Volume b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-918b61b8-d9e3-463d-b575-c40737c41127 tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/b943c0c4-ded1-41bd-8d0f-9aff5e5512a7" status: 404 len: 109 microversion: 2.1 time: 0.077487 Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3618/6960] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Nov 2 13:10:40 2022] DELETE /compute/v2.1/os-volumes/b943c0c4-ded1-41bd-8d0f-9aff5e5512a7 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:10:40.210169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b38ccf1-23e8-4694-b35c-77fbbba2465a tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Calling method '.version_select at 0x7f228c239550>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:40.261793 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8b38ccf1-23e8-4694-b35c-77fbbba2465a tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] HTTP exception thrown: Volume 1c2b9150-494c-4406-bc7c-17add08feb42 could not be found. Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b38ccf1-23e8-4694-b35c-77fbbba2465a tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Request method failure captured: Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/os-volumes/1c2b9150-494c-4406-bc7c-17add08feb42 HTTP/1.1 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmxP1RGeYxLC_uwbcWc3DXMHJIzwIlKSevzY5AsrgDucmzHhlxu_nt7SwS-oEMU3LTDEsKvN5Z9PpZYiP8HrvOrb2NfK_NM06K2xTGW4oCahmxbNthsytbYLxtH1TMF3-oXciKc658lBJ2dCGs7m4S71PfPYpUBGWbNQ2luesi8nVUE Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a42534be90ec4e42af1ccea61ed9bd64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: a42534be90ec4e42af1ccea61ed9bd64 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-723230892 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: c6420b93ccd544e3b0794895d67cfb28 Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-723230892-project Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: method: Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: exception: Volume 1c2b9150-494c-4406-bc7c-17add08feb42 could not be found. Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1c2b9150-494c-4406-bc7c-17add08feb42'} Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1c2b9150-494c-4406-bc7c-17add08feb42 could not be found. (HTTP 404) (Request-ID: req-46061cab-90a9-4a5a-9bb2-763595dd2708) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:10:40.264359 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1c2b9150-494c-4406-bc7c-17add08feb42 could not be found. Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1c2b9150-494c-4406-bc7c-17add08feb42 could not be found. Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1c2b9150-494c-4406-bc7c-17add08feb42 could not be found. Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b38ccf1-23e8-4694-b35c-77fbbba2465a tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] Returning 404 to user: Volume 1c2b9150-494c-4406-bc7c-17add08feb42 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8b38ccf1-23e8-4694-b35c-77fbbba2465a tempest-VolumesNegativeTest-723230892 tempest-VolumesNegativeTest-723230892-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1c2b9150-494c-4406-bc7c-17add08feb42" status: 404 len: 109 microversion: 2.1 time: 0.060597 Nov 02 13:10:40.275139 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3619/6961] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Nov 2 13:10:40 2022] GET /compute/v2.1/os-volumes/1c2b9150-494c-4406-bc7c-17add08feb42 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:11:01.807538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=14 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:01.808307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:01.825837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:01.828710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:01.851135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:01.851655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:01.852116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:01.852864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:01.853343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:01.853801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:02.003733 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-73870782-f110-4d33-b318-800ecc98a56b tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "POST /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91/action" status: 200 len: 24573 microversion: 2.1 time: 0.198805 Nov 02 13:11:02.004758 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3620/6962] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:11:01 2022] POST /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91/action => generated 24573 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:11:24.464682 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:11:24.466455 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:11:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:11:24.473036 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:11:24.473849 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:11:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:11:42.386406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:42.388073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:42.415580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:42.417442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:42.426119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:42.429168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:42.430383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:42.434583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:42.435596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:42.436352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:42.470810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:11:42.569190 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a86681a2-be4c-43ba-b3b5-51ff7ac10ff7 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 204 len: 0 microversion: 2.1 time: 0.187703 Nov 02 13:11:42.570274 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3621/6963] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:11:42 2022] DELETE /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:11:42.786255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e1b86bed-713f-4698-a31a-ef17de8f7900 req-a94f9890-ec4f-44b0-8b2f-78a6d016a016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6413fbc1-87c5-453b-bf1c-4668bdcdec91", "tag": "8445918c-a059-40f4-9a58-7fb446a7b66a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:42.801265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1b86bed-713f-4698-a31a-ef17de8f7900 req-a94f9890-ec4f-44b0-8b2f-78a6d016a016 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:42.801691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1b86bed-713f-4698-a31a-ef17de8f7900 req-a94f9890-ec4f-44b0-8b2f-78a6d016a016 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:42.802079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e1b86bed-713f-4698-a31a-ef17de8f7900 req-a94f9890-ec4f-44b0-8b2f-78a6d016a016 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:42.814890 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e1b86bed-713f-4698-a31a-ef17de8f7900 req-a94f9890-ec4f-44b0-8b2f-78a6d016a016 service nova] Creating event network-changed:8445918c-a059-40f4-9a58-7fb446a7b66a for instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 on n-h2-855650-5 Nov 02 13:11:42.827840 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e1b86bed-713f-4698-a31a-ef17de8f7900 req-a94f9890-ec4f-44b0-8b2f-78a6d016a016 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249548 Nov 02 13:11:42.828540 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3622/6964] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:42.834624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:42.835338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:42.843979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:42.844487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:42.844944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:42.845663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:42.846285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:42.846621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:43.067652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:43.077621 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3de4fef8-fa3d-4004-b66e-5c2057a9a829 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1691 microversion: 2.1 time: 0.247657 Nov 02 13:11:43.079597 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3623/6965] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:42 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:44.105288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:44.106423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:44.114208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:44.114722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:44.115177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:44.115905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:44.116398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:44.117200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:44.311722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:44.346521 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6167676-1f0a-4100-ae1f-0da633c8523f tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1691 microversion: 2.1 time: 0.244590 Nov 02 13:11:44.347280 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3624/6966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:44 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:11:45.226936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-717d1504-112e-4acd-b0c1-b8391086b3ef req-be8d3ba3-4356-4877-b1af-ad4a710196ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6413fbc1-87c5-453b-bf1c-4668bdcdec91", "name": "network-vif-deleted", "tag": "8445918c-a059-40f4-9a58-7fb446a7b66a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:45.238655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-717d1504-112e-4acd-b0c1-b8391086b3ef req-be8d3ba3-4356-4877-b1af-ad4a710196ae service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:45.239487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-717d1504-112e-4acd-b0c1-b8391086b3ef req-be8d3ba3-4356-4877-b1af-ad4a710196ae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:45.240036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-717d1504-112e-4acd-b0c1-b8391086b3ef req-be8d3ba3-4356-4877-b1af-ad4a710196ae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:45.255224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-717d1504-112e-4acd-b0c1-b8391086b3ef req-be8d3ba3-4356-4877-b1af-ad4a710196ae service nova] Creating event network-vif-deleted:8445918c-a059-40f4-9a58-7fb446a7b66a for instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 on n-h2-855650-5 Nov 02 13:11:45.262203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-717d1504-112e-4acd-b0c1-b8391086b3ef req-be8d3ba3-4356-4877-b1af-ad4a710196ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138951 Nov 02 13:11:45.263180 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3625/6967] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:45.377532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:45.378946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:45.386389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:45.387150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:45.387738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:45.388806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:45.389512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:45.390441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:45.433559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:45.434088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:45.434545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:45.435011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lazy-loading 'fault' on Instance uuid 6413fbc1-87c5-453b-bf1c-4668bdcdec91 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:11:45.483075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b040caac0349ffbe7e23b18769bad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8298d308cf40d6adfae4b378b13281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:45.496766 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14a0adf2-0435-4a5a-8722-cf5a36c72a51 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 200 len: 1357 microversion: 2.1 time: 0.124567 Nov 02 13:11:45.497366 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3626/6968] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:45 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 1357 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:46.522917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:46.524578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] [instance: 6413fbc1-87c5-453b-bf1c-4668bdcdec91] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:46.537489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:46.538116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:46.538644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:46.539386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:46.539908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:46.540544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:46.558869 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] HTTP exception thrown: Instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 could not be found. Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Request method failure captured: Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 HTTP/1.1 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmka0UtFqJo2p1FuykiDL2PwMcgraY9pqGeA62hyS-KcQKxCFIPsV1EHPqy8Xx9mC5sS8GeLrRB-WIrkKZRktqGfjXQkW8-F7y5h0nkAthBHoj_HauQLaycYcEgKRwbq1hWX-gqpL_uyQPOXVYNpwgGlz5_2rN-Uxx8W2JjBjVs3a2A Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 8b8298d308cf40d6adfae4b378b13281 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8b8298d308cf40d6adfae4b378b13281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 8b8298d308cf40d6adfae4b378b13281 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1410606748 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestNetworkAdvancedServerOps-1410606748-project Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 04b040caac0349ffbe7e23b18769bad1 Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1410606748-project Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 could not be found. Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6413fbc1-87c5-453b-bf1c-4668bdcdec91'} Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 could not be found. Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 could not be found. Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:11:46.561004 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:11:46.564436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:11:46.564436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:11:46.564436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:11:46.564436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:11:46.564436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:11:46.564436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:11:46.564436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 could not be found. Nov 02 13:11:46.564436 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:11:46.577203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Returning 404 to user: Instance 6413fbc1-87c5-453b-bf1c-4668bdcdec91 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:11:46.580905 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-27f231b9-394a-40c2-a89e-85f8fe674da4 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91" status: 404 len: 111 microversion: 2.1 time: 0.061071 Nov 02 13:11:46.581760 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3627/6969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:46 2022] GET /compute/v2.1/servers/6413fbc1-87c5-453b-bf1c-4668bdcdec91 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:11:52.105925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a03f1cf-101f-4ba5-9f19-a2ae22c6a793 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] Calling method '.version_select at 0x7f228c216af0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:52.152438 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a03f1cf-101f-4ba5-9f19-a2ae22c6a793 tempest-TestNetworkAdvancedServerOps-1410606748 tempest-TestNetworkAdvancedServerOps-1410606748-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1130539494" status: 202 len: 0 microversion: 2.1 time: 0.051528 Nov 02 13:11:52.153414 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3628/6970] 10.222.0.45 () {58 vars in 1284 bytes} [Wed Nov 2 13:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1130539494 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:12:01.521174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:01.857728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-354385718", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "24c75f88-3977-4855-bdf4-3a81d546cbcc"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:01.927585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] validate_networks() for [('24c75f88-3977-4855-bdf4-3a81d546cbcc', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:12:02.616206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:12:02.617521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:12:02.618056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:12:02.618519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:12:02.619613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:12:02.629015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.629558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.630043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.630798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.631268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.631712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.653385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Getting quotas for project 0624ff9e20ea4df08574b01daeabe756. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:12:02.659690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Getting quotas for user d8f1267d3dfb42d3af59d08e22714cc6 and project 0624ff9e20ea4df08574b01daeabe756. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:12:02.677449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:12:02.680224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:12:02.737344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64ec206d-9810-4d4c-b4b7-15a3c95f36fd tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217932 Nov 02 13:12:02.738279 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3629/6971] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:12:02.750860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5de79f31-7fb4-4398-a50a-468af46b0641 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:02.751735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5de79f31-7fb4-4398-a50a-468af46b0641 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:02.817609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5de79f31-7fb4-4398-a50a-468af46b0641 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:02.825705 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5de79f31-7fb4-4398-a50a-468af46b0641 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1214 microversion: 2.1 time: 0.079025 Nov 02 13:12:02.838509 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3630/6972] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:02 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:03.855352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:03.856387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:03.864330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:03.864919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:03.865457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:03.866300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:03.866957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:03.867576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:03.964806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:03.972986 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0543e8d-6291-4b45-868c-f7c43730d05c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1266 microversion: 2.1 time: 0.123475 Nov 02 13:12:03.990394 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3631/6973] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:03 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:05.004041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:05.004692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:05.017707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:05.018707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:05.021352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:05.022167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:05.022961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:05.023561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:05.287277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:05.298398 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62510cb0-d10a-4acd-a9e6-05f3942c8828 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1314 microversion: 2.1 time: 0.297861 Nov 02 13:12:05.299875 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3632/6974] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:04 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:05.982790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-89acf240-1ec4-4c4c-a5f8-0015e05a94b1 req-983d0f6e-b54c-484f-9241-630687af95ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eaf34d-38f7-4479-8a30-dfab6aa17d96", "tag": "c91b94ff-232e-4ede-9fa7-179cd109c7aa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:06.002235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89acf240-1ec4-4c4c-a5f8-0015e05a94b1 req-983d0f6e-b54c-484f-9241-630687af95ed service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:06.003220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89acf240-1ec4-4c4c-a5f8-0015e05a94b1 req-983d0f6e-b54c-484f-9241-630687af95ed service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:06.003827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89acf240-1ec4-4c4c-a5f8-0015e05a94b1 req-983d0f6e-b54c-484f-9241-630687af95ed service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:06.021212 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-89acf240-1ec4-4c4c-a5f8-0015e05a94b1 req-983d0f6e-b54c-484f-9241-630687af95ed service nova] Creating event network-changed:c91b94ff-232e-4ede-9fa7-179cd109c7aa for instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 on n-h2-855650-5 Nov 02 13:12:06.027906 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-89acf240-1ec4-4c4c-a5f8-0015e05a94b1 req-983d0f6e-b54c-484f-9241-630687af95ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051000 Nov 02 13:12:06.028902 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3633/6975] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:12:06.331771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:06.334143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:06.351513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:06.353076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:06.355392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:06.356555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:06.361530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:06.362433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:06.611648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:06.620641 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-335567b3-cacd-47ad-bbc2-9c7845fcc27d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1314 microversion: 2.1 time: 0.295394 Nov 02 13:12:06.621308 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3634/6976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:06 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:07.645164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:07.646102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:07.653715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:07.654468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:07.655015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:07.656006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:07.656675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:07.657178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:07.861946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:07.870891 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e68a26c-065f-4def-a59e-f1c68de9f4a4 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1314 microversion: 2.1 time: 0.229820 Nov 02 13:12:07.871721 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3635/6977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:07 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:08.895693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:08.896350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:08.906209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:08.906830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:08.907297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:08.908203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:08.908974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:08.909557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:09.129489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:09.141663 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a6abb964-de03-4650-b50d-a2beb373dd83 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1314 microversion: 2.1 time: 0.249400 Nov 02 13:12:09.154255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3636/6978] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:08 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:10.169200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:10.172921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:10.186498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:10.187277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:10.187792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:10.188537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:10.189182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:10.189853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:10.467916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:10.479980 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c0ed106f-9aba-4953-995b-40e6bc980606 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1314 microversion: 2.1 time: 0.317016 Nov 02 13:12:10.480949 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3637/6979] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:10 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:11.506836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:11.507476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:11.524167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:11.525545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:11.526108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:11.527600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:11.528119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:11.528697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:11.964773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:11.978724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f72d6e4e-33ea-4ad5-a50f-b27a306d3e63 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1314 microversion: 2.1 time: 0.475474 Nov 02 13:12:11.991113 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3638/6980] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:11 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:12.006789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-aaec45dd-feb4-42b1-99dc-789658d3e3d2 req-bf38f032-22f0-4c8f-84d9-ce8813f2f6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eaf34d-38f7-4479-8a30-dfab6aa17d96", "name": "network-vif-plugged", "status": "completed", "tag": "c91b94ff-232e-4ede-9fa7-179cd109c7aa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:12.031820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aaec45dd-feb4-42b1-99dc-789658d3e3d2 req-bf38f032-22f0-4c8f-84d9-ce8813f2f6e6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:12.033192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aaec45dd-feb4-42b1-99dc-789658d3e3d2 req-bf38f032-22f0-4c8f-84d9-ce8813f2f6e6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:12.034924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-aaec45dd-feb4-42b1-99dc-789658d3e3d2 req-bf38f032-22f0-4c8f-84d9-ce8813f2f6e6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:12.069119 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-aaec45dd-feb4-42b1-99dc-789658d3e3d2 req-bf38f032-22f0-4c8f-84d9-ce8813f2f6e6 service nova] Creating event network-vif-plugged:c91b94ff-232e-4ede-9fa7-179cd109c7aa for instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 on n-h2-855650-5 Nov 02 13:12:12.081883 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-aaec45dd-feb4-42b1-99dc-789658d3e3d2 req-bf38f032-22f0-4c8f-84d9-ce8813f2f6e6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086317 Nov 02 13:12:12.083177 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3639/6981] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:13.011087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:13.011981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:13.026678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:13.027848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:13.029062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:13.033060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.034288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.035372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.036501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.037222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.051876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.301489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:13.310065 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f19335aa-e5d7-47c2-bb97-ac029d7f187f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1314 microversion: 2.1 time: 0.306583 Nov 02 13:12:13.310827 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3640/6982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:13 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:14.333412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:14.335173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:14.343196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.343711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.344168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.345071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.345554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.346031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.508529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:14.520718 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3528a0d7-7466-4f03-a7f9-abb56c398e9f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1502 microversion: 2.1 time: 0.190828 Nov 02 13:12:14.521463 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3641/6983] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:14 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:14.550848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:14.552218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:14.561037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.562859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.563424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.564273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.564906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.565448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.835840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:14.847096 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ce16259-83de-4e32-8fdb-c92b5aaded40 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1502 microversion: 2.1 time: 0.303975 Nov 02 13:12:14.862417 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3642/6984] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:14 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:14.871727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:14.872282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:14.878982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.879321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.880216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.880984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.881461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.881907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.907950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lazy-loading 'flavor' on Instance uuid 17eaf34d-38f7-4479-8a30-dfab6aa17d96 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:12:15.000424 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01a4b09b-fe3d-4b2e-8b64-3e53f26af49a tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "POST /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96/action" status: 202 len: 0 microversion: 2.1 time: 0.133111 Nov 02 13:12:15.004505 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3643/6985] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:12:14 2022] POST /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:12:15.010003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:15.010679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:15.017601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.018182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.018676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:15.019455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.019940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.020389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:15.229314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:15.238854 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-074f06d2-e483-41bf-a8cc-656a454210fe tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1510 microversion: 2.1 time: 0.233108 Nov 02 13:12:15.247000 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3644/6986] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:15 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:16.277517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:16.278306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:16.285934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.287141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.287598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.288403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.288912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.289356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.823495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:16.831769 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07ef88b3-b70e-4e9f-9335-59fcfa2dbd0b tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1493 microversion: 2.1 time: 0.558595 Nov 02 13:12:16.832497 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3645/6987] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:16 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1493 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:16.856253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:16.856825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:16.863269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.863768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.864216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.864922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.865420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.865857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.897030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:16.941450 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad87fa9c-60c5-4f85-9600-2d8f124455bf tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "POST /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96/action" status: 202 len: 0 microversion: 2.1 time: 0.089043 Nov 02 13:12:16.945311 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3646/6988] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:12:16 2022] POST /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:16.952445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:16.953298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:16.960300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.960707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.961600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.962740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.963553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.964079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:17.235835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:17.249441 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11ae02b2-dfc8-4fc7-85b5-41f41ffb4998 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1499 microversion: 2.1 time: 0.301229 Nov 02 13:12:17.250706 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3647/6989] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:16 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1499 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:18.276661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:18.278090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:18.286368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:18.287794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:18.288304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:18.289269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:18.289950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:18.290518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:18.441210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:18.452008 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1757f5f6-b269-4175-a101-09ac7985726d tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1499 microversion: 2.1 time: 0.180443 Nov 02 13:12:18.453434 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3648/6990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:18 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1499 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:19.476865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:19.478179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:19.492223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:19.493010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:19.493647 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:19.494596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:19.495208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:19.495794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:19.725545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:19.734946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88b26b43-8a65-4a33-ba14-b247c7c9e4f0 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1502 microversion: 2.1 time: 0.261975 Nov 02 13:12:19.735835 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3649/6991] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:19 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:19.761194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:19.762437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:19.776400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:19.777357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:19.778306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:19.779189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:19.779802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:19.780388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:19.812050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lazy-loading 'flavor' on Instance uuid 17eaf34d-38f7-4479-8a30-dfab6aa17d96 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:12:19.936861 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a101dea2-7aa0-41b9-937d-204ad20919b1 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "POST /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96/action" status: 202 len: 0 microversion: 2.1 time: 0.180325 Nov 02 13:12:19.938547 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3650/6992] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:12:19 2022] POST /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:19.968969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:19.970160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:19.980454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:19.981559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:19.982194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:19.983174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:19.983794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:19.984829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:20.248885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:20.273996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a442c814-b2fc-450b-a401-a5551b093f91 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1510 microversion: 2.1 time: 0.306332 Nov 02 13:12:20.273996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3651/6993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:19 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1510 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:21.288411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:21.289817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:21.299632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:21.300142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:21.300605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:21.301348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:21.301803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:21.302285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:21.463225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:21.472734 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3609885-17d4-4769-8531-cfe9f6cff010 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1493 microversion: 2.1 time: 0.188747 Nov 02 13:12:21.474211 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3652/6994] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:21 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1493 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:21.497818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:21.498504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:21.505381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:21.506103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:21.506642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:21.507362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:21.507911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:21.508494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:21.587490 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-717eaddb-7fa1-458b-9e9f-7a55a6e71580 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "POST /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96/action" status: 202 len: 0 microversion: 2.1 time: 0.095016 Nov 02 13:12:21.588682 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3653/6995] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:12:21 2022] POST /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:21.597704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:21.598712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:21.609221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:21.610078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:21.610575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:21.611549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:21.612175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:21.612684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:21.844543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:21.855361 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dfb9d0c1-dc3e-4293-93dc-6d1faaa92af8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1499 microversion: 2.1 time: 0.262197 Nov 02 13:12:21.856309 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3654/6996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:21 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1499 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:22.889221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:22.890109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:22.897470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:22.898006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:22.898584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:22.899941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:22.900552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:22.900985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:23.070859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:23.080596 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9faabca6-c0e9-4056-b8a4-c32596d16900 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1499 microversion: 2.1 time: 0.203396 Nov 02 13:12:23.081216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3655/6997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:22 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1499 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:24.104366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:24.105876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:24.112635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:24.113340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:24.113640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:24.114402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:24.114868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:24.115312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:24.294666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:24.304146 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a8e898a-6c61-4d34-a0b4-c0ca9f0b110c tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1502 microversion: 2.1 time: 0.203850 Nov 02 13:12:24.320568 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3656/6998] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:24 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:24.331833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:24.332356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:24.339263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:24.339769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:24.340405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:24.341294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:24.341913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:24.342535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:24.373580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:12:24.490577 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f021f247-8f16-4221-85c7-16a0cd0a2c97 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "DELETE /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 204 len: 0 microversion: 2.1 time: 0.164037 Nov 02 13:12:24.491176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3657/6999] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:24 2022] DELETE /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:12:24.501447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:24.502195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:24.510415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:24.511180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:24.511793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:24.512677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:24.513293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:24.514044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:24.518849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:24.947943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:24.958005 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9bfa872-4ac6-407c-9b95-ac1ac6eddec8 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1508 microversion: 2.1 time: 0.460370 Nov 02 13:12:24.960947 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3658/7000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:24 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:25.984653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:25.985736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:25.993898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:25.994492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:25.995036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:25.995850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:25.996547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:25.997082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:26.167242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:26.176664 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a2497d97-b1fc-4ddb-a405-b3201dd773d5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1508 microversion: 2.1 time: 0.196455 Nov 02 13:12:26.177366 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3659/7001] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:25 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:27.204828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:27.206167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:27.225642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:27.226392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:27.227020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:27.227933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:27.228551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:27.229131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:27.433397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f1267d3dfb42d3af59d08e22714cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0624ff9e20ea4df08574b01daeabe756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:27.462731 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-815a4c79-2a8c-45c9-b12d-e93fdf1ef67f tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 200 len: 1508 microversion: 2.1 time: 0.261105 Nov 02 13:12:27.464406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3660/7002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:27 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:27.594280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-437e7870-40aa-4ab4-aff1-ad45e37a9270 req-56bb4c1d-c7dc-4101-8b74-4510206fa43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eaf34d-38f7-4479-8a30-dfab6aa17d96", "name": "network-vif-deleted", "tag": "c91b94ff-232e-4ede-9fa7-179cd109c7aa"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:27.607368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-437e7870-40aa-4ab4-aff1-ad45e37a9270 req-56bb4c1d-c7dc-4101-8b74-4510206fa43b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:27.608225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-437e7870-40aa-4ab4-aff1-ad45e37a9270 req-56bb4c1d-c7dc-4101-8b74-4510206fa43b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:27.608888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-437e7870-40aa-4ab4-aff1-ad45e37a9270 req-56bb4c1d-c7dc-4101-8b74-4510206fa43b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:27.632857 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-437e7870-40aa-4ab4-aff1-ad45e37a9270 req-56bb4c1d-c7dc-4101-8b74-4510206fa43b service nova] Creating event network-vif-deleted:c91b94ff-232e-4ede-9fa7-179cd109c7aa for instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 on n-h2-855650-5 Nov 02 13:12:27.640176 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-437e7870-40aa-4ab4-aff1-ad45e37a9270 req-56bb4c1d-c7dc-4101-8b74-4510206fa43b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049523 Nov 02 13:12:27.641579 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3661/7003] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:12:28.498438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:28.499095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] [instance: 17eaf34d-38f7-4479-8a30-dfab6aa17d96] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:28.517934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:28.518487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:28.518956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:28.519702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:28.520165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:28.520604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:28.536962 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] HTTP exception thrown: Instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 could not be found. Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Request method failure captured: Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 HTTP/1.1 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmyfNJTUPPkmgmxvcqbWv21sg_-7MyDWeHvoXMUz7lUWK5Zi5nB91pBVpy_ul74A2T0UBrM-wSIdEaOfmZKoEEOrDu6Yr6zBRvWuepf-Q0X1Uy-N_QaStdSI9HKQlaa_yD7wJfKYafhi5rhIuLAsQw5e94Zu1kPlEQTEKi-81pXQf8Q Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 0624ff9e20ea4df08574b01daeabe756 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestServerAdvancedOps-2135072656 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0624ff9e20ea4df08574b01daeabe756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0624ff9e20ea4df08574b01daeabe756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0624ff9e20ea4df08574b01daeabe756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0624ff9e20ea4df08574b01daeabe756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestServerAdvancedOps-2135072656 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 0624ff9e20ea4df08574b01daeabe756 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestServerAdvancedOps-2135072656 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestServerAdvancedOps-2135072656-project Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: d8f1267d3dfb42d3af59d08e22714cc6 Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestServerAdvancedOps-2135072656-project Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 could not be found. Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '17eaf34d-38f7-4479-8a30-dfab6aa17d96'} Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 could not be found. Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 could not be found. Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:28.539284 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:12:28.542904 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:28.542904 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:28.542904 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:28.542904 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:28.542904 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:28.542904 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 could not be found. Nov 02 13:12:28.542904 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:12:28.543999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] Returning 404 to user: Instance 17eaf34d-38f7-4479-8a30-dfab6aa17d96 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:28.546924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e6707ab-f82d-43d2-8cbe-bf61e27ccbf5 tempest-TestServerAdvancedOps-2135072656 tempest-TestServerAdvancedOps-2135072656-project] 10.222.0.45 "GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96" status: 404 len: 111 microversion: 2.1 time: 0.054009 Nov 02 13:12:28.547989 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3662/7004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:28 2022] GET /compute/v2.1/servers/17eaf34d-38f7-4479-8a30-dfab6aa17d96 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:13:19.134347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b7c9d7cb-4af4-4e55-a72a-f7f1df0d61c6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Action: 'create', calling method: .version_select at 0x7f228c333310>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-849783172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIUILTwOH2lFZ8dZ2M/WHn38MNPR0fhjw3FxUfOzCXNrKttJJgBfb70e8NCb2zNm7SEczlFjM7y0bOlnUgh3HhaSy5zZ8KYSDrKCprROPzEZOZTW8zQfpsK5UJaJ8d5AQ=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:19.140689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:19.141898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=20 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:19.157201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-b7c9d7cb-4af4-4e55-a72a-f7f1df0d61c6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Getting quotas for project 6bd9cbd41bfe453bad4eeb7a049f961a. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:13:19.164259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-b7c9d7cb-4af4-4e55-a72a-f7f1df0d61c6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Getting quotas for user 6f29991421e94e75be7fffe371d4bc73 and project 6bd9cbd41bfe453bad4eeb7a049f961a. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:13:19.197109 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b7c9d7cb-4af4-4e55-a72a-f7f1df0d61c6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.067744 Nov 02 13:13:19.203373 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3663/7005] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:13:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:20.341364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-2052219225", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cc532f2d-13a2-4ea3-9b8f-ca74b6fda683", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-849783172", "security_groups": [{"name": "tempest-secgroup-smoke-206113583"}], "networks": [{"uuid": "66668f5e-337e-42f6-bf82-1f073b944719"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:20.472253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] validate_networks() for [('66668f5e-337e-42f6-bf82-1f073b944719', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:13:21.002672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:13:21.003179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:13:21.003699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:13:21.004137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:13:21.004752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:13:21.017024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:21.017533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:21.018017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:21.018784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:21.019463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:21.019917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:21.044744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Getting quotas for project 6bd9cbd41bfe453bad4eeb7a049f961a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:13:21.050617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Getting quotas for user 6f29991421e94e75be7fffe371d4bc73 and project 6bd9cbd41bfe453bad4eeb7a049f961a. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:13:21.112082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:13:21.114502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc532f2d-13a2-4ea3-9b8f-ca74b6fda683',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:13:21.252685 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14cf6c13-ee06-4dfe-bbae-cfbff52d89ac tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.916967 Nov 02 13:13:21.253622 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3664/7006] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:13:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:13:21.266839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da773636-3209-4ee6-b229-eb766d93fa22 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:21.267479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da773636-3209-4ee6-b229-eb766d93fa22 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:21.331055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-da773636-3209-4ee6-b229-eb766d93fa22 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:21.341806 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da773636-3209-4ee6-b229-eb766d93fa22 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1098 microversion: 2.1 time: 0.079328 Nov 02 13:13:21.343705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3665/7007] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:21 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1098 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:22.367737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:22.368396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:22.376510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:22.377267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:22.377820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:22.378908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:22.379478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:22.380068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:22.453702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:22.462819 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e06b1b89-d50c-4b9a-b1f0-ba7219f2e56b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1196 microversion: 2.1 time: 0.099790 Nov 02 13:13:22.463593 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3666/7008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:22 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1196 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:23.492986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:23.494045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:23.516871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:23.522763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:23.527898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:23.528855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:23.529496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:23.530122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:23.789571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:23.799079 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf17ee9c-2418-4d80-9834-2556db0548c7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1281 microversion: 2.1 time: 0.311553 Nov 02 13:13:23.800240 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3667/7009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:23 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1281 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:24.686323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9262d9dd-bdc7-4b4b-9033-e8ccf3cb25ff req-0f84c6f2-d2d0-48b5-8699-82f5af7b87dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74263068-31cb-4e54-abef-1564358e11b7", "tag": "b55196c2-ebd3-4e8f-b067-58504d8a29b1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:24.706380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9262d9dd-bdc7-4b4b-9033-e8ccf3cb25ff req-0f84c6f2-d2d0-48b5-8699-82f5af7b87dc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:24.707225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9262d9dd-bdc7-4b4b-9033-e8ccf3cb25ff req-0f84c6f2-d2d0-48b5-8699-82f5af7b87dc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:24.707993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9262d9dd-bdc7-4b4b-9033-e8ccf3cb25ff req-0f84c6f2-d2d0-48b5-8699-82f5af7b87dc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:24.728487 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9262d9dd-bdc7-4b4b-9033-e8ccf3cb25ff req-0f84c6f2-d2d0-48b5-8699-82f5af7b87dc service nova] Creating event network-changed:b55196c2-ebd3-4e8f-b067-58504d8a29b1 for instance 74263068-31cb-4e54-abef-1564358e11b7 on n-h2-855650-5 Nov 02 13:13:24.741890 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9262d9dd-bdc7-4b4b-9033-e8ccf3cb25ff req-0f84c6f2-d2d0-48b5-8699-82f5af7b87dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056318 Nov 02 13:13:24.743216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3668/7010] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:24.830815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:24.831643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:24.840456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:24.841093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:24.841699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:24.843002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:24.843609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:24.844181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:25.058984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:25.072258 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1162e771-4832-44a3-b22d-e58b60934f61 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1281 microversion: 2.1 time: 0.247423 Nov 02 13:13:25.073389 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3669/7011] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:24 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1281 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:26.098702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:26.100360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:26.107347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:26.108356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:26.109075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:26.110490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:26.111203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:26.111859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:26.267438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:26.280000 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-56ee8585-d211-4b20-8b24-a4df97546e69 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1281 microversion: 2.1 time: 0.186151 Nov 02 13:13:26.281076 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3670/7012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:26 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:27.308686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:27.310516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:27.319708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:27.320541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:27.321151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:27.322150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:27.322801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:27.323464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:27.486443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:27.495707 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c285600-dad4-43fd-9c64-23046f608928 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1281 microversion: 2.1 time: 0.193317 Nov 02 13:13:27.496639 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3671/7013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:27 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:28.423966 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:13:28.424500 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:13:28.520723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:28.521448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:28.531280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:28.532057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:28.532519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:28.533253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:28.533945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:28.534436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:28.729675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:28.739084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f2d99e0-3bf1-44ff-a579-f194dd4302d7 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1281 microversion: 2.1 time: 0.222789 Nov 02 13:13:28.739807 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3672/7014] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:28 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:29.765003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:29.765614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:29.773482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:29.774148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:29.774693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:29.775586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:29.776100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:29.776552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:29.930520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:29.938672 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c25c9241-9cce-46e1-be3d-ad31cf39d427 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.177570 Nov 02 13:13:29.939258 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3673/7015] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:29 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:30.963790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:30.964572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:30.974133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:30.974895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:30.975632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:30.976518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:30.977273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:30.977747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.032309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:31.136068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:31.144316 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44dbb01d-e384-4d2b-8ad7-c8ea8b0a1da6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.185045 Nov 02 13:13:31.144900 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3674/7016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:30 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:32.167984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:32.168608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:32.170824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:32.177445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:32.178358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:32.178899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:32.179744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:32.180309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:32.180831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:32.336914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:32.351497 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19844fca-6a3d-4fb1-b8ae-5d628f01599b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.187661 Nov 02 13:13:32.352583 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3675/7017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:32 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:33.388451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:33.389381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:33.397027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:33.397539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:33.398017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:33.398750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:33.399223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:33.399698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:33.556436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:33.565722 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c0a1d7ba-02d1-4e5e-8635-083350e2587d tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.181100 Nov 02 13:13:33.566370 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3676/7018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:33 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:34.590046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:34.598042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:34.606955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:34.607857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:34.608129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:34.608935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:34.609417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:34.610065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:34.783944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:34.798297 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4bb36d38-2a9d-4156-89ad-45cdfdfd5647 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.211909 Nov 02 13:13:34.799386 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3677/7019] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:34 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:35.825454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:35.828356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:35.835184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:35.835687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:35.836147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:35.836870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:35.837828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:35.838325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:35.983276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:35.992186 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a1da04c-7283-4944-b11e-8e70a5e0eeda tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.171543 Nov 02 13:13:35.992768 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3678/7020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:35 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:36.856626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1018618068", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:36.912335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:13:37.109491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:13:37.109995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:13:37.110496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:13:37.110923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:13:37.111354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:13:37.120403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:37.120912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:37.121364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:37.122162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:37.122631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:37.123077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:37.140239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Getting quotas for project b3ccc9a26d2d40a988573a671e9afa55. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:13:37.145449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Getting quotas for user a6806f93b59f48dbb9aebaaea66901c0 and project b3ccc9a26d2d40a988573a671e9afa55. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:13:37.158418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:13:37.160812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:13:37.206526 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bc812309-4fb3-4070-a26d-4baf678d0378 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.353784 Nov 02 13:13:37.207309 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3679/7021] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:13:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:13:37.218224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:37.218851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:37.225903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:37.226368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:37.226870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:37.227506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:37.227984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:37.228396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:37.379400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:37.389429 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20709d4d-d535-4288-89bb-39780fcdca0b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.175056 Nov 02 13:13:37.390037 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3680/7022] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:37 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:37.402169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad35219e-4891-47b5-8048-e7c17e156ecd tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:37.402912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad35219e-4891-47b5-8048-e7c17e156ecd tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:37.458354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad35219e-4891-47b5-8048-e7c17e156ecd tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:37.466011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad35219e-4891-47b5-8048-e7c17e156ecd tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1215 microversion: 2.1 time: 0.073976 Nov 02 13:13:37.466516 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3681/7023] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:37 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:38.413350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:38.414052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:38.421407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:38.421918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:38.422406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:38.423135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:38.423599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:38.424049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:38.603677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:38.620937 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-59f4ddef-5380-4633-b0ae-8b094544b67c tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.211209 Nov 02 13:13:38.621719 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3682/7024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:38 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:38.626913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:38.627681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:38.637318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:38.638023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:38.638729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:38.639622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:38.640103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:38.640545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:38.710383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:38.718922 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b6b3453e-61eb-4dfb-935a-7f9a5161b454 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1273 microversion: 2.1 time: 0.095829 Nov 02 13:13:38.719529 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3683/7025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:38 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:39.644280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.645083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:39.653751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:39.654539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:39.655152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:39.656070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:39.656706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:39.657330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:39.679308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:39.821066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:39.829574 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64f27d0b-cd80-451e-bf10-72d5b1f8b2cb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.189297 Nov 02 13:13:39.830321 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3684/7026] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:39 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:39.835968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.836901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:39.852329 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:39.852859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:39.853374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:39.854202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:39.854695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:39.855207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:40.006376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:40.021377 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71b3d2c5-a5d0-49d1-85e5-65f1e6f08aad tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1315 microversion: 2.1 time: 0.189202 Nov 02 13:13:40.023098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3685/7027] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:39 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:40.268071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2fe18df4-dce5-4260-8c1f-b3ded0879693 req-07a942d3-dab0-4cb7-9d00-f577c8944fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74263068-31cb-4e54-abef-1564358e11b7", "name": "network-vif-plugged", "status": "completed", "tag": "b55196c2-ebd3-4e8f-b067-58504d8a29b1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:40.278430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2fe18df4-dce5-4260-8c1f-b3ded0879693 req-07a942d3-dab0-4cb7-9d00-f577c8944fe9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:40.278927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2fe18df4-dce5-4260-8c1f-b3ded0879693 req-07a942d3-dab0-4cb7-9d00-f577c8944fe9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:40.279410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2fe18df4-dce5-4260-8c1f-b3ded0879693 req-07a942d3-dab0-4cb7-9d00-f577c8944fe9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:40.292810 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2fe18df4-dce5-4260-8c1f-b3ded0879693 req-07a942d3-dab0-4cb7-9d00-f577c8944fe9 service nova] Creating event network-vif-plugged:b55196c2-ebd3-4e8f-b067-58504d8a29b1 for instance 74263068-31cb-4e54-abef-1564358e11b7 on n-h2-855650-5 Nov 02 13:13:40.298344 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2fe18df4-dce5-4260-8c1f-b3ded0879693 req-07a942d3-dab0-4cb7-9d00-f577c8944fe9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212112 Nov 02 13:13:40.299130 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3686/7028] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:40.525173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7b9ffba8-e8e8-463e-bddf-13aa50b05cc3 req-9fe5d2cf-17cc-4f8a-abfa-baa3625bfc78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c4eb32-6a7b-4370-ace7-4eecca30c927", "tag": "1588bd6a-77ba-42a1-9666-747b7f277c9c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:40.536423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7b9ffba8-e8e8-463e-bddf-13aa50b05cc3 req-9fe5d2cf-17cc-4f8a-abfa-baa3625bfc78 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:40.537951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7b9ffba8-e8e8-463e-bddf-13aa50b05cc3 req-9fe5d2cf-17cc-4f8a-abfa-baa3625bfc78 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:40.537951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7b9ffba8-e8e8-463e-bddf-13aa50b05cc3 req-9fe5d2cf-17cc-4f8a-abfa-baa3625bfc78 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:40.550896 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7b9ffba8-e8e8-463e-bddf-13aa50b05cc3 req-9fe5d2cf-17cc-4f8a-abfa-baa3625bfc78 service nova] Creating event network-changed:1588bd6a-77ba-42a1-9666-747b7f277c9c for instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 on n-h1-855650-5 Nov 02 13:13:40.556488 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7b9ffba8-e8e8-463e-bddf-13aa50b05cc3 req-9fe5d2cf-17cc-4f8a-abfa-baa3625bfc78 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037367 Nov 02 13:13:40.557100 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3687/7029] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:40.856823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:40.857582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:40.865713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:40.866227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:40.866771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:40.867504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:40.867972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:40.868419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:41.017499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:41.027611 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec1b45c3-7851-4b38-9844-2799e6e32384 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1269 microversion: 2.1 time: 0.177284 Nov 02 13:13:41.028139 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3688/7030] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:40 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:41.046846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:41.047645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:41.055186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:41.055698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:41.056160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:41.056895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:41.057502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:41.057950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:41.191624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:41.200062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8f8d35ae-6691-4109-9d4c-1baa633211fa tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1315 microversion: 2.1 time: 0.157437 Nov 02 13:13:41.200635 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3689/7031] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:41 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:42.051520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:42.052210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:42.056544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:42.061203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:42.061716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:42.062209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:42.062937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:42.063464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:42.063929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:42.208039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:42.222226 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de58d189-f748-4f2e-bee9-1472f4113601 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1458 microversion: 2.1 time: 0.175319 Nov 02 13:13:42.222950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3690/7032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:42 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1458 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:42.227590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:42.228226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:42.234663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:42.235175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:42.235669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:42.236400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:42.236876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:42.237323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:42.382949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:42.391848 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e8e63db-5638-47f4-94c2-2fdf65db8f9e tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1315 microversion: 2.1 time: 0.167946 Nov 02 13:13:42.392738 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3691/7033] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:42 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:42.400211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:42.400211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:42.406152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:42.406672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:42.407139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:42.407862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:42.408333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:42.408780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:42.549687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:42.558189 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f0b071cb-b958-438e-af61-22127314a319 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1458 microversion: 2.1 time: 0.164661 Nov 02 13:13:42.558782 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3692/7034] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:42 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:43.417715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.419189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:43.430008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:43.430008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:43.430008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:43.430617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:43.430890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:43.431330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:43.701244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:43.709921 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0b8fadc-210b-483e-9cbe-79e9bc486a84 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1315 microversion: 2.1 time: 0.297358 Nov 02 13:13:43.710868 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3693/7035] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:44.734206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.734842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:44.742403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:44.747842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:44.747842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:44.747842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:44.747842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:44.747842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:44.951853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:44.970254 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4268eb08-a93a-44cf-98b1-b8b92adfa4ae tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1315 microversion: 2.1 time: 0.239898 Nov 02 13:13:44.986025 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3694/7036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:44 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:44.991225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f242ce25-bc03-4592-8971-969b242a08d3 req-ad0405b6-4744-4305-b45b-0516e6f60700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74263068-31cb-4e54-abef-1564358e11b7", "tag": "b55196c2-ebd3-4e8f-b067-58504d8a29b1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:45.006548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f242ce25-bc03-4592-8971-969b242a08d3 req-ad0405b6-4744-4305-b45b-0516e6f60700 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:45.008476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f242ce25-bc03-4592-8971-969b242a08d3 req-ad0405b6-4744-4305-b45b-0516e6f60700 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:45.008990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f242ce25-bc03-4592-8971-969b242a08d3 req-ad0405b6-4744-4305-b45b-0516e6f60700 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:45.027659 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f242ce25-bc03-4592-8971-969b242a08d3 req-ad0405b6-4744-4305-b45b-0516e6f60700 service nova] Creating event network-changed:b55196c2-ebd3-4e8f-b067-58504d8a29b1 for instance 74263068-31cb-4e54-abef-1564358e11b7 on n-h2-855650-5 Nov 02 13:13:45.033438 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f242ce25-bc03-4592-8971-969b242a08d3 req-ad0405b6-4744-4305-b45b-0516e6f60700 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050156 Nov 02 13:13:45.034560 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3695/7037] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:45.997569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:45.998328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:46.007260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.007782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.008350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:46.009093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.009575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.010041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:46.175511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:46.206175 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80beecf6-e062-4938-beb1-957e40b89acb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1315 microversion: 2.1 time: 0.213826 Nov 02 13:13:46.206796 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3696/7038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:45 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:46.665423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f603ff1b-86e1-43c2-a279-fa9659e57cdd req-15d579af-f14f-4109-b3c3-0f22f0fb89dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74263068-31cb-4e54-abef-1564358e11b7", "tag": "b55196c2-ebd3-4e8f-b067-58504d8a29b1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:46.675473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f603ff1b-86e1-43c2-a279-fa9659e57cdd req-15d579af-f14f-4109-b3c3-0f22f0fb89dd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.676084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f603ff1b-86e1-43c2-a279-fa9659e57cdd req-15d579af-f14f-4109-b3c3-0f22f0fb89dd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.676602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f603ff1b-86e1-43c2-a279-fa9659e57cdd req-15d579af-f14f-4109-b3c3-0f22f0fb89dd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:46.689885 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f603ff1b-86e1-43c2-a279-fa9659e57cdd req-15d579af-f14f-4109-b3c3-0f22f0fb89dd service nova] Creating event network-changed:b55196c2-ebd3-4e8f-b067-58504d8a29b1 for instance 74263068-31cb-4e54-abef-1564358e11b7 on n-h2-855650-5 Nov 02 13:13:46.696523 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f603ff1b-86e1-43c2-a279-fa9659e57cdd req-15d579af-f14f-4109-b3c3-0f22f0fb89dd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035005 Nov 02 13:13:46.697146 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3697/7039] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:46.895136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2b9c44e5-8c05-47f4-adb9-5c2085159062 req-f9d1326a-e349-43b9-afa9-8f5bbea3b85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c4eb32-6a7b-4370-ace7-4eecca30c927", "name": "network-vif-plugged", "status": "completed", "tag": "1588bd6a-77ba-42a1-9666-747b7f277c9c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:46.909156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b9c44e5-8c05-47f4-adb9-5c2085159062 req-f9d1326a-e349-43b9-afa9-8f5bbea3b85a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.909914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b9c44e5-8c05-47f4-adb9-5c2085159062 req-f9d1326a-e349-43b9-afa9-8f5bbea3b85a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.910449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2b9c44e5-8c05-47f4-adb9-5c2085159062 req-f9d1326a-e349-43b9-afa9-8f5bbea3b85a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:46.932416 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2b9c44e5-8c05-47f4-adb9-5c2085159062 req-f9d1326a-e349-43b9-afa9-8f5bbea3b85a service nova] Creating event network-vif-plugged:1588bd6a-77ba-42a1-9666-747b7f277c9c for instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 on n-h1-855650-5 Nov 02 13:13:46.939080 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2b9c44e5-8c05-47f4-adb9-5c2085159062 req-f9d1326a-e349-43b9-afa9-8f5bbea3b85a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055050 Nov 02 13:13:46.940289 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3698/7040] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:47.228523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:47.233690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:47.234869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:47.243976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:47.244500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:47.245141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:47.246145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:47.246804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:47.247261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:47.447551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:47.459177 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2ddaa89a-99ce-4e17-8227-4acfbea9b5c4 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1315 microversion: 2.1 time: 0.232269 Nov 02 13:13:47.460018 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3699/7041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:47 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:48.491271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:48.491969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:48.493914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:48.500651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:48.501170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:48.501630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:48.502398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:48.502878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:48.503326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:48.655744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:48.665413 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71baa35e-36c8-47ee-9c38-bcb15d50fcee tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1315 microversion: 2.1 time: 0.178062 Nov 02 13:13:48.666201 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3700/7042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:48 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:48.713154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d98f71fd-a94d-4587-8dae-447ce74a881f req-8735fb4c-549d-4c4c-ba67-fb4f668a8a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74263068-31cb-4e54-abef-1564358e11b7", "tag": "b55196c2-ebd3-4e8f-b067-58504d8a29b1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:48.723474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d98f71fd-a94d-4587-8dae-447ce74a881f req-8735fb4c-549d-4c4c-ba67-fb4f668a8a95 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:48.724045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d98f71fd-a94d-4587-8dae-447ce74a881f req-8735fb4c-549d-4c4c-ba67-fb4f668a8a95 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:48.725343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d98f71fd-a94d-4587-8dae-447ce74a881f req-8735fb4c-549d-4c4c-ba67-fb4f668a8a95 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:48.740220 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d98f71fd-a94d-4587-8dae-447ce74a881f req-8735fb4c-549d-4c4c-ba67-fb4f668a8a95 service nova] Creating event network-changed:b55196c2-ebd3-4e8f-b067-58504d8a29b1 for instance 74263068-31cb-4e54-abef-1564358e11b7 on n-h2-855650-5 Nov 02 13:13:48.746794 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d98f71fd-a94d-4587-8dae-447ce74a881f req-8735fb4c-549d-4c4c-ba67-fb4f668a8a95 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037422 Nov 02 13:13:48.747609 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3701/7043] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:49.690502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:49.691227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:49.699643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:49.704475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:49.705004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:49.705986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:49.706581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:49.707034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:49.863709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:49.872504 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e861e55-a8fe-49fa-89f5-c5794de926fb tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1465 microversion: 2.1 time: 0.187201 Nov 02 13:13:49.873109 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3702/7044] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:49 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1465 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:49.920063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:49.920587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:49.926789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:49.928252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:49.928552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:49.929275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:49.929746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:49.930220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:49.956937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:13:50.010155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:50.046423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f0eaf62-c755-4e03-8a8c-4277099d0e38 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "DELETE /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 204 len: 0 microversion: 2.1 time: 0.129704 Nov 02 13:13:50.047416 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3703/7045] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:13:49 2022] DELETE /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:13:50.056739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.057474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:50.063611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.064121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.064581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.065307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.065782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.066261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.204119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:50.212539 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08da64a4-adc2-40ee-8b76-950c4badae96 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1471 microversion: 2.1 time: 0.160281 Nov 02 13:13:50.213033 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3704/7046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:50 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:51.240438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:51.241701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:51.249528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.250067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.250537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.251290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.251768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.252214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.389811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:51.398283 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc5a75a1-5047-489a-9252-d449b40bb159 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1471 microversion: 2.1 time: 0.165207 Nov 02 13:13:51.398960 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3705/7047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:51 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:52.077892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-92f89950-ab33-45fd-8094-b5073e72e315 req-ce510032-d920-43f1-b453-ea2f270925f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c4eb32-6a7b-4370-ace7-4eecca30c927", "name": "network-vif-deleted", "tag": "1588bd6a-77ba-42a1-9666-747b7f277c9c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:52.089256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-92f89950-ab33-45fd-8094-b5073e72e315 req-ce510032-d920-43f1-b453-ea2f270925f2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:52.089816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-92f89950-ab33-45fd-8094-b5073e72e315 req-ce510032-d920-43f1-b453-ea2f270925f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:52.090307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-92f89950-ab33-45fd-8094-b5073e72e315 req-ce510032-d920-43f1-b453-ea2f270925f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:52.102624 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-92f89950-ab33-45fd-8094-b5073e72e315 req-ce510032-d920-43f1-b453-ea2f270925f2 service nova] Creating event network-vif-deleted:1588bd6a-77ba-42a1-9666-747b7f277c9c for instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 on n-h1-855650-5 Nov 02 13:13:52.109538 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-92f89950-ab33-45fd-8094-b5073e72e315 req-ce510032-d920-43f1-b453-ea2f270925f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035574 Nov 02 13:13:52.110219 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3706/7048] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:52.423042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:52.423794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:52.431145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:52.431653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:52.432110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:52.432828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:52.433298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:52.433747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:52.468458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:52.468972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:52.469424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:52.469902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lazy-loading 'fault' on Instance uuid 13c4eb32-6a7b-4370-ace7-4eecca30c927 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:13:52.518140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6806f93b59f48dbb9aebaaea66901c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ccc9a26d2d40a988573a671e9afa55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:52.526532 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9cdca3af-2ec9-4800-96d1-d97363a3fb8f tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 200 len: 1305 microversion: 2.1 time: 0.108630 Nov 02 13:13:52.527127 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3707/7049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:52 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:53.550685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:53.551578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] [instance: 13c4eb32-6a7b-4370-ace7-4eecca30c927] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:53.559094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:53.559631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:53.560097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:53.560829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:53.561324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:53.561776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:53.576797 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] HTTP exception thrown: Instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 could not be found. Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Request method failure captured: Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 HTTP/1.1 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmz_hK91ljF6Yx2Q2c3huYQc3oqzOdT6PT_W9LjQWwbFPLyjdK9L0mgslpI3UxUlZ4IYc_n-FqdeO1RIuT3oDGf8sM69HauUEHpiszne17TEhj7gpttnxw03nGIPWp6bxxarm2prJ9ZJAoAQDmL-h66PtW4wYgQjefNsiA479eotpjg Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: b3ccc9a26d2d40a988573a671e9afa55 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-1720511597 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3ccc9a26d2d40a988573a671e9afa55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b3ccc9a26d2d40a988573a671e9afa55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3ccc9a26d2d40a988573a671e9afa55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b3ccc9a26d2d40a988573a671e9afa55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-1720511597 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: b3ccc9a26d2d40a988573a671e9afa55 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-1720511597 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-1720511597-project Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a6806f93b59f48dbb9aebaaea66901c0 Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-1720511597-project Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 could not be found. Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '13c4eb32-6a7b-4370-ace7-4eecca30c927'} Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 could not be found. Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 could not be found. Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:53.578667 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 could not be found. Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] Returning 404 to user: Instance 13c4eb32-6a7b-4370-ace7-4eecca30c927 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a8c38760-c528-4e06-bffa-5f2013917314 tempest-VolumesNegativeTest-1720511597 tempest-VolumesNegativeTest-1720511597-project] 10.222.0.45 "GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927" status: 404 len: 111 microversion: 2.1 time: 0.033570 Nov 02 13:13:53.583995 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3708/7050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:53 2022] GET /compute/v2.1/servers/13c4eb32-6a7b-4370-ace7-4eecca30c927 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:14:20.710775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:20.712197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:20.714997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:20.715757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:20.721833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:20.722429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:20.723653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:20.724386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:20.724858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:20.725477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:20.756592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:14:20.860198 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a0d13940-7221-4c4c-a9b4-ea69450ab010 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "DELETE /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 204 len: 0 microversion: 2.1 time: 0.155315 Nov 02 13:14:20.860899 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3709/7051] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:14:20 2022] DELETE /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:14:20.871054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ca2d06f7-3ac7-4419-b57e-1eff436a64d3 req-34e06bc7-7840-4475-93c8-bcd93547928e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74263068-31cb-4e54-abef-1564358e11b7", "tag": "b55196c2-ebd3-4e8f-b067-58504d8a29b1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:20.883391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ca2d06f7-3ac7-4419-b57e-1eff436a64d3 req-34e06bc7-7840-4475-93c8-bcd93547928e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:20.883903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ca2d06f7-3ac7-4419-b57e-1eff436a64d3 req-34e06bc7-7840-4475-93c8-bcd93547928e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:20.884360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ca2d06f7-3ac7-4419-b57e-1eff436a64d3 req-34e06bc7-7840-4475-93c8-bcd93547928e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:20.906739 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ca2d06f7-3ac7-4419-b57e-1eff436a64d3 req-34e06bc7-7840-4475-93c8-bcd93547928e service nova] Creating event network-changed:b55196c2-ebd3-4e8f-b067-58504d8a29b1 for instance 74263068-31cb-4e54-abef-1564358e11b7 on n-h2-855650-5 Nov 02 13:14:20.915627 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ca2d06f7-3ac7-4419-b57e-1eff436a64d3 req-34e06bc7-7840-4475-93c8-bcd93547928e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052354 Nov 02 13:14:20.916161 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3710/7052] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:20.926829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:20.928169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:20.937237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:20.937896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:20.938563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:20.939899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:20.940422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:20.941223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.099208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:21.107630 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-41101029-4fd7-4c45-9618-f26372d3f6bb tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1582 microversion: 2.1 time: 0.189621 Nov 02 13:14:21.108303 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3711/7053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:20 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1582 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:22.135383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:22.136030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:22.142229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:22.142969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:22.143578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:22.144295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:22.145391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:22.145836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:22.295417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:22.304848 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-28c3f607-0e1a-4ef4-801b-dc747c459b37 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1582 microversion: 2.1 time: 0.175930 Nov 02 13:14:22.305468 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3712/7054] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:22 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1582 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:23.330414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:23.331745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:23.340454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.341174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.342617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.343504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.344012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.344475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.422457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:23.432336 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2edbe9d1-be82-40a3-b512-0e7cea98eea6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1397 microversion: 2.1 time: 0.106960 Nov 02 13:14:23.432941 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3713/7055] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:23 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1397 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:23.439547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6e6d6841-fdcb-4df3-950a-cfa0103cbbe3 req-d4754691-3a0e-4cc0-a7de-8e5700c6e262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74263068-31cb-4e54-abef-1564358e11b7", "name": "network-vif-deleted", "tag": "b55196c2-ebd3-4e8f-b067-58504d8a29b1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:23.452777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e6d6841-fdcb-4df3-950a-cfa0103cbbe3 req-d4754691-3a0e-4cc0-a7de-8e5700c6e262 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.453291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e6d6841-fdcb-4df3-950a-cfa0103cbbe3 req-d4754691-3a0e-4cc0-a7de-8e5700c6e262 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.453749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6e6d6841-fdcb-4df3-950a-cfa0103cbbe3 req-d4754691-3a0e-4cc0-a7de-8e5700c6e262 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.469475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6e6d6841-fdcb-4df3-950a-cfa0103cbbe3 req-d4754691-3a0e-4cc0-a7de-8e5700c6e262 service nova] Creating event network-vif-deleted:b55196c2-ebd3-4e8f-b067-58504d8a29b1 for instance 74263068-31cb-4e54-abef-1564358e11b7 on n-h2-855650-5 Nov 02 13:14:23.476210 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6e6d6841-fdcb-4df3-950a-cfa0103cbbe3 req-d4754691-3a0e-4cc0-a7de-8e5700c6e262 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041089 Nov 02 13:14:23.476826 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3714/7056] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:24.464112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:24.465829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:24.474571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:24.475355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:24.475980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:24.476877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:24.482441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:24.488857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:24.568968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:24.577549 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4075fad7-ca58-4b64-ad3e-897f28610913 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1229 microversion: 2.1 time: 0.124694 Nov 02 13:14:24.593379 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3715/7057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:24 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1229 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:25.601796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:25.602569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:25.609715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.610275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.610814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.611556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.612074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.612475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.691515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:25.700021 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc5e4487-a815-40fa-9928-39f1b17c30e6 tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1229 microversion: 2.1 time: 0.102634 Nov 02 13:14:25.700948 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3716/7058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:25 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:26.723238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:26.724116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:26.731842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.732487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.733026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.733847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.734471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.734994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.813467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:26.823179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c8f934e-30e1-477f-ace9-9d306f057ecf tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1229 microversion: 2.1 time: 0.103923 Nov 02 13:14:26.823870 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3717/7059] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:26 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:27.848753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:27.850108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:27.857443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.857956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.858471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:27.859187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.859661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.860100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:27.895924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.896432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.896940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:27.897581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lazy-loading 'fault' on Instance uuid 74263068-31cb-4e54-abef-1564358e11b7 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:27.942879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f29991421e94e75be7fffe371d4bc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd9cbd41bfe453bad4eeb7a049f961a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:27.951188 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1783ce22-8262-41da-be86-9f8f0133307f tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 200 len: 1234 microversion: 2.1 time: 0.107404 Nov 02 13:14:27.951842 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3718/7060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:27 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 1234 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:28.975657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:28.976298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] [instance: 74263068-31cb-4e54-abef-1564358e11b7] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:28.983394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.983963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.984423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.985136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.985599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.986063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.000077 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] HTTP exception thrown: Instance 74263068-31cb-4e54-abef-1564358e11b7 could not be found. Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Request method failure captured: Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 HTTP/1.1 Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYmxgAVYqM1T5Vy_Qkj06h5XD_d9veiUbJNgLxwy56z6oJmxzY1XH7FeyJK4mcrVGTw5Okx0zxo2Ge8RLxsNV7A04NzwXjxd6GYoj1CPxdp_hvJcdtJKfVhxik4jGuhHxhRy1YfONPYP3iIuI8BMwVLuyWU8JA65zhksEF51uVqLHU2k Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 6bd9cbd41bfe453bad4eeb7a049f961a Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBackupRestore-1403797440 Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6bd9cbd41bfe453bad4eeb7a049f961a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6bd9cbd41bfe453bad4eeb7a049f961a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6bd9cbd41bfe453bad4eeb7a049f961a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6bd9cbd41bfe453bad4eeb7a049f961a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBackupRestore-1403797440 Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 6bd9cbd41bfe453bad4eeb7a049f961a Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1403797440 Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestVolumeBackupRestore-1403797440-project Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6f29991421e94e75be7fffe371d4bc73 Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBackupRestore-1403797440-project Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 74263068-31cb-4e54-abef-1564358e11b7 could not be found. Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '74263068-31cb-4e54-abef-1564358e11b7'} Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74263068-31cb-4e54-abef-1564358e11b7 could not be found. Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74263068-31cb-4e54-abef-1564358e11b7 could not be found. Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:29.001779 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74263068-31cb-4e54-abef-1564358e11b7 could not be found. Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Returning 404 to user: Instance 74263068-31cb-4e54-abef-1564358e11b7 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:29.006264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8af720fc-61e7-4156-83fc-93e835f65b2b tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7" status: 404 len: 111 microversion: 2.1 time: 0.032376 Nov 02 13:14:29.007396 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3719/7061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:28 2022] GET /compute/v2.1/servers/74263068-31cb-4e54-abef-1564358e11b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:14:29.174181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ff81355-27d6-4be6-a087-71073437f0cd tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] Calling method '.version_select at 0x7f228da65820>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.197357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ff81355-27d6-4be6-a087-71073437f0cd tempest-TestVolumeBackupRestore-1403797440 tempest-TestVolumeBackupRestore-1403797440-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-849783172" status: 202 len: 0 microversion: 2.1 time: 0.028543 Nov 02 13:14:29.200271 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3720/7062] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Nov 2 13:14:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-849783172 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:14:44.495239 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:14:44.495809 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:14:44.499508 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:14:44.499624 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:14:56.828472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:56.829227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:56.833736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-43866057", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "713ef480-0276-4514-8741-3b1455eb71dc"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:56.894519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] validate_networks() for [('713ef480-0276-4514-8741-3b1455eb71dc', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:57.247874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:14:57.248317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:14:57.248837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:14:57.249278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:14:57.249696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:14:57.258903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.259312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.259768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.260511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.260986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.261425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.278177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Getting quotas for project 3102aac8df4d4ba6bdd10cdb6320f456. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:57.283510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Getting quotas for user 87fe230d09354a15a769c2222fbda81e and project 3102aac8df4d4ba6bdd10cdb6320f456. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:57.296398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:14:57.298854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:14:57.346127 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b81c990d-d3a3-4826-bc69-4ab4cb01879d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519619 Nov 02 13:14:57.347329 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3721/7063] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:14:57.358799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90439cbc-e424-4545-bb1d-e5ae4224f8a5 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.359488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90439cbc-e424-4545-bb1d-e5ae4224f8a5 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:57.414700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-90439cbc-e424-4545-bb1d-e5ae4224f8a5 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:57.422856 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90439cbc-e424-4545-bb1d-e5ae4224f8a5 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1217 microversion: 2.1 time: 0.068092 Nov 02 13:14:57.423618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3722/7064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:58.446906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:58.447534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:58.454382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:58.454878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:58.455332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:58.456544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:58.457009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:58.457446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:58.522936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.531404 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f3833df-f618-4b5e-a951-86be45e2724f tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1269 microversion: 2.1 time: 0.088494 Nov 02 13:14:58.532013 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3723/7065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:58 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:59.556511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:59.557236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:59.565164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.565669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.566151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.566873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.567337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.567931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.715090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:59.723704 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6dbc816e-90e9-498f-927d-1469d2c3cdb8 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1317 microversion: 2.1 time: 0.171496 Nov 02 13:14:59.724299 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3724/7066] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:59 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:00.338491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d2901b88-f90e-4505-a20d-5b13584318a1 req-6ce56634-a89e-4928-a137-4c72e48d1e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47318ad2-2f39-46ae-918a-0bbc2b9a925a", "tag": "e92bc907-c839-409b-a739-5eb4235fb85d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:00.352117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2901b88-f90e-4505-a20d-5b13584318a1 req-6ce56634-a89e-4928-a137-4c72e48d1e1a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.352992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2901b88-f90e-4505-a20d-5b13584318a1 req-6ce56634-a89e-4928-a137-4c72e48d1e1a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.354305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d2901b88-f90e-4505-a20d-5b13584318a1 req-6ce56634-a89e-4928-a137-4c72e48d1e1a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.367428 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d2901b88-f90e-4505-a20d-5b13584318a1 req-6ce56634-a89e-4928-a137-4c72e48d1e1a service nova] Creating event network-changed:e92bc907-c839-409b-a739-5eb4235fb85d for instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a on n-h2-855650-5 Nov 02 13:15:00.372633 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d2901b88-f90e-4505-a20d-5b13584318a1 req-6ce56634-a89e-4928-a137-4c72e48d1e1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039200 Nov 02 13:15:00.374038 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3725/7067] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:15:00.748117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:00.748938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:00.756451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.756958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.757415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.758170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.758650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.759093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.900818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:00.908767 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab90c35a-d324-420c-81ea-181d98123617 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1317 microversion: 2.1 time: 0.164891 Nov 02 13:15:00.909359 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3726/7068] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:00 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:01.932278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:01.932895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:01.939522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:01.940045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:01.940504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:01.941213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:01.941687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:01.942227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.244739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:02.253371 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e869f3e-b892-417c-aa43-a227a30fdae0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1317 microversion: 2.1 time: 0.324911 Nov 02 13:15:02.253941 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3727/7069] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:01 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:03.277320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:03.278145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:03.285250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.285776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.286976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.287783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.288186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.288635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.434011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.442703 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-57883559-a489-4a59-bf7d-046c8d5af274 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1317 microversion: 2.1 time: 0.170120 Nov 02 13:15:03.443284 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3728/7070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:03 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:04.466642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:04.467307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:04.475947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.476467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.477095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.478661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.479153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.479590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.618947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:04.626729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2be39a9d-f414-4c55-97cd-074326e12506 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1317 microversion: 2.1 time: 0.164646 Nov 02 13:15:04.627810 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3729/7071] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:04 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:05.651499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:05.652201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:05.659002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:05.659507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:05.659963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:05.661360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:05.661840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:05.662324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:05.798281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:05.806427 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55065fd1-431a-4b37-9194-2291bbde7db4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1317 microversion: 2.1 time: 0.159331 Nov 02 13:15:05.807141 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3730/7072] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:05 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:06.477997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a82c29ef-bad8-4f29-8905-993a25d493a2 req-804497a6-7eda-4e11-bdbe-8b8224f8e86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47318ad2-2f39-46ae-918a-0bbc2b9a925a", "name": "network-vif-plugged", "status": "completed", "tag": "e92bc907-c839-409b-a739-5eb4235fb85d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:06.490312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a82c29ef-bad8-4f29-8905-993a25d493a2 req-804497a6-7eda-4e11-bdbe-8b8224f8e86e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.490830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a82c29ef-bad8-4f29-8905-993a25d493a2 req-804497a6-7eda-4e11-bdbe-8b8224f8e86e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.491287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a82c29ef-bad8-4f29-8905-993a25d493a2 req-804497a6-7eda-4e11-bdbe-8b8224f8e86e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.503178 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a82c29ef-bad8-4f29-8905-993a25d493a2 req-804497a6-7eda-4e11-bdbe-8b8224f8e86e service nova] Creating event network-vif-plugged:e92bc907-c839-409b-a739-5eb4235fb85d for instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a on n-h2-855650-5 Nov 02 13:15:06.509032 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a82c29ef-bad8-4f29-8905-993a25d493a2 req-804497a6-7eda-4e11-bdbe-8b8224f8e86e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034788 Nov 02 13:15:06.509816 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3731/7073] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:15:06.830912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:06.831679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:06.838314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.838843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.839278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.839993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.840465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.840906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.976889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.984794 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2a24a094-008e-4a4e-a50b-5810b1f75376 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1317 microversion: 2.1 time: 0.159145 Nov 02 13:15:06.985356 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3732/7074] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:06 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:08.009732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:08.010406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:08.012458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:08.013214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:08.020767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.021276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.021733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.022562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.023037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.023483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.166793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.174589 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5111fefe-5cc1-437f-9511-eff96dcd58f0 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1317 microversion: 2.1 time: 0.168936 Nov 02 13:15:08.175180 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3733/7075] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:08 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:09.200817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.201456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:09.209537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.210068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.210578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.211420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.211961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.212428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.353558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.361483 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bdfd7252-92c1-48cc-bcce-455a454b0ccd tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1505 microversion: 2.1 time: 0.164689 Nov 02 13:15:09.362137 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3734/7076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:24.629666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e629f762-545a-4a7c-86c7-7748f0bcd2e0", "device": "/dev/sdb"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:24.632302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.635499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:24.636299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=66 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:24.642483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.642993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.643455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.644175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.644723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.645170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.911447 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5fc70bb-f5d2-4df1-80e4-e9bc8fbb144d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "POST /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284882 Nov 02 13:15:24.912073 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3735/7077] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:15:24 2022] POST /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:15:48.749912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:48.750898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:48.755578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:48.756171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:48.763533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.764008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.764459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.765165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.765628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.766088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.854470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lazy-loading 'services' on Instance uuid 47318ad2-2f39-46ae-918a-0bbc2b9a925a {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:48.930516 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-50c807df-226d-49f7-9acf-577ad683fa8b tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a/os-volume_attachments/e629f762-545a-4a7c-86c7-7748f0bcd2e0" status: 202 len: 0 microversion: 2.1 time: 0.182196 Nov 02 13:15:48.931406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3736/7078] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:15:48 2022] DELETE /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a/os-volume_attachments/e629f762-545a-4a7c-86c7-7748f0bcd2e0 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:15:54.323589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:54.324311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:54.332303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.332832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.333306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.334101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.334592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.335055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.363889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:15:54.449580 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67f2ffbf-5f12-4765-b7c9-73e38cf5b6a2 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 204 len: 0 microversion: 2.1 time: 0.130857 Nov 02 13:15:54.450524 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3737/7079] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:15:54 2022] DELETE /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:54.459459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:54.460171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:54.466411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.466821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.467273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.467982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.468446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.468891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.611781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:54.621333 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65e4c66d-e43a-45fb-a995-6eb71e2270ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1511 microversion: 2.1 time: 0.166028 Nov 02 13:15:54.621955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3738/7080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:54 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:55.645101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:55.645769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:55.652546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.653044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.653489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.654245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.654712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.655144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.790401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.799164 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfd7c906-0697-4492-9a85-b22072d931c4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1511 microversion: 2.1 time: 0.158057 Nov 02 13:15:55.799797 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3739/7081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:55 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:56.824467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:56.825089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:56.832229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.832735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.833189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.833915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.834408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.835462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.910051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.921321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-025518cb-233c-4fcf-94ae-a1822cde0b73 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 200 len: 1469 microversion: 2.1 time: 0.100475 Nov 02 13:15:56.922831 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3740/7082] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:56 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 1469 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:56.944083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7aaf71aa-8310-43f9-80f4-35d48acb2110 req-850315a7-742b-454f-8cd5-b3fb01ab5d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47318ad2-2f39-46ae-918a-0bbc2b9a925a", "name": "network-vif-deleted", "tag": "e92bc907-c839-409b-a739-5eb4235fb85d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:56.954207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7aaf71aa-8310-43f9-80f4-35d48acb2110 req-850315a7-742b-454f-8cd5-b3fb01ab5d9b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.954708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7aaf71aa-8310-43f9-80f4-35d48acb2110 req-850315a7-742b-454f-8cd5-b3fb01ab5d9b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.955209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7aaf71aa-8310-43f9-80f4-35d48acb2110 req-850315a7-742b-454f-8cd5-b3fb01ab5d9b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.966613 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7aaf71aa-8310-43f9-80f4-35d48acb2110 req-850315a7-742b-454f-8cd5-b3fb01ab5d9b service nova] Creating event network-vif-deleted:e92bc907-c839-409b-a739-5eb4235fb85d for instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a on n-h2-855650-5 Nov 02 13:15:56.971849 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7aaf71aa-8310-43f9-80f4-35d48acb2110 req-850315a7-742b-454f-8cd5-b3fb01ab5d9b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033405 Nov 02 13:15:56.973169 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3741/7083] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:57.950714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:57.951601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 47318ad2-2f39-46ae-918a-0bbc2b9a925a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:57.961628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.962465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.963208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:57.964351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.965030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.965678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:57.987792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] HTTP exception thrown: Instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a could not be found. Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Request method failure captured: Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a HTTP/1.1 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm0YND83CeG4hRN2SQMfm0DaGmK_1o9YHe0S1F0v39Olj06I6WGYbPWSR7yYYWsk99ZIG9_DpfKlOQ9svkbOYMRW-VoCgcHyxRiphLSJgdvnKQbpDmIRzUF11-dNZQSrAsY0n2Eek6YPRI_de97tRsJlyDVc1b0BeywEVwdOURUxDsI Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 3102aac8df4d4ba6bdd10cdb6320f456 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotTestJSON-122924794 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3102aac8df4d4ba6bdd10cdb6320f456"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3102aac8df4d4ba6bdd10cdb6320f456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3102aac8df4d4ba6bdd10cdb6320f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3102aac8df4d4ba6bdd10cdb6320f456"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotTestJSON-122924794 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 3102aac8df4d4ba6bdd10cdb6320f456 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-122924794 Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotTestJSON-122924794-project Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 87fe230d09354a15a769c2222fbda81e Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotTestJSON-122924794-project Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a could not be found. Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '47318ad2-2f39-46ae-918a-0bbc2b9a925a'} Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a could not be found. Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a could not be found. Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:57.990190 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a could not be found. Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Returning 404 to user: Instance 47318ad2-2f39-46ae-918a-0bbc2b9a925a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9122c96-3c07-4d60-9d3f-fc212143863a tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a" status: 404 len: 111 microversion: 2.1 time: 0.046961 Nov 02 13:15:57.997903 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3742/7084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:57 2022] GET /compute/v2.1/servers/47318ad2-2f39-46ae-918a-0bbc2b9a925a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:16:04.788898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1899440246", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "713ef480-0276-4514-8741-3b1455eb71dc"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:04.845526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] validate_networks() for [('713ef480-0276-4514-8741-3b1455eb71dc', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:05.202592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:16:05.203047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:16:05.203596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:16:05.204029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:16:05.204459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:16:05.213441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:05.213948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:05.214452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:05.215212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:05.215693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:05.216144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:05.233833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Getting quotas for project 3102aac8df4d4ba6bdd10cdb6320f456. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:05.239686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Getting quotas for user 87fe230d09354a15a769c2222fbda81e and project 3102aac8df4d4ba6bdd10cdb6320f456. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:05.252870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:16:05.255371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:16:05.303384 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7a6a45d7-538b-4729-9434-f7216924fa84 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518271 Nov 02 13:16:05.304052 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3743/7085] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:16:05.315158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d51b6c64-8899-4779-9915-fe19ad262aa5 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:05.315805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d51b6c64-8899-4779-9915-fe19ad262aa5 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:05.373357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d51b6c64-8899-4779-9915-fe19ad262aa5 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:05.380944 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d51b6c64-8899-4779-9915-fe19ad262aa5 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1219 microversion: 2.1 time: 0.069642 Nov 02 13:16:05.381629 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3744/7086] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:05 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:06.405268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:06.406038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:06.415285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:06.416117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:06.416803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:06.417590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:06.418180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:06.418635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:06.500718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:06.509083 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9c53320-f083-4c20-b42a-8ab7aee610b4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1279 microversion: 2.1 time: 0.107885 Nov 02 13:16:06.509681 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3745/7087] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:06 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:07.533056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:07.535062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:07.542334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:07.542841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:07.543308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:07.544042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:07.544555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:07.545004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:07.682607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:07.690645 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-13fbc485-cee2-4de9-9fd7-b5e92f2b56ed tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1319 microversion: 2.1 time: 0.161707 Nov 02 13:16:07.691297 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3746/7088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:07 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:07.773155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2df7bab5-f066-42f9-b53d-4e7ce46cb8c8 req-9eaaaa22-d733-447a-b8d2-90dd300740e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1507a679-9f2b-4fa2-9827-e7bd478e2e02", "tag": "0b90de0e-5fb0-4d4f-9955-0e7857820d5e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:07.784703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2df7bab5-f066-42f9-b53d-4e7ce46cb8c8 req-9eaaaa22-d733-447a-b8d2-90dd300740e5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:07.785501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2df7bab5-f066-42f9-b53d-4e7ce46cb8c8 req-9eaaaa22-d733-447a-b8d2-90dd300740e5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:07.786248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2df7bab5-f066-42f9-b53d-4e7ce46cb8c8 req-9eaaaa22-d733-447a-b8d2-90dd300740e5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:07.797841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2df7bab5-f066-42f9-b53d-4e7ce46cb8c8 req-9eaaaa22-d733-447a-b8d2-90dd300740e5 service nova] Creating event network-changed:0b90de0e-5fb0-4d4f-9955-0e7857820d5e for instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 on n-h2-855650-5 Nov 02 13:16:07.803281 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2df7bab5-f066-42f9-b53d-4e7ce46cb8c8 req-9eaaaa22-d733-447a-b8d2-90dd300740e5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034318 Nov 02 13:16:07.804089 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3747/7089] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:08.716465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:08.717089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:08.724003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:08.724521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:08.724981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:08.725699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:08.726222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:08.726671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:08.860075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:08.868581 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6591026-9a8a-4c92-a1aa-f3a36cb217d4 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1319 microversion: 2.1 time: 0.157403 Nov 02 13:16:08.869165 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3748/7090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:08 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:09.891279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:09.891947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:09.899523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:09.900276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:09.900875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:09.901761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:09.902374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:09.902827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.038837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:10.047061 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-10b28a48-9e42-46e1-b3a5-9fd677b6982e tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1319 microversion: 2.1 time: 0.159832 Nov 02 13:16:10.047648 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3749/7091] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:09 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:11.071300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:11.071974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:11.078894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.079507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.079976 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.080703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.081719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.082230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.217723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:11.225648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7e584ed0-234e-438c-b76b-6ab08611e255 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1319 microversion: 2.1 time: 0.158360 Nov 02 13:16:11.226343 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3750/7092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:11 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:12.250851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:12.251831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:12.259348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.259856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.260320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.261036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.261507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.262078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.416915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.426068 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-daff42df-a09e-4d80-ad07-f6c8a065b3a3 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1319 microversion: 2.1 time: 0.179720 Nov 02 13:16:12.426480 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3751/7093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:12 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:12.741245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-10400336-a2ac-44b0-8c96-9f12a4dec1ec req-473bde3d-0610-4d3d-9200-589db11a0dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1507a679-9f2b-4fa2-9827-e7bd478e2e02", "name": "network-vif-plugged", "status": "completed", "tag": "0b90de0e-5fb0-4d4f-9955-0e7857820d5e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:12.751045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-10400336-a2ac-44b0-8c96-9f12a4dec1ec req-473bde3d-0610-4d3d-9200-589db11a0dab service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.751550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-10400336-a2ac-44b0-8c96-9f12a4dec1ec req-473bde3d-0610-4d3d-9200-589db11a0dab service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.752005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-10400336-a2ac-44b0-8c96-9f12a4dec1ec req-473bde3d-0610-4d3d-9200-589db11a0dab service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.764252 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-10400336-a2ac-44b0-8c96-9f12a4dec1ec req-473bde3d-0610-4d3d-9200-589db11a0dab service nova] Creating event network-vif-plugged:0b90de0e-5fb0-4d4f-9955-0e7857820d5e for instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 on n-h2-855650-5 Nov 02 13:16:12.769776 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-10400336-a2ac-44b0-8c96-9f12a4dec1ec req-473bde3d-0610-4d3d-9200-589db11a0dab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Nov 02 13:16:12.770519 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3752/7094] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:13.452592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:13.453306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:13.460270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.460769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.461217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.461918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.462502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.462846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.598599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.606724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-51b5b9d2-3919-4d9d-8096-3215cffa0a01 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1319 microversion: 2.1 time: 0.160290 Nov 02 13:16:13.607341 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3753/7095] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:13 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:14.630974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:14.631620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:14.638482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.638990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.639460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.640179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.640661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.641105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.660494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:14.778725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:14.787404 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77fb6868-8309-4d68-8bf7-388e3c279b9d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1507 microversion: 2.1 time: 0.160370 Nov 02 13:16:14.787996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3754/7096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:14 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:14.811508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d11ea34-cb28-4f67-8c22-8bf18329d7c4", "device": "/dev/sdb"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:14.814291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:14.820590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.821095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.821559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.822319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.822798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.823244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.090273 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19a7486c-a1e6-40ee-bf3a-befccc954d07 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "POST /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282938 Nov 02 13:16:15.090921 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3755/7097] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:16:14 2022] POST /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:36.696012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:36.696681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:36.699247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:36.699992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:36.701063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:36.702065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:36.711923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.712438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.712903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.713636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.714144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.714593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.800162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lazy-loading 'services' on Instance uuid 1507a679-9f2b-4fa2-9827-e7bd478e2e02 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:16:36.874077 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fdf777a-e86f-4d50-84a7-d8f5ebe6f5ba tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02/os-volume_attachments/2d11ea34-cb28-4f67-8c22-8bf18329d7c4" status: 202 len: 0 microversion: 2.1 time: 0.182090 Nov 02 13:16:36.874880 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3756/7098] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:16:36 2022] DELETE /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02/os-volume_attachments/2d11ea34-cb28-4f67-8c22-8bf18329d7c4 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:16:42.244351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:42.245017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:42.252902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.253410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.253878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.254650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.255166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.255602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.281791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:16:42.366506 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-32ca10a7-618b-43a3-bb22-559cda137edb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 204 len: 0 microversion: 2.1 time: 0.125926 Nov 02 13:16:42.367237 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3757/7099] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:16:42 2022] DELETE /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:16:42.376261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:42.377142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:42.384099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.384599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.385050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.385759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.386247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.386713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.523029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.531123 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-29d7c70b-af37-431b-a754-da326b382353 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1513 microversion: 2.1 time: 0.159079 Nov 02 13:16:42.531679 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3758/7100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:42 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:43.555401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.556508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:43.564412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.564972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.565423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.566190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.566711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.567186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.708123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:43.716196 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-626b13fc-0cae-4808-8575-cf6309acb256 tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1513 microversion: 2.1 time: 0.165292 Nov 02 13:16:43.716788 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3759/7101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:43 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:44.740432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:44.741073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:44.748203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.748724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.749191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.749985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.750478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.750974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.823922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87fe230d09354a15a769c2222fbda81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102aac8df4d4ba6bdd10cdb6320f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:44.833075 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bbf89dca-5fb6-4e23-b1aa-7fdb4dbd0b2d tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 200 len: 1471 microversion: 2.1 time: 0.096683 Nov 02 13:16:44.833950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3760/7102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:44 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:45.061202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e0abec83-9d42-4cf6-bff4-9cfea676bc08 req-4ab1cbb3-5822-46de-afa5-91ce1a1d9f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1507a679-9f2b-4fa2-9827-e7bd478e2e02", "name": "network-vif-deleted", "tag": "0b90de0e-5fb0-4d4f-9955-0e7857820d5e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:45.072213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e0abec83-9d42-4cf6-bff4-9cfea676bc08 req-4ab1cbb3-5822-46de-afa5-91ce1a1d9f86 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.072706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e0abec83-9d42-4cf6-bff4-9cfea676bc08 req-4ab1cbb3-5822-46de-afa5-91ce1a1d9f86 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.073151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e0abec83-9d42-4cf6-bff4-9cfea676bc08 req-4ab1cbb3-5822-46de-afa5-91ce1a1d9f86 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.084532 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e0abec83-9d42-4cf6-bff4-9cfea676bc08 req-4ab1cbb3-5822-46de-afa5-91ce1a1d9f86 service nova] Creating event network-vif-deleted:0b90de0e-5fb0-4d4f-9955-0e7857820d5e for instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 on n-h2-855650-5 Nov 02 13:16:45.090027 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e0abec83-9d42-4cf6-bff4-9cfea676bc08 req-4ab1cbb3-5822-46de-afa5-91ce1a1d9f86 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032600 Nov 02 13:16:45.090917 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3761/7103] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:45.858070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:45.858779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] [instance: 1507a679-9f2b-4fa2-9827-e7bd478e2e02] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:45.866755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.867263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.867726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.868450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.868929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.869370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.883777 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] HTTP exception thrown: Instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 could not be found. Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Request method failure captured: Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 HTTP/1.1 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm0YND83CeG4hRN2SQMfm0DaGmK_1o9YHe0S1F0v39Olj06I6WGYbPWSR7yYYWsk99ZIG9_DpfKlOQ9svkbOYMRW-VoCgcHyxRiphLSJgdvnKQbpDmIRzUF11-dNZQSrAsY0n2Eek6YPRI_de97tRsJlyDVc1b0BeywEVwdOURUxDsI Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 3102aac8df4d4ba6bdd10cdb6320f456 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotTestJSON-122924794 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3102aac8df4d4ba6bdd10cdb6320f456"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3102aac8df4d4ba6bdd10cdb6320f456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3102aac8df4d4ba6bdd10cdb6320f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3102aac8df4d4ba6bdd10cdb6320f456"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotTestJSON-122924794 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 3102aac8df4d4ba6bdd10cdb6320f456 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-122924794 Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotTestJSON-122924794-project Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 87fe230d09354a15a769c2222fbda81e Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotTestJSON-122924794-project Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 could not be found. Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '1507a679-9f2b-4fa2-9827-e7bd478e2e02'} Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 could not be found. Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 could not be found. Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:45.885475 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 could not be found. Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] Returning 404 to user: Instance 1507a679-9f2b-4fa2-9827-e7bd478e2e02 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8c3748c-aceb-453b-81d4-187d47d78dfb tempest-VolumesSnapshotTestJSON-122924794 tempest-VolumesSnapshotTestJSON-122924794-project] 10.222.0.45 "GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02" status: 404 len: 111 microversion: 2.1 time: 0.034381 Nov 02 13:16:45.890545 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3762/7104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:45 2022] GET /compute/v2.1/servers/1507a679-9f2b-4fa2-9827-e7bd478e2e02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:16:48.436247 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:16:48.437443 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:17:53.191247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:53.192044 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:53.369186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1414849352", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:53.559666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] validate_networks() for None {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:17:53.758538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:17:53.758967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:17:53.759487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:17:53.759911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:17:53.760368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:17:53.770339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.770869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.771327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.772074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.772551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.772989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.791129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Getting quotas for project 3a9a5b0150e94aba8a039fcd16939b49. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:17:53.796949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Getting quotas for user 5fae712588ad4fe692856d104a3f0b3f and project 3a9a5b0150e94aba8a039fcd16939b49. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:17:53.810213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:17:53.812652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:17:53.859197 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-12dab2c5-bc96-4842-88a7-7e9c85649ed8 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670701 Nov 02 13:17:53.859861 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3763/7105] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:17:53.875140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ac602193-7732-47f4-b0ec-3c77553a556e tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:53.876416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ac602193-7732-47f4-b0ec-3c77553a556e tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:53.936626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ac602193-7732-47f4-b0ec-3c77553a556e tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:53.944752 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ac602193-7732-47f4-b0ec-3c77553a556e tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1222 microversion: 2.1 time: 0.073567 Nov 02 13:17:53.945648 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3764/7106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:53 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:54.969005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:54.969682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:54.977091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.977606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.978087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.978818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.979291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.979736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.053139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:55.062336 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c64af5e7-0778-450c-a72b-2b17956bc4c2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1274 microversion: 2.1 time: 0.097223 Nov 02 13:17:55.063169 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3765/7107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:54 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:56.087765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:56.088488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:56.097170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.097170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.097588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.098554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.099418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.100022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.243566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:56.251790 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d3b5322-a9d3-4b13-a206-c3077c9f2e20 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1322 microversion: 2.1 time: 0.168199 Nov 02 13:17:56.252337 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3766/7108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:56 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:56.963370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-30313b34-25b1-4773-abeb-d73916fa8787 req-9ac28953-7b04-494d-aefa-39a962255168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971848fe-76b8-4b3a-a4d8-c31fbbd4848c", "tag": "a45d676e-27e7-4588-a4e8-8b8c42fc5fa1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:56.973828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-30313b34-25b1-4773-abeb-d73916fa8787 req-9ac28953-7b04-494d-aefa-39a962255168 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.974369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-30313b34-25b1-4773-abeb-d73916fa8787 req-9ac28953-7b04-494d-aefa-39a962255168 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.974825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-30313b34-25b1-4773-abeb-d73916fa8787 req-9ac28953-7b04-494d-aefa-39a962255168 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.988871 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-30313b34-25b1-4773-abeb-d73916fa8787 req-9ac28953-7b04-494d-aefa-39a962255168 service nova] Creating event network-changed:a45d676e-27e7-4588-a4e8-8b8c42fc5fa1 for instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c on n-h2-855650-5 Nov 02 13:17:56.994157 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-30313b34-25b1-4773-abeb-d73916fa8787 req-9ac28953-7b04-494d-aefa-39a962255168 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111626 Nov 02 13:17:56.994908 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3767/7109] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:17:57.276314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:57.277158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:57.283673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:57.284180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:57.284635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:57.285350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:57.285819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:57.286350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:57.422311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:57.430727 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7356c5c2-0810-4583-9e30-72c003e9b966 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1322 microversion: 2.1 time: 0.159480 Nov 02 13:17:57.431242 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3768/7110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:57 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:58.453403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:58.454102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:58.461590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.462117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.462577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.463286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.463752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.464192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.597835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:58.605929 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e29752a1-c20b-428c-9157-0f73f062a44c tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1322 microversion: 2.1 time: 0.156491 Nov 02 13:17:58.606559 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3769/7111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:58 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:59.629215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:59.629931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:59.636968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:59.637485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:59.637951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:59.638742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:59.639217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:59.639664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:59.777625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:59.786086 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80866324-e7a9-45d2-b934-6a019172b4a5 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1322 microversion: 2.1 time: 0.161077 Nov 02 13:17:59.786680 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3770/7112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:59 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:00.809149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:00.809803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:00.816865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.817369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.817829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.818583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.819053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.819497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.952358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:00.960522 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0eb010a5-e80b-478c-b931-fcc781e3ec93 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1322 microversion: 2.1 time: 0.155224 Nov 02 13:18:00.961134 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3771/7113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:00 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:01.984862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:01.985530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:01.992985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:01.993497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:01.993983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:01.994718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:01.995194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:01.995639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:02.139598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:02.147581 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ed2e0d7e-dd2d-4cbb-b309-db1a5ded29f6 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1322 microversion: 2.1 time: 0.166694 Nov 02 13:18:02.148158 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3772/7114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:01 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:03.172030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:03.172814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:03.179982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.180493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.180963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.181686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.182186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.182634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.352227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:03.361671 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c08ec5b5-ea1b-4e19-8820-1bf3fac59140 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1322 microversion: 2.1 time: 0.193137 Nov 02 13:18:03.362828 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3773/7115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:03 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:03.431027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d66db3ad-e37b-458f-80a3-e89d07d936ad req-50dc98b5-407e-4b53-bc83-c114ed4cf1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971848fe-76b8-4b3a-a4d8-c31fbbd4848c", "name": "network-vif-plugged", "status": "completed", "tag": "a45d676e-27e7-4588-a4e8-8b8c42fc5fa1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:03.442616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d66db3ad-e37b-458f-80a3-e89d07d936ad req-50dc98b5-407e-4b53-bc83-c114ed4cf1b7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.443120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d66db3ad-e37b-458f-80a3-e89d07d936ad req-50dc98b5-407e-4b53-bc83-c114ed4cf1b7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.443572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d66db3ad-e37b-458f-80a3-e89d07d936ad req-50dc98b5-407e-4b53-bc83-c114ed4cf1b7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.455881 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d66db3ad-e37b-458f-80a3-e89d07d936ad req-50dc98b5-407e-4b53-bc83-c114ed4cf1b7 service nova] Creating event network-vif-plugged:a45d676e-27e7-4588-a4e8-8b8c42fc5fa1 for instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c on n-h2-855650-5 Nov 02 13:18:03.461554 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d66db3ad-e37b-458f-80a3-e89d07d936ad req-50dc98b5-407e-4b53-bc83-c114ed4cf1b7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092353 Nov 02 13:18:03.462345 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3774/7116] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:04.382120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:04.382960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:04.388174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:04.388905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:04.396205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.396721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.397181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.397899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.398406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.398858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.506798 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:18:04.507407 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:18:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:18:04.509631 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:18:04.509926 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:18:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:18:04.535039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:04.542873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4cde2fce-9bdf-4ecd-8b4a-94abe8830129 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1322 microversion: 2.1 time: 0.161743 Nov 02 13:18:04.543592 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3775/7117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:04 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:05.567574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:05.568253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:05.574804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:05.575309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:05.575765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:05.576472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:05.576946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:05.577388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:05.713268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:05.721945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f12329c7-0c42-4135-9067-ecd67f1bea02 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1471 microversion: 2.1 time: 0.158886 Nov 02 13:18:05.722557 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3776/7118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:05 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:05.794199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-277f7673-4f6f-42b9-b04f-e6c3f1f2c023 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Calling method '.version_select at 0x7f2292ab8ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:05.858892 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-277f7673-4f6f-42b9-b04f-e6c3f1f2c023 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/22191c4e1cb6468bbe9e276845a87a17" status: 200 len: 371 microversion: 2.1 time: 0.115588 Nov 02 13:18:05.859483 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3777/7119] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 13:18:05 2022] GET /compute/v2.1/os-quota-sets/22191c4e1cb6468bbe9e276845a87a17 => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:05.871994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9752525-ac54-46ab-84f8-20564ddbbc8d tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1265803181", "id": 1633524653, "os-flavor-access:is_public": "True"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:05.893621 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9752525-ac54-46ab-84f8-20564ddbbc8d tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.025325 Nov 02 13:18:05.894441 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3778/7120] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:18:05 2022] POST /compute/v2.1/flavors => generated 438 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:05.906840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1633524653"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:05.909767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:05.916027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:05.916470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:05.916926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:05.917644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:05.918148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:05.918598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.004957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e7cf99917a5341e79e50a44d520af470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22191c4e1cb6468bbe9e276845a87a17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.011275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1265803181 {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:18:06.019033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.019529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.020007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.020756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.021307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.021752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.043175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Getting quotas for project 3a9a5b0150e94aba8a039fcd16939b49. Resources: {'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:06.048331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Getting quotas for user 5fae712588ad4fe692856d104a3f0b3f and project 3a9a5b0150e94aba8a039fcd16939b49. Resources: {'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:06.060586 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.compute.api [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] ram quota exceeded for 22191c4e1cb6468bbe9e276845a87a17, tried to resize instance. Nov 02 13:18:06.061155 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Request method failure captured: Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c/action HTTP/1.1 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 39 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm4BoCtRS0YoY3UA9Ja98SwGRXjJOw_9aTiKanxvW1gFk1xz6SYkPryy7ulj5BOS307tXD1lSbcfI1zv5LpLAeYe220xuTNlgiv6Tg9ns4EcyWb-oYBI9vy9AmbGDqoTepjkX6XxfZhpw7ylYqcL6JYhvXOmA-3VZwzfue89LAv43JY Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 22191c4e1cb6468bbe9e276845a87a17 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-980317949 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22191c4e1cb6468bbe9e276845a87a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22191c4e1cb6468bbe9e276845a87a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22191c4e1cb6468bbe9e276845a87a17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22191c4e1cb6468bbe9e276845a87a17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdminNegativeTestJSON-980317949 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 22191c4e1cb6468bbe9e276845a87a17 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-980317949 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdminNegativeTestJSON-980317949-project-admin Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e7cf99917a5341e79e50a44d520af470 Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdminNegativeTestJSON-980317949-project-admin Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: {"resize": {"flavorRef": "1633524653"}} Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '971848fe-76b8-4b3a-a4d8-c31fbbd4848c', 'body': {'resize': {'flavorRef': '1633524653'}}} Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:18:06.065698 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3931d367-c662-416c-b5bd-018226c8558a tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c/action" status: 403 len: 118 microversion: 2.1 time: 0.164083 Nov 02 13:18:06.070463 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3779/7121] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:18:05 2022] POST /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c/action => generated 118 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:18:06.076112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94c96ed2-daf3-4e72-9690-0745850d5180 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.094249 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94c96ed2-daf3-4e72-9690-0745850d5180 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1633524653" status: 202 len: 0 microversion: 2.1 time: 0.021687 Nov 02 13:18:06.094837 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3780/7122] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 13:18:06 2022] DELETE /compute/v2.1/flavors/1633524653 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:18:06.102605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-243b8b86-4955-4151-a080-d17ddd34824d tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.126075 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-243b8b86-4955-4151-a080-d17ddd34824d tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026846 Nov 02 13:18:06.127188 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3781/7123] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:06.148200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40f0c010-f894-42b9-a677-3377f4deea42 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Calling method '.version_select at 0x7f228ebb1430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.212891 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40f0c010-f894-42b9-a677-3377f4deea42 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/22191c4e1cb6468bbe9e276845a87a17" status: 200 len: 371 microversion: 2.1 time: 0.068150 Nov 02 13:18:06.213481 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3782/7124] 10.222.0.45 () {58 vars in 1242 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/os-quota-sets/22191c4e1cb6468bbe9e276845a87a17 => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:06.225617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34c2bc64-8af6-44bb-9f89-1850a2a465a0 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-90816957", "id": 1636158219, "os-flavor-access:is_public": "True"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:06.244431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34c2bc64-8af6-44bb-9f89-1850a2a465a0 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022409 Nov 02 13:18:06.245050 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3783/7125] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:18:06 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:06.257400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1636158219"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:06.259768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.266438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.266946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.267404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.268119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.268593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.269037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.300443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e7cf99917a5341e79e50a44d520af470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22191c4e1cb6468bbe9e276845a87a17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.307774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-90816957 {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:18:06.314870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.315372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.315829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.316589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.317059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.317524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.342662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Getting quotas for project 3a9a5b0150e94aba8a039fcd16939b49. Resources: {'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:06.348969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Getting quotas for user 5fae712588ad4fe692856d104a3f0b3f and project 3a9a5b0150e94aba8a039fcd16939b49. Resources: {'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:06.363483 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.compute.api [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] cores quota exceeded for 22191c4e1cb6468bbe9e276845a87a17, tried to resize instance. Nov 02 13:18:06.364068 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Request method failure captured: Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c/action HTTP/1.1 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 39 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm4BoCtRS0YoY3UA9Ja98SwGRXjJOw_9aTiKanxvW1gFk1xz6SYkPryy7ulj5BOS307tXD1lSbcfI1zv5LpLAeYe220xuTNlgiv6Tg9ns4EcyWb-oYBI9vy9AmbGDqoTepjkX6XxfZhpw7ylYqcL6JYhvXOmA-3VZwzfue89LAv43JY Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 22191c4e1cb6468bbe9e276845a87a17 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-980317949 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader,admin Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader,admin Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22191c4e1cb6468bbe9e276845a87a17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/22191c4e1cb6468bbe9e276845a87a17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/22191c4e1cb6468bbe9e276845a87a17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_22191c4e1cb6468bbe9e276845a87a17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdminNegativeTestJSON-980317949 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 22191c4e1cb6468bbe9e276845a87a17 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-980317949 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdminNegativeTestJSON-980317949-project-admin Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: e7cf99917a5341e79e50a44d520af470 Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdminNegativeTestJSON-980317949-project-admin Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: {"resize": {"flavorRef": "1636158219"}} Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '971848fe-76b8-4b3a-a4d8-c31fbbd4848c', 'body': {'resize': {'flavorRef': '1636158219'}}} Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:18:06.366058 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-442609bc-70ba-45c9-81cc-78029ca02c7c tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c/action" status: 403 len: 113 microversion: 2.1 time: 0.113908 Nov 02 13:18:06.370632 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3784/7126] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:18:06 2022] POST /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c/action => generated 113 bytes in 115 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:18:06.376146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98f2487e-bcba-4d3a-8515-6b89840426e3 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.390685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:06.397462 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98f2487e-bcba-4d3a-8515-6b89840426e3 tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1636158219" status: 202 len: 0 microversion: 2.1 time: 0.024814 Nov 02 13:18:06.398220 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3785/7127] 10.222.0.45 () {58 vars in 1161 bytes} [Wed Nov 2 13:18:06 2022] DELETE /compute/v2.1/flavors/1636158219 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:18:06.407905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78208376-8069-4cbe-a68f-99ac3bc575bf tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.438160 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78208376-8069-4cbe-a68f-99ac3bc575bf tempest-ServersAdminNegativeTestJSON-980317949 tempest-ServersAdminNegativeTestJSON-980317949-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034860 Nov 02 13:18:06.438685 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3786/7128] 10.222.0.45 () {58 vars in 1146 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:06.460484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.460994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.467257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.467760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.468216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.468927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.469395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.469842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.497641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:06.512463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:06.578469 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ce0aa73-9352-4057-b642-7ee4f028b1e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "DELETE /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 204 len: 0 microversion: 2.1 time: 0.121548 Nov 02 13:18:06.582697 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3787/7129] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:18:06 2022] DELETE /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:18:06.588201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.588906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.594993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.595554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.596022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.596737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.597213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.597658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.733892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.742179 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5451d3cc-8b36-44e8-a1ba-904fc24335e1 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1477 microversion: 2.1 time: 0.158134 Nov 02 13:18:06.742898 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3788/7130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:07.765812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:07.766590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:07.774292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:07.774819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:07.775282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:07.776015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:07.776495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:07.777032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:07.916100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:07.924461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fc4ea95-aa08-4415-bb64-81f9fac39ee2 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1477 microversion: 2.1 time: 0.162742 Nov 02 13:18:07.925058 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3789/7131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:07 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:08.678217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-77f40ec4-82cf-4682-a8d5-bcb58bb6c7f5 req-624876a4-23ed-4a33-a583-1e67141ef3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971848fe-76b8-4b3a-a4d8-c31fbbd4848c", "name": "network-vif-deleted", "tag": "a45d676e-27e7-4588-a4e8-8b8c42fc5fa1"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:08.691348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-77f40ec4-82cf-4682-a8d5-bcb58bb6c7f5 req-624876a4-23ed-4a33-a583-1e67141ef3f2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.691844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-77f40ec4-82cf-4682-a8d5-bcb58bb6c7f5 req-624876a4-23ed-4a33-a583-1e67141ef3f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.692293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-77f40ec4-82cf-4682-a8d5-bcb58bb6c7f5 req-624876a4-23ed-4a33-a583-1e67141ef3f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.706193 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-77f40ec4-82cf-4682-a8d5-bcb58bb6c7f5 req-624876a4-23ed-4a33-a583-1e67141ef3f2 service nova] Creating event network-vif-deleted:a45d676e-27e7-4588-a4e8-8b8c42fc5fa1 for instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c on n-h2-855650-5 Nov 02 13:18:08.713088 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-77f40ec4-82cf-4682-a8d5-bcb58bb6c7f5 req-624876a4-23ed-4a33-a583-1e67141ef3f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039350 Nov 02 13:18:08.713709 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3790/7132] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:08.948580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:08.949223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:08.957091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.957585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.958072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.958785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.959339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.959797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.995826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.996316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.996764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.997223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lazy-loading 'fault' on Instance uuid 971848fe-76b8-4b3a-a4d8-c31fbbd4848c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:09.039629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fae712588ad4fe692856d104a3f0b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9a5b0150e94aba8a039fcd16939b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:09.047689 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f9357a21-2783-46ed-b582-753873f23650 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 200 len: 1312 microversion: 2.1 time: 0.103492 Nov 02 13:18:09.048372 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3791/7133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:08 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:10.073031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:10.073652 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] [instance: 971848fe-76b8-4b3a-a4d8-c31fbbd4848c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:10.081709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.082239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.082697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.083875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.084264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.084705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.099000 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] HTTP exception thrown: Instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c could not be found. Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Request method failure captured: Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c HTTP/1.1 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm4A60FFN7XZJy-27OuofumiaDUPQNcFmtSakcwUyKzQ3qf8gHDzOiS_0DxAjH4eDjq-3vhoseBdUQ6Qim-tSEgr0XSpxnlttVpeOtoovpDsYejyzaxxBgaQ1Uyi--uVoybjVPGkQXXieidpcm_qQhdUaffYnxCd-JiQ-A1Lv18uD7k Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 3a9a5b0150e94aba8a039fcd16939b49 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1221523918 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a9a5b0150e94aba8a039fcd16939b49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3a9a5b0150e94aba8a039fcd16939b49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3a9a5b0150e94aba8a039fcd16939b49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3a9a5b0150e94aba8a039fcd16939b49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1221523918 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 3a9a5b0150e94aba8a039fcd16939b49 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1221523918 Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersAdminNegativeTestJSON-1221523918-project Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5fae712588ad4fe692856d104a3f0b3f Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1221523918-project Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c could not be found. Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '971848fe-76b8-4b3a-a4d8-c31fbbd4848c'} Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c could not be found. Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c could not be found. Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.100726 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c could not be found. Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] Returning 404 to user: Instance 971848fe-76b8-4b3a-a4d8-c31fbbd4848c could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be5d45f5-d9fa-46ac-9633-b8f75ee0c623 tempest-ServersAdminNegativeTestJSON-1221523918 tempest-ServersAdminNegativeTestJSON-1221523918-project] 10.222.0.45 "GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c" status: 404 len: 111 microversion: 2.1 time: 0.033855 Nov 02 13:18:10.105432 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3792/7134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:10 2022] GET /compute/v2.1/servers/971848fe-76b8-4b3a-a4d8-c31fbbd4848c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:18:16.877394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:16.878241 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:17.000840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-433219732", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "e7c3f844-4dfe-4660-8e8b-a660a6b829ac"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:17.056536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] validate_networks() for [('e7c3f844-4dfe-4660-8e8b-a660a6b829ac', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:18:17.452143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:18:17.452590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:18:17.453101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:18:17.453530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:18:17.453959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:18:17.464450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.464964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.465429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.466219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.466701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.467153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.486469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Getting quotas for project f1bc3b08d8c446eba178c7e41779a3ea. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:17.491924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Getting quotas for user f4af6b99e3194f0ab076dfd88e08bd8b and project f1bc3b08d8c446eba178c7e41779a3ea. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:17.505248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:18:17.507749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:18:17.556256 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-28b10e7e-8a9a-4ef3-8c17-cac4a2ae473c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685137 Nov 02 13:18:17.564142 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3793/7135] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:18:17.570319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-119d7c67-3f44-4d36-bf90-27979b8bcf82 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:17.571215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-119d7c67-3f44-4d36-bf90-27979b8bcf82 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:17.627835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-119d7c67-3f44-4d36-bf90-27979b8bcf82 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:17.636762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-119d7c67-3f44-4d36-bf90-27979b8bcf82 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1214 microversion: 2.1 time: 0.070742 Nov 02 13:18:17.637406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3794/7136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:17 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:18.663621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-807b415b-10ba-4d14-9d27-b90101fa4106 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:18.664672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-807b415b-10ba-4d14-9d27-b90101fa4106 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:18.721681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-807b415b-10ba-4d14-9d27-b90101fa4106 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:18.728911 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-807b415b-10ba-4d14-9d27-b90101fa4106 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1214 microversion: 2.1 time: 0.071491 Nov 02 13:18:18.729499 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3795/7137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:18 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:19.753548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c404f52-bb90-4261-9ae7-572bdbe88c48 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:19.754314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c404f52-bb90-4261-9ae7-572bdbe88c48 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:19.818441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c404f52-bb90-4261-9ae7-572bdbe88c48 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:19.828655 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c404f52-bb90-4261-9ae7-572bdbe88c48 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1214 microversion: 2.1 time: 0.079969 Nov 02 13:18:19.830388 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3796/7138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:19 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:20.855472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83f07a79-3118-47fa-a85e-9817006a4e01 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:20.856341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83f07a79-3118-47fa-a85e-9817006a4e01 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:20.923871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-83f07a79-3118-47fa-a85e-9817006a4e01 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:20.931882 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83f07a79-3118-47fa-a85e-9817006a4e01 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1214 microversion: 2.1 time: 0.080671 Nov 02 13:18:20.932485 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3797/7139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:20 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:21.972410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:21.973141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:21.983735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.984713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.985462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.986454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.987054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.987756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.082612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:22.092837 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67776ce9-fb4f-4bf6-ba36-ec37557bdb7a tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1218 microversion: 2.1 time: 0.125224 Nov 02 13:18:22.093726 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3798/7140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:21 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:23.117031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:23.118066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:23.127748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:23.128268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:23.128733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:23.129473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:23.129953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:23.130444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:23.203167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:23.212227 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a277b27-f1c9-4772-a35f-f84f2ed530ef tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1272 microversion: 2.1 time: 0.099174 Nov 02 13:18:23.212827 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3799/7141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:23 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:24.237542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:24.238246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:24.246712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:24.247229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:24.247685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.248415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:24.248893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:24.249337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.400279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:24.409125 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e311e97-831b-4631-af53-b515ad1a6df9 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1314 microversion: 2.1 time: 0.175543 Nov 02 13:18:24.409835 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3800/7142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:24 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:24.459432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8cd7ad7d-122c-49d8-b418-3f9e20b6e98e req-753fb1c8-2890-488a-b01c-6636d93fe536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1020c30-3895-4d9c-b7c3-85aa6b32d3ec", "tag": "11629391-624f-4be0-95d3-4e55896a916c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:24.470475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8cd7ad7d-122c-49d8-b418-3f9e20b6e98e req-753fb1c8-2890-488a-b01c-6636d93fe536 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:24.472352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8cd7ad7d-122c-49d8-b418-3f9e20b6e98e req-753fb1c8-2890-488a-b01c-6636d93fe536 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:24.472352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8cd7ad7d-122c-49d8-b418-3f9e20b6e98e req-753fb1c8-2890-488a-b01c-6636d93fe536 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.487918 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8cd7ad7d-122c-49d8-b418-3f9e20b6e98e req-753fb1c8-2890-488a-b01c-6636d93fe536 service nova] Creating event network-changed:11629391-624f-4be0-95d3-4e55896a916c for instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec on n-h2-855650-5 Nov 02 13:18:24.493496 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8cd7ad7d-122c-49d8-b418-3f9e20b6e98e req-753fb1c8-2890-488a-b01c-6636d93fe536 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038906 Nov 02 13:18:24.494183 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3801/7143] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:25.434169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:25.434885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:25.441990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.442490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.443023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.443663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.444129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.444569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.580196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:25.588745 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f4dd2445-90ff-49ed-8253-f515f54028fd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1314 microversion: 2.1 time: 0.159568 Nov 02 13:18:25.589255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3802/7144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:25 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:26.613281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:26.613988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:26.621261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.621681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.622184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.622912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.623389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.623837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.765225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:26.773848 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-882757c2-b2cf-477e-a0f6-0aa4144a4b46 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1314 microversion: 2.1 time: 0.164916 Nov 02 13:18:26.774501 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3803/7145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:26 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:27.798262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.798966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:27.800865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:27.807798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.808313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.808779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.810052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.810052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.810469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.954303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:27.963248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2df1ea4-1661-4699-971f-bd144564f62d tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1314 microversion: 2.1 time: 0.168973 Nov 02 13:18:27.963843 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3804/7146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:28.987368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:28.988081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:28.994958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.995463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.995921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.996669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.997140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.997582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.144841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:29.153142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bf9443cc-651d-454c-8cce-d48e8abfcfd5 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1314 microversion: 2.1 time: 0.169877 Nov 02 13:18:29.153823 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3805/7147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:28 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:29.497019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ca5f04de-0444-4c47-a267-ffb62a3422bf req-9c6ee7d8-427b-4aec-afdf-30c5177e99e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1020c30-3895-4d9c-b7c3-85aa6b32d3ec", "name": "network-vif-plugged", "status": "completed", "tag": "11629391-624f-4be0-95d3-4e55896a916c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:29.510675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ca5f04de-0444-4c47-a267-ffb62a3422bf req-9c6ee7d8-427b-4aec-afdf-30c5177e99e9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.510675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ca5f04de-0444-4c47-a267-ffb62a3422bf req-9c6ee7d8-427b-4aec-afdf-30c5177e99e9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.510675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ca5f04de-0444-4c47-a267-ffb62a3422bf req-9c6ee7d8-427b-4aec-afdf-30c5177e99e9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.524333 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ca5f04de-0444-4c47-a267-ffb62a3422bf req-9c6ee7d8-427b-4aec-afdf-30c5177e99e9 service nova] Creating event network-vif-plugged:11629391-624f-4be0-95d3-4e55896a916c for instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec on n-h2-855650-5 Nov 02 13:18:29.529887 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ca5f04de-0444-4c47-a267-ffb62a3422bf req-9c6ee7d8-427b-4aec-afdf-30c5177e99e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036448 Nov 02 13:18:29.530609 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3806/7148] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:30.179118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:30.179841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:30.187273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:30.187779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:30.188233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:30.188955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:30.189418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:30.189875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:30.335912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:30.345075 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-944a6f77-da8d-4952-86f2-b0ab37c6a091 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1314 microversion: 2.1 time: 0.171618 Nov 02 13:18:30.345661 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3807/7149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:30 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:31.369084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:31.369782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:31.371902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=14 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:31.379117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.379634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.380092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.380825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.381298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.381742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.521064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:31.529307 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bbdd4129-7815-40c7-b5f0-4e3b14a56504 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1501 microversion: 2.1 time: 0.164363 Nov 02 13:18:31.529901 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3808/7150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:31 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:31.552753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:31.555064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:31.561003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.561512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.561982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.562717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.563204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.563769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.638604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:31.644356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Old instance type m1.heat2, new instance type m1.heat {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:18:31.651161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:18:31.651603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:18:31.652100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:18:31.652530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:18:31.652964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:18:31.697930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:31.771359 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-839f1c05-77df-4506-aa42-da45fc442007 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "POST /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec/action" status: 202 len: 0 microversion: 2.1 time: 0.223200 Nov 02 13:18:31.771985 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3809/7151] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:18:31 2022] POST /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:18:31.780554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:31.781195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:31.788682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.789202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.789662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.790511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.790985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.791428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.944501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:31.955125 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b12ee091-59c3-4317-8902-479e062008c6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1510 microversion: 2.1 time: 0.178638 Nov 02 13:18:31.956266 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3810/7152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:31 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:32.981692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:32.982373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:32.990517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:32.991038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:32.991501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:32.992957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:32.993434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:32.994272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.154543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:33.170121 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2aad90c5-b2c6-48eb-b9df-daef20d8c126 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1510 microversion: 2.1 time: 0.193382 Nov 02 13:18:33.171832 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3811/7153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:32 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:34.208847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:34.209481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:34.216614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:34.217128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:34.217612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:34.218357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:34.218836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:34.219282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:34.367796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:34.375955 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-751656d0-836c-4fcc-a649-4aeead5b90d3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.171078 Nov 02 13:18:34.376551 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3812/7154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:34 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:35.401049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:35.401914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:35.408792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:35.409310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:35.409775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:35.410557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:35.411030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:35.411479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:35.557184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:35.566526 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-93876ca3-674c-4b2c-a1d8-908c3775b217 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.169028 Nov 02 13:18:35.567134 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3813/7155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:35 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:36.590289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:36.590936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:36.593626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:36.600312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.600825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.601288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.602082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.602517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.602968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.758183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:36.766322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a30e2ee-ea0f-4d41-9c32-765b7010a440 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.180013 Nov 02 13:18:36.766916 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3814/7156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:36 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:37.791020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:37.791691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:37.798830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.799335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.799787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.800507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.800967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.801402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.963346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:37.972457 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b641644f-682b-4e2f-be18-818a322dd617 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.184706 Nov 02 13:18:37.973054 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3815/7157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:37 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:38.995873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:38.996582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:39.003978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.004556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.004922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.005662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.006136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.006569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.150784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:39.159055 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e70fbf2-9dad-4ef0-b5f1-0d462d690934 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.167499 Nov 02 13:18:39.160148 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3816/7158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:38 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:40.184247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:40.184969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:40.192756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.193254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.193719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.194471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.194946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.195388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.360211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:40.368940 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f6fe3ee-d888-4042-82db-43a973addf33 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.188705 Nov 02 13:18:40.369526 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3817/7159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:40 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:41.394244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:41.394992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:41.402094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:41.402684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:41.403057 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:41.403786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:41.404264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:41.404706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:41.545254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:41.554117 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-550b9c76-7556-47e3-bdf9-3ebabad4dedb tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.164300 Nov 02 13:18:41.554716 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3818/7160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:41 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:42.578322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:42.578981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:42.588031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.588553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.589010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.589802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.590252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.590700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.748969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:42.758781 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c5031f20-c559-4383-8711-a5a67f47cbd3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.184533 Nov 02 13:18:42.759386 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3819/7161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:42 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:43.782341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:43.783336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:43.791126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.791621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.792070 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.792789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.793254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.793686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.936964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:43.945249 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1b0d83a-ed25-4a6c-bbc4-4baaa2088785 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.166712 Nov 02 13:18:43.945752 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3820/7162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:43 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:44.969292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:44.970179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:44.977704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.978264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.978727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.979448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.979920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.980363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:45.118703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:45.127507 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6412d919-05e3-46fb-b772-0722685d3c31 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.162092 Nov 02 13:18:45.128412 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3821/7163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:44 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:46.151443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:46.152228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:46.159360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.159868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.160327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.161056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.161537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.162012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.322993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:46.331573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4f28b75-d15c-470b-9e67-584b51b3927c tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.184016 Nov 02 13:18:46.332410 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3822/7164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:46 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:47.355087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:47.355780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:47.363106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:47.363616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:47.364072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:47.364791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:47.365268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:47.365707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:47.505670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:47.513954 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-842449dc-5a99-4753-bd73-7f6dfdd045d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.162674 Nov 02 13:18:47.514597 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3823/7165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:47 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:48.540261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:48.540952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:48.548189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.548669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.549125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.549862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.550364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.550804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.703778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:48.712582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7611d5d5-7072-454e-b5fb-e9b8b3c5ecbd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.176179 Nov 02 13:18:48.713027 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3824/7166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:48 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:49.735919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:49.736768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:49.744391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.744823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.745282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.746032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.746509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.746949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.766471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:49.892987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:49.902024 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ffe842a-51e2-4f22-95fe-32a3cd0214e8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.169977 Nov 02 13:18:49.902638 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3825/7167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:49 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:50.926847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:50.927957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:50.935299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.935738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.936200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.936929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.937404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.937849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:51.079937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:51.088156 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f6234a2-f899-465f-aa72-f077fc01e1d6 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.165864 Nov 02 13:18:51.088789 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3826/7168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:50 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:52.114469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:52.115279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:52.124422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.124940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.125403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.126177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.126653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.127089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.281661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:52.290205 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dc166b0f-c7b9-4791-8ecc-5d2f06907cc8 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.181516 Nov 02 13:18:52.290827 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3827/7169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:52 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:53.315645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:53.316485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:53.323932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.324447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.324910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.325683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.326198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.326651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.487867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:53.495948 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e249092-ff4d-4d12-92c1-ec23e6e7ce14 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.185013 Nov 02 13:18:53.496552 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3828/7170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:53 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:54.520723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:54.521439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:54.528393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.528899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.529355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.530102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.530582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.531025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.671064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:54.679212 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d7604b0c-4542-4a13-a372-3a11e4b7ab95 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.163077 Nov 02 13:18:54.679799 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3829/7171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:54 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:55.703415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:55.704055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:55.711485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.711993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.712453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.713196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.713669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.714145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.847258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:55.855844 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df11cd69-881a-41e2-a66d-0aabbfe29212 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.156444 Nov 02 13:18:55.856447 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3830/7172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:55 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:56.879876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:56.880564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:56.887748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:56.888253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:56.888711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:56.889433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:56.889893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:56.890367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:57.026988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:57.035462 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4aef91ce-e3de-4ea2-91ae-e0edd3aed7e1 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.160091 Nov 02 13:18:57.036049 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3831/7173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:56 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:58.063966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:58.065144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:58.077525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:58.078365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:58.078884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:58.079651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:58.080121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:58.081344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:58.227092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:58.236595 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e8e4be9-65de-4f2f-8d08-fbd4cdb8c88e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.180273 Nov 02 13:18:58.237205 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3832/7174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:58 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:59.263903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:59.264752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:59.272149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:59.272655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:59.273142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:59.273890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:59.274387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:59.274832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:59.412950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:59.421140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86f137b0-ecad-46f2-87a5-ac38e0d77f16 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.161187 Nov 02 13:18:59.421716 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3833/7175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:59 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:00.445902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:00.446610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:00.453712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:00.454259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:00.454736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:00.455452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:00.455925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:00.456360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:00.593141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:00.601022 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e23c2360-7129-4042-98f7-27b6e395e33b tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1515 microversion: 2.1 time: 0.159045 Nov 02 13:19:00.601618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3834/7176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:00 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:01.625269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:01.626080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:01.635072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:01.635072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:01.635475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:01.636236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:01.636712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:01.637164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:01.775658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:01.783945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f37cf56f-5ede-4f05-8afd-1dcd32ae157f tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1514 microversion: 2.1 time: 0.163023 Nov 02 13:19:01.784545 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3835/7177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:01 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:02.086763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9079dd63-6132-4620-b5a5-52adb84ca711 req-e6eac83e-a623-4871-a6ad-86148bf94af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1020c30-3895-4d9c-b7c3-85aa6b32d3ec", "name": "network-vif-unplugged", "status": "completed", "tag": "11629391-624f-4be0-95d3-4e55896a916c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:02.098248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9079dd63-6132-4620-b5a5-52adb84ca711 req-e6eac83e-a623-4871-a6ad-86148bf94af6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:02.098857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9079dd63-6132-4620-b5a5-52adb84ca711 req-e6eac83e-a623-4871-a6ad-86148bf94af6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:02.099304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9079dd63-6132-4620-b5a5-52adb84ca711 req-e6eac83e-a623-4871-a6ad-86148bf94af6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:02.114802 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9079dd63-6132-4620-b5a5-52adb84ca711 req-e6eac83e-a623-4871-a6ad-86148bf94af6 service nova] Creating event network-vif-unplugged:11629391-624f-4be0-95d3-4e55896a916c for instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec on n-h1-855650-5 Nov 02 13:19:02.121037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-9079dd63-6132-4620-b5a5-52adb84ca711 req-e6eac83e-a623-4871-a6ad-86148bf94af6 service nova] Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:19:02.134105 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9079dd63-6132-4620-b5a5-52adb84ca711 req-e6eac83e-a623-4871-a6ad-86148bf94af6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051054 Nov 02 13:19:02.134739 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3836/7178] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:02.809337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:02.810183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:02.817615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:02.818166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:02.818624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:02.819344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:02.819845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:02.820290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:02.971795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:02.980792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-031b87e6-4694-45ee-a2cb-e6fc7c1aaebe tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1514 microversion: 2.1 time: 0.175784 Nov 02 13:19:02.981395 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3837/7179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:02 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:04.006459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:04.007094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:04.014282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:04.014798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:04.015257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:04.015974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:04.016452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:04.016896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:04.152182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:04.160335 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5eadf057-3156-4f9d-b0e8-d9353159d6cd tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1512 microversion: 2.1 time: 0.157943 Nov 02 13:19:04.160920 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3838/7180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:04 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:04.165324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e8725552-ff9b-4fb6-b996-d19d6ca9509c req-cd83df5f-e95d-4160-b710-3f165884874b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1020c30-3895-4d9c-b7c3-85aa6b32d3ec", "tag": "11629391-624f-4be0-95d3-4e55896a916c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:04.174536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8725552-ff9b-4fb6-b996-d19d6ca9509c req-cd83df5f-e95d-4160-b710-3f165884874b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:04.175036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8725552-ff9b-4fb6-b996-d19d6ca9509c req-cd83df5f-e95d-4160-b710-3f165884874b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:04.175484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e8725552-ff9b-4fb6-b996-d19d6ca9509c req-cd83df5f-e95d-4160-b710-3f165884874b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:04.187472 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e8725552-ff9b-4fb6-b996-d19d6ca9509c req-cd83df5f-e95d-4160-b710-3f165884874b service nova] Creating event network-changed:11629391-624f-4be0-95d3-4e55896a916c for instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec on n-h1-855650-5 Nov 02 13:19:04.192863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-e8725552-ff9b-4fb6-b996-d19d6ca9509c req-cd83df5f-e95d-4160-b710-3f165884874b service nova] Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:19:04.203516 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e8725552-ff9b-4fb6-b996-d19d6ca9509c req-cd83df5f-e95d-4160-b710-3f165884874b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041457 Nov 02 13:19:04.204120 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3839/7181] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:05.186180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:05.186896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:05.193342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:05.193843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:05.194315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:05.195032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:05.195503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:05.195941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:05.336419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:05.344432 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-738fff8e-cd52-419d-baa7-d91cd36691a3 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1512 microversion: 2.1 time: 0.163543 Nov 02 13:19:05.345017 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3840/7182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:05 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:06.368893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:06.369606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:06.376565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.377145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.378150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.378860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.379328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.379769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.524366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:06.533086 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fb7af421-f173-4e14-92c2-9d67eadcf683 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1509 microversion: 2.1 time: 0.168046 Nov 02 13:19:06.533732 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3841/7183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:06 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:06.556837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:06.557958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:06.565408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.566178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.566840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.567783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.568416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.568870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.600667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:19:06.603835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:06.659524 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.compute.api [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Found an unconfirmed migration during delete, id: 16, status: finished Nov 02 13:19:08.553724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=58 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:08.573478 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd749406-d0c0-48e4-a342-9729d3604f17 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 204 len: 0 microversion: 2.1 time: 2.020772 Nov 02 13:19:08.577341 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3842/7184] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:19:06 2022] DELETE /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 0 bytes in 2023 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:19:08.583686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:08.584413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:08.590750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:08.591176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:08.591626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:08.592344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:08.592814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:08.593253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:08.738195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:08.746439 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea622427-968c-4bca-b852-01febcd6da5e tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1501 microversion: 2.1 time: 0.167409 Nov 02 13:19:08.747037 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3843/7185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:08 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:08.752040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-76c05783-989e-42cf-b34d-0cf141ec0c51 req-766d8cc2-70f2-4c53-bc28-0ee7b0504f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1020c30-3895-4d9c-b7c3-85aa6b32d3ec", "name": "network-vif-plugged", "status": "completed", "tag": "11629391-624f-4be0-95d3-4e55896a916c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:08.763973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76c05783-989e-42cf-b34d-0cf141ec0c51 req-766d8cc2-70f2-4c53-bc28-0ee7b0504f3b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:08.764471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76c05783-989e-42cf-b34d-0cf141ec0c51 req-766d8cc2-70f2-4c53-bc28-0ee7b0504f3b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:08.764928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-76c05783-989e-42cf-b34d-0cf141ec0c51 req-766d8cc2-70f2-4c53-bc28-0ee7b0504f3b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:08.777499 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-76c05783-989e-42cf-b34d-0cf141ec0c51 req-766d8cc2-70f2-4c53-bc28-0ee7b0504f3b service nova] Creating event network-vif-plugged:11629391-624f-4be0-95d3-4e55896a916c for instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec on n-h1-855650-5 Nov 02 13:19:08.782554 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-76c05783-989e-42cf-b34d-0cf141ec0c51 req-766d8cc2-70f2-4c53-bc28-0ee7b0504f3b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Nov 02 13:19:08.783176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3844/7186] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:09.773473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:09.774304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:09.781581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:09.782455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:09.782921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:09.784144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:09.784630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:09.785077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:09.938678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4af6b99e3194f0ab076dfd88e08bd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc3b08d8c446eba178c7e41779a3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:09.947126 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9a6e3a5-ccd0-4a6a-9464-40dbe17b34f0 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 200 len: 1501 microversion: 2.1 time: 0.178885 Nov 02 13:19:09.947725 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3845/7187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:09 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:10.706000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d65a430a-9253-447b-aa9a-f234cba03005 req-12325f3c-3e74-415d-8d86-0cadb09ef23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1020c30-3895-4d9c-b7c3-85aa6b32d3ec", "name": "network-vif-deleted", "tag": "11629391-624f-4be0-95d3-4e55896a916c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:10.722564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d65a430a-9253-447b-aa9a-f234cba03005 req-12325f3c-3e74-415d-8d86-0cadb09ef23d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.723130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d65a430a-9253-447b-aa9a-f234cba03005 req-12325f3c-3e74-415d-8d86-0cadb09ef23d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.723671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d65a430a-9253-447b-aa9a-f234cba03005 req-12325f3c-3e74-415d-8d86-0cadb09ef23d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:10.737588 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d65a430a-9253-447b-aa9a-f234cba03005 req-12325f3c-3e74-415d-8d86-0cadb09ef23d service nova] Creating event network-vif-deleted:11629391-624f-4be0-95d3-4e55896a916c for instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec on n-h1-855650-5 Nov 02 13:19:10.743777 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d65a430a-9253-447b-aa9a-f234cba03005 req-12325f3c-3e74-415d-8d86-0cadb09ef23d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045215 Nov 02 13:19:10.744692 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3846/7188] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:10.972217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:10.973787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:10.981504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.982049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.982516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:10.983231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.983696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.984134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.000256 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] HTTP exception thrown: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Request method failure captured: Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec HTTP/1.1 Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm4Y2BziwkZEx6Fh9KGcPZjUoq9Ah37HSNHLHVBfbp-RCcyPA1RwJHqGkB7d8d73Xkg6sFQ1qc6N9geeZYmSpdV4gD3XPSpapxnoEtLVRBVqiFs97yV65rmLeiEublDOxP5MXI-KAZu9QbAqqsAF0PFjYjcBbwMiI2KHZ5PgrnUImY8 Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f1bc3b08d8c446eba178c7e41779a3ea Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f1bc3b08d8c446eba178c7e41779a3ea Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-940773891-project Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f4af6b99e3194f0ab076dfd88e08bd8b Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-940773891-project Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a1020c30-3895-4d9c-b7c3-85aa6b32d3ec'} Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:11.002653 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Returning 404 to user: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-365f98e3-ef21-46f3-ba1e-167e8447e681 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 404 len: 111 microversion: 2.1 time: 0.037321 Nov 02 13:19:11.007352 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3847/7189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:10 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:19:11.027890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:11.028409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:11.035221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.035730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.036191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.036914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.037376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.037823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.052833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] HTTP exception thrown: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Request method failure captured: Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec HTTP/1.1 Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm4Y2BziwkZEx6Fh9KGcPZjUoq9Ah37HSNHLHVBfbp-RCcyPA1RwJHqGkB7d8d73Xkg6sFQ1qc6N9geeZYmSpdV4gD3XPSpapxnoEtLVRBVqiFs97yV65rmLeiEublDOxP5MXI-KAZu9QbAqqsAF0PFjYjcBbwMiI2KHZ5PgrnUImY8 Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f1bc3b08d8c446eba178c7e41779a3ea Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f1bc3b08d8c446eba178c7e41779a3ea Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-940773891-project Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f4af6b99e3194f0ab076dfd88e08bd8b Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-940773891-project Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a1020c30-3895-4d9c-b7c3-85aa6b32d3ec'} Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:11.054454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Returning 404 to user: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-587af7b1-b25a-441e-95ea-01a79404b593 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 404 len: 111 microversion: 2.1 time: 0.032237 Nov 02 13:19:11.058633 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3848/7190] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:19:11 2022] DELETE /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:19:11.064459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:11.065084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] [instance: a1020c30-3895-4d9c-b7c3-85aa6b32d3ec] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:11.071495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.071999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.072452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.073212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.073679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.074161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.090774 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] HTTP exception thrown: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Request method failure captured: Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec HTTP/1.1 Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm4Y2BziwkZEx6Fh9KGcPZjUoq9Ah37HSNHLHVBfbp-RCcyPA1RwJHqGkB7d8d73Xkg6sFQ1qc6N9geeZYmSpdV4gD3XPSpapxnoEtLVRBVqiFs97yV65rmLeiEublDOxP5MXI-KAZu9QbAqqsAF0PFjYjcBbwMiI2KHZ5PgrnUImY8 Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: f1bc3b08d8c446eba178c7e41779a3ea Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f1bc3b08d8c446eba178c7e41779a3ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: f1bc3b08d8c446eba178c7e41779a3ea Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-940773891 Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-940773891-project Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: f4af6b99e3194f0ab076dfd88e08bd8b Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-940773891-project Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'a1020c30-3895-4d9c-b7c3-85aa6b32d3ec'} Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:11.092454 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] Returning 404 to user: Instance a1020c30-3895-4d9c-b7c3-85aa6b32d3ec could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb19d4f4-9a3c-4142-bb9f-06b1d0d08463 tempest-DeleteServersTestJSON-940773891 tempest-DeleteServersTestJSON-940773891-project] 10.222.0.45 "GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec" status: 404 len: 111 microversion: 2.1 time: 0.033226 Nov 02 13:19:11.097507 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3849/7191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:11 2022] GET /compute/v2.1/servers/a1020c30-3895-4d9c-b7c3-85aa6b32d3ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:20.563719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1933271295", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "1cecbcbc-6bf7-4dba-9182-c5b363ee096c"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:20.624284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] validate_networks() for [('1cecbcbc-6bf7-4dba-9182-c5b363ee096c', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:19:21.079303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:21.144289 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:19:21.144699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:19:21.145239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:19:21.145657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:19:21.146087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:19:21.158941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:21.159452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:21.159931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:21.160684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:21.161157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:21.161601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:21.184010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Getting quotas for project 6c2d244716964e2c9520bca174e33120. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:19:21.189906 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Getting quotas for user 6036506aeaf94ef4b31be5396db62af8 and project 6c2d244716964e2c9520bca174e33120. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:19:21.203380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:19:21.205866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:19:21.255983 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a833adc1-2cc0-43d6-b34b-eb03ee6cbd7f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835238 Nov 02 13:19:21.256933 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3850/7192] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:19:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:19:21.271662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9c33703-3366-41fd-8215-cfd5e7696864 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:21.272431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9c33703-3366-41fd-8215-cfd5e7696864 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:21.332217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b9c33703-3366-41fd-8215-cfd5e7696864 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:21.341425 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9c33703-3366-41fd-8215-cfd5e7696864 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1218 microversion: 2.1 time: 0.074465 Nov 02 13:19:21.342086 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3851/7193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:21 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:22.365466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:22.366292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:22.376209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.376730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:22.377198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.377923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.378424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:22.378954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.448932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:22.458947 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8eadd6b3-1744-4860-b6b8-4941d807a093 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1270 microversion: 2.1 time: 0.097940 Nov 02 13:19:22.459859 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3852/7194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:22 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:23.485307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:23.486985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:23.495423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.496279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.497090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.498115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.498811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.499460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.666068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:23.675730 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d80afde8-a6e4-4a19-b81e-2d6c65c8bd92 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1318 microversion: 2.1 time: 0.194828 Nov 02 13:19:23.691152 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3853/7195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:23 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:24.536535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1a64920b-e9b8-4c95-926f-478cbeb94fde req-e9006150-1cfa-4c14-8d21-29e514a6ca01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d68768e8-3531-459c-a05b-780085cbfe77", "tag": "4a969f34-a21b-4e01-b154-28316b86a328"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:24.561105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1a64920b-e9b8-4c95-926f-478cbeb94fde req-e9006150-1cfa-4c14-8d21-29e514a6ca01 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.561858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1a64920b-e9b8-4c95-926f-478cbeb94fde req-e9006150-1cfa-4c14-8d21-29e514a6ca01 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.562486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1a64920b-e9b8-4c95-926f-478cbeb94fde req-e9006150-1cfa-4c14-8d21-29e514a6ca01 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.576515 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1a64920b-e9b8-4c95-926f-478cbeb94fde req-e9006150-1cfa-4c14-8d21-29e514a6ca01 service nova] Creating event network-changed:4a969f34-a21b-4e01-b154-28316b86a328 for instance d68768e8-3531-459c-a05b-780085cbfe77 on n-h2-855650-5 Nov 02 13:19:24.585771 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1a64920b-e9b8-4c95-926f-478cbeb94fde req-e9006150-1cfa-4c14-8d21-29e514a6ca01 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058939 Nov 02 13:19:24.586813 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3854/7196] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:24.702340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:24.703080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:24.710701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.711524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.711995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.712761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.713238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.713718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.863405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:24.872213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3c2d2d3-6b3f-4a9f-856f-a9cffc8dc4e7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1318 microversion: 2.1 time: 0.174403 Nov 02 13:19:24.872819 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3855/7197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:24 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:25.896291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:25.896934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:25.904517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:25.905027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:25.905491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:25.906238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:25.906721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:25.907171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:26.051625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:26.060628 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4cd98d6f-159d-4833-958b-557df98eaed1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1318 microversion: 2.1 time: 0.168337 Nov 02 13:19:26.061476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3856/7198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:25 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:27.088301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:27.089143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:27.099373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:27.100083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:27.100997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:27.102102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:27.102454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:27.102989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:27.310170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:27.324260 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bac338a3-94eb-4323-9a8e-75862cca4dc8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1318 microversion: 2.1 time: 0.242434 Nov 02 13:19:27.325569 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3857/7199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:27 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:28.366547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:28.367366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:28.374943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.376067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.376542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.377276 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.377743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.378219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.543128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:28.553659 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-033aa165-dd82-4347-a139-19d47ea70e40 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1318 microversion: 2.1 time: 0.192827 Nov 02 13:19:28.554299 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3858/7200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:28 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:29.577016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:29.577706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:29.584637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:29.585141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:29.585600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:29.586355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:29.586827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:29.587272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:29.723818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:29.734106 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2336e657-9846-4cf6-ad92-de005078b1c5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1318 microversion: 2.1 time: 0.160848 Nov 02 13:19:29.734725 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3859/7201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:29 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:29.795576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fc73f58d-c8bb-483b-8dc1-dc1fb3602f8d req-8f88d399-3d56-44e1-9606-653cfd6645fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68768e8-3531-459c-a05b-780085cbfe77", "name": "network-vif-plugged", "status": "completed", "tag": "4a969f34-a21b-4e01-b154-28316b86a328"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:29.807862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc73f58d-c8bb-483b-8dc1-dc1fb3602f8d req-8f88d399-3d56-44e1-9606-653cfd6645fc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:29.809142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc73f58d-c8bb-483b-8dc1-dc1fb3602f8d req-8f88d399-3d56-44e1-9606-653cfd6645fc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:29.809600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc73f58d-c8bb-483b-8dc1-dc1fb3602f8d req-8f88d399-3d56-44e1-9606-653cfd6645fc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:29.823480 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fc73f58d-c8bb-483b-8dc1-dc1fb3602f8d req-8f88d399-3d56-44e1-9606-653cfd6645fc service nova] Creating event network-vif-plugged:4a969f34-a21b-4e01-b154-28316b86a328 for instance d68768e8-3531-459c-a05b-780085cbfe77 on n-h2-855650-5 Nov 02 13:19:29.829248 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fc73f58d-c8bb-483b-8dc1-dc1fb3602f8d req-8f88d399-3d56-44e1-9606-653cfd6645fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037080 Nov 02 13:19:29.830021 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3860/7202] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:30.759333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:30.760073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:30.767623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.768700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.769149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:30.769858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.770355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.770785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:30.908406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:30.916307 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4630bde3-0abf-4867-89aa-550b0b20403b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1318 microversion: 2.1 time: 0.161254 Nov 02 13:19:30.916976 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3861/7203] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:30 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:31.939606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:31.940356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:31.942280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:31.943016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:31.950606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:31.951100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:31.951555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:31.952251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:31.952711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:31.953146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.091043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:32.100062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe4059c0-c1e3-4532-a24b-9a4ebe377630 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1508 microversion: 2.1 time: 0.164366 Nov 02 13:19:32.100667 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3862/7204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:31 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:32.125047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:32.125836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:32.132786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.133299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.133790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.134686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.135165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.135608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.543462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:32.551844 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82c5f0d4-dda2-40b8-b4f4-555f51fb3d1d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1508 microversion: 2.1 time: 0.430902 Nov 02 13:19:32.552669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3863/7205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:32 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1508 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:32.574918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:32.577337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:32.583408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.583909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.584364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.585073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.585558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.586003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.651778 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b5f26a9c-e678-4550-9874-0b5c0c4bba7a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "PUT /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1080 microversion: 2.1 time: 0.080554 Nov 02 13:19:32.652337 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3864/7206] 10.222.0.45 () {60 vars in 1256 bytes} [Wed Nov 2 13:19:32 2022] PUT /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1080 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:32.670569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:32.671193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:32.678119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.678626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.679087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.679833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.680305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.680776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.811811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:32.820573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c02954c2-232d-45d8-9c7c-fbac68d0f9bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1506 microversion: 2.1 time: 0.153689 Nov 02 13:19:32.821169 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3865/7207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:32 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:32.842786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:32.843409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:32.850198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.850706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.851161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.851896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.852342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.852792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.990026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:32.998024 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62673d0d-6558-4bf5-b26b-994345b3ff51 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1506 microversion: 2.1 time: 0.159096 Nov 02 13:19:32.998609 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3866/7208] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:32 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:33.020721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:33.023287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:33.029615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:33.030148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:33.030609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:33.031320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:33.031793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:33.032244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:33.063447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:33.069218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Old instance type m1.heat2, new instance type m1.heat {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:19:33.075766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:19:33.076196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:19:33.076681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:19:33.077104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:19:33.077525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:19:33.115615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:33.143786 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b763a7bb-06ce-4daa-a267-f753a4737f5a tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "POST /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77/action" status: 202 len: 0 microversion: 2.1 time: 0.126888 Nov 02 13:19:33.144684 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3867/7209] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:19:33 2022] POST /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:19:33.152404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:33.153034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:33.160957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:33.161534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:33.161903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:33.162657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:33.163154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:33.163600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:33.310378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:33.318786 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c60558b8-3b73-4ef5-a5dc-35b2d75f96ac tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1517 microversion: 2.1 time: 0.170058 Nov 02 13:19:33.319382 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3868/7210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:33 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:34.343579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:34.344902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:34.351648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:34.352150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:34.352623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:34.353338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:34.353796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:34.354256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:34.496462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:34.507050 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9e7155b8-1e6a-4c00-9a45-9900e25ef7a2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1517 microversion: 2.1 time: 0.167727 Nov 02 13:19:34.507975 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3869/7211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:34 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:35.531332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:35.532027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:35.539394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:35.539891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:35.540346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:35.541066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:35.541538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:35.541995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:35.677026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:35.685891 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90448371-fd7d-4e3d-9bc4-de2a00f5c4d6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.158497 Nov 02 13:19:35.686557 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3870/7212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:35 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:36.708889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:36.709632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:36.716579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.717084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.717548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.718296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.718772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.719216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.857025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:36.865841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3fae77ea-5c49-44e7-a65b-a5971fddc5d5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.160851 Nov 02 13:19:36.866480 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3871/7213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:36 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:37.888964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:37.889653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:37.896606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.897114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.897574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:37.898323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.898794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.899244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.031448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:38.039588 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-975b1abf-6ae3-441a-bdf3-2df7f1fe20f3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.154559 Nov 02 13:19:38.040176 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3872/7214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:37 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:39.064089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:39.064980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:39.068145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:39.073814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.074354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.075095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.075547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.076021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.076466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.216488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:39.224709 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-328c2ee1-2c34-4cc7-8a10-0af96cfe4a43 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.164869 Nov 02 13:19:39.225453 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3873/7215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:39 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:40.248981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:40.249656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:40.257629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.258148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.258625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.259320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.259788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.260226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.401466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:40.409513 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-957fcda3-d111-4e08-918a-4c1fdabb84cb tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.164587 Nov 02 13:19:40.410150 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3874/7216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:40 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:41.433842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:41.434581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:41.441500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.442073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.442547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.443225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.443690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.444128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.578351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:41.586802 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44b327bf-ec86-44b5-8fb4-1038e2606d82 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.157130 Nov 02 13:19:41.587438 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3875/7217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:41 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:42.611071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:42.611730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:42.619693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:42.620203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:42.620667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:42.621400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:42.621867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:42.622346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:42.760622 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:42.768448 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-409bbbcf-fe31-4737-82b8-e709c1c90648 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161503 Nov 02 13:19:42.769031 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3876/7218] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:42 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:43.792171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:43.792856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:43.800735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.801741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.802564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.803366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.803905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.804333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.948794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:43.957360 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-668797d2-9ca5-485f-8bc3-9193a26aadf8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.168957 Nov 02 13:19:43.958156 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3877/7219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:43 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:44.981669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:44.982482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:44.990529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.991054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.991513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.992234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.992700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.993140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:45.130936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:45.138802 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e611c78d-d4c2-42d6-bed5-bca6568c8add tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161670 Nov 02 13:19:45.139380 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3878/7220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:44 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:46.165252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:46.166103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:46.172911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.173414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.173872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.174620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.175089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.175531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.308855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:46.317426 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec4d041f-5e09-4fc0-81e8-1737fc80a577 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.157563 Nov 02 13:19:46.318192 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3879/7221] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:46 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:47.342234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:47.342858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:47.350657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.351156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.351598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.352302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.352758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.353190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.489175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:47.497137 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-861fcf7d-9e4e-4185-a7ed-24a14ba5a50b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.158891 Nov 02 13:19:47.497724 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3880/7222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:47 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:48.521489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:48.522187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:48.529783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.530322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.530785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.531504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.531984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.532523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.670193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:48.678463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0504086e-09f7-4386-bd83-e16830f26103 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161482 Nov 02 13:19:48.679055 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3881/7223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:48 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:49.702558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:49.703181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:49.710137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.710651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.711109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.711824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.712297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.712742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.844874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:49.852741 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9289ad89-d128-4181-909e-96d1c95bf892 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.154380 Nov 02 13:19:49.853339 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3882/7224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:49 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:50.877313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:50.878081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:50.885539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.886067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.886520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:50.887226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.887689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.888128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.026607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:51.034648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a2fbc30-0925-4cb7-99b0-6c656fdddd47 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161251 Nov 02 13:19:51.035276 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3883/7225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:50 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:52.059388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:52.060017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:52.067011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.068322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.068838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.069710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.070222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.070963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.076724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:52.205606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:52.213563 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-591370f0-8a47-432b-b944-695292d4981d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.158074 Nov 02 13:19:52.214262 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3884/7226] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:52 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:53.237451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:53.238122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:53.245053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.245547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.246017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.246730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.247189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.247621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.398320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:53.407009 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-671dda3e-460f-42c0-964f-3a690481c458 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.173646 Nov 02 13:19:53.407606 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3885/7227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:53 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:54.430343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:54.431018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:54.438515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:54.439062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:54.439522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.440247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:54.440724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:54.441171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.578711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:54.587237 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-449a33df-ca8a-4c09-a47a-659ff14928ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161082 Nov 02 13:19:54.587819 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3886/7228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:54 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:55.611452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:55.612177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:55.619060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.619554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.619999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.620698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.621189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.621626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.761131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:55.769350 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c7d838a-87fa-44b1-8648-aebda7f6fa0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161861 Nov 02 13:19:55.769937 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3887/7229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:55 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:55.958468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG neutronclient.v2_0.client [None req-652c9c03-f780-4c96-a224-753388d297f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=120723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:19:55.959302 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-652c9c03-f780-4c96-a224-753388d297f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 899.738703 Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack [None req-652c9c03-f780-4c96-a224-753388d297f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Traceback (most recent call last): Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self.find_resource_by_id(resource, name_or_id, Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack raise exceptions.NotFound(message=not_found_message) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'tempest-secgroup-smoke-151727032' Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Traceback (most recent call last): Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack raise client_exc(message=error_message, Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-7f366aa2-07f6-4d9a-ba02-059e58e9fdba'] Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Traceback (most recent call last): Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return req.get_response(self.application) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack self._log_req(req, res, start) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack self.force_reraise() Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack raise self.value Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack res = req.get_response(self.application) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return resp(environ, start_response) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return request.get_response(self.application) Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Nov 02 13:19:56.032569 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack response = req.get_response(self._app) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return resp(environ, start_response) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return resp(environ, start_response) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack response = self.app(environ, start_response) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return resp(environ, start_response) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return method(req=request, **action_args) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return f(*args, **kwargs) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return func(*args, **kwargs) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return func(*args, **kwargs) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return func(*args, **kwargs) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack [Previous line repeated 10 more times] Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self._create_instance( Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack security_groups = self._check_requested_secgroups( Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return neutronv20.find_resourceid_by_name_or_id( Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return find_resource_by_name_or_id(client, resource, name_or_id, Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return client.find_resource(resource, name_or_id, project_id, Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 02 13:19:56.037615 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self._find_resource_by_name( Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 457, in _find_resource_by_name Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack data = obj_lister(**params) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1063, in list_security_groups Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self.list('security_groups', self.security_groups_path, Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack res = self.get(path, params=params) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack raise exception.Unauthorized() Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack [None req-652c9c03-f780-4c96-a224-753388d297f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] http://10.222.0.45/compute/v2.1/servers returned with HTTP 401 Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-652c9c03-f780-4c96-a224-753388d297f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:19:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:19:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.45) Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: CRITICAL nova [None req-652c9c03-f780-4c96-a224-753388d297f2 tempest-TestVolumeBootPattern-1746756080 tempest-TestVolumeBootPattern-1746756080-project] Unhandled error: OSError: write error Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova OSError: write error Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova Nov 02 13:19:56.041917 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3343/7230] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:04:56 2022] POST /compute/v2.1/servers => generated 0 bytes in 899816 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Nov 02 13:19:56.793110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:56.793747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:56.800665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.801173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.802026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.803003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.803491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.803936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.942913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:56.950753 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e9c30e9-2830-419d-bdeb-5db545f59ac6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161651 Nov 02 13:19:56.951338 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3888/7231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:56 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:57.977017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:57.977564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:57.987565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.988063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.988514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.989719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.990210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.990647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:58.132198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:58.140107 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-96e4ffff-a0c0-44a1-ab15-55f765fbd262 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.169119 Nov 02 13:19:58.140694 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3344/7232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:57 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:59.166386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:59.167017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:59.174829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:59.175332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:59.175832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.176488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:59.176950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:59.177389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.314098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:59.323298 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad19cf87-0cdd-4f35-b115-0d99a2b29395 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161255 Nov 02 13:19:59.323950 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3889/7233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:59 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:00.347320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:00.347942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:00.357744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.358271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.358721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:00.359421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.359883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.360310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:00.491449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:00.499497 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4795db26-4f6b-46cd-bbcc-78bba5f239c6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.156175 Nov 02 13:20:00.500068 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3345/7234] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:00 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:01.523191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:01.523815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:01.530800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:01.531296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:01.531752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:01.532456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:01.532916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:01.533354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:01.672291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:01.680537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9429ebb2-7837-4022-98a1-5e3b72588075 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.161345 Nov 02 13:20:01.681108 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3890/7235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:01 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:02.704706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:02.705316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:02.714435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.714927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.715381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.716088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.716591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.717023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.857373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:02.865395 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-456f7d56-2ef1-4ed5-898a-663072d81e0c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.164701 Nov 02 13:20:02.865996 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3346/7236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:02 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:03.891638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:03.892262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:03.899795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:03.900300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:03.900751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:03.901469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:03.901931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:03.902396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:04.052694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:04.061108 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17d37635-6ce7-443e-baef-d89d764c88c7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.173390 Nov 02 13:20:04.061856 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3891/7237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:03 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:05.084984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:05.085599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:05.094652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:05.095142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:05.095580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:05.096298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:05.096751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:05.097175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:05.232322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:05.240369 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d67c5992-2dc2-4e43-aeb3-308b35d07d09 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.159287 Nov 02 13:20:05.240970 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3347/7238] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:05 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:06.264826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:06.265481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:06.267838 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:20:06.267980 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:20:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 (ip 10.222.0.45) !!! Nov 02 13:20:06.274763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:06.275264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:06.275721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:06.276478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:06.276951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:06.277389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:06.422076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:06.431322 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90aa29ee-79f7-4347-b81f-6469a043b40c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.170418 Nov 02 13:20:06.431923 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3892/7239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:06 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:07.455344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:07.455978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:07.463634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:07.464261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:07.464808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:07.465520 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:07.465990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:07.466443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:07.609935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:07.617893 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b8264ab-c95a-4c8c-a0c4-efe89f15bffe tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.166498 Nov 02 13:20:07.618538 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3348/7240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:07 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:08.643787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:08.644325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:08.652952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:08.653460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:08.653919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.654660 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:08.655162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:08.655611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.789045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:08.797110 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff4f811b-313e-43b8-a6b0-0a8e704f0242 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.159026 Nov 02 13:20:08.797692 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3893/7241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:08 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:09.820797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:09.821393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:09.823467 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:20:09.823615 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:20:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 (ip 10.222.0.45) !!! Nov 02 13:20:09.830325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:09.830815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:09.831256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:09.831961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:09.832412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:09.832837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:09.973646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:09.981542 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e472ee3b-9dfb-4acf-9d9c-fe2dbb7b7b6d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.164654 Nov 02 13:20:09.982187 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3349/7242] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:09 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:11.005253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:11.005813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:11.008565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=42 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:11.014326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:11.014838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:11.015305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.016025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:11.016501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:11.016961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.148014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:11.156391 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7036ce9e-f679-4b1c-90f8-04e1e478e3aa tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1522 microversion: 2.1 time: 0.155540 Nov 02 13:20:11.156981 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3894/7243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:10 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:12.179750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:12.180371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:12.188094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.188597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.189112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.189758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.190246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.190696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.407140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:12.415832 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c2a23bbe-c398-447b-bc79-2e4c16a524d9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1521 microversion: 2.1 time: 0.239688 Nov 02 13:20:12.416618 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3350/7244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:12 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:12.731217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6f7c1133-116c-4763-a71d-a4c88d59371d req-98e396bd-4b43-4c95-8519-505323c51ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68768e8-3531-459c-a05b-780085cbfe77", "name": "network-vif-unplugged", "status": "completed", "tag": "4a969f34-a21b-4e01-b154-28316b86a328"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:12.747187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6f7c1133-116c-4763-a71d-a4c88d59371d req-98e396bd-4b43-4c95-8519-505323c51ab0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.748093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6f7c1133-116c-4763-a71d-a4c88d59371d req-98e396bd-4b43-4c95-8519-505323c51ab0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.748907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6f7c1133-116c-4763-a71d-a4c88d59371d req-98e396bd-4b43-4c95-8519-505323c51ab0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.772102 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6f7c1133-116c-4763-a71d-a4c88d59371d req-98e396bd-4b43-4c95-8519-505323c51ab0 service nova] Creating event network-vif-unplugged:4a969f34-a21b-4e01-b154-28316b86a328 for instance d68768e8-3531-459c-a05b-780085cbfe77 on n-h1-855650-5 Nov 02 13:20:12.783219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-6f7c1133-116c-4763-a71d-a4c88d59371d req-98e396bd-4b43-4c95-8519-505323c51ab0 service nova] Instance d68768e8-3531-459c-a05b-780085cbfe77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:20:12.804403 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6f7c1133-116c-4763-a71d-a4c88d59371d req-98e396bd-4b43-4c95-8519-505323c51ab0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078110 Nov 02 13:20:12.805551 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3895/7245] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:13.440175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:13.440803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:13.448447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:13.448936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:13.449388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:13.450123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:13.450590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:13.451021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:13.653738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:13.662097 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-356035a0-d05c-4c0a-b3b5-29e01c190c64 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1521 microversion: 2.1 time: 0.225769 Nov 02 13:20:13.662810 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3351/7246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:13 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:14.689017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:14.689661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:14.696054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.697056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.697517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.698264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.698746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.699185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.831667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-648bdf82-fcb5-42c4-af3f-a220b029fbfb req-3766bf32-1533-4f4b-a075-3e920b8dd800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d68768e8-3531-459c-a05b-780085cbfe77", "tag": "4a969f34-a21b-4e01-b154-28316b86a328"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:14.837184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:14.844595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-648bdf82-fcb5-42c4-af3f-a220b029fbfb req-3766bf32-1533-4f4b-a075-3e920b8dd800 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.845228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-648bdf82-fcb5-42c4-af3f-a220b029fbfb req-3766bf32-1533-4f4b-a075-3e920b8dd800 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.845685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-648bdf82-fcb5-42c4-af3f-a220b029fbfb req-3766bf32-1533-4f4b-a075-3e920b8dd800 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.846237 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-daff1df3-e19e-4756-8465-f44a22f9a3ab tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1519 microversion: 2.1 time: 0.162513 Nov 02 13:20:14.846900 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3896/7247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:14 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:14.859356 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-648bdf82-fcb5-42c4-af3f-a220b029fbfb req-3766bf32-1533-4f4b-a075-3e920b8dd800 service nova] Creating event network-changed:4a969f34-a21b-4e01-b154-28316b86a328 for instance d68768e8-3531-459c-a05b-780085cbfe77 on n-h1-855650-5 Nov 02 13:20:14.865088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-648bdf82-fcb5-42c4-af3f-a220b029fbfb req-3766bf32-1533-4f4b-a075-3e920b8dd800 service nova] Instance d68768e8-3531-459c-a05b-780085cbfe77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:20:14.879039 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-648bdf82-fcb5-42c4-af3f-a220b029fbfb req-3766bf32-1533-4f4b-a075-3e920b8dd800 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051050 Nov 02 13:20:14.879665 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3352/7248] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:20:15.872944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:15.873680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:15.880951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:15.881456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:15.881915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:15.882666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:15.883132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:15.883572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:16.016383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:16.024201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9f1a93c9-2295-480f-8242-21e533f4d3bc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1519 microversion: 2.1 time: 0.155800 Nov 02 13:20:16.024776 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3897/7249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:15 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:17.049346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:17.050248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:17.057857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.058360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.058805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.059706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.060168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.060648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.208950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:17.217122 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e06521f1-8ff8-4b43-bacf-1b580ebcda00 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1519 microversion: 2.1 time: 0.173373 Nov 02 13:20:17.217723 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3353/7250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:17 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:18.240548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:18.241181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:18.248155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.248664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.249124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.249843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.250355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.250801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.391670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:18.400200 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6ad2b3c-ada1-4b28-ab67-daefa3898d36 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1516 microversion: 2.1 time: 0.162908 Nov 02 13:20:18.400787 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3898/7251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:18 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:18.423117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:18.423541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:18.431606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.432106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.432558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.433403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.434052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.434571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.497831 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6bc853f-4311-4b3a-8270-d9193ce5e5c8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "POST /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77/action" status: 204 len: 0 microversion: 2.1 time: 0.079076 Nov 02 13:20:18.498518 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3354/7252] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:20:18 2022] POST /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:20:18.506827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:18.507449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:18.514231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.514798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.515255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.516017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.516537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.517017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.655193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:18.663318 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e913f422-dcc8-4d90-baca-7182ef4cacf1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1516 microversion: 2.1 time: 0.160403 Nov 02 13:20:18.664303 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3899/7253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:18 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:19.004248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f4e0cae8-f009-46ef-bf76-ff52ede4548c req-d19b8589-f14e-4a74-ab3b-2ff576bb8985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68768e8-3531-459c-a05b-780085cbfe77", "name": "network-vif-plugged", "status": "completed", "tag": "4a969f34-a21b-4e01-b154-28316b86a328"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:19.016000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f4e0cae8-f009-46ef-bf76-ff52ede4548c req-d19b8589-f14e-4a74-ab3b-2ff576bb8985 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.017029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f4e0cae8-f009-46ef-bf76-ff52ede4548c req-d19b8589-f14e-4a74-ab3b-2ff576bb8985 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.017762 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f4e0cae8-f009-46ef-bf76-ff52ede4548c req-d19b8589-f14e-4a74-ab3b-2ff576bb8985 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.034085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f4e0cae8-f009-46ef-bf76-ff52ede4548c req-d19b8589-f14e-4a74-ab3b-2ff576bb8985 service nova] Creating event network-vif-plugged:4a969f34-a21b-4e01-b154-28316b86a328 for instance d68768e8-3531-459c-a05b-780085cbfe77 on n-h1-855650-5 Nov 02 13:20:19.041530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-f4e0cae8-f009-46ef-bf76-ff52ede4548c req-d19b8589-f14e-4a74-ab3b-2ff576bb8985 service nova] Instance d68768e8-3531-459c-a05b-780085cbfe77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:20:19.055237 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f4e0cae8-f009-46ef-bf76-ff52ede4548c req-d19b8589-f14e-4a74-ab3b-2ff576bb8985 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054977 Nov 02 13:20:19.056599 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3355/7254] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:19.686922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:19.687582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:19.695320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.695842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.696792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.697515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.698027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.698474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.831200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:19.840003 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b2d61c44-6f20-4931-a693-b196039ccb21 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1516 microversion: 2.1 time: 0.156993 Nov 02 13:20:19.840594 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3900/7255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:19 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:20.864804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.865746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:20.874888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.875444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.875987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.876858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.877427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.877992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.017270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:21.025759 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be04ae6f-96e9-4442-bd82-7d0aa9669595 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1508 microversion: 2.1 time: 0.166666 Nov 02 13:20:21.026370 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3356/7256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:20 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:21.048668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:21.049331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:21.056727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.057236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.057698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.058459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.058940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.059381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.064674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:21.196029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:21.204288 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c735068-2190-4477-8dc0-b6eca7134905 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1508 microversion: 2.1 time: 0.159708 Nov 02 13:20:21.204866 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3901/7257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:21 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:21.230397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9d6a3718-948f-4ee2-a5fc-c4de2c538e05 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Action: 'create', calling method: .version_select at 0x7f228e9869d0>, body: {"keypair": {"name": "tempest-keypair-425115341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR+UOTbnoYW8B4eXp0NiP+AurX86Lt4j1afw8x2vrVIDje2+HUerJww538erNeXYdY9XAoNUyHQxHD3/DG/ZGZmuHvvcCqG+49OPdxRqW6oD9BN/CVirYGWQ75b7PMfsw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:21.248671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-9d6a3718-948f-4ee2-a5fc-c4de2c538e05 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Getting quotas for project 6c2d244716964e2c9520bca174e33120. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:20:21.253883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-9d6a3718-948f-4ee2-a5fc-c4de2c538e05 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Getting quotas for user 6036506aeaf94ef4b31be5396db62af8 and project 6c2d244716964e2c9520bca174e33120. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:20:21.283877 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9d6a3718-948f-4ee2-a5fc-c4de2c538e05 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057071 Nov 02 13:20:21.284484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3357/7258] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:20:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:22.503264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:22.503902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:22.511021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:22.511551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:22.512033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:22.513118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:22.513585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:22.514062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:22.646847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:22.655338 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7da8e54-de04-413b-a618-970011c1106d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 200 len: 1508 microversion: 2.1 time: 0.155943 Nov 02 13:20:22.655907 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3902/7259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:22 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:22.678816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:22.679606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:22.686422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:22.686917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:22.687364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:22.688076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:22.688538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:22.689002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:22.715038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:20:22.794282 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32e449b0-c235-47ab-86ef-918996a83893 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 204 len: 0 microversion: 2.1 time: 0.120001 Nov 02 13:20:22.794938 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3358/7260] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:20:22 2022] DELETE /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:20:22.854632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1170788915", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "1cecbcbc-6bf7-4dba-9182-c5b363ee096c"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:22.918987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] validate_networks() for [('1cecbcbc-6bf7-4dba-9182-c5b363ee096c', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:20:23.306690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:20:23.307176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:20:23.307682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:20:23.308163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:20:23.308629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:20:23.318015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:23.318526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:23.318985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:23.319745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:23.320221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:23.320661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:23.339062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Getting quotas for project 6c2d244716964e2c9520bca174e33120. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:20:23.344849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Getting quotas for user 6036506aeaf94ef4b31be5396db62af8 and project 6c2d244716964e2c9520bca174e33120. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:20:23.358450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:20:23.360888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:20:23.406920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44929bfe-3c89-476c-a1bc-8eb3a4876f9b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556553 Nov 02 13:20:23.407498 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3903/7261] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:20:23.419709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-93162bff-c191-4b8a-acb8-b0ce6f7f9534 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:23.420428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-93162bff-c191-4b8a-acb8-b0ce6f7f9534 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:23.485151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-93162bff-c191-4b8a-acb8-b0ce6f7f9534 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:23.492526 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-93162bff-c191-4b8a-acb8-b0ce6f7f9534 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1218 microversion: 2.1 time: 0.077049 Nov 02 13:20:23.493159 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3359/7262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:23 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:24.516337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:24.519017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:24.531753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:24.532490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:24.532944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:24.533663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:24.534164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:24.534599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:24.601077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:24.609562 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b6d7aaa4-d5cf-4080-beac-ae5fef3062ec tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1270 microversion: 2.1 time: 0.097748 Nov 02 13:20:24.610208 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3904/7263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:24 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:25.052445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-44eda0ed-e2db-49c1-a95f-413e5c0e095f req-947c1261-ce9f-4353-ac7c-ff9bfa1bbebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68768e8-3531-459c-a05b-780085cbfe77", "name": "network-vif-deleted", "tag": "4a969f34-a21b-4e01-b154-28316b86a328"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:25.070217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-44eda0ed-e2db-49c1-a95f-413e5c0e095f req-947c1261-ce9f-4353-ac7c-ff9bfa1bbebc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:25.074793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-44eda0ed-e2db-49c1-a95f-413e5c0e095f req-947c1261-ce9f-4353-ac7c-ff9bfa1bbebc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:25.075383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-44eda0ed-e2db-49c1-a95f-413e5c0e095f req-947c1261-ce9f-4353-ac7c-ff9bfa1bbebc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:25.091671 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-44eda0ed-e2db-49c1-a95f-413e5c0e095f req-947c1261-ce9f-4353-ac7c-ff9bfa1bbebc service nova] Creating event network-vif-deleted:4a969f34-a21b-4e01-b154-28316b86a328 for instance d68768e8-3531-459c-a05b-780085cbfe77 on n-h1-855650-5 Nov 02 13:20:25.097213 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-44eda0ed-e2db-49c1-a95f-413e5c0e095f req-947c1261-ce9f-4353-ac7c-ff9bfa1bbebc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048723 Nov 02 13:20:25.098160 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3360/7264] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:25.633337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:25.634589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:25.644307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:25.644896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:25.645538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:25.646692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:25.648327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:25.649168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:25.817534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:25.826382 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d54cf4be-75c3-4fab-bdde-503acbbd1ec2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1318 microversion: 2.1 time: 0.197139 Nov 02 13:20:25.827510 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3905/7265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:25 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:26.852456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:26.853778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:26.860480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:26.860964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:26.861402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:26.862581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:26.862834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:26.863262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:26.866165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:27.010285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:27.019029 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36a42cf0-206f-4c57-a597-f919b40f07c3 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1318 microversion: 2.1 time: 0.171936 Nov 02 13:20:27.019628 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3361/7266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:26 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:27.112139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-39e17bf5-f2ad-481e-893a-f14bc3c70299 req-464612eb-ef24-4bd1-82d5-91d61bbb6a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15480092-bebd-420f-a450-0bed8eec3df0", "tag": "c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:27.122612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-39e17bf5-f2ad-481e-893a-f14bc3c70299 req-464612eb-ef24-4bd1-82d5-91d61bbb6a17 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:27.123109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-39e17bf5-f2ad-481e-893a-f14bc3c70299 req-464612eb-ef24-4bd1-82d5-91d61bbb6a17 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:27.123560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-39e17bf5-f2ad-481e-893a-f14bc3c70299 req-464612eb-ef24-4bd1-82d5-91d61bbb6a17 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:27.137839 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-39e17bf5-f2ad-481e-893a-f14bc3c70299 req-464612eb-ef24-4bd1-82d5-91d61bbb6a17 service nova] Creating event network-changed:c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d for instance 15480092-bebd-420f-a450-0bed8eec3df0 on n-h1-855650-5 Nov 02 13:20:27.142878 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-39e17bf5-f2ad-481e-893a-f14bc3c70299 req-464612eb-ef24-4bd1-82d5-91d61bbb6a17 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034521 Nov 02 13:20:27.143490 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3906/7267] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:28.043950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:28.043950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:28.046436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:28.051565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:28.052069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:28.052522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:28.053235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:28.053699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:28.054428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:28.191884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:28.199668 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5f873020-0311-44d1-b7a5-7939917341d4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1318 microversion: 2.1 time: 0.160931 Nov 02 13:20:28.200243 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3362/7268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:28 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:29.224650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:29.225274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:29.231687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.232190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.232703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.233434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.233908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.234392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.376568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:29.384599 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9dc0fcbe-3cff-48a9-a188-b4052d04f33f tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1318 microversion: 2.1 time: 0.165264 Nov 02 13:20:29.385183 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3907/7269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:29 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:30.408196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:30.408836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:30.415942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:30.416433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:30.416863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:30.417594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:30.418074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:30.418504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:30.551395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:30.560103 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-69990fa2-179a-4dc5-984f-730a27edc768 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1318 microversion: 2.1 time: 0.155826 Nov 02 13:20:30.560693 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3363/7270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:30 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:31.583689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:31.584339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:31.592016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:31.592435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:31.592882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:31.593588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:31.594187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:31.594627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:31.732498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:31.740435 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9795103-33ff-4f0e-80c5-0111808fb63b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1318 microversion: 2.1 time: 0.160705 Nov 02 13:20:31.741015 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3908/7271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:31 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:32.763588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:32.764223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:32.771187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:32.771682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:32.772129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:32.772839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:32.773310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:32.773744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:32.912903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:32.921534 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2777766e-d70a-473a-9d53-c3335cfcd415 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1318 microversion: 2.1 time: 0.162026 Nov 02 13:20:32.922123 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3364/7272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:32 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:33.087355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a4ecd700-e372-410e-873c-6d9353a66bee req-9cf4978c-7f91-4fe8-a0c5-1c98b166d888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15480092-bebd-420f-a450-0bed8eec3df0", "name": "network-vif-plugged", "status": "completed", "tag": "c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:33.098886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4ecd700-e372-410e-873c-6d9353a66bee req-9cf4978c-7f91-4fe8-a0c5-1c98b166d888 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:33.099391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4ecd700-e372-410e-873c-6d9353a66bee req-9cf4978c-7f91-4fe8-a0c5-1c98b166d888 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:33.099842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4ecd700-e372-410e-873c-6d9353a66bee req-9cf4978c-7f91-4fe8-a0c5-1c98b166d888 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:33.112218 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a4ecd700-e372-410e-873c-6d9353a66bee req-9cf4978c-7f91-4fe8-a0c5-1c98b166d888 service nova] Creating event network-vif-plugged:c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d for instance 15480092-bebd-420f-a450-0bed8eec3df0 on n-h1-855650-5 Nov 02 13:20:33.117249 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a4ecd700-e372-410e-873c-6d9353a66bee req-9cf4978c-7f91-4fe8-a0c5-1c98b166d888 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Nov 02 13:20:33.117866 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3909/7273] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:33.945223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:33.945827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:33.947771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:33.954258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:33.954758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:33.955210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:33.955922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:33.956470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:33.956832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:34.094220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:34.102181 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-54f79338-ce14-488a-97bd-24cfef94845d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1318 microversion: 2.1 time: 0.160941 Nov 02 13:20:34.102777 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3365/7274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:33 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:35.123370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:35.124158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:35.129140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:35.129858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:35.137704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:35.138237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:35.138695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.139402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:35.139872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:35.140341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.272157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:35.281568 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1f283e2-348e-4035-a40f-ce3274ca9f98 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1509 microversion: 2.1 time: 0.159215 Nov 02 13:20:35.282187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3910/7275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:35 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:35.305152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:35.305770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:35.313144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:35.313633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:35.314107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.314912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:35.315279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:35.315716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.449776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:35.457693 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6f0a2a8b-272b-49b8-a6ac-1233e5ccffc5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1509 microversion: 2.1 time: 0.156860 Nov 02 13:20:35.458433 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3366/7276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:35 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:35.480145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:35.482488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:35.488552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:35.489053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:35.489501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.490244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:35.490712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:35.491149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.519868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:35.525406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:20:35.531992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:20:35.532424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:20:35.532915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:20:35.533345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:20:35.533766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:20:35.597661 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c8ef8852-9fe2-44bc-98ee-067de84e3dbd tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "POST /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0/action" status: 202 len: 0 microversion: 2.1 time: 0.121871 Nov 02 13:20:35.598307 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3911/7277] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:20:35 2022] POST /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:20:35.607064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:35.607697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:35.613678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:35.614210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:35.614658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.615370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:35.615828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:35.616260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.787026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:35.795992 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-41e98063-d784-499a-8264-b74486ad6fd8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1516 microversion: 2.1 time: 0.193293 Nov 02 13:20:35.796586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3367/7278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:35 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:36.821139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:36.822386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:36.830572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:36.831075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:36.831541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:36.832249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:36.832716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:36.833163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:36.983410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:36.992122 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7659dbd-3e53-4486-9170-4d1e490f23c4 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1516 microversion: 2.1 time: 0.175827 Nov 02 13:20:36.992706 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3912/7279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:36 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:38.017261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:38.017885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:38.024862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:38.025367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:38.025818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:38.026560 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:38.027024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:38.027460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:38.445535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:38.453699 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-254b59df-6d63-46a4-93cf-68a3ed6863ee tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.440393 Nov 02 13:20:38.454324 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3368/7280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:38 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:39.476895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:39.477439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:39.484355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:39.484886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:39.485305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:39.486035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:39.486521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:39.486950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:39.620927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:39.629596 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b7ca34c0-942b-4982-bfaa-998615bc6627 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.156654 Nov 02 13:20:39.630227 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3913/7281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:39 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:40.655243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:40.655804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:40.663422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.664019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.664471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.665188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.665649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.666190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.796537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:40.804322 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-027db27b-4b14-4331-b542-082677a4cc6b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.153842 Nov 02 13:20:40.805248 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3369/7282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:40 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:41.827751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:41.828383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:41.831163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:41.836653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:41.837151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:41.837607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:41.838342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:41.838810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:41.839248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:41.977635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:41.986293 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0492511f-a5d5-49c1-ae81-46f222a97544 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.162861 Nov 02 13:20:41.986877 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3914/7283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:41 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:43.009807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:43.010479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:43.017415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:43.017901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:43.018390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:43.019098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:43.019576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:43.020009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:43.155993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:43.164028 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7afcc62a-01da-486d-8929-f2f9ad528c0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.158257 Nov 02 13:20:43.164627 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3370/7284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:43 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:44.187861 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:44.188490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:44.195477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:44.195988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:44.196450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:44.197172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:44.197655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:44.198125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:44.339540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:44.348296 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-21553303-8591-4064-ad3b-fb6be72adcf5 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.164289 Nov 02 13:20:44.348892 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3915/7285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:44 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:45.372026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:45.372655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:45.380387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:45.380879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:45.381330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.382065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:45.382523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:45.382957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.512193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:45.520126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57b649bc-04c8-4bba-a8e3-8ef6d1ba3157 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.152041 Nov 02 13:20:45.520710 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3371/7286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:45 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:46.544820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:46.546002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:46.553148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:46.553649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:46.554207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:46.555259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:46.556439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:46.556439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:46.693469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:46.701376 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1353e8ff-e5cc-4ede-8dbc-f2e529fc5de9 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.160553 Nov 02 13:20:46.701957 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3916/7287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:46 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:47.725048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:47.725633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:47.732588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:47.733087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:47.733542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.734349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:47.734816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:47.735251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.873776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:47.882142 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-455f5c93-4f69-43ac-8cc6-354f97200ede tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.161082 Nov 02 13:20:47.882960 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3372/7288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:47 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:48.906301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:48.906910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:48.914390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:48.914891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:48.915350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:48.916059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:48.916527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:48.916966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:49.055537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:49.063987 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a16d0f7-29a4-4364-9e55-22051287dc8b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.161665 Nov 02 13:20:49.064567 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3917/7289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:48 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:50.087098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:50.087725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:50.095424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:50.095911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:50.096357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:50.097056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:50.097534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:50.097960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:50.231158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:50.239549 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b0a47ec-b2d3-4a86-a0d1-b66e97bba616 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.156380 Nov 02 13:20:50.240133 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3373/7290] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:50 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:51.263323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:51.264082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:51.271312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:51.271809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:51.272266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.272967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:51.273431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:51.273863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.276516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:51.412929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:51.421724 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b8ac897-5a13-46bd-94f2-5dd6720f09cf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.162281 Nov 02 13:20:51.422352 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3918/7291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:51 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:52.445272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:52.445875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:52.452808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:52.453301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:52.453756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:52.454491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:52.454952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:52.455387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:52.594093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:52.602002 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6cc6f30b-44ac-45f1-a518-4c62a143bcba tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.160648 Nov 02 13:20:52.602600 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3374/7292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:52 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:53.625645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:53.626228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:53.633437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:53.633945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:53.634439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:53.635166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:53.635686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:53.636211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:53.774447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:53.783595 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0830581c-f0c8-4bf5-99ee-c19858f38a0b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.162466 Nov 02 13:20:53.784256 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3919/7293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:53 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:54.808819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:54.809419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:54.816697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.817187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.817628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.818352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.818803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.819226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.960470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:54.968431 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-77165b4a-caa8-4e93-96e0-0d082795940c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.164004 Nov 02 13:20:54.969021 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3375/7294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:54 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:55.992249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.992886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:56.000594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:56.001129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:56.001588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:56.002356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:56.002833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:56.003277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:56.139502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:56.147388 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40972536-7c4c-4e3d-a86c-88da9ddbf350 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.159220 Nov 02 13:20:56.147969 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3920/7295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:57.171864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:57.172552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:57.179451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:57.179943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:57.180627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:57.181325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:57.181774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:57.182226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:57.184843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=90 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:57.316533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:57.328272 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b8e8a0b9-6f66-47da-8a8a-1d7c43fdc409 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.160301 Nov 02 13:20:57.328879 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3376/7296] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:57 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:58.352212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:58.352832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:58.360540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:58.361038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:58.361490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:58.362305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:58.362768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:58.363206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:58.493586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:58.501774 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c392cca1-c740-4a58-8a6e-2adac1c72273 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.153502 Nov 02 13:20:58.502391 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3921/7297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:58 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:59.525224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:59.525857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:59.529063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=30 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:59.536044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.536545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.536987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.537699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.538188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.538630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.676353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:59.684547 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-359cf2f4-a9f8-41f8-aaf9-c6ef6f81062e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.163637 Nov 02 13:20:59.685133 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3377/7298] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:59 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:00.708597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:00.709148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:00.716349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.717328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.717797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.718543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.719016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.719492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.856689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:00.865282 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c114565a-d107-4689-ad7e-19cbfdf97902 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.160624 Nov 02 13:21:00.865887 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3922/7299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:00 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:01.888806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:01.889583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:01.896292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.896778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.897231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.897914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.898393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.898830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:02.031159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:02.039213 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9a826788-876d-4ce3-8d89-35843be93cdc tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.154361 Nov 02 13:21:02.039801 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3378/7300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:01 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:03.063999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:03.064645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:03.071573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:03.072077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:03.072537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.073254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:03.073725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:03.074204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.206911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:03.214688 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1008aa7f-6d56-4a14-be6f-98e007851b60 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.155411 Nov 02 13:21:03.215271 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3923/7301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:03 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:04.238142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:04.238956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:04.245948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:04.246475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:04.247307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.247610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:04.248072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:04.248503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.396357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:04.406301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-faf938cc-f88e-4b70-8c2b-3c1217ba4dd7 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1521 microversion: 2.1 time: 0.172049 Nov 02 13:21:04.406905 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3379/7302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:04 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:05.133043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0df2687b-607e-4759-a73d-feac089dc012 req-23d914a7-8e48-46f8-88fe-c54691e93459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15480092-bebd-420f-a450-0bed8eec3df0", "name": "network-vif-unplugged", "status": "completed", "tag": "c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:05.144415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0df2687b-607e-4759-a73d-feac089dc012 req-23d914a7-8e48-46f8-88fe-c54691e93459 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.145063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0df2687b-607e-4759-a73d-feac089dc012 req-23d914a7-8e48-46f8-88fe-c54691e93459 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.145602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0df2687b-607e-4759-a73d-feac089dc012 req-23d914a7-8e48-46f8-88fe-c54691e93459 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.159080 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0df2687b-607e-4759-a73d-feac089dc012 req-23d914a7-8e48-46f8-88fe-c54691e93459 service nova] Creating event network-vif-unplugged:c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d for instance 15480092-bebd-420f-a450-0bed8eec3df0 on n-h2-855650-5 Nov 02 13:21:05.164916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-0df2687b-607e-4759-a73d-feac089dc012 req-23d914a7-8e48-46f8-88fe-c54691e93459 service nova] Instance 15480092-bebd-420f-a450-0bed8eec3df0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:21:05.177552 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0df2687b-607e-4759-a73d-feac089dc012 req-23d914a7-8e48-46f8-88fe-c54691e93459 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048548 Nov 02 13:21:05.178396 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3924/7303] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:05.430112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:05.430994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:05.437851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.438374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.438848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.439525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.439984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.440410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.674334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:05.682582 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9053196f-836f-449f-b397-cc6a3fbc7ca1 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1520 microversion: 2.1 time: 0.256706 Nov 02 13:21:05.683275 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3380/7304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:05 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:06.708168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:06.708792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:06.715829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:06.716325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:06.716787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:06.717497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:06.717953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:06.719005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:06.869299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:06.877328 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-165a982a-fbda-4acc-80b3-8bc6a12c05e0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1518 microversion: 2.1 time: 0.173555 Nov 02 13:21:06.877929 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3925/7305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:06 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:07.196042 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b42b8830-da4a-4f4d-bfa5-55feae270830 req-43a6a869-1a4a-4b07-9f78-7b1fe71b8625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15480092-bebd-420f-a450-0bed8eec3df0", "tag": "c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:07.206847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b42b8830-da4a-4f4d-bfa5-55feae270830 req-43a6a869-1a4a-4b07-9f78-7b1fe71b8625 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.207327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b42b8830-da4a-4f4d-bfa5-55feae270830 req-43a6a869-1a4a-4b07-9f78-7b1fe71b8625 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.207765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b42b8830-da4a-4f4d-bfa5-55feae270830 req-43a6a869-1a4a-4b07-9f78-7b1fe71b8625 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.219852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b42b8830-da4a-4f4d-bfa5-55feae270830 req-43a6a869-1a4a-4b07-9f78-7b1fe71b8625 service nova] Creating event network-changed:c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d for instance 15480092-bebd-420f-a450-0bed8eec3df0 on n-h2-855650-5 Nov 02 13:21:07.225354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-b42b8830-da4a-4f4d-bfa5-55feae270830 req-43a6a869-1a4a-4b07-9f78-7b1fe71b8625 service nova] Instance 15480092-bebd-420f-a450-0bed8eec3df0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:21:07.237346 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b42b8830-da4a-4f4d-bfa5-55feae270830 req-43a6a869-1a4a-4b07-9f78-7b1fe71b8625 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045094 Nov 02 13:21:07.237993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3381/7306] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:07.902061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:07.902696 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:07.910168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.910674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.911135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.911849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.912323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.912766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:08.047384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:08.055356 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aae03a65-c673-4752-a280-021bb3555959 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1518 microversion: 2.1 time: 0.157265 Nov 02 13:21:08.056203 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3926/7307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:07 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:09.080538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:09.081240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:09.087429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.087916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.088355 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.089043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.089497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.089919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.256049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:09.264235 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f2cbe7d-9259-4a56-8673-30d4503d2393 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1515 microversion: 2.1 time: 0.188841 Nov 02 13:21:09.265086 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3382/7308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:09 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:09.288104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:09.288683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:09.295633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.296136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.297073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.297775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.298263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.298702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.377617 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2b5564b-61f8-47f7-b8ae-ebd30e513f30 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "POST /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0/action" status: 204 len: 0 microversion: 2.1 time: 0.093343 Nov 02 13:21:09.378315 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3927/7309] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:21:09 2022] POST /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0/action => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:21:09.386745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:09.387757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:09.394936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.395848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.396685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.397448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.398269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.398901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.681780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:09.690398 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8bdb817-1c70-408f-92ff-3d2388425eb0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1515 microversion: 2.1 time: 0.307625 Nov 02 13:21:09.691319 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3383/7310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:09 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:10.715926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:10.716777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:10.724979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.725828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.726323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.727064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.727538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.727979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.874905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:10.883143 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c7bc0bb3-8215-42f0-a545-d34da5ff10b0 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1515 microversion: 2.1 time: 0.172839 Nov 02 13:21:10.884053 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3928/7311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:10 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:11.909243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:11.909861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:11.916855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:11.917341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:11.917786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:11.918531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:11.918987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:11.919421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.065019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.073777 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bf3df465-2245-4e68-a35b-500e277df4e2 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1507 microversion: 2.1 time: 0.168403 Nov 02 13:21:12.074417 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3384/7312] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:11 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:12.095975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.096604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.099528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=30 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:12.105367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.105903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.106458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.107159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.107638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.108103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.256376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.265752 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5da6564b-360b-43d1-816a-69a4e2e11bce tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1507 microversion: 2.1 time: 0.173462 Nov 02 13:21:12.272468 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3929/7313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:12 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:12.290307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.290836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.298962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.300087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.300087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.300636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.301079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.301515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.390980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6d36f398-ea26-4d11-907a-014385ccdd3f req-8979e93c-4012-4304-b471-b832307383d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15480092-bebd-420f-a450-0bed8eec3df0", "name": "network-vif-plugged", "status": "completed", "tag": "c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:12.409095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d36f398-ea26-4d11-907a-014385ccdd3f req-8979e93c-4012-4304-b471-b832307383d9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.409498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d36f398-ea26-4d11-907a-014385ccdd3f req-8979e93c-4012-4304-b471-b832307383d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.409951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6d36f398-ea26-4d11-907a-014385ccdd3f req-8979e93c-4012-4304-b471-b832307383d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.422590 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6d36f398-ea26-4d11-907a-014385ccdd3f req-8979e93c-4012-4304-b471-b832307383d9 service nova] Creating event network-vif-plugged:c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d for instance 15480092-bebd-420f-a450-0bed8eec3df0 on n-h2-855650-5 Nov 02 13:21:12.428241 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6d36f398-ea26-4d11-907a-014385ccdd3f req-8979e93c-4012-4304-b471-b832307383d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047779 Nov 02 13:21:12.429165 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3930/7314] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:12.465331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.474271 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9c1a1ac-c86b-4233-931f-9df73ba6ec6e tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1507 microversion: 2.1 time: 0.189134 Nov 02 13:21:12.474867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3385/7315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:12 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:12.497552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.498167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.504363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.504858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.505308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.506035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.506499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.506931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.532076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:21:12.618752 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0db44b8e-1ea6-43fc-8490-ea8794efa8bf tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "DELETE /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 204 len: 0 microversion: 2.1 time: 0.124965 Nov 02 13:21:12.619682 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3931/7316] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:21:12 2022] DELETE /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:21:12.641455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.642040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.649366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.649863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.650338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.651050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.651509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.651941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.679169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:21:12.725697 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.compute.api [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Instance is already in deleting state, ignoring this request Nov 02 13:21:12.726472 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-efd34557-2308-4331-95c0-b7ef9ccfa973 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "DELETE /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 204 len: 0 microversion: 2.1 time: 0.091804 Nov 02 13:21:12.727049 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3386/7317] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:21:12 2022] DELETE /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:21:12.735853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.736607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.742863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.743369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.743821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.744552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.745013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.745440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.883464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.883464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:12.888306 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e15e6ab5-94c7-4c06-9088-ea2fcece2fb8 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1513 microversion: 2.1 time: 0.156807 Nov 02 13:21:12.888906 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3932/7318] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:12 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:13.912661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:13.913287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:13.920138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.920629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.921075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.922451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.922910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.923342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.061431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.069714 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-97486039-47ee-4777-a93a-adbdc1f65655 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1513 microversion: 2.1 time: 0.160945 Nov 02 13:21:14.070346 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3387/7319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:13 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:14.670102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-327816a1-a95c-41cc-ab02-af7ae0a20973 req-7a0ed981-b987-45eb-af87-96b5b0d17d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15480092-bebd-420f-a450-0bed8eec3df0", "name": "network-vif-deleted", "tag": "c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:14.691199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-327816a1-a95c-41cc-ab02-af7ae0a20973 req-7a0ed981-b987-45eb-af87-96b5b0d17d9a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.691915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-327816a1-a95c-41cc-ab02-af7ae0a20973 req-7a0ed981-b987-45eb-af87-96b5b0d17d9a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.692469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-327816a1-a95c-41cc-ab02-af7ae0a20973 req-7a0ed981-b987-45eb-af87-96b5b0d17d9a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.705350 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-327816a1-a95c-41cc-ab02-af7ae0a20973 req-7a0ed981-b987-45eb-af87-96b5b0d17d9a service nova] Creating event network-vif-deleted:c1ba237a-e1d5-4cc0-b7dd-a155a2a7e16d for instance 15480092-bebd-420f-a450-0bed8eec3df0 on n-h2-855650-5 Nov 02 13:21:14.710238 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-327816a1-a95c-41cc-ab02-af7ae0a20973 req-7a0ed981-b987-45eb-af87-96b5b0d17d9a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044606 Nov 02 13:21:14.711119 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3933/7320] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:15.093001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:15.093652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:15.100555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.101063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.101557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.102245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.102714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.103146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.141789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.142322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.142825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.143237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lazy-loading 'fault' on Instance uuid 15480092-bebd-420f-a450-0bed8eec3df0 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:15.190713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6036506aeaf94ef4b31be5396db62af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d244716964e2c9520bca174e33120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:15.199130 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d9588d16-4951-459c-9c01-1c8728df5ab6 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 200 len: 1306 microversion: 2.1 time: 0.110066 Nov 02 13:21:15.199881 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3388/7321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:15 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:16.225343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.226082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: 15480092-bebd-420f-a450-0bed8eec3df0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.232285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.232786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.233242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.234026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.234500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.234942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.248381 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] HTTP exception thrown: Instance 15480092-bebd-420f-a450-0bed8eec3df0 could not be found. Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Request method failure captured: Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 HTTP/1.1 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm5Yy4owWXjkiPKgbdNE1dq6NTiXAF9xSUxlpkKdO6-7JAyH6piD9xHVu-F0-E6BlgGcyOkCQwDF0bqp7efno0GNRbgQfkp4wGfl82utwFAjzvnF9TZhNIU07xV6LEvpQHX3jdl9qwcVsdinWtkW6oauS2biiYh3pecmNB2fwY77hT4 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 6c2d244716964e2c9520bca174e33120 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6c2d244716964e2c9520bca174e33120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6c2d244716964e2c9520bca174e33120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6c2d244716964e2c9520bca174e33120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6c2d244716964e2c9520bca174e33120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 6c2d244716964e2c9520bca174e33120 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerDiskConfigTestJSON-114037425-project Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6036506aeaf94ef4b31be5396db62af8 Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerDiskConfigTestJSON-114037425-project Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 15480092-bebd-420f-a450-0bed8eec3df0 could not be found. Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '15480092-bebd-420f-a450-0bed8eec3df0'} Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15480092-bebd-420f-a450-0bed8eec3df0 could not be found. Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15480092-bebd-420f-a450-0bed8eec3df0 could not be found. Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:16.250621 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15480092-bebd-420f-a450-0bed8eec3df0 could not be found. Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Returning 404 to user: Instance 15480092-bebd-420f-a450-0bed8eec3df0 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a223a23-1158-4076-9b20-16aabf85409b tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0" status: 404 len: 111 microversion: 2.1 time: 0.031995 Nov 02 13:21:16.255365 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3934/7322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/15480092-bebd-420f-a450-0bed8eec3df0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:21:16.261068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5ae9c7c-e9cd-41f5-9642-72ee6b98cc5d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '.version_select at 0x7f228e8c2040>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.282494 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5ae9c7c-e9cd-41f5-9642-72ee6b98cc5d tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425115341" status: 202 len: 0 microversion: 2.1 time: 0.025201 Nov 02 13:21:16.283197 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3389/7323] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 13:21:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425115341 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:21:16.898494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.898978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.905430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.906480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.906924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.907657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.908118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.908552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.923140 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] HTTP exception thrown: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Request method failure captured: Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 HTTP/1.1 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm5Yy4owWXjkiPKgbdNE1dq6NTiXAF9xSUxlpkKdO6-7JAyH6piD9xHVu-F0-E6BlgGcyOkCQwDF0bqp7efno0GNRbgQfkp4wGfl82utwFAjzvnF9TZhNIU07xV6LEvpQHX3jdl9qwcVsdinWtkW6oauS2biiYh3pecmNB2fwY77hT4 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 6c2d244716964e2c9520bca174e33120 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6c2d244716964e2c9520bca174e33120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6c2d244716964e2c9520bca174e33120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6c2d244716964e2c9520bca174e33120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6c2d244716964e2c9520bca174e33120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 6c2d244716964e2c9520bca174e33120 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerDiskConfigTestJSON-114037425-project Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6036506aeaf94ef4b31be5396db62af8 Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerDiskConfigTestJSON-114037425-project Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'd68768e8-3531-459c-a05b-780085cbfe77'} Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:21:16.924702 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Returning 404 to user: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5d1fc12c-dbda-4301-802a-32815f3aa079 tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 404 len: 111 microversion: 2.1 time: 0.032003 Nov 02 13:21:16.933604 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3935/7324] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:21:16 2022] DELETE /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:21:16.939121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.939756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] [instance: d68768e8-3531-459c-a05b-780085cbfe77] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.946588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.947091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.947538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.948287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.948753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.949187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.969723 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] HTTP exception thrown: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Request method failure captured: Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 HTTP/1.1 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm5Yy4owWXjkiPKgbdNE1dq6NTiXAF9xSUxlpkKdO6-7JAyH6piD9xHVu-F0-E6BlgGcyOkCQwDF0bqp7efno0GNRbgQfkp4wGfl82utwFAjzvnF9TZhNIU07xV6LEvpQHX3jdl9qwcVsdinWtkW6oauS2biiYh3pecmNB2fwY77hT4 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 6c2d244716964e2c9520bca174e33120 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6c2d244716964e2c9520bca174e33120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6c2d244716964e2c9520bca174e33120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6c2d244716964e2c9520bca174e33120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6c2d244716964e2c9520bca174e33120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 6c2d244716964e2c9520bca174e33120 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-114037425 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerDiskConfigTestJSON-114037425-project Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6036506aeaf94ef4b31be5396db62af8 Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerDiskConfigTestJSON-114037425-project Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'd68768e8-3531-459c-a05b-780085cbfe77'} Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:16.971472 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] Returning 404 to user: Instance d68768e8-3531-459c-a05b-780085cbfe77 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e92412fb-bc72-45b7-809e-7a9f210e697c tempest-ServerDiskConfigTestJSON-114037425 tempest-ServerDiskConfigTestJSON-114037425-project] 10.222.0.45 "GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77" status: 404 len: 111 microversion: 2.1 time: 0.039691 Nov 02 13:21:16.976096 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3390/7325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/d68768e8-3531-459c-a05b-780085cbfe77 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:21:26.065853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f30e3f2d-57b6-49e1-a7c4-a78e911284aa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'create', calling method: .version_select at 0x7f228e6c1160>, body: {"keypair": {"name": "tempest-keypair-783021381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqM7/ocVzIpvxoXmtUJ+N6+336qTlqiM8BKR79iUO7CPRuoxrCCOrvZRBpKBFfmHKzS1Y0QZWX5bWv+zlVxPac3ix734zMpu8b7bfBxUcHUjDE+FWg6jukSV2eOJWjA9Q=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:26.082889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f30e3f2d-57b6-49e1-a7c4-a78e911284aa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for project 5345434f4a0144bf93bf64442bfe411c. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:21:26.088831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-f30e3f2d-57b6-49e1-a7c4-a78e911284aa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for user b990a688f9c44a5a8c2fae7818d46c5d and project 5345434f4a0144bf93bf64442bfe411c. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:21:26.135177 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f30e3f2d-57b6-49e1-a7c4-a78e911284aa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.197054 Nov 02 13:21:26.135808 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3936/7326] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:21:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:27.532394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-48157118", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcb8e111-a978-4e3e-b47a-9c5ed66997ad"}], "security_groups": [{"name": "tempest-securitygroup--1285657684"}], "key_name": "tempest-keypair-783021381", "user_data": "}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:27.541621 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:21:27.541834 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:21:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Nov 02 13:21:27.542966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:27.544086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:27.665641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] validate_networks() for [('fcb8e111-a978-4e3e-b47a-9c5ed66997ad', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:21:28.184611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:28.185071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:28.185548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:28.185984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:28.186570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:28.196358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.196868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.197301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.198078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.198532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.198954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.219776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for project 5345434f4a0144bf93bf64442bfe411c. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:21:28.225670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for user b990a688f9c44a5a8c2fae7818d46c5d and project 5345434f4a0144bf93bf64442bfe411c. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:21:28.240847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:21:28.243372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:21:28.295961 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e285847-5700-4d85-bae9-7b53099206a0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.768843 Nov 02 13:21:28.297012 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3391/7327] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:21:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:21:28.305254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:28.311387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d9c7487-6224-403a-a406-564803b44f55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:28.314646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d9c7487-6224-403a-a406-564803b44f55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:28.384986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d9c7487-6224-403a-a406-564803b44f55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:28.394290 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d9c7487-6224-403a-a406-564803b44f55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1236 microversion: 2.1 time: 0.089650 Nov 02 13:21:28.395029 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3937/7328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:28 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:29.417694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:29.418354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:29.427624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.428131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.428580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.429700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.430200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.430635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.506172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:29.514599 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3a25d2f6-60f6-4295-a6ea-b9f410d39a02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1288 microversion: 2.1 time: 0.101668 Nov 02 13:21:29.526522 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3392/7329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:29 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:30.540591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:30.541153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:30.549995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:30.550508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:30.550962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.551687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:30.552156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:30.552596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.703664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:30.711871 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-13d08c2e-99ea-4dde-b5b1-a1da5013f5e6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.175329 Nov 02 13:21:30.712467 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3938/7330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:30 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:31.293871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e238d2bf-960f-400a-8efd-2835a38c0ded req-1a39d2be-8bb0-4ff9-bb82-c49853a4b491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac50158-8ef0-4537-8203-2b7c51ad49d0", "tag": "4ee6ab60-0a6d-44f0-8678-47cbf0b01618"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:31.310052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e238d2bf-960f-400a-8efd-2835a38c0ded req-1a39d2be-8bb0-4ff9-bb82-c49853a4b491 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.310551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e238d2bf-960f-400a-8efd-2835a38c0ded req-1a39d2be-8bb0-4ff9-bb82-c49853a4b491 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.310991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e238d2bf-960f-400a-8efd-2835a38c0ded req-1a39d2be-8bb0-4ff9-bb82-c49853a4b491 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.324451 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e238d2bf-960f-400a-8efd-2835a38c0ded req-1a39d2be-8bb0-4ff9-bb82-c49853a4b491 service nova] Creating event network-changed:4ee6ab60-0a6d-44f0-8678-47cbf0b01618 for instance aac50158-8ef0-4537-8203-2b7c51ad49d0 on n-h2-855650-5 Nov 02 13:21:31.330461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e238d2bf-960f-400a-8efd-2835a38c0ded req-1a39d2be-8bb0-4ff9-bb82-c49853a4b491 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040270 Nov 02 13:21:31.331725 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3393/7331] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:31.737089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:31.737701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:31.745273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.745770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.746268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.747153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.747583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.747994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.881188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:31.889590 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0131ea89-7153-4457-9d2e-f2f61ddfb060 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.157037 Nov 02 13:21:31.890258 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3939/7332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:31 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:32.919924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:32.920635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:32.927147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:32.927637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:32.928085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:32.928785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:32.929237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:32.929661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.061483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:33.070022 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8b9c2ee-06f2-441b-9d51-087e87479b38 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.161376 Nov 02 13:21:33.070599 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3394/7333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:32 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:34.093038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:34.094543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:34.101531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.102071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.102539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.103268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.103745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.104249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.245215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:34.253698 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3084d161-cb7b-4260-88d5-21a0fc632699 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.164626 Nov 02 13:21:34.254488 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3940/7334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:34 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:35.276845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:35.277465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:35.285399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.285898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.286424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.287193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.287652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.288094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.421526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:35.429537 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-357185a7-a9ca-4895-b581-87c57200df7c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.156621 Nov 02 13:21:35.430210 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3395/7335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:35 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:36.453046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:36.454318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:36.461131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.461684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.462358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.463085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.463561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.464008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.604885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:36.613530 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d66529de-329f-4786-9148-f8215cb7541c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.164330 Nov 02 13:21:36.614165 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3941/7336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:36 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:37.636725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:37.637290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:37.644156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.644645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.645109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.645872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.646541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.646981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.791738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:37.800190 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d7a0e1c8-a705-4ca0-85d5-ce2048cd5c68 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.167431 Nov 02 13:21:37.811277 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3396/7337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:37 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:38.463185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7453d1eb-2bcc-49a0-92d1-6f11349eb357 req-6c8a5cdd-7195-4313-960f-c698b79081d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac50158-8ef0-4537-8203-2b7c51ad49d0", "name": "network-vif-plugged", "status": "completed", "tag": "4ee6ab60-0a6d-44f0-8678-47cbf0b01618"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:38.470367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:38.477372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7453d1eb-2bcc-49a0-92d1-6f11349eb357 req-6c8a5cdd-7195-4313-960f-c698b79081d8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.477887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7453d1eb-2bcc-49a0-92d1-6f11349eb357 req-6c8a5cdd-7195-4313-960f-c698b79081d8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.478361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7453d1eb-2bcc-49a0-92d1-6f11349eb357 req-6c8a5cdd-7195-4313-960f-c698b79081d8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.490907 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7453d1eb-2bcc-49a0-92d1-6f11349eb357 req-6c8a5cdd-7195-4313-960f-c698b79081d8 service nova] Creating event network-vif-plugged:4ee6ab60-0a6d-44f0-8678-47cbf0b01618 for instance aac50158-8ef0-4537-8203-2b7c51ad49d0 on n-h2-855650-5 Nov 02 13:21:38.496094 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7453d1eb-2bcc-49a0-92d1-6f11349eb357 req-6c8a5cdd-7195-4313-960f-c698b79081d8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036697 Nov 02 13:21:38.496714 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3942/7338] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:21:38.824394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:38.825014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:38.827030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:38.828502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:38.835711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.836213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.836670 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.837376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.837843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.838416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.976252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:38.986098 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c2946ea8-5c1a-4076-9159-8f631dd1568d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.165552 Nov 02 13:21:38.986700 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3397/7339] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:38 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:40.010716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:40.011440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:40.019592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.020103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.020559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.021274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.021736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.022208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.173224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:40.181764 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-158ac0d5-978b-49ef-b4c0-a6cca6c26ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1362 microversion: 2.1 time: 0.175316 Nov 02 13:21:40.182662 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3943/7340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:40 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:41.205799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:41.206554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:41.213458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.213944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.214418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.215112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.215566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.215989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.351672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:41.359586 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-791ffdcc-e476-4593-82c7-a2b83a698b95 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1550 microversion: 2.1 time: 0.158189 Nov 02 13:21:41.360168 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3398/7341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:41 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:41.382224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:41.382772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:41.389599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.390699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.391168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.391910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.392361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.392808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.470981 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-26e64c6a-7967-4540-8f2e-68565c943043 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092741 Nov 02 13:21:41.471593 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3944/7342] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 13:21:41 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:42.806142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b3ba3944-db07-4928-8dec-c0178c45d2c3 req-7a05a18a-5202-4177-b737-39f77430ee61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac50158-8ef0-4537-8203-2b7c51ad49d0", "tag": "4ee6ab60-0a6d-44f0-8678-47cbf0b01618"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:42.816144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b3ba3944-db07-4928-8dec-c0178c45d2c3 req-7a05a18a-5202-4177-b737-39f77430ee61 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.816624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b3ba3944-db07-4928-8dec-c0178c45d2c3 req-7a05a18a-5202-4177-b737-39f77430ee61 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.817059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b3ba3944-db07-4928-8dec-c0178c45d2c3 req-7a05a18a-5202-4177-b737-39f77430ee61 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.829171 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b3ba3944-db07-4928-8dec-c0178c45d2c3 req-7a05a18a-5202-4177-b737-39f77430ee61 service nova] Creating event network-changed:4ee6ab60-0a6d-44f0-8678-47cbf0b01618 for instance aac50158-8ef0-4537-8203-2b7c51ad49d0 on n-h2-855650-5 Nov 02 13:21:42.834372 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b3ba3944-db07-4928-8dec-c0178c45d2c3 req-7a05a18a-5202-4177-b737-39f77430ee61 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089529 Nov 02 13:21:42.835241 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3399/7343] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:22:58.229115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:58.230142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=36 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:58.234513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.235154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.242856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.243403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.243816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.244539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.245012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.245454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.435479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.444153 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18262bc5-2e38-4c78-b742-dbe559b16646 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1668 microversion: 2.1 time: 0.218518 Nov 02 13:22:58.444739 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3945/7344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1668 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:58.466454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:58.467197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=42 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:58.472104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.472846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.480951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.481450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.481899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.482633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.483097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.483529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.623724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.631994 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-615182a4-c737-4159-9bd9-120fdad8aea1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1668 microversion: 2.1 time: 0.167904 Nov 02 13:22:58.632592 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3400/7345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:58.655256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.655830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.662471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.662980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.663430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.664135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.664596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.665035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.799535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.807507 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ca940d5-8a9c-44ec-9924-cf13269598d5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1668 microversion: 2.1 time: 0.156839 Nov 02 13:22:58.808098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3946/7346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:58.830846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:58.833641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.839873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.840362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.840808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.841511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.841990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.842430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.883320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.889808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120723) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:22:58.897328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:58.897757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:58.898268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:58.898690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:58.899110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:58.964216 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a7a445ff-4ba9-42b2-b707-2a10c7c5f74d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0/action" status: 202 len: 0 microversion: 2.1 time: 0.137270 Nov 02 13:22:58.964754 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3401/7347] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:22:58 2022] POST /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:22:58.973653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.974320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.980295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.980802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.981266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.982009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.982486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.982928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.124088 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.132923 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-098391c2-b76c-4b16-b1f3-0ed5d7a64b2a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1677 microversion: 2.1 time: 0.163797 Nov 02 13:22:59.133518 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3947/7348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.157368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.158287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.165599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.166118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.166565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.167257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.167710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.168170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.303893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.313814 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d2b9f776-4399-4d62-9468-089027fc15b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1677 microversion: 2.1 time: 0.161394 Nov 02 13:23:00.314566 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3402/7349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:01.341415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.342076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.349250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.349758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.350256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.350981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.351453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.351899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.486974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.496823 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ebdbdbc-020f-41e1-a255-5335fb815814 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.159497 Nov 02 13:23:01.497430 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3948/7350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:01 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:02.521458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:02.522111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:02.529690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.530215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.530663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.531372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.531834 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.532273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.670655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:02.679184 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0e99dc03-b017-4d9e-94f0-c49606a40976 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.162252 Nov 02 13:23:02.679764 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3403/7351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:02 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:03.703517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:03.704068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:03.710882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.711394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.711853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.712571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.713045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.713501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.848214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.856087 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04370028-2f8b-4298-9f12-399837376557 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.156598 Nov 02 13:23:03.856766 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3949/7352] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:03 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:04.884314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:04.887368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:04.896853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.897656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.898397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:04.899551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.900302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.901204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:05.086248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.094148 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f58505a-5869-41ae-b13f-76154f9b2678 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.218277 Nov 02 13:23:05.094742 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3404/7353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:04 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:06.117457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:06.118128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:06.124884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.125392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.125846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.126595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.127077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.127520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.260866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:06.268845 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-516fdf60-ba5c-4d76-8029-d518d044ea94 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.155281 Nov 02 13:23:06.269473 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3950/7354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:06 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:07.293476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:07.294143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:07.301837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.302391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.302828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.303543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.304007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.304441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.437371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.445798 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-73e7921e-d1e1-4590-bf57-b70559c6bec7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.156333 Nov 02 13:23:07.446415 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3405/7355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:07 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:08.470103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:08.470646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:08.477781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:08.478314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:08.478765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:08.479479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:08.479946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:08.480382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:08.625207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:08.634230 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-644ee087-4f9b-451c-8079-91b06fd3962f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.168226 Nov 02 13:23:08.634821 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3951/7356] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:08 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:09.658646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:09.659195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:09.667639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:09.668175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:09.668635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:09.669480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:09.669999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:09.670441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:09.811344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:09.819345 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dd6777b6-4ba7-4af6-b2c9-3dad91316d07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.165125 Nov 02 13:23:09.819795 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3406/7357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:09 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:10.843317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:10.843948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:10.851615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.852113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.852566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.853274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.853749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.854213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.987732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:10.996195 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48dc7100-c608-4945-b32b-fca8e798f939 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.156996 Nov 02 13:23:10.996801 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3952/7358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:10 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:12.022278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:12.022909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:12.030122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.030633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.031083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.031806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.032272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.032710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.168616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:12.176993 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32bba545-604b-4828-8f80-67a302c3f1cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.159297 Nov 02 13:23:12.189988 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3407/7359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:12 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:13.203703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:13.204333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:13.211492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:13.212004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:13.212467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:13.213196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:13.213671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:13.214152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:13.361992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:13.370884 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6ff0bd6-2b74-4ed6-9d51-019976365e00 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1682 microversion: 2.1 time: 0.171446 Nov 02 13:23:13.371679 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3953/7360] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:13 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:14.217484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-44d7066c-aa95-4315-b336-1a267d4b3d85 req-d582fb34-9833-4360-b114-c6acffa397e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac50158-8ef0-4537-8203-2b7c51ad49d0", "name": "network-vif-unplugged", "status": "completed", "tag": "4ee6ab60-0a6d-44f0-8678-47cbf0b01618"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:14.228001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-44d7066c-aa95-4315-b336-1a267d4b3d85 req-d582fb34-9833-4360-b114-c6acffa397e1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.228521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-44d7066c-aa95-4315-b336-1a267d4b3d85 req-d582fb34-9833-4360-b114-c6acffa397e1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.228962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-44d7066c-aa95-4315-b336-1a267d4b3d85 req-d582fb34-9833-4360-b114-c6acffa397e1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.241660 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-44d7066c-aa95-4315-b336-1a267d4b3d85 req-d582fb34-9833-4360-b114-c6acffa397e1 service nova] Creating event network-vif-unplugged:4ee6ab60-0a6d-44f0-8678-47cbf0b01618 for instance aac50158-8ef0-4537-8203-2b7c51ad49d0 on n-h1-855650-5 Nov 02 13:23:14.247676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-44d7066c-aa95-4315-b336-1a267d4b3d85 req-d582fb34-9833-4360-b114-c6acffa397e1 service nova] Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:23:14.260655 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-44d7066c-aa95-4315-b336-1a267d4b3d85 req-d582fb34-9833-4360-b114-c6acffa397e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104786 Nov 02 13:23:14.261277 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3408/7361] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:23:14.395403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:14.396169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:14.403297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.403808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.404281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.404992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.405455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.405888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.546533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:14.554666 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2b75ba0-8f91-4464-8114-d6c6852315c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1681 microversion: 2.1 time: 0.163061 Nov 02 13:23:14.555174 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3954/7362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:14 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:15.580982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:15.581700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:15.588864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.589755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.589755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.590468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.590936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.591374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.735093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:15.743999 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a0df5659-d48b-4c8a-9e07-58f8b65cc6bb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1679 microversion: 2.1 time: 0.168250 Nov 02 13:23:15.744634 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3409/7363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:15 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:16.277323 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1b094226-17b6-43c9-8b15-2002bca6417f req-a611cca4-b611-4c00-b786-4fc27fae8355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac50158-8ef0-4537-8203-2b7c51ad49d0", "tag": "4ee6ab60-0a6d-44f0-8678-47cbf0b01618"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:16.288430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1b094226-17b6-43c9-8b15-2002bca6417f req-a611cca4-b611-4c00-b786-4fc27fae8355 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.288916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1b094226-17b6-43c9-8b15-2002bca6417f req-a611cca4-b611-4c00-b786-4fc27fae8355 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.289356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1b094226-17b6-43c9-8b15-2002bca6417f req-a611cca4-b611-4c00-b786-4fc27fae8355 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:16.304363 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1b094226-17b6-43c9-8b15-2002bca6417f req-a611cca4-b611-4c00-b786-4fc27fae8355 service nova] Creating event network-changed:4ee6ab60-0a6d-44f0-8678-47cbf0b01618 for instance aac50158-8ef0-4537-8203-2b7c51ad49d0 on n-h1-855650-5 Nov 02 13:23:16.310343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-1b094226-17b6-43c9-8b15-2002bca6417f req-a611cca4-b611-4c00-b786-4fc27fae8355 service nova] Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:23:16.321980 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1b094226-17b6-43c9-8b15-2002bca6417f req-a611cca4-b611-4c00-b786-4fc27fae8355 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048316 Nov 02 13:23:16.322629 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3955/7364] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:16.768157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:16.768786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:16.775881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.776369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.776819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:16.777539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.778022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.778440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:16.959478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:16.967540 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-197e8c97-12ff-4f26-b779-798b6519aab3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1679 microversion: 2.1 time: 0.203643 Nov 02 13:23:16.968113 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3410/7365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:16 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:17.991793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:17.992465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:17.999602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.000097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.000547 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.001254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.001717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.002185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.142991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:18.150966 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6643208b-7bb1-44b2-b689-9cc013caccd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1679 microversion: 2.1 time: 0.163720 Nov 02 13:23:18.151554 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3956/7366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:17 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:19.175056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:19.175768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:19.183251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.183751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.184201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:19.184927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.185389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.186111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:19.318893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:19.329794 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-416443f1-f2e8-4224-89c2-520aa213706d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1679 microversion: 2.1 time: 0.158108 Nov 02 13:23:19.330976 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3411/7367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:19 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:20.356543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:20.357324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:20.365786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.366318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.366772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.367483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.367945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.368410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.504762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:20.512824 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ce11114-7e5f-4087-927e-70218e09bc0d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1676 microversion: 2.1 time: 0.161147 Nov 02 13:23:20.513422 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3957/7368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:20 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:20.537168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:20.537780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:20.544743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.545251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.545701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.546442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.546906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.547352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.611573 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0d5ddccd-36ea-4fb3-95f7-70691a632455 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0/action" status: 204 len: 0 microversion: 2.1 time: 0.078728 Nov 02 13:23:20.612148 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3412/7369] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:23:20 2022] POST /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:23:20.621850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:20.623129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:20.630236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.630752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.631212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.631937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.632411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.632867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.785377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:20.794431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-44d9f0ed-3c4c-408c-aeab-ffd50bc3b86a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1676 microversion: 2.1 time: 0.177027 Nov 02 13:23:20.795228 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3958/7370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:20 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:21.820844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:21.822626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:21.829976 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.830492 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.830946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.831661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.832119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.832551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.984138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:21.993374 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dd25ae05-95a4-4c00-a216-33915e9c8232 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1676 microversion: 2.1 time: 0.179434 Nov 02 13:23:21.994200 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3413/7371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:21 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:22.019079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9e1eb6f3-2d14-4427-84dc-b7923fa0e473 req-ee26154c-ae67-4241-9e67-1d47cc7f673f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac50158-8ef0-4537-8203-2b7c51ad49d0", "name": "network-vif-plugged", "status": "completed", "tag": "4ee6ab60-0a6d-44f0-8678-47cbf0b01618"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:22.029813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9e1eb6f3-2d14-4427-84dc-b7923fa0e473 req-ee26154c-ae67-4241-9e67-1d47cc7f673f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.030271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9e1eb6f3-2d14-4427-84dc-b7923fa0e473 req-ee26154c-ae67-4241-9e67-1d47cc7f673f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.030729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9e1eb6f3-2d14-4427-84dc-b7923fa0e473 req-ee26154c-ae67-4241-9e67-1d47cc7f673f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.043730 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9e1eb6f3-2d14-4427-84dc-b7923fa0e473 req-ee26154c-ae67-4241-9e67-1d47cc7f673f service nova] Creating event network-vif-plugged:4ee6ab60-0a6d-44f0-8678-47cbf0b01618 for instance aac50158-8ef0-4537-8203-2b7c51ad49d0 on n-h1-855650-5 Nov 02 13:23:22.048816 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9e1eb6f3-2d14-4427-84dc-b7923fa0e473 req-ee26154c-ae67-4241-9e67-1d47cc7f673f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150952 Nov 02 13:23:22.049754 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3959/7372] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:23.021803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:23.022429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:23.029257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.029750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.030237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.030943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.031408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.031845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.048185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:23.171807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.179776 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-09e6626c-f9ab-45ba-b438-4f19fbf973b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1668 microversion: 2.1 time: 0.162678 Nov 02 13:23:23.180365 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3414/7373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:23 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:23.204369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:23.205077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:23.212204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.212695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.213147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.213846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.214346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.214780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.354969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.363309 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-61034771-f657-4dc6-b2f4-ce233be0bb78 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1668 microversion: 2.1 time: 0.163915 Nov 02 13:23:23.363896 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3960/7374] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:23 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:23.386350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:23.386981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:23.393213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.393713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.394195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.394906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.395370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.396366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.533133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.541051 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fc9a5957-beb3-4c9f-8b49-ad66384428f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1668 microversion: 2.1 time: 0.158646 Nov 02 13:23:23.541629 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3415/7375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:23 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:23.564291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:23.564731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:23.571453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.571960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.572412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.573157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.573628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.574140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.598729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:23:23.626246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:23.677924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c7e0960-67e8-4c38-a02c-67e51a0bdd07 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 204 len: 0 microversion: 2.1 time: 0.116627 Nov 02 13:23:23.678664 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3961/7376] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:23:23 2022] DELETE /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:23:23.691108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:23.692252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:23.701166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.701674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.702149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.702865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.703326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.703758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.842897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.851621 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f8a81d4b-c1a5-4789-9092-c45b1961d41a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1674 microversion: 2.1 time: 0.168220 Nov 02 13:23:23.852221 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3416/7377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:23 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:24.877417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:24.878173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:24.887860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.888452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.888921 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.889743 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.890274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.890811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:25.028205 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:25.036160 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f166465-6a59-497c-b97e-bd7e5e01268d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1674 microversion: 2.1 time: 0.163570 Nov 02 13:23:25.037315 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3962/7378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:24 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:26.060288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:26.061409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:26.069227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:26.069724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:26.070230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.070927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:26.071384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:26.071828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.164793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.173258 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7fee13d2-0528-45ea-b2f4-db78b4e06720 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 200 len: 1606 microversion: 2.1 time: 0.117014 Nov 02 13:23:26.173867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3417/7379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:26 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 1606 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:26.245918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ed38b49f-ed3a-4780-8590-1b4a95864c94 req-b9402dd5-759b-4b85-9992-e5d077dcdb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac50158-8ef0-4537-8203-2b7c51ad49d0", "name": "network-vif-deleted", "tag": "4ee6ab60-0a6d-44f0-8678-47cbf0b01618"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:26.257206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ed38b49f-ed3a-4780-8590-1b4a95864c94 req-b9402dd5-759b-4b85-9992-e5d077dcdb47 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:26.257711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ed38b49f-ed3a-4780-8590-1b4a95864c94 req-b9402dd5-759b-4b85-9992-e5d077dcdb47 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:26.258193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ed38b49f-ed3a-4780-8590-1b4a95864c94 req-b9402dd5-759b-4b85-9992-e5d077dcdb47 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.270276 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ed38b49f-ed3a-4780-8590-1b4a95864c94 req-b9402dd5-759b-4b85-9992-e5d077dcdb47 service nova] Creating event network-vif-deleted:4ee6ab60-0a6d-44f0-8678-47cbf0b01618 for instance aac50158-8ef0-4537-8203-2b7c51ad49d0 on n-h1-855650-5 Nov 02 13:23:26.276889 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ed38b49f-ed3a-4780-8590-1b4a95864c94 req-b9402dd5-759b-4b85-9992-e5d077dcdb47 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034634 Nov 02 13:23:26.277945 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3963/7380] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:27.198390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.199192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:27.205591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.206116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.206584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.207285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.207745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.208669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.223556 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 HTTP/1.1 Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'aac50158-8ef0-4537-8203-2b7c51ad49d0'} Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:27.225875 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3c745150-fa41-4df8-b055-abbdf6c580cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 404 len: 111 microversion: 2.1 time: 0.033182 Nov 02 13:23:27.230427 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3418/7381] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:27 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:23:27.243566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.244578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:27.251120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.251899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.252066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.252767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.253236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.253674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.269957 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 HTTP/1.1 Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'aac50158-8ef0-4537-8203-2b7c51ad49d0'} Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:27.272161 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a60876a8-0435-46d2-af39-affb5be67056 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 404 len: 111 microversion: 2.1 time: 0.034624 Nov 02 13:23:27.276086 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3964/7382] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:27 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:23:27.327490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1902069748", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "fcb8e111-a978-4e3e-b47a-9c5ed66997ad"}], "security_groups": [{"name": "tempest-securitygroup--1285657684"}], "key_name": "tempest-keypair-783021381", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:27.438273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] validate_networks() for [('fcb8e111-a978-4e3e-b47a-9c5ed66997ad', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:23:27.818895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:23:27.819324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:23:27.819815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:23:27.820230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:23:27.820653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:23:27.830013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.830508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.830957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.831701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.832164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.832601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.850073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for project 5345434f4a0144bf93bf64442bfe411c. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:27.855478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for user b990a688f9c44a5a8c2fae7818d46c5d and project 5345434f4a0144bf93bf64442bfe411c. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:27.868186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:23:27.870654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:23:27.918154 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-30988094-36fc-4a22-8736-878af0ef5fcd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.594512 Nov 02 13:23:27.918820 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3419/7383] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:23:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:23:27.930836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08ff492c-3327-4bf0-983b-71ace46e33e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.931507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08ff492c-3327-4bf0-983b-71ace46e33e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:27.985786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-08ff492c-3327-4bf0-983b-71ace46e33e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.993548 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08ff492c-3327-4bf0-983b-71ace46e33e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1238 microversion: 2.1 time: 0.067195 Nov 02 13:23:27.994162 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3965/7384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:27 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:29.019616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:29.021163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:29.023926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:29.032519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.033023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.033473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.034528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.035006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.035453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.128999 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.137797 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98c0aa92-2d23-4366-93f6-6310a486d4cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1298 microversion: 2.1 time: 0.123494 Nov 02 13:23:29.139021 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3420/7385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:29 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:30.163818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:30.164545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:30.168340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:30.175117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.175640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.176106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.177014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.177494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.177941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.322850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:30.332251 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-23c5c29b-4911-4c74-9477-dba5891c501f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1364 microversion: 2.1 time: 0.172133 Nov 02 13:23:30.345594 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3966/7386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:30 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:30.611662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-c24f4c3c-b86c-4465-b4f5-ad03da498536 req-99b0eade-94a9-48b3-bdea-f3b79cabfa22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c285df-3729-4704-8ba6-865b2d62d55b", "tag": "5c29f966-87d1-4f9f-996e-b00e3c5873fc"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:30.624416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c24f4c3c-b86c-4465-b4f5-ad03da498536 req-99b0eade-94a9-48b3-bdea-f3b79cabfa22 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.624800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c24f4c3c-b86c-4465-b4f5-ad03da498536 req-99b0eade-94a9-48b3-bdea-f3b79cabfa22 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.625278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-c24f4c3c-b86c-4465-b4f5-ad03da498536 req-99b0eade-94a9-48b3-bdea-f3b79cabfa22 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.637396 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-c24f4c3c-b86c-4465-b4f5-ad03da498536 req-99b0eade-94a9-48b3-bdea-f3b79cabfa22 service nova] Creating event network-changed:5c29f966-87d1-4f9f-996e-b00e3c5873fc for instance f1c285df-3729-4704-8ba6-865b2d62d55b on n-h1-855650-5 Nov 02 13:23:30.642491 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-c24f4c3c-b86c-4465-b4f5-ad03da498536 req-99b0eade-94a9-48b3-bdea-f3b79cabfa22 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034568 Nov 02 13:23:30.643457 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3421/7387] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:23:31.358704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:31.359341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:31.367304 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:31.367808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:31.368273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:31.368991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:31.369466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:31.369910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:31.501072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:31.508998 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0451612-6359-456f-9319-3c2458e9e8c3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1364 microversion: 2.1 time: 0.154282 Nov 02 13:23:31.509575 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3967/7388] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:31 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:32.534233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:32.534921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:32.541366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:32.541857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:32.542321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:32.543018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:32.543471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:32.543896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:32.678532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:32.686531 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-39397498-2b7e-4207-a37e-b489e31b8c5b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1364 microversion: 2.1 time: 0.157219 Nov 02 13:23:32.687115 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3422/7389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:32 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:33.712047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:33.712628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:33.719138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:33.719643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:33.720105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:33.720828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:33.721301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:33.721746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:33.860968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:33.868911 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-31855d68-d1d3-4bd4-97c9-291ad48e5cbc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1364 microversion: 2.1 time: 0.161639 Nov 02 13:23:33.869503 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3968/7390] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:33 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:34.893825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:34.894480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:34.902077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:34.902578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:34.903022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:34.903767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:34.904222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:34.904654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:35.327502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:35.335725 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5152d38d-1e99-4133-a178-c0010a1e1a9a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1364 microversion: 2.1 time: 0.446479 Nov 02 13:23:35.336315 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3423/7391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:34 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1364 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:35.929775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-24ade9bb-88a0-4c5f-99c4-3b63da33d189 req-609bf685-5242-402b-a1f1-4267a1abecba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c285df-3729-4704-8ba6-865b2d62d55b", "name": "network-vif-plugged", "status": "completed", "tag": "5c29f966-87d1-4f9f-996e-b00e3c5873fc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:35.940972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-24ade9bb-88a0-4c5f-99c4-3b63da33d189 req-609bf685-5242-402b-a1f1-4267a1abecba service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:35.941474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-24ade9bb-88a0-4c5f-99c4-3b63da33d189 req-609bf685-5242-402b-a1f1-4267a1abecba service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:35.941919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-24ade9bb-88a0-4c5f-99c4-3b63da33d189 req-609bf685-5242-402b-a1f1-4267a1abecba service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:35.954294 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-24ade9bb-88a0-4c5f-99c4-3b63da33d189 req-609bf685-5242-402b-a1f1-4267a1abecba service nova] Creating event network-vif-plugged:5c29f966-87d1-4f9f-996e-b00e3c5873fc for instance f1c285df-3729-4704-8ba6-865b2d62d55b on n-h1-855650-5 Nov 02 13:23:35.960461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-24ade9bb-88a0-4c5f-99c4-3b63da33d189 req-609bf685-5242-402b-a1f1-4267a1abecba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034478 Nov 02 13:23:35.961067 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3969/7392] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:36.361412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:36.362000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:36.369484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:36.369993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:36.370447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:36.371154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:36.371605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:36.372030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:36.513205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:36.521054 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ee00557-34a5-4281-9ab6-ac59dcee93cd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1364 microversion: 2.1 time: 0.164365 Nov 02 13:23:36.521639 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3424/7393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:36 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:37.547078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:37.547911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:37.554557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:37.555020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:37.555471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:37.556219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:37.556643 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:37.557083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:37.696990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:37.705266 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-affb4a9a-6be8-497f-b5d3-65eb48941273 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1551 microversion: 2.1 time: 0.163731 Nov 02 13:23:37.705865 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3970/7394] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:37 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:37.729244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:37.729803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:37.736840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:37.737328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:37.737772 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:37.738514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:37.738977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:37.739913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:37.821058 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-219d7750-1b73-490a-a161-6340ecef0249 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095669 Nov 02 13:23:37.821666 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3425/7395] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 13:23:37 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:38.787697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-165b9d93-ddec-4901-806f-03ef1d25a588 req-52ff8fa5-3b17-49a6-a500-7e6e30f947fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c285df-3729-4704-8ba6-865b2d62d55b", "tag": "5c29f966-87d1-4f9f-996e-b00e3c5873fc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:38.792694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:38.799642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-165b9d93-ddec-4901-806f-03ef1d25a588 req-52ff8fa5-3b17-49a6-a500-7e6e30f947fd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:38.800142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-165b9d93-ddec-4901-806f-03ef1d25a588 req-52ff8fa5-3b17-49a6-a500-7e6e30f947fd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:38.800591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-165b9d93-ddec-4901-806f-03ef1d25a588 req-52ff8fa5-3b17-49a6-a500-7e6e30f947fd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:38.812397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-165b9d93-ddec-4901-806f-03ef1d25a588 req-52ff8fa5-3b17-49a6-a500-7e6e30f947fd service nova] Creating event network-changed:5c29f966-87d1-4f9f-996e-b00e3c5873fc for instance f1c285df-3729-4704-8ba6-865b2d62d55b on n-h1-855650-5 Nov 02 13:23:38.818500 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-165b9d93-ddec-4901-806f-03ef1d25a588 req-52ff8fa5-3b17-49a6-a500-7e6e30f947fd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034146 Nov 02 13:23:38.819108 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3971/7396] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:03.376924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:03.377775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:03.380242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=11 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:03.381069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=55 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:03.388135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f8a287bf-bddb-4909-bf51-b5b6cf963a4e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:03.395471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a287bf-bddb-4909-bf51-b5b6cf963a4e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.395965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a287bf-bddb-4909-bf51-b5b6cf963a4e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.396412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8a287bf-bddb-4909-bf51-b5b6cf963a4e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.420093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f8a287bf-bddb-4909-bf51-b5b6cf963a4e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Going to try to stop instance {{(pid=120723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:25:03.468710 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f8a287bf-bddb-4909-bf51-b5b6cf963a4e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/action" status: 202 len: 0 microversion: 2.1 time: 0.093116 Nov 02 13:25:03.469425 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3426/7397] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:25:03 2022] POST /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:25:03.476824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=11 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:03.477603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:03.479027 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:25:03.479237 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b (ip 10.222.0.45) !!! Nov 02 13:25:03.482471 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:25:03.482651 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b (ip 10.222.0.45) !!! Nov 02 13:25:03.492012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:03.493091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:03.510965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.511473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.511932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.512867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.513377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.513823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.653225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:03.661158 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d77b59f1-e6b7-4965-87c6-ec35eaaae36e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.186556 Nov 02 13:25:03.661818 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3972/7398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:03 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:04.691255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:04.692799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:04.701801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:04.702364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:04.702817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:04.703533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:04.703995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:04.704430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:04.887036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:04.896190 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dead1655-df4c-4f1e-aa55-bdd51dd874f8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.210574 Nov 02 13:25:04.896791 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3427/7399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:04 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:05.920904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:05.921529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:05.924087 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:25:05.929319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:05.929824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:05.930410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:05.931131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:05.931603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:05.932045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:06.067548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:06.076135 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f587dfe-136f-4885-a3dc-4b18334f4b47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.159218 Nov 02 13:25:06.076711 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3973/7400] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:05 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:07.100965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:07.101599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:07.109222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:07.109717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:07.110209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:07.110914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:07.111381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:07.111814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:07.250567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:07.258564 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-01054c33-d991-485a-9f13-b6dd6387b16c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.161510 Nov 02 13:25:07.259150 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3428/7401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:07 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:08.282342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:08.282961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:08.291869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:08.292417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:08.292831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:08.294150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:08.294619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:08.295060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:08.301369 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 37526. Nov 02 13:25:08.431596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:08.440378 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba5fec28-5428-4534-914a-9c44944c98e1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.161974 Nov 02 13:25:08.440954 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3974/7402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:08 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:09.463124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:09.464716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:09.472473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:09.472958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:09.473400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:09.474148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:09.474610 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:09.475076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:09.616465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:09.624734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b26f131a-b402-464b-8fef-364a9999c126 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.165499 Nov 02 13:25:09.625325 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3429/7403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:09 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:10.649050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:10.649685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:10.656769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:10.657272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:10.657730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:10.658482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:10.658958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:10.659423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:10.796670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:10.805326 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8037cf7e-cc8e-43b0-aa8a-50ea562b3659 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.160481 Nov 02 13:25:10.805905 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3975/7404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:10 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:11.830505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:11.831123 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:11.838168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:11.838666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:11.839109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:11.839824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:11.840338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:11.840756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:11.989494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:11.998901 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4da23642-af7c-4ba4-9fc0-d1a263fa70eb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.172457 Nov 02 13:25:11.999764 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3430/7405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:11 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:13.023422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:13.024087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:13.031746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:13.032259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:13.032719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:13.033430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:13.033904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:13.034375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:13.166156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:13.174164 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70d881e2-4b39-4de6-a166-5c547abdd00a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.154660 Nov 02 13:25:13.174855 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3976/7406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:13 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:14.198646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:14.199496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:14.206256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.206749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.207189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.207908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.208362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.208787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.382981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:14.391221 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c324a605-0478-4ae9-8d3e-79402e13d378 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1656 microversion: 2.1 time: 0.196524 Nov 02 13:25:14.391807 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3431/7407] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:14 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1656 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:14.414498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:14.416775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:14.424440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.424945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.425404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.426159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.426635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.427084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.459175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:14.465000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:25:14.472221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:14.472657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:14.473148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:14.473573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:14.474126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:14.542523 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b974851d-65c6-4985-bc4f-fa3aa6e2d28b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/action" status: 202 len: 0 microversion: 2.1 time: 0.131849 Nov 02 13:25:14.547274 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3977/7408] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:25:14 2022] POST /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:25:14.552506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:14.553950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:14.561248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.562080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.562691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.564339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.564339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.564950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.755006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:14.763431 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-433e404d-aa95-4407-b36c-b97487dbd295 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.215018 Nov 02 13:25:14.764112 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3432/7409] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:14 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:15.788754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:15.789378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:15.796346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:15.797071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:15.797521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:15.798257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:15.798726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:15.799163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:15.941253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:15.951791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d7aa29a-865b-44e7-8a20-75512185f0c2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1679 microversion: 2.1 time: 0.167701 Nov 02 13:25:15.952366 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3978/7410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:15 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:16.976353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:16.976971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:16.984334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:16.984846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:16.985289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:16.986181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:16.986644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:16.987079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:17.127722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:17.135873 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cac504a3-8401-415c-ae48-84348fb77223 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1684 microversion: 2.1 time: 0.163645 Nov 02 13:25:17.136453 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3433/7411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:16 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:18.161430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:18.162064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:18.169004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.169506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.170026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.170777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.171231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.171673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.301791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:18.310396 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17130738-b20f-4530-835f-95acfc13ef71 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1684 microversion: 2.1 time: 0.152892 Nov 02 13:25:18.311067 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3979/7412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:18 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:19.338218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:19.338874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:19.346461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:19.346958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:19.347403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:19.348113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:19.348572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:19.349006 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:19.606124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:19.614056 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c6ff3bf-c231-4068-8f56-9f12598c803e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1683 microversion: 2.1 time: 0.282673 Nov 02 13:25:19.614651 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3434/7413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:19 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1683 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:19.704949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-254e0e02-e0b0-41c1-99e8-17cf5896006b req-c4f6f039-9366-4457-909f-95c9b8c454df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c285df-3729-4704-8ba6-865b2d62d55b", "name": "network-vif-unplugged", "status": "completed", "tag": "5c29f966-87d1-4f9f-996e-b00e3c5873fc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:19.716893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-254e0e02-e0b0-41c1-99e8-17cf5896006b req-c4f6f039-9366-4457-909f-95c9b8c454df service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:19.717606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-254e0e02-e0b0-41c1-99e8-17cf5896006b req-c4f6f039-9366-4457-909f-95c9b8c454df service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:19.718272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-254e0e02-e0b0-41c1-99e8-17cf5896006b req-c4f6f039-9366-4457-909f-95c9b8c454df service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:19.731364 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-254e0e02-e0b0-41c1-99e8-17cf5896006b req-c4f6f039-9366-4457-909f-95c9b8c454df service nova] Creating event network-vif-unplugged:5c29f966-87d1-4f9f-996e-b00e3c5873fc for instance f1c285df-3729-4704-8ba6-865b2d62d55b on n-h2-855650-5 Nov 02 13:25:19.737372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-254e0e02-e0b0-41c1-99e8-17cf5896006b req-c4f6f039-9366-4457-909f-95c9b8c454df service nova] Instance f1c285df-3729-4704-8ba6-865b2d62d55b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:25:19.749295 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-254e0e02-e0b0-41c1-99e8-17cf5896006b req-c4f6f039-9366-4457-909f-95c9b8c454df service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049645 Nov 02 13:25:19.749907 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3980/7414] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:20.638424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:20.639053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:20.646659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.647155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.647609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.648326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.648781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.649208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.870112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:20.878254 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8059ae62-9eb9-4eff-9963-0b835101b5b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1683 microversion: 2.1 time: 0.243833 Nov 02 13:25:20.878854 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3435/7415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:20 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:21.766627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a7dba7a2-7c58-45fd-89fd-ff07d3611d70 req-4be06c86-97d5-4f10-9319-f0b7f95ba341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c285df-3729-4704-8ba6-865b2d62d55b", "tag": "5c29f966-87d1-4f9f-996e-b00e3c5873fc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:21.776517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a7dba7a2-7c58-45fd-89fd-ff07d3611d70 req-4be06c86-97d5-4f10-9319-f0b7f95ba341 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.777014 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a7dba7a2-7c58-45fd-89fd-ff07d3611d70 req-4be06c86-97d5-4f10-9319-f0b7f95ba341 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.777456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a7dba7a2-7c58-45fd-89fd-ff07d3611d70 req-4be06c86-97d5-4f10-9319-f0b7f95ba341 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:21.789899 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a7dba7a2-7c58-45fd-89fd-ff07d3611d70 req-4be06c86-97d5-4f10-9319-f0b7f95ba341 service nova] Creating event network-changed:5c29f966-87d1-4f9f-996e-b00e3c5873fc for instance f1c285df-3729-4704-8ba6-865b2d62d55b on n-h2-855650-5 Nov 02 13:25:21.795314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-a7dba7a2-7c58-45fd-89fd-ff07d3611d70 req-4be06c86-97d5-4f10-9319-f0b7f95ba341 service nova] Instance f1c285df-3729-4704-8ba6-865b2d62d55b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:25:21.806341 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a7dba7a2-7c58-45fd-89fd-ff07d3611d70 req-4be06c86-97d5-4f10-9319-f0b7f95ba341 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045274 Nov 02 13:25:21.807167 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3981/7416] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:21.904066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:21.904778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:21.913692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.914227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.914678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:21.915453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.915908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.916338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:22.127783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:22.135875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a155db9c-a5eb-4854-b7f5-1591bed037cc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1681 microversion: 2.1 time: 0.236557 Nov 02 13:25:22.136367 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3436/7417] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:21 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:23.161327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:23.162074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:23.168352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:23.168922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:23.169338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:23.170099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:23.170581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:23.171024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:23.307121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:23.316938 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37a62785-6e95-41e1-bf0a-2a3d0de1d1b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1681 microversion: 2.1 time: 0.160829 Nov 02 13:25:23.317525 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3982/7418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:23 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:24.341801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:24.342377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:24.349948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.350470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.350915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.351876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.352335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.352758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.489131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:24.497211 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7b89994e-80f0-4d9a-8c2a-65ddf3cc7730 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1677 microversion: 2.1 time: 0.160153 Nov 02 13:25:24.497853 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3437/7419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:24 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:24.520832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:24.521413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:24.528983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.529488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.529938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.530663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.531129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.531566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.597557 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07b6ca12-d8f9-4451-9cb4-d0300a84eb74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/action" status: 204 len: 0 microversion: 2.1 time: 0.080359 Nov 02 13:25:24.598423 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3983/7420] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:25:24 2022] POST /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:25:24.608100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:24.608726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:24.615248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.615922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.616436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.617242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.617743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.618279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.839515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:24.848367 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c21636d8-7c32-4e91-bb24-8017ffefc90d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1677 microversion: 2.1 time: 0.244671 Nov 02 13:25:24.848908 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3438/7421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:24 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:25.875350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:25.876574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:25.883542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:25.884300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:25.884914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:25.885824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:25.886420 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:25.886913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:26.029363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:26.037425 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07a9e614-9118-4997-80be-9eeb40e9072a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1677 microversion: 2.1 time: 0.168739 Nov 02 13:25:26.038032 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3984/7422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:25 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:27.063067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:27.063689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:27.070921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.071424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.071953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.072636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.073100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.073534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.212804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:27.221406 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-484b3be1-f309-42dc-ab2c-8214a188aa8b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1656 microversion: 2.1 time: 0.162892 Nov 02 13:25:27.222050 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3439/7423] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:27 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:27.244688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:27.245326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:27.252324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.252834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.253297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.254072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.254517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.254966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.393130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:27.402366 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90d4cdfa-33ab-42ab-8e81-941b4e94a778 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1656 microversion: 2.1 time: 0.161499 Nov 02 13:25:27.402949 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3985/7424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:27 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:27.425897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b27d6064-bb90-4918-b5a8-2fa9ce739bc6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:27.431996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b27d6064-bb90-4918-b5a8-2fa9ce739bc6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.432486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b27d6064-bb90-4918-b5a8-2fa9ce739bc6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.432923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b27d6064-bb90-4918-b5a8-2fa9ce739bc6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.456027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b27d6064-bb90-4918-b5a8-2fa9ce739bc6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Going to try to start instance {{(pid=120723) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:25:27.481091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:27.508527 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b27d6064-bb90-4918-b5a8-2fa9ce739bc6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/action" status: 202 len: 0 microversion: 2.1 time: 0.086332 Nov 02 13:25:27.509338 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3440/7425] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:25:27 2022] POST /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:25:27.526964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:27.528138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:27.535731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.536533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.537071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.542193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.542794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.543314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.679395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-70a25960-2a0c-47d0-8975-93c135cdcfac req-c41b80f0-eb4c-44ca-8641-8d31749d56a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c285df-3729-4704-8ba6-865b2d62d55b", "name": "network-vif-plugged", "status": "completed", "tag": "5c29f966-87d1-4f9f-996e-b00e3c5873fc"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:27.692057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-70a25960-2a0c-47d0-8975-93c135cdcfac req-c41b80f0-eb4c-44ca-8641-8d31749d56a9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.692791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-70a25960-2a0c-47d0-8975-93c135cdcfac req-c41b80f0-eb4c-44ca-8641-8d31749d56a9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.693640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-70a25960-2a0c-47d0-8975-93c135cdcfac req-c41b80f0-eb4c-44ca-8641-8d31749d56a9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.707459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:27.711098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:27.713282 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-70a25960-2a0c-47d0-8975-93c135cdcfac req-c41b80f0-eb4c-44ca-8641-8d31749d56a9 service nova] Creating event network-vif-plugged:5c29f966-87d1-4f9f-996e-b00e3c5873fc for instance f1c285df-3729-4704-8ba6-865b2d62d55b on n-h2-855650-5 Nov 02 13:25:27.720876 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-70a25960-2a0c-47d0-8975-93c135cdcfac req-c41b80f0-eb4c-44ca-8641-8d31749d56a9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045519 Nov 02 13:25:27.721393 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2901b924-8d73-4da2-9037-d9fca7239d86 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1665 microversion: 2.1 time: 0.198849 Nov 02 13:25:27.722764 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3441/7426] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:25:27.734745 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3986/7427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:27 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1665 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:28.748878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:28.749575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:28.756234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.756731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.757178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.757889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.758386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.758855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.899756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:28.907699 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d4fef5d1-82e2-443b-9014-caeb7d9a9b96 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1665 microversion: 2.1 time: 0.164402 Nov 02 13:25:28.908288 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3442/7428] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:28 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:29.931509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:29.932130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:29.940855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:29.941358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:29.941813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:29.942627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:29.943098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:29.943540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.079158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:30.087037 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a772812d-8cd4-48fd-b955-e8bc5922a757 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1669 microversion: 2.1 time: 0.159396 Nov 02 13:25:30.087611 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3987/7429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:29 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:30.110840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:30.111438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:30.118515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.119011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.119450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.120156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.120634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.121063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.150566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:25:30.229857 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6707efd0-a5ae-4b77-a2a2-756893a072d7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 204 len: 0 microversion: 2.1 time: 0.123189 Nov 02 13:25:30.230574 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3443/7430] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:25:30 2022] DELETE /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:25:30.239702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:30.240519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:30.246542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.247011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.247460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.248233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.248733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.249171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.389042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:30.397008 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77023e72-592f-4518-ae4e-3d85830764a2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1675 microversion: 2.1 time: 0.161165 Nov 02 13:25:30.397589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3988/7431] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:30 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:31.422099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:31.422809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:31.429739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:31.430269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:31.430710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:31.431411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:31.431869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:31.432298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:31.569698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:31.577737 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6b69918-e15a-4906-a200-0428ea4a643f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1675 microversion: 2.1 time: 0.160412 Nov 02 13:25:31.578427 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3444/7432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:31 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:32.589532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7eaaf5fb-bea7-4fc1-89b5-f45d18d79f01 req-52912ead-0e3a-4510-bdbb-be3a936c517e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c285df-3729-4704-8ba6-865b2d62d55b", "name": "network-vif-deleted", "tag": "5c29f966-87d1-4f9f-996e-b00e3c5873fc"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:32.600233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7eaaf5fb-bea7-4fc1-89b5-f45d18d79f01 req-52912ead-0e3a-4510-bdbb-be3a936c517e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.600890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7eaaf5fb-bea7-4fc1-89b5-f45d18d79f01 req-52912ead-0e3a-4510-bdbb-be3a936c517e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.601422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7eaaf5fb-bea7-4fc1-89b5-f45d18d79f01 req-52912ead-0e3a-4510-bdbb-be3a936c517e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.608926 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:32.610309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:32.614429 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7eaaf5fb-bea7-4fc1-89b5-f45d18d79f01 req-52912ead-0e3a-4510-bdbb-be3a936c517e service nova] Creating event network-vif-deleted:5c29f966-87d1-4f9f-996e-b00e3c5873fc for instance f1c285df-3729-4704-8ba6-865b2d62d55b on n-h2-855650-5 Nov 02 13:25:32.620242 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7eaaf5fb-bea7-4fc1-89b5-f45d18d79f01 req-52912ead-0e3a-4510-bdbb-be3a936c517e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034769 Nov 02 13:25:32.620953 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3989/7433] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:32.624230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.624722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.625211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.628345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.628824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.629266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.702687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:32.710817 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4875af37-07c0-4237-944c-3814aa74bb10 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 200 len: 1323 microversion: 2.1 time: 0.112932 Nov 02 13:25:32.711272 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3445/7434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:32 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 1323 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:33.744343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:33.744872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:33.746850 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=41 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:33.752461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:33.752961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:33.753416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:33.754162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:33.754631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:33.755073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:33.769743 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b HTTP/1.1 Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'f1c285df-3729-4704-8ba6-865b2d62d55b'} Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:33.771449 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-618b7275-8ae1-4bed-8ac4-efeab9fa7613 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 404 len: 111 microversion: 2.1 time: 0.034570 Nov 02 13:25:33.776233 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3990/7435] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:33 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:25:33.789075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:33.789698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:33.792583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:33.798033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:33.798523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:33.798967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:33.799667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:33.800128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:33.800554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:33.816440 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b HTTP/1.1 Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f1c285df-3729-4704-8ba6-865b2d62d55b'} Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:33.818160 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-83bdbd4f-3672-4175-bacb-f974e7dad530 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 404 len: 111 microversion: 2.1 time: 0.034420 Nov 02 13:25:33.822864 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3446/7436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:33 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:25:33.869321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2144653628", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "fcb8e111-a978-4e3e-b47a-9c5ed66997ad"}], "security_groups": [{"name": "tempest-securitygroup--1285657684"}], "key_name": "tempest-keypair-783021381", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:33.980493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] validate_networks() for [('fcb8e111-a978-4e3e-b47a-9c5ed66997ad', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:34.406012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:34.406458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:34.406952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:34.407376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:34.407802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:34.416666 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:34.417151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:34.417596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:34.418367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:34.418830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:34.419263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:34.437119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for project 5345434f4a0144bf93bf64442bfe411c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:34.442697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for user b990a688f9c44a5a8c2fae7818d46c5d and project 5345434f4a0144bf93bf64442bfe411c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:34.455031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:34.457423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:34.505213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-054a4c5e-3660-42ef-b27c-25aadbb9d154 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639738 Nov 02 13:25:34.505870 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3991/7437] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:25:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:25:34.517193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8ae30c7f-8c84-4e3f-8c77-85b415943a91 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:34.517880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8ae30c7f-8c84-4e3f-8c77-85b415943a91 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:34.574087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8ae30c7f-8c84-4e3f-8c77-85b415943a91 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:34.581456 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8ae30c7f-8c84-4e3f-8c77-85b415943a91 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1238 microversion: 2.1 time: 0.068029 Nov 02 13:25:34.581994 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3447/7438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:34 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:35.606318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:35.606940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:35.616851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:35.617358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:35.617812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:35.618573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:35.619249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:35.619867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:35.684239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:35.693064 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba799462-340a-4ddf-be3d-71af2578a393 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1298 microversion: 2.1 time: 0.091499 Nov 02 13:25:35.693674 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3992/7439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:35 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:36.719267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:36.720639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:36.731226 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.731825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.732876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.733659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.734157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.734587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.978715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:36.987505 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5ffeced1-8c32-4715-b242-3f8266716ff4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1364 microversion: 2.1 time: 0.272376 Nov 02 13:25:36.988092 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3448/7440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:36 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:37.453134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f5df9465-8dff-4e6a-a579-de7577612110 req-fedb6070-87c6-42c9-89a3-e1ef43870360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:37.464725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5df9465-8dff-4e6a-a579-de7577612110 req-fedb6070-87c6-42c9-89a3-e1ef43870360 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.465224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5df9465-8dff-4e6a-a579-de7577612110 req-fedb6070-87c6-42c9-89a3-e1ef43870360 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.465678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f5df9465-8dff-4e6a-a579-de7577612110 req-fedb6070-87c6-42c9-89a3-e1ef43870360 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.478014 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f5df9465-8dff-4e6a-a579-de7577612110 req-fedb6070-87c6-42c9-89a3-e1ef43870360 service nova] Creating event network-changed:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h1-855650-5 Nov 02 13:25:37.483307 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f5df9465-8dff-4e6a-a579-de7577612110 req-fedb6070-87c6-42c9-89a3-e1ef43870360 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034792 Nov 02 13:25:37.483926 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3993/7441] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:38.012080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:38.012646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:38.019816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:38.020305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:38.020752 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:38.021456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:38.021916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:38.022390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:38.155033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:38.162955 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f7ed19a7-a5ac-45f1-870d-94c065f34b4d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1364 microversion: 2.1 time: 0.154917 Nov 02 13:25:38.163538 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3449/7442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:38 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:39.188824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:39.189823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:39.196235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.196736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.197226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.198195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.198443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.198889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.343770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:39.352913 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-afea6275-1f0a-471f-a9c4-d377bdf933e2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1364 microversion: 2.1 time: 0.169068 Nov 02 13:25:39.358640 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3994/7443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:39 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:40.377135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:40.377759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:40.385209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.385783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.386283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.387009 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.387483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.390001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.606782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:40.615539 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cddfec3f-c468-4a40-ba16-e8a8164350fc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1364 microversion: 2.1 time: 0.242377 Nov 02 13:25:40.616242 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3450/7444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:40 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:41.640676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:41.641307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:41.648366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.648869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.649335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.650065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.650551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.650986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.798316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:41.806345 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8d574bc-973c-4a7a-86c6-4e1f3b075c7b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1364 microversion: 2.1 time: 0.170366 Nov 02 13:25:41.806955 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3995/7445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:41 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:42.831564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:42.832337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:42.839357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.839851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.840300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.841008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.841495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.841928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.979451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:42.988196 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8690f792-2c83-497f-a431-8bafdda792c0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1364 microversion: 2.1 time: 0.160497 Nov 02 13:25:42.988796 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3451/7446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:42 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:44.011421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:44.011961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:44.019777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:44.020300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:44.021040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:44.021802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:44.022316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:44.022774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:44.170928 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:44.179513 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6eabc70-236a-4a66-9d4c-204b855efcf9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1364 microversion: 2.1 time: 0.171985 Nov 02 13:25:44.180104 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3996/7447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:44 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:44.527372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f2449641-557a-4bf1-9fcc-0824b697e786 req-01da678e-9ec9-4db5-a7e4-842b4fd0a343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "name": "network-vif-plugged", "status": "completed", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:44.539950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f2449641-557a-4bf1-9fcc-0824b697e786 req-01da678e-9ec9-4db5-a7e4-842b4fd0a343 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:44.540444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f2449641-557a-4bf1-9fcc-0824b697e786 req-01da678e-9ec9-4db5-a7e4-842b4fd0a343 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:44.540881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f2449641-557a-4bf1-9fcc-0824b697e786 req-01da678e-9ec9-4db5-a7e4-842b4fd0a343 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:44.553790 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f2449641-557a-4bf1-9fcc-0824b697e786 req-01da678e-9ec9-4db5-a7e4-842b4fd0a343 service nova] Creating event network-vif-plugged:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h1-855650-5 Nov 02 13:25:44.559114 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f2449641-557a-4bf1-9fcc-0824b697e786 req-01da678e-9ec9-4db5-a7e4-842b4fd0a343 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035835 Nov 02 13:25:44.560015 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3452/7448] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:45.204986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:45.205557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:45.207504 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:45.208184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:45.214919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:45.215415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:45.215859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:45.216599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:45.217056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:45.217498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:45.353048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:45.361083 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4365c29b-37e3-47be-8eb6-aa975613cf73 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1364 microversion: 2.1 time: 0.160647 Nov 02 13:25:45.361660 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3997/7449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:45 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:46.382472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:46.388061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:46.388835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:46.395384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.395880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.396344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.397066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.397527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.397975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.535467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:46.543461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32450868-ee39-43a2-a5df-95646f0e4d36 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1552 microversion: 2.1 time: 0.162237 Nov 02 13:25:46.544044 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3453/7450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:46 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:46.568228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:46.568786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:46.575597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.576096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.576556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.577270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.577740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.578220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.660533 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b41e3c1-f275-40fd-be57-7ca37285f3df tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096484 Nov 02 13:25:46.661186 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3998/7451] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 13:25:46 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:47.610343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f2cd9496-df8a-4a55-ab0f-3aa8ed5c37bf req-c32799e6-411a-494d-a328-867b4a928552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:47.621477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f2cd9496-df8a-4a55-ab0f-3aa8ed5c37bf req-c32799e6-411a-494d-a328-867b4a928552 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:47.622095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f2cd9496-df8a-4a55-ab0f-3aa8ed5c37bf req-c32799e6-411a-494d-a328-867b4a928552 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:47.622609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f2cd9496-df8a-4a55-ab0f-3aa8ed5c37bf req-c32799e6-411a-494d-a328-867b4a928552 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:47.635032 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f2cd9496-df8a-4a55-ab0f-3aa8ed5c37bf req-c32799e6-411a-494d-a328-867b4a928552 service nova] Creating event network-changed:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h1-855650-5 Nov 02 13:25:47.642181 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f2cd9496-df8a-4a55-ab0f-3aa8ed5c37bf req-c32799e6-411a-494d-a328-867b4a928552 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Nov 02 13:25:47.643192 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3454/7452] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:14.238490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:14.239827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=55 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:14.293178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:14.295518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:14.302505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:14.303017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:14.303468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:14.304177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:14.304677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:14.305119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:14.333989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:14.340704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Old instance type m1.heat2, new instance type m1.heat {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:27:14.348131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:27:14.349028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:27:14.349566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:27:14.349946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:27:14.350401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:27:14.419438 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4384f996-de92-4312-98ad-5f8eaccc1b69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef/action" status: 202 len: 0 microversion: 2.1 time: 0.183360 Nov 02 13:27:14.420098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3999/7453] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:27:14 2022] POST /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:14.427992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=19 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:14.428758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:14.429847 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:27:14.430026 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:27:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef (ip 10.222.0.45) !!! Nov 02 13:27:14.431728 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:27:14.431728 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:27:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef (ip 10.222.0.45) !!! Nov 02 13:27:14.440375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:14.441117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:14.453231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:14.453738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:14.454213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:14.454947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:14.455415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:14.455853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:14.623171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:14.634509 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f48c2037-523d-45f7-be36-4b63cef14132 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1679 microversion: 2.1 time: 0.209465 Nov 02 13:27:14.635559 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3455/7454] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:14 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:15.660259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:15.660862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:15.669281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:15.669799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:15.670305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:15.671046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:15.671525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:15.671978 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:15.827944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:15.837226 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1639c32-f53b-43d9-886b-31d0b1bab3a8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1679 microversion: 2.1 time: 0.182229 Nov 02 13:27:15.837834 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4000/7455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:15 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:16.862974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:16.863600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:16.871272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:16.871766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:16.872216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:16.872955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:16.873416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:16.873850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:17.017613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:17.026024 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4db9b25c-a50c-4d0e-9cf1-eaa677098a24 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.167134 Nov 02 13:27:17.026618 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3456/7456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:16 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:18.049515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:18.050231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:18.057517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:18.058069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:18.058528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:18.059263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:18.059734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:18.060177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:18.206566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:18.215654 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3450dac1-111e-4292-9c09-e1b3e0e0ce8f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.170094 Nov 02 13:27:18.216260 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4001/7457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:18 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:19.241729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:19.242371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:19.249371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:19.249854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:19.250325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:19.251023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:19.251486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:19.251987 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:19.408773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:19.416836 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6a9acf2-c4c3-47e9-8da0-99ef2f7c4ad4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.179851 Nov 02 13:27:19.417440 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3457/7458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:19 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:20.440498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:20.441149 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:20.449369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:20.449884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:20.450380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:20.451116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:20.451591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:20.452038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:20.600580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:20.608629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3483e3dc-3ad8-4bbe-aeda-c7bf1c11db4a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.172102 Nov 02 13:27:20.609250 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4002/7459] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:20 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:21.633489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:21.634121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:21.641768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:21.642324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:21.642775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:21.643509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:21.643957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:21.644412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:21.788940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:21.799487 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-306d791b-bc32-470d-9f9a-51650482a062 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.170643 Nov 02 13:27:21.800084 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3458/7460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:21 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:22.823326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:22.823963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:22.831078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:22.831585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:22.832042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:22.833296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:22.833773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:22.834244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:22.970943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:22.979876 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-25a757a0-e865-4770-8dc4-e6c5a7c5b0fa tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.160472 Nov 02 13:27:22.980655 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4003/7461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:22 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:24.003875 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:24.004498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:24.011245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:24.011742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:24.012200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:24.012910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:24.013371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:24.013803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:24.149189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:24.157140 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-246e5031-c5cd-40f1-82a3-fe30e509867b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.157180 Nov 02 13:27:24.157714 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3459/7462] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:23 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:25.181107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:25.181926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:25.190071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:25.190593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:25.191054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:25.191796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:25.192530 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:25.192975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:25.346478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:25.355597 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-63734e32-ddb0-4e06-9519-250dda3a30fe tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.178580 Nov 02 13:27:25.356200 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4004/7463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:25 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:26.381882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:26.382804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:26.390361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:26.390870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:26.391342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:26.392041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:26.392501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:26.392933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:26.529498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:26.537465 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8c6577eb-2816-45c4-aae8-62a89345297e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.160203 Nov 02 13:27:26.538093 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3460/7464] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:26 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:27.561078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:27.561709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:27.569402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:27.569915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:27.570402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:27.571123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:27.571594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:27.572031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:27.718659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:27.727339 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b55714f2-991c-4343-b591-1bc5a48a3d3c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.170166 Nov 02 13:27:27.727948 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4005/7465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:27 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:28.751628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:28.752253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:28.759489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:28.759998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:28.760444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:28.761179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:28.761649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:28.762124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:28.914490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:28.922472 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9dcc0e6e-8ba2-4c23-8b0a-550bdc272450 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1684 microversion: 2.1 time: 0.175125 Nov 02 13:27:28.923058 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3461/7466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:28 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:29.669248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ccb933a0-1c98-4b96-b544-b213330a4928 req-ba149763-8c8c-4402-88b2-39194764ffeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "name": "network-vif-unplugged", "status": "completed", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:29.682061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ccb933a0-1c98-4b96-b544-b213330a4928 req-ba149763-8c8c-4402-88b2-39194764ffeb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.682556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ccb933a0-1c98-4b96-b544-b213330a4928 req-ba149763-8c8c-4402-88b2-39194764ffeb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.683008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ccb933a0-1c98-4b96-b544-b213330a4928 req-ba149763-8c8c-4402-88b2-39194764ffeb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:29.697727 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ccb933a0-1c98-4b96-b544-b213330a4928 req-ba149763-8c8c-4402-88b2-39194764ffeb service nova] Creating event network-vif-unplugged:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h2-855650-5 Nov 02 13:27:29.704483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-ccb933a0-1c98-4b96-b544-b213330a4928 req-ba149763-8c8c-4402-88b2-39194764ffeb service nova] Instance 3101a61a-4422-4101-af1e-393758f059ef is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:27:29.717834 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ccb933a0-1c98-4b96-b544-b213330a4928 req-ba149763-8c8c-4402-88b2-39194764ffeb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052400 Nov 02 13:27:29.718513 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4006/7467] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:29.946889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:29.947617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:29.955245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.955755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.956210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:29.957122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.957432 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.958519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:30.179225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:30.188953 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-319b292c-2e63-45a1-9608-6b0d807e8ce4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1683 microversion: 2.1 time: 0.246774 Nov 02 13:27:30.189833 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3462/7468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:29 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1683 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:31.218687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:31.219318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:31.227765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.228476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.228926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.229715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.230354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.230981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.397100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:31.406683 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6762af68-036f-44cb-90b5-0f51d87d1f42 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1681 microversion: 2.1 time: 0.194387 Nov 02 13:27:31.407703 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4007/7469] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:31 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:31.748621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5b7fa340-5a27-4553-a022-7b4a4303deec req-ea783ca1-508a-4ac6-b385-8fa9dd722061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:31.759761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5b7fa340-5a27-4553-a022-7b4a4303deec req-ea783ca1-508a-4ac6-b385-8fa9dd722061 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.760247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5b7fa340-5a27-4553-a022-7b4a4303deec req-ea783ca1-508a-4ac6-b385-8fa9dd722061 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.760683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5b7fa340-5a27-4553-a022-7b4a4303deec req-ea783ca1-508a-4ac6-b385-8fa9dd722061 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.774341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5b7fa340-5a27-4553-a022-7b4a4303deec req-ea783ca1-508a-4ac6-b385-8fa9dd722061 service nova] Creating event network-changed:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h2-855650-5 Nov 02 13:27:31.780690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-5b7fa340-5a27-4553-a022-7b4a4303deec req-ea783ca1-508a-4ac6-b385-8fa9dd722061 service nova] Instance 3101a61a-4422-4101-af1e-393758f059ef is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:27:31.793539 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5b7fa340-5a27-4553-a022-7b4a4303deec req-ea783ca1-508a-4ac6-b385-8fa9dd722061 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049876 Nov 02 13:27:31.794344 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3463/7470] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:27:32.433761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:32.434583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:32.442380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:32.442925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:32.443391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:32.444136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:32.444655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:32.445105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:32.594892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:32.603837 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-334993e6-77d6-49ed-acd3-5d10f3bf8904 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1681 microversion: 2.1 time: 0.175805 Nov 02 13:27:32.604437 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4008/7471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:32 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:33.632023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:33.633175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:33.641310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:33.641814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:33.642347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:33.643027 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:33.643633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:33.643925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:33.858416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:33.869374 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-814b08b2-7e6d-4d2f-bb0e-428d82e0eeda tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1681 microversion: 2.1 time: 0.244173 Nov 02 13:27:33.870392 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3464/7472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:33 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:34.894965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:34.896100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:34.903234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:34.903971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:34.904445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:34.905187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:34.905664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:34.906139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.059133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:35.074777 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5284ab80-3294-4b63-8e95-2dfc3d99d395 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1678 microversion: 2.1 time: 0.183408 Nov 02 13:27:35.075844 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4009/7473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:34 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:35.104501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:35.105196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:35.112592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.113000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.113441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.114676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.115130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.115551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.157342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.157827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.158307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.159047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.159500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.159931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.182605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for project 5345434f4a0144bf93bf64442bfe411c. Resources: {'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:35.188396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for user b990a688f9c44a5a8c2fae7818d46c5d and project 5345434f4a0144bf93bf64442bfe411c. Resources: {'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:35.299315 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6e4ca44-ec78-4b99-a0b5-3ea225d59a6b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef/action" status: 202 len: 0 microversion: 2.1 time: 0.198694 Nov 02 13:27:35.299947 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3465/7474] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:27:35 2022] POST /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:35.309497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:35.310166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:35.316553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.317523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.317821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.318578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.319054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.319619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.492208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:35.500715 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05ca5a46-d18b-4d3c-8d22-cee3c4557354 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1677 microversion: 2.1 time: 0.195263 Nov 02 13:27:35.508798 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4010/7475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:35 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:36.326514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-525b7f39-ac84-48ac-85c0-dcf3255c050c req-675ff8dd-8b08-4adf-925c-0ba0da100dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "name": "network-vif-plugged", "status": "completed", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:36.339057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-525b7f39-ac84-48ac-85c0-dcf3255c050c req-675ff8dd-8b08-4adf-925c-0ba0da100dba service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:36.339790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-525b7f39-ac84-48ac-85c0-dcf3255c050c req-675ff8dd-8b08-4adf-925c-0ba0da100dba service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:36.340234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-525b7f39-ac84-48ac-85c0-dcf3255c050c req-675ff8dd-8b08-4adf-925c-0ba0da100dba service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:36.352058 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-525b7f39-ac84-48ac-85c0-dcf3255c050c req-675ff8dd-8b08-4adf-925c-0ba0da100dba service nova] Creating event network-vif-plugged:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h2-855650-5 Nov 02 13:27:36.358209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-525b7f39-ac84-48ac-85c0-dcf3255c050c req-675ff8dd-8b08-4adf-925c-0ba0da100dba service nova] Instance 3101a61a-4422-4101-af1e-393758f059ef is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:27:36.369462 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-525b7f39-ac84-48ac-85c0-dcf3255c050c req-675ff8dd-8b08-4adf-925c-0ba0da100dba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048094 Nov 02 13:27:36.370107 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3466/7476] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:36.524890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:36.525452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:36.532436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:36.532935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:36.533392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:36.534140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:36.534615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:36.535059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:36.673833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:36.683321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2646734-12ee-4619-9ad3-de9fc0215771 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1677 microversion: 2.1 time: 0.162352 Nov 02 13:27:36.683923 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4011/7477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:36 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:37.709943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:37.710698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:37.716946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.717431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.717871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:37.718602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.719061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.719496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:37.876503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:37.885672 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1d7e2326-7a2e-44b9-b6dc-50b057b38deb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1677 microversion: 2.1 time: 0.181416 Nov 02 13:27:37.886387 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3467/7478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:37 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:38.715305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ba916c95-034f-4746-94b1-a1d22dd3a3c8 req-39bd1b04-7c1d-4010-91c9-77cf4ba43bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "name": "network-vif-unplugged", "status": "completed", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:38.726253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ba916c95-034f-4746-94b1-a1d22dd3a3c8 req-39bd1b04-7c1d-4010-91c9-77cf4ba43bd6 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.726756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ba916c95-034f-4746-94b1-a1d22dd3a3c8 req-39bd1b04-7c1d-4010-91c9-77cf4ba43bd6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.727232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ba916c95-034f-4746-94b1-a1d22dd3a3c8 req-39bd1b04-7c1d-4010-91c9-77cf4ba43bd6 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.739388 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ba916c95-034f-4746-94b1-a1d22dd3a3c8 req-39bd1b04-7c1d-4010-91c9-77cf4ba43bd6 service nova] Creating event network-vif-unplugged:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h1-855650-5 Nov 02 13:27:38.744997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-ba916c95-034f-4746-94b1-a1d22dd3a3c8 req-39bd1b04-7c1d-4010-91c9-77cf4ba43bd6 service nova] Instance 3101a61a-4422-4101-af1e-393758f059ef is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:27:38.757635 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ba916c95-034f-4746-94b1-a1d22dd3a3c8 req-39bd1b04-7c1d-4010-91c9-77cf4ba43bd6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045979 Nov 02 13:27:38.758311 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4012/7479] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:38.915250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:38.915881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:38.923261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.923857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.924309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.925038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.925501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.925936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:39.387873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:39.396586 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-44b82d3a-1486-43d0-9a56-1df746aab1af tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1677 microversion: 2.1 time: 0.485362 Nov 02 13:27:39.397186 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3468/7480] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:38 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1677 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:40.421826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:40.422569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:40.430161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:40.430670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:40.431133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:40.431847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:40.432325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:40.432763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:40.569872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:40.577784 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2254c523-9b18-4d43-9626-83e4f7bf47ec tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1677 microversion: 2.1 time: 0.161115 Nov 02 13:27:40.578406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4013/7481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:40 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:40.795626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-ea04b72f-e90a-4b26-abf3-14e481b9c91b req-d699822a-c0d8-4947-adf5-a8f4ad358370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:40.806478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea04b72f-e90a-4b26-abf3-14e481b9c91b req-d699822a-c0d8-4947-adf5-a8f4ad358370 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:40.806954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea04b72f-e90a-4b26-abf3-14e481b9c91b req-d699822a-c0d8-4947-adf5-a8f4ad358370 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:40.807384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-ea04b72f-e90a-4b26-abf3-14e481b9c91b req-d699822a-c0d8-4947-adf5-a8f4ad358370 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:40.811271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:40.820214 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-ea04b72f-e90a-4b26-abf3-14e481b9c91b req-d699822a-c0d8-4947-adf5-a8f4ad358370 service nova] Creating event network-changed:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h1-855650-5 Nov 02 13:27:40.826958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-ea04b72f-e90a-4b26-abf3-14e481b9c91b req-d699822a-c0d8-4947-adf5-a8f4ad358370 service nova] Instance 3101a61a-4422-4101-af1e-393758f059ef is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:27:40.838829 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-ea04b72f-e90a-4b26-abf3-14e481b9c91b req-d699822a-c0d8-4947-adf5-a8f4ad358370 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046870 Nov 02 13:27:40.839439 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3469/7482] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:41.600689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:41.601312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:41.608467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:41.608988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:41.609440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:41.610335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:41.610671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:41.611116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:41.752059 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:41.756234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:41.761927 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37e4edae-b9ec-401a-b50d-f5c3a55c3edc tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1677 microversion: 2.1 time: 0.165183 Nov 02 13:27:41.762559 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4014/7483] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:41 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:42.787353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:42.788072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:42.794683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:42.795176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:42.795624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:42.796329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:42.796787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:42.797217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:42.941429 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:42.950334 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-49e6f853-7d73-4cff-ae9e-96584effbdd6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1677 microversion: 2.1 time: 0.168218 Nov 02 13:27:42.950942 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3470/7484] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:42 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:43.975763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:43.976301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:43.987183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:43.987683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:43.988134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:43.988846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:43.989306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:43.989738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.132706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:44.142592 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f0f05e03-fc4b-4132-912c-aec8a97f1695 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1670 microversion: 2.1 time: 0.171289 Nov 02 13:27:44.143187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4015/7485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:43 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:44.166940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:44.167554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:44.174787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.175283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.175729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.176445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.176993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.177348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.320743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:44.330251 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d8f06bae-94f8-4feb-8279-f9573516e4d6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1670 microversion: 2.1 time: 0.167125 Nov 02 13:27:44.330862 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3471/7486] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:44 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:44.353933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:44.354809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:44.356874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=39 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:44.362409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.362916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.363406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.364123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.364871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.365372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.523662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:44.531820 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f97e069e-5b33-411b-ae9b-60e2573ced74 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1670 microversion: 2.1 time: 0.181911 Nov 02 13:27:44.532407 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4016/7487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:44 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:44.555438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:44.555972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:44.558119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:44.564216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.564710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.565154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.565871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.566356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.566790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.595307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:27:44.681578 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-baddd8ac-616d-48b1-aa79-12639bb9a903 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 204 len: 0 microversion: 2.1 time: 0.130153 Nov 02 13:27:44.682645 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3472/7488] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:27:44 2022] DELETE /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:27:44.697609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:44.698391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:44.705485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.706051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.706667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.707435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.707926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.708874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.856733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:44.865083 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9b8646c-39e3-4f36-9ce2-e988c7670e5f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1676 microversion: 2.1 time: 0.177769 Nov 02 13:27:44.865681 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4017/7489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:44 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:45.890192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:45.891047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:45.893563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:45.900690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:45.901182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:45.901620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:45.902369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:45.902828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:45.903505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:46.067970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:46.076494 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-385a964b-1756-4dc4-8fa3-0ca1b042b4a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1676 microversion: 2.1 time: 0.190751 Nov 02 13:27:46.077106 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3473/7490] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:45 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:47.107115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:47.108026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:47.116717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:47.117435 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:47.118064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:47.118806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:47.119483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:47.119924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:47.143316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-96a15733-dd04-4388-a65a-97b6a1f44141 req-dbd27586-80c5-4ef7-ab65-66567596a120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3101a61a-4422-4101-af1e-393758f059ef", "name": "network-vif-deleted", "tag": "d0086c65-e8f1-42d6-a577-808f7b6408cf"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:47.190441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-96a15733-dd04-4388-a65a-97b6a1f44141 req-dbd27586-80c5-4ef7-ab65-66567596a120 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:47.191182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-96a15733-dd04-4388-a65a-97b6a1f44141 req-dbd27586-80c5-4ef7-ab65-66567596a120 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:47.192067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-96a15733-dd04-4388-a65a-97b6a1f44141 req-dbd27586-80c5-4ef7-ab65-66567596a120 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:47.209834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:47.216359 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-96a15733-dd04-4388-a65a-97b6a1f44141 req-dbd27586-80c5-4ef7-ab65-66567596a120 service nova] Creating event network-vif-deleted:d0086c65-e8f1-42d6-a577-808f7b6408cf for instance 3101a61a-4422-4101-af1e-393758f059ef on n-h1-855650-5 Nov 02 13:27:47.220162 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43c9232c-a07d-43d5-a4a4-168e5687c4d8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 200 len: 1608 microversion: 2.1 time: 0.117059 Nov 02 13:27:47.221008 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4018/7491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:47 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 1608 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:47.238479 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-96a15733-dd04-4388-a65a-97b6a1f44141 req-dbd27586-80c5-4ef7-ab65-66567596a120 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104049 Nov 02 13:27:47.239107 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3474/7492] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:48.244669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:48.245321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:48.252253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:48.252792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:48.253222 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:48.253931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:48.254437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:48.254883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:48.268600 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef HTTP/1.1 Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3101a61a-4422-4101-af1e-393758f059ef'} Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:48.270346 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4cce9f81-3bba-40f6-966b-03da60030b1e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 404 len: 111 microversion: 2.1 time: 0.031617 Nov 02 13:27:48.275733 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4019/7493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:48 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:27:48.292435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:48.293142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:48.299417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:48.299902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:48.300351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:48.301045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:48.301555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:48.302024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:48.315335 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef HTTP/1.1 Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3101a61a-4422-4101-af1e-393758f059ef'} Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:48.316975 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8c6dd5b1-77dd-40d9-9c07-322cc4bfb969 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 404 len: 111 microversion: 2.1 time: 0.032005 Nov 02 13:27:48.321894 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3475/7494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:48 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:27:48.400831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-9688891", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "fcb8e111-a978-4e3e-b47a-9c5ed66997ad"}], "security_groups": [{"name": "tempest-securitygroup--1285657684"}], "key_name": "tempest-keypair-783021381", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:48.511810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] validate_networks() for [('fcb8e111-a978-4e3e-b47a-9c5ed66997ad', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:27:48.892264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:27:48.892264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:27:48.892264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:27:48.892264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:27:48.892864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:27:48.902816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:48.903316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:48.903777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:48.904521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:48.904994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:48.905438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:48.922376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for project 5345434f4a0144bf93bf64442bfe411c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:48.927753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for user b990a688f9c44a5a8c2fae7818d46c5d and project 5345434f4a0144bf93bf64442bfe411c. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:48.940549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:27:48.943561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:27:48.990815 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37a1848b-107d-4a34-b586-b1c5945ca033 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.594867 Nov 02 13:27:48.991391 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4020/7495] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:27:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:27:49.003250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c2a63fe-a9c6-4220-b084-37367acd0eb3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:49.004026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1c2a63fe-a9c6-4220-b084-37367acd0eb3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:49.065141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c2a63fe-a9c6-4220-b084-37367acd0eb3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:49.073280 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1c2a63fe-a9c6-4220-b084-37367acd0eb3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1235 microversion: 2.1 time: 0.073835 Nov 02 13:27:49.073851 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3476/7496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:48 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:50.097590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:50.098253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:50.106371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:50.106942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:50.107319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:50.108242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:50.108716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:50.109159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:50.180138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:50.189170 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a80d587e-d767-4bd7-b149-a4aa213db7fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1295 microversion: 2.1 time: 0.096198 Nov 02 13:27:50.189754 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4021/7497] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:50 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:51.214376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:51.214957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:51.222962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:51.223453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:51.223960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:51.224676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:51.225225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:51.225673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:51.491666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:51.499908 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f5b6524c-bb32-4d24-a577-3f05d2c54de4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1361 microversion: 2.1 time: 0.289723 Nov 02 13:27:51.501435 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3477/7498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:51 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:51.684990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-cded9efb-a588-4a6a-a146-fab6030427e7 req-534f64e2-4fa6-4c53-a4cd-6e7b6c4b7bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:51.696724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cded9efb-a588-4a6a-a146-fab6030427e7 req-534f64e2-4fa6-4c53-a4cd-6e7b6c4b7bfc service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:51.697221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cded9efb-a588-4a6a-a146-fab6030427e7 req-534f64e2-4fa6-4c53-a4cd-6e7b6c4b7bfc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:51.698337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cded9efb-a588-4a6a-a146-fab6030427e7 req-534f64e2-4fa6-4c53-a4cd-6e7b6c4b7bfc service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:51.711530 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-cded9efb-a588-4a6a-a146-fab6030427e7 req-534f64e2-4fa6-4c53-a4cd-6e7b6c4b7bfc service nova] Creating event network-changed:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h2-855650-5 Nov 02 13:27:51.717094 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-cded9efb-a588-4a6a-a146-fab6030427e7 req-534f64e2-4fa6-4c53-a4cd-6e7b6c4b7bfc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035753 Nov 02 13:27:51.717094 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4022/7499] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:27:52.526300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:52.526981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:52.534489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:52.534971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:52.535409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:52.536099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:52.536573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:52.536997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:52.678939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:52.686849 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bb3e8def-a8d2-4e58-ad82-07da3ba803ed tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1361 microversion: 2.1 time: 0.165360 Nov 02 13:27:52.687438 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3478/7500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:52 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:53.713234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:53.713930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:53.720298 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:53.720808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:53.721261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:53.721997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:53.722467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:53.722911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:53.859565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:53.867495 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ee1adad1-7187-479f-9df6-5862fbe8b3bd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1361 microversion: 2.1 time: 0.159882 Nov 02 13:27:53.868132 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4023/7501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:53 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:54.891913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:54.892568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:54.899647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:54.900136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:54.900573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:54.901307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:54.901756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:54.902230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:55.041088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:55.049068 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-47a113af-685c-4018-b25a-281704d39c0f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1361 microversion: 2.1 time: 0.161105 Nov 02 13:27:55.049659 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3479/7502] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:54 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:56.074315 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:56.074957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:56.082007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.082524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.082975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.083690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.084156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.084593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.219494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:56.228286 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e27bf3f-2f2a-41d2-a0ed-507cc605a2c9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1361 microversion: 2.1 time: 0.158549 Nov 02 13:27:56.228878 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4024/7503] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:56 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:57.252912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:57.253592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:57.261158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.261708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.262176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.262887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.263349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.263786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.424602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:57.433661 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cf42d9d8-af19-4deb-8f9b-8c71c6ade2f4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1361 microversion: 2.1 time: 0.184648 Nov 02 13:27:57.434277 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3480/7504] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:57 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:58.434900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a3f00fc2-ceaf-4002-95b9-66d991ce5ce3 req-5e2c51fe-39a5-4589-a9d6-5d7d1769c053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "name": "network-vif-plugged", "status": "completed", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:58.448721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a3f00fc2-ceaf-4002-95b9-66d991ce5ce3 req-5e2c51fe-39a5-4589-a9d6-5d7d1769c053 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:58.449286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a3f00fc2-ceaf-4002-95b9-66d991ce5ce3 req-5e2c51fe-39a5-4589-a9d6-5d7d1769c053 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:58.450061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a3f00fc2-ceaf-4002-95b9-66d991ce5ce3 req-5e2c51fe-39a5-4589-a9d6-5d7d1769c053 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:58.459020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:58.459710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:58.463003 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a3f00fc2-ceaf-4002-95b9-66d991ce5ce3 req-5e2c51fe-39a5-4589-a9d6-5d7d1769c053 service nova] Creating event network-vif-plugged:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h2-855650-5 Nov 02 13:27:58.467002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:58.467494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:58.467984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:58.468582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a3f00fc2-ceaf-4002-95b9-66d991ce5ce3 req-5e2c51fe-39a5-4589-a9d6-5d7d1769c053 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037612 Nov 02 13:27:58.468701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:58.469362 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4025/7505] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:58.469486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:58.469890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:58.664120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:58.672071 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ca5edf1-76b6-4e84-bc8e-4149e06b9a1f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1361 microversion: 2.1 time: 0.218029 Nov 02 13:27:58.672710 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3481/7506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:58 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:59.698282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:59.699200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:59.701208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:59.701907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:59.709572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:59.710184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:59.710722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:59.711469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:59.711999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:59.712608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:59.920907 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:59.931431 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e084c49e-cadb-4685-8aa7-247a8934a57b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1361 microversion: 2.1 time: 0.237270 Nov 02 13:27:59.932202 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4026/7507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:59 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:00.955746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:00.956356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:00.959062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:00.965326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.965818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.966289 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:00.966988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.967450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.967909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:01.102332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:01.110103 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-da8278ee-57cf-4d51-b54c-15b757ed5bcb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1549 microversion: 2.1 time: 0.158266 Nov 02 13:28:01.110682 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3482/7508] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:28:00 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:01.134124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:01.134665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:01.141592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:01.142129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:01.142584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:01.143292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:01.143762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:01.144200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:01.224895 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-947aadda-d6d7-4b7c-8047-5f7c19967e44 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095261 Nov 02 13:28:01.225512 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4027/7509] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 13:28:01 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:02.171667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-45574fcf-53d4-4128-979f-818fdb689390 req-1d1b6829-6c5e-4aab-907a-f9d4afad5221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:02.183040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-45574fcf-53d4-4128-979f-818fdb689390 req-1d1b6829-6c5e-4aab-907a-f9d4afad5221 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.183617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-45574fcf-53d4-4128-979f-818fdb689390 req-1d1b6829-6c5e-4aab-907a-f9d4afad5221 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.184130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-45574fcf-53d4-4128-979f-818fdb689390 req-1d1b6829-6c5e-4aab-907a-f9d4afad5221 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.196176 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-45574fcf-53d4-4128-979f-818fdb689390 req-1d1b6829-6c5e-4aab-907a-f9d4afad5221 service nova] Creating event network-changed:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h2-855650-5 Nov 02 13:28:02.201780 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-45574fcf-53d4-4128-979f-818fdb689390 req-1d1b6829-6c5e-4aab-907a-f9d4afad5221 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033706 Nov 02 13:28:02.202507 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3483/7510] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:15.594319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:15.595887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=60 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:15.596974 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:29:15.597130 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:29:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 (ip 10.222.0.45) !!! Nov 02 13:29:15.603439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:15.604068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:15.613156 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.613658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.614146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:15.614857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.615321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.615756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:15.754300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:15.762889 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48440125-774b-40a9-a262-988416967b67 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1667 microversion: 2.1 time: 0.171711 Nov 02 13:29:15.763477 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4028/7511] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:15 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:15.784380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:15.785117 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:15.791241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4712072e-84d2-48d0-a4d4-77f43432a80f"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:15.793746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:15.802796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.803491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.803936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:15.804649 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.805283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.805706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:16.079781 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f20944c2-5233-46e2-a20b-b0110c470225 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297293 Nov 02 13:29:16.080393 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3484/7512] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:29:15 2022] POST /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:26.848778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:26.851060 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:26.853878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:26.854575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:26.860436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:26.860961 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:26.861416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:26.862172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:26.862649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:26.863099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:26.904668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:26.910989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Old instance type m1.heat2, new instance type m1.heat {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:29:26.918476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:29:26.918922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:29:26.919422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:29:26.919851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:29:26.920283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:29:26.985665 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e474501b-7c85-4ac0-a22f-d7997d41f4f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/action" status: 202 len: 0 microversion: 2.1 time: 0.140521 Nov 02 13:29:26.986287 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4029/7513] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:29:26 2022] POST /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:29:26.995017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:26.995806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:26.999391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:27.000224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:27.006758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:27.007366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:27.007850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:27.008804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:27.009273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:27.009740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:27.185299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:27.194254 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-733fed5f-11a0-4773-8c4d-223a253ea6b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1722 microversion: 2.1 time: 0.203439 Nov 02 13:29:27.195108 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3485/7514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:26 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:28.219357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:28.219968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:28.228277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:28.228757 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:28.229235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:28.229950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:28.230464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:28.230904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:28.377581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:28.387380 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dabcf666-7002-417f-b473-da1fe0ae2e69 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1722 microversion: 2.1 time: 0.171528 Nov 02 13:29:28.387624 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4030/7515] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:28 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:29.411838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:29.412458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:29.420260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:29.420758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:29.421204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:29.421922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:29.422564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:29.423000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:29.564061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:29.573930 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-04943361-9883-4ac5-bbe6-74763d95b19e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.165881 Nov 02 13:29:29.574494 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3486/7516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:29 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:30.599337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:30.599892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:30.607342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:30.607837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:30.608286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:30.608999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:30.609458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:30.609890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:30.750082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:30.758729 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eca6d9e1-91ce-44da-9661-633cc111723f tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.163463 Nov 02 13:29:30.759327 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4031/7517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:30 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:31.785807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:31.786682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:31.796513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:31.797384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:31.798334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:31.799556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:31.800365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:31.801030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:31.944993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:31.954035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5ce67f17-489b-4058-ba2b-ee32e9578a9e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.174663 Nov 02 13:29:31.954610 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3487/7518] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:31 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:32.976923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:32.977542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:32.984727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:32.985236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:32.985695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:32.986492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:32.986959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:32.987422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:33.122759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:33.131053 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f5df74da-08ee-472a-9866-f89598810f43 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.158138 Nov 02 13:29:33.131633 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4032/7519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:32 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:34.156398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:34.157387 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:34.164548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:34.165039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:34.165499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:34.166333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:34.166796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:34.167230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:34.305759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:34.314250 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b8895bc5-ff09-4518-9389-cc2e92db6441 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.163000 Nov 02 13:29:34.314838 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3488/7520] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:34 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:35.338889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:35.339524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:35.348248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:35.348829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:35.349413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:35.350106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:35.351243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:35.351243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:35.498308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:35.506727 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e81f7e86-a01c-413a-a00d-3b8875d33e02 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.171856 Nov 02 13:29:35.507310 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4033/7521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:35 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:36.529510 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:36.530159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:36.537224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:36.537714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:36.538191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:36.538885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:36.539344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:36.539767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:36.673877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:36.682288 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cad12fd4-6dd2-499d-be9d-cdcf1e9e84cf tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.156672 Nov 02 13:29:36.682867 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3489/7522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:36 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:37.707055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:37.707694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:37.714831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:37.715334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:37.715791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:37.716501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:37.716974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:37.717423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:37.851845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:37.860471 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af6d57a5-b9fa-47fc-aad7-f30721695509 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.157565 Nov 02 13:29:37.861088 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4034/7523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:37 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:38.885065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:38.885766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:38.892879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:38.893375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:38.893822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:38.894566 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:38.895031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:38.895465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:39.032312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:39.040633 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b38db717-3c59-41e5-a856-73dfabe1b69d tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.159577 Nov 02 13:29:39.041210 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3490/7524] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:38 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:40.064870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:40.065525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:40.072508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:40.073012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:40.073472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:40.074211 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:40.075379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:40.075851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:40.212072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:40.220926 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ca416ea-9555-433b-9362-a6f16fe324b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.160062 Nov 02 13:29:40.221498 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4035/7525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:40 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:41.244922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:41.245535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:41.252512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:41.253002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:41.253455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:41.254187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:41.254650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:41.255082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:41.398807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:41.407457 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7d6d4f70-05a6-4d27-b83b-8afe46f6eb35 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.166519 Nov 02 13:29:41.408064 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3491/7526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:41 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:42.431444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:42.432041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:42.439372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:42.439918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:42.440385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:42.441116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:42.441587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:42.442093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:42.576476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:42.585244 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b93b5d69-e129-482d-99ec-f68b2aa088ab tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.157824 Nov 02 13:29:42.585832 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4036/7527] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:42 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:43.610534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:43.611181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:43.619153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:43.619647 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:43.620084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:43.620786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:43.621241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:43.622244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:43.762847 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:43.774176 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-407ab24f-f997-42a4-8e82-3525895b3b55 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.168057 Nov 02 13:29:43.774629 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3492/7528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:43 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:44.799266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:44.799931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:44.806883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:44.807381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:44.807838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:44.808549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:44.809024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:44.809461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:44.943092 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:44.952857 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d90fbf90-e9d7-4941-a3d2-b3433867453e tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.157791 Nov 02 13:29:44.953456 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4037/7529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:44 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:45.978769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:45.979421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:45.986958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:45.987453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:45.987900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:45.988614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:45.989072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:45.989507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:46.124197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:46.132569 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd2cb235-a8a8-4904-badf-187e0ea31978 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.157858 Nov 02 13:29:46.133275 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3493/7530] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:45 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:47.159263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:47.159755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:47.165855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:47.166385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:47.166835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:47.167552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:47.168011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:47.168938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:47.311897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:47.320767 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d7a416e3-adeb-4165-a3fc-ece16cf97b85 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1727 microversion: 2.1 time: 0.166403 Nov 02 13:29:47.321358 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4038/7531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:47 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:48.344818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:48.345603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:48.352872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:48.353369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:48.353814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:48.354564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:48.355024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:48.355575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:48.590839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:48.600363 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8044b050-3028-4463-9488-c1df1e7abe87 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1726 microversion: 2.1 time: 0.259413 Nov 02 13:29:48.600968 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3494/7532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:48 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:48.820857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e46394c3-1b00-44f1-bc2e-794ebe752fd3 req-1f70a545-0fc8-49e7-ab54-426e136414c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "name": "network-vif-unplugged", "status": "completed", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:48.831233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e46394c3-1b00-44f1-bc2e-794ebe752fd3 req-1f70a545-0fc8-49e7-ab54-426e136414c8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:48.831715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e46394c3-1b00-44f1-bc2e-794ebe752fd3 req-1f70a545-0fc8-49e7-ab54-426e136414c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:48.832173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e46394c3-1b00-44f1-bc2e-794ebe752fd3 req-1f70a545-0fc8-49e7-ab54-426e136414c8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:48.845310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e46394c3-1b00-44f1-bc2e-794ebe752fd3 req-1f70a545-0fc8-49e7-ab54-426e136414c8 service nova] Creating event network-vif-unplugged:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h1-855650-5 Nov 02 13:29:48.851889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-e46394c3-1b00-44f1-bc2e-794ebe752fd3 req-1f70a545-0fc8-49e7-ab54-426e136414c8 service nova] Instance 49f8dfba-e277-4d78-9925-78347bf42747 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:29:48.864955 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e46394c3-1b00-44f1-bc2e-794ebe752fd3 req-1f70a545-0fc8-49e7-ab54-426e136414c8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104522 Nov 02 13:29:48.865605 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4039/7533] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:29:49.625351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:49.625995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:49.633087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:49.633593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:49.634071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:49.634786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:49.635246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:49.635686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:49.836811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:49.845343 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48e86d94-1d2a-4962-bfd5-d4036c980255 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1726 microversion: 2.1 time: 0.224390 Nov 02 13:29:49.845945 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3495/7534] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:49 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:50.870632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:50.872320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:50.878589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:50.879110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:50.879570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:50.880295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:50.880770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:50.881210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:50.884642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-66b8dee1-c156-4c91-a4e4-ea53fb13609a req-393850f7-3eff-429d-b564-3a9e33a1d8ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:50.901594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-66b8dee1-c156-4c91-a4e4-ea53fb13609a req-393850f7-3eff-429d-b564-3a9e33a1d8ec service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:50.902260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-66b8dee1-c156-4c91-a4e4-ea53fb13609a req-393850f7-3eff-429d-b564-3a9e33a1d8ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:50.903496 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-66b8dee1-c156-4c91-a4e4-ea53fb13609a req-393850f7-3eff-429d-b564-3a9e33a1d8ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:50.917297 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-66b8dee1-c156-4c91-a4e4-ea53fb13609a req-393850f7-3eff-429d-b564-3a9e33a1d8ec service nova] Creating event network-changed:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h1-855650-5 Nov 02 13:29:50.923474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-66b8dee1-c156-4c91-a4e4-ea53fb13609a req-393850f7-3eff-429d-b564-3a9e33a1d8ec service nova] Instance 49f8dfba-e277-4d78-9925-78347bf42747 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:29:50.936065 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-66b8dee1-c156-4c91-a4e4-ea53fb13609a req-393850f7-3eff-429d-b564-3a9e33a1d8ec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056259 Nov 02 13:29:50.936897 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3496/7535] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:51.038117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:51.047176 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1794243-aacc-4c5e-bb7e-71ad671c6b05 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.181792 Nov 02 13:29:51.048096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4040/7536] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:50 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:52.073757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:52.074484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:52.081346 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:52.081829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:52.082293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:52.082988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:52.083438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:52.083872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:52.221287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:52.230097 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1c668b83-1324-4335-a0c0-8ca7faa7dfa9 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.161569 Nov 02 13:29:52.230687 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3497/7537] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:52 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:53.254346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:53.255026 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:53.262829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:53.263436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:53.263833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:53.264548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:53.265021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:53.265487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:53.421048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:53.430287 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f281f19b-c00f-44bf-80c3-a7360bcfbabd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.179860 Nov 02 13:29:53.430890 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4041/7538] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:53 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:54.457299 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:54.457852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:54.465020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:54.466367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:54.466818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:54.467532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:54.467984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:54.468413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:54.616659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:54.626465 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-26fb344f-0bf0-4c29-b759-a54f45c2a5b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.173283 Nov 02 13:29:54.627231 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3498/7539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:54 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:55.651017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:55.651659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:55.658711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:55.659214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:55.659673 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:55.660388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:55.660857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:55.661327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:55.792774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:55.801250 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-550ea3ad-784a-42cc-b467-547def96521b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.154145 Nov 02 13:29:55.801849 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4042/7540] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:55 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:56.826047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:56.826673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:56.833498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:56.834035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:56.834484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:56.835192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:56.835653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:56.836089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:56.969245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:56.977628 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-def4c1b7-3707-4831-bb73-0a7b69731a57 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.156084 Nov 02 13:29:56.978232 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3499/7541] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:56 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:58.000191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:58.000818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:58.003686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=33 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:58.009654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:58.010261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:58.010730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:58.011451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:58.011953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:58.012397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:58.015201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:58.146358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:58.155390 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f4967f6-ed6e-4b8b-af74-8e0ee211e459 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.159129 Nov 02 13:29:58.155967 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4043/7542] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:57 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:59.179393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:59.180018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:59.182701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=31 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:59.189012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:59.189554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:59.190024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:59.190737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:59.191197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:59.191622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:59.194584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=89 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:59.331467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:59.342150 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c02a762c-7eee-48a7-80c6-beae17f91bf1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.166492 Nov 02 13:29:59.342801 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3500/7543] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:59 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:00.367188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:00.367888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:00.375460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:00.375965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:00.376434 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:00.377148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:00.377699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:00.378097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:00.517905 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:00.526450 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8416d695-d49e-43b6-932d-b182adc16179 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.163161 Nov 02 13:30:00.527040 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4044/7544] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:00 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:01.549995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:01.550607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:01.557572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:01.558094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:01.558535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:01.559221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:01.560171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:01.560593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:01.698903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:01.707739 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b3819c4a-73fd-4c40-bfe7-e7541f5e947b tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.161643 Nov 02 13:30:01.708327 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3501/7545] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:01 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:02.731588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:02.732770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:02.739573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:02.740132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:02.740682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:02.741568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:02.742202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:02.742702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:02.875213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:02.883617 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39663739-3468-40e7-a73d-e5d3e5002ced tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.156213 Nov 02 13:30:02.884209 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4045/7546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:02 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:03.964480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:03.965100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:03.973169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:03.973671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:03.974169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:03.974892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:03.975353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:03.975789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:04.111831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:04.121040 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2865e63e-4481-49bb-b7ad-f2321b81491c tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1724 microversion: 2.1 time: 0.160460 Nov 02 13:30:04.121635 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3502/7547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:03 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:05.143824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:05.144453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:05.151421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.151918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.152373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.153114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.153545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.153992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.290332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:05.299457 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4acb2697-9857-4933-93e1-1e7d3164c085 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1721 microversion: 2.1 time: 0.159660 Nov 02 13:30:05.300049 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4046/7548] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:05 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:05.322742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:05.323306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:05.330676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.331178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.331697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.332420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.332880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.333313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.375233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.375634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.376078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.376819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.377281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.377715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.398454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for project 5345434f4a0144bf93bf64442bfe411c. Resources: {'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:05.403662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Getting quotas for user b990a688f9c44a5a8c2fae7818d46c5d and project 5345434f4a0144bf93bf64442bfe411c. Resources: {'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:05.507389 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b161b22-10da-4ed7-bcbf-94c25ef096fb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "POST /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/action" status: 202 len: 0 microversion: 2.1 time: 0.188969 Nov 02 13:30:05.508224 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3503/7549] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:30:05 2022] POST /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:30:05.516767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:05.517396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:05.523522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.524030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.524687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.525182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.525824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.526107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.668356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:05.677081 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec935f51-ace3-49ee-a360-c32d5a05de56 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.164317 Nov 02 13:30:05.677605 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4047/7550] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:05 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:06.701702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:06.702376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:06.713239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:06.713733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:06.714211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:06.714924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:06.715389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:06.715826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:06.895116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:06.903788 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ed98ac7-85dc-4b4d-a46d-d6a90ec9d644 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.206504 Nov 02 13:30:06.904876 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3504/7551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:06 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:07.751441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-4d604f1d-05a7-42cd-9672-27b6e4c30b7f req-58f3d222-f969-4fae-ac1e-fec09cc8d8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "name": "network-vif-plugged", "status": "completed", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:07.761166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4d604f1d-05a7-42cd-9672-27b6e4c30b7f req-58f3d222-f969-4fae-ac1e-fec09cc8d8bb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:07.761684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4d604f1d-05a7-42cd-9672-27b6e4c30b7f req-58f3d222-f969-4fae-ac1e-fec09cc8d8bb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:07.762187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-4d604f1d-05a7-42cd-9672-27b6e4c30b7f req-58f3d222-f969-4fae-ac1e-fec09cc8d8bb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:07.774987 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-4d604f1d-05a7-42cd-9672-27b6e4c30b7f req-58f3d222-f969-4fae-ac1e-fec09cc8d8bb service nova] Creating event network-vif-plugged:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h1-855650-5 Nov 02 13:30:07.781180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-4d604f1d-05a7-42cd-9672-27b6e4c30b7f req-58f3d222-f969-4fae-ac1e-fec09cc8d8bb service nova] Instance 49f8dfba-e277-4d78-9925-78347bf42747 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:30:07.791945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-4d604f1d-05a7-42cd-9672-27b6e4c30b7f req-58f3d222-f969-4fae-ac1e-fec09cc8d8bb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096637 Nov 02 13:30:07.792546 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4048/7552] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:30:07.928653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:07.929224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:07.937349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:07.937846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:07.938324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:07.939032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:07.939567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:07.940552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:08.078477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:08.087122 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3da2bc94-1df6-44c8-9018-991edc22f880 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.162504 Nov 02 13:30:08.087711 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3505/7553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:07 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:09.112821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:09.113528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:09.120565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:09.121063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:09.121508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:09.122251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:09.122716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:09.123674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:09.267973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:09.276508 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c93576d-fc32-45df-ba01-8b3439b996d0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.168843 Nov 02 13:30:09.277103 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4049/7554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:09 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:10.300814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:10.301461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:10.309153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:10.309674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:10.310160 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:10.311427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:10.312058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:10.312504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:10.456927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:10.465436 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2848c187-8b48-4eb2-b307-d2f89343a6b6 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.168546 Nov 02 13:30:10.466041 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3506/7555] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:10 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:11.456076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-598aca09-fa1a-41f7-b3a0-fc4098bf9f1e req-3df0900a-5337-4dfa-9deb-a5817a484f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "name": "network-vif-unplugged", "status": "completed", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:11.468461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-598aca09-fa1a-41f7-b3a0-fc4098bf9f1e req-3df0900a-5337-4dfa-9deb-a5817a484f39 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:11.469665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-598aca09-fa1a-41f7-b3a0-fc4098bf9f1e req-3df0900a-5337-4dfa-9deb-a5817a484f39 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:11.470158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-598aca09-fa1a-41f7-b3a0-fc4098bf9f1e req-3df0900a-5337-4dfa-9deb-a5817a484f39 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:11.484112 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-598aca09-fa1a-41f7-b3a0-fc4098bf9f1e req-3df0900a-5337-4dfa-9deb-a5817a484f39 service nova] Creating event network-vif-unplugged:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h2-855650-5 Nov 02 13:30:11.490303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:11.491477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:11.499593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:11.500329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:11.500957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:11.503236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:11.503881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:11.504382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-598aca09-fa1a-41f7-b3a0-fc4098bf9f1e req-3df0900a-5337-4dfa-9deb-a5817a484f39 service nova] Instance 49f8dfba-e277-4d78-9925-78347bf42747 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:30:11.504666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:11.518209 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-598aca09-fa1a-41f7-b3a0-fc4098bf9f1e req-3df0900a-5337-4dfa-9deb-a5817a484f39 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065934 Nov 02 13:30:11.519680 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4050/7556] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:11.732805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:11.743164 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2712f5d0-f1e8-4b49-88d0-a09bd62a6014 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.257316 Nov 02 13:30:11.743918 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3507/7557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:11 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:12.770414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:12.771163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:12.777745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:12.778293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:12.778753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:12.780005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:12.780487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:12.780926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:12.924967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:12.934709 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef37d8b1-ea81-48e7-ade6-78fe016e50f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.169683 Nov 02 13:30:12.935337 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4051/7558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:12 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:13.548368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b20c754d-13b3-41cd-9e2c-da2b77780d73 req-5374c1f2-f524-4486-8e0d-3d1145a8f522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:13.558694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b20c754d-13b3-41cd-9e2c-da2b77780d73 req-5374c1f2-f524-4486-8e0d-3d1145a8f522 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:13.559176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b20c754d-13b3-41cd-9e2c-da2b77780d73 req-5374c1f2-f524-4486-8e0d-3d1145a8f522 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:13.559612 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b20c754d-13b3-41cd-9e2c-da2b77780d73 req-5374c1f2-f524-4486-8e0d-3d1145a8f522 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:13.572188 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b20c754d-13b3-41cd-9e2c-da2b77780d73 req-5374c1f2-f524-4486-8e0d-3d1145a8f522 service nova] Creating event network-changed:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h2-855650-5 Nov 02 13:30:13.578439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-b20c754d-13b3-41cd-9e2c-da2b77780d73 req-5374c1f2-f524-4486-8e0d-3d1145a8f522 service nova] Instance 49f8dfba-e277-4d78-9925-78347bf42747 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:30:13.590018 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b20c754d-13b3-41cd-9e2c-da2b77780d73 req-5374c1f2-f524-4486-8e0d-3d1145a8f522 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045748 Nov 02 13:30:13.590586 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3508/7559] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:13.958620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:13.960214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:13.968235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:13.969032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:13.969491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:13.970274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:13.970911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:13.971351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:14.116705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:14.125293 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84f94d4e-8e8b-4eae-9f19-5bad4f09a70a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.170532 Nov 02 13:30:14.126276 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4052/7560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:13 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:15.153708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:15.155848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:15.162567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:15.162938 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:15.163393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:15.164317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:15.164799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:15.165242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:15.378782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:15.387635 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-835cfc14-ab5e-4be3-a245-4503ecdf92f0 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.240999 Nov 02 13:30:15.388227 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3509/7561] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:15 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:16.412066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:16.412901 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:16.421247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:16.421730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:16.422235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:16.422949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:16.423416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:16.423844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:16.568989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:16.579154 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6a22566e-dd29-4446-9466-0c92069e2711 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.171012 Nov 02 13:30:16.580018 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4053/7562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:16 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:17.604451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:17.605064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:17.607063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:17.614036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:17.614504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:17.614945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:17.615644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:17.616095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:17.616668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:17.768514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:17.776962 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a4943c2e-c485-45c7-a82e-a12de033f041 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.176380 Nov 02 13:30:17.777558 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3510/7563] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:17 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:18.802511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:18.803143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:18.810180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:18.810692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:18.811148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:18.811865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:18.812338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:18.812783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:18.945728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:18.954351 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d0273a3-622c-4c9f-a218-3b8da1e3ac30 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.155937 Nov 02 13:30:18.954837 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4054/7564] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:18 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:19.978959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:19.979581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:19.987030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:19.987528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:19.987974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:19.988672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:19.989137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:19.989567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:20.119714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:20.128658 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-761f6d89-e41c-47f0-a7f8-bef09f9649a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.153634 Nov 02 13:30:20.129253 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3511/7565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:19 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:21.152802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:21.153431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:21.160350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:21.160859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:21.161316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:21.162056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:21.162531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:21.162975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:21.303009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:21.311962 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2247cadf-57aa-4d70-9d4c-ad4a1432dce2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.163337 Nov 02 13:30:21.312537 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4055/7566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:21 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:22.335659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:22.336277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:22.344100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.344585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.345026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:22.345730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.346776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.346776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:22.488403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:22.496833 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-caff999e-5a01-4a49-bb2f-140a4523ac98 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.165107 Nov 02 13:30:22.497420 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3512/7567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:22 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:23.520913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:23.521545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:23.528661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:23.529661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:23.530171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:23.530892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:23.531364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:23.531812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:23.663169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:23.671653 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-00320264-2df5-4c24-899a-b1e03dc013a5 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.154665 Nov 02 13:30:23.672240 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4056/7568] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:23 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:24.695672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:24.696222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:24.703180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:24.703683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:24.704133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.704844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:24.705314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:24.705746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.838917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:24.847788 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-904ac4f6-74ce-4394-a947-ee0a9ed792fd tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.156411 Nov 02 13:30:24.848381 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3513/7569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:24 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:25.872055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:25.872717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:25.880175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:25.880677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:25.881134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:25.881846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:25.882476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:25.882922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:26.018326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:26.026789 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-455e4de2-e8be-45eb-b3ee-76c666ee64c1 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1720 microversion: 2.1 time: 0.158653 Nov 02 13:30:26.027371 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4057/7570] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:25 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:27.051948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.052744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.059457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.059945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.060385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.061082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.061532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.061972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.064608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:27.204806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:27.213546 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-aadb371a-4cdf-4dcb-94ef-8b927bde0e66 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1713 microversion: 2.1 time: 0.165479 Nov 02 13:30:27.214372 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3514/7571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:27 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1713 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:27.237397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.238140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.245510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.245856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.246380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.247091 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.247561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.248025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.388120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:27.397118 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f10c0cad-1520-40c8-935c-92d91ebdb8a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1713 microversion: 2.1 time: 0.163639 Nov 02 13:30:27.397713 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4058/7572] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:27 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:27.420438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.421058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.427359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.427852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.428292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.428995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.429482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.429909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.559969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:27.568370 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-29e415e1-bb3c-4d10-a71c-e0e63ae90214 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1713 microversion: 2.1 time: 0.152072 Nov 02 13:30:27.568951 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3515/7573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:27 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:27.592783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.593312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.599584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.600095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.600558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.601271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.601772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.602275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.627395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:30:27.653819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:27.714193 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4cd86f4b-328e-49ab-a841-bfa421bddee4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 204 len: 0 microversion: 2.1 time: 0.126311 Nov 02 13:30:27.714790 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4059/7574] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:30:27 2022] DELETE /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:30:27.723692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.724311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.732284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.732769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.733213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.733952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.734495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.734934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.874180 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:27.882407 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8417e3db-2862-4451-a827-275bca5091b2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1719 microversion: 2.1 time: 0.162616 Nov 02 13:30:27.882978 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3516/7575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:27 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:28.908302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:28.909022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:28.911862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:28.917396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:28.917897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:28.918403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:28.919119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:28.919691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:28.920133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:29.054793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:29.063817 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-827e14dd-15a0-42de-bdc7-f29ceeb785ac tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1719 microversion: 2.1 time: 0.160344 Nov 02 13:30:29.064506 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4060/7576] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:28 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:29.168527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-709f9941-df53-4103-859a-f9d4ec883df2 req-07e3c2ea-0558-4c20-90f4-522559bf8c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "name": "network-vif-plugged", "status": "completed", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:29.179322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-709f9941-df53-4103-859a-f9d4ec883df2 req-07e3c2ea-0558-4c20-90f4-522559bf8c75 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:29.179816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-709f9941-df53-4103-859a-f9d4ec883df2 req-07e3c2ea-0558-4c20-90f4-522559bf8c75 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:29.180253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-709f9941-df53-4103-859a-f9d4ec883df2 req-07e3c2ea-0558-4c20-90f4-522559bf8c75 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:29.192647 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-709f9941-df53-4103-859a-f9d4ec883df2 req-07e3c2ea-0558-4c20-90f4-522559bf8c75 service nova] Creating event network-vif-plugged:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h2-855650-5 Nov 02 13:30:29.198089 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-709f9941-df53-4103-859a-f9d4ec883df2 req-07e3c2ea-0558-4c20-90f4-522559bf8c75 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033295 Nov 02 13:30:29.198697 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3517/7577] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:30:30.090738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:30.092251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:30.099990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:30.100493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:30.100964 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:30.101686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:30.102187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:30.102635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:30.170940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:30.181011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22806846-e5fc-40bb-a784-38e862877689 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1651 microversion: 2.1 time: 0.094899 Nov 02 13:30:30.182476 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4061/7578] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:30 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1651 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:30.475718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7ba76a9e-4321-4980-b193-331bbf74752a req-ccf66344-9758-4bd9-8065-905248a3b1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f8dfba-e277-4d78-9925-78347bf42747", "name": "network-vif-deleted", "tag": "b68565a0-af55-4348-9053-54c95afa3fca"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:30.488602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:30.491063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7ba76a9e-4321-4980-b193-331bbf74752a req-ccf66344-9758-4bd9-8065-905248a3b1f2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:30.491589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7ba76a9e-4321-4980-b193-331bbf74752a req-ccf66344-9758-4bd9-8065-905248a3b1f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:30.491990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7ba76a9e-4321-4980-b193-331bbf74752a req-ccf66344-9758-4bd9-8065-905248a3b1f2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:30.507751 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7ba76a9e-4321-4980-b193-331bbf74752a req-ccf66344-9758-4bd9-8065-905248a3b1f2 service nova] Creating event network-vif-deleted:b68565a0-af55-4348-9053-54c95afa3fca for instance 49f8dfba-e277-4d78-9925-78347bf42747 on n-h2-855650-5 Nov 02 13:30:30.512950 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7ba76a9e-4321-4980-b193-331bbf74752a req-ccf66344-9758-4bd9-8065-905248a3b1f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042343 Nov 02 13:30:30.514469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3518/7579] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:31.205328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:31.205977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:31.213395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:31.213697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:31.214367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:31.215472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:31.216094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:31.216744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:31.287417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:31.298143 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7cbfb9fb-e2fb-42a7-be42-aaa0c522eb47 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1366 microversion: 2.1 time: 0.097050 Nov 02 13:30:31.298810 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4062/7580] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:31 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:32.323013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:32.323828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:32.330352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:32.331482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:32.331482 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:32.332050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:32.332484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:32.333120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:32.406293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:32.415040 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce766699-7fc2-4310-9e85-7c5be1fb5ee2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1366 microversion: 2.1 time: 0.097497 Nov 02 13:30:32.415721 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3519/7581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:32 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:33.441036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:33.441675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:33.449501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:33.450040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:33.450509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:33.451264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:33.451734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:33.452173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:33.516362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:33.524965 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9546b3c6-ca19-417f-a867-9906328975cb tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1366 microversion: 2.1 time: 0.087999 Nov 02 13:30:33.525643 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4063/7582] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:33 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:34.547967 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:34.548742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:34.556163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.556675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.557124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.557849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.558427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.558775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.630292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b990a688f9c44a5a8c2fae7818d46c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5345434f4a0144bf93bf64442bfe411c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:34.639489 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58a5a6f8-3b7b-4102-b823-bcfcab269199 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 200 len: 1366 microversion: 2.1 time: 0.095477 Nov 02 13:30:34.640447 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3520/7583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:34 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:35.663461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:35.664180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:35.670955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.671451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.671902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.672599 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.673061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.673497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.686986 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 HTTP/1.1 Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '49f8dfba-e277-4d78-9925-78347bf42747'} Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:35.688631 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f92103b4-f5d9-4f8f-9e12-362f5ea31df2 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 404 len: 111 microversion: 2.1 time: 0.030697 Nov 02 13:30:35.694203 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4064/7584] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:35 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:35.753437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:35.755703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:35.762618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.763583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.764031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.764757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.765212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.765642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.778546 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/os-volume_attachments HTTP/1.1 Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': '49f8dfba-e277-4d78-9925-78347bf42747'} Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:35.780910 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c8477b8-6076-440d-aa66-93333eea80a4 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033048 Nov 02 13:30:35.785549 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3521/7585] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:30:35 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.114438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.114957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.123001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.124162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.124162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.124686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.125152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.125588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.143722 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 HTTP/1.1 Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '49f8dfba-e277-4d78-9925-78347bf42747'} Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:39.145320 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e85301fd-634a-480b-aaef-8f9b1318dfff tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 404 len: 111 microversion: 2.1 time: 0.036529 Nov 02 13:30:39.150302 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4065/7586] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:30:39 2022] DELETE /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.156196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.156821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 49f8dfba-e277-4d78-9925-78347bf42747] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.164060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.164559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.165008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.165723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.166240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.168620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.181273 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 HTTP/1.1 Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '49f8dfba-e277-4d78-9925-78347bf42747'} Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.182902 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance 49f8dfba-e277-4d78-9925-78347bf42747 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5c9e3274-439e-487c-bb87-d103be1d44a7 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747" status: 404 len: 111 microversion: 2.1 time: 0.032318 Nov 02 13:30:39.188330 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3522/7587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:39 2022] GET /compute/v2.1/servers/49f8dfba-e277-4d78-9925-78347bf42747 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.194293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.194839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.201883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.202414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.202891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.203589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.204053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.204496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.223582 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef HTTP/1.1 Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '3101a61a-4422-4101-af1e-393758f059ef'} Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:39.225179 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-312288c3-7bc2-4126-b840-491d23b5dd6a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 404 len: 111 microversion: 2.1 time: 0.036548 Nov 02 13:30:39.231946 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4066/7588] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:30:39 2022] DELETE /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.238814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.239456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: 3101a61a-4422-4101-af1e-393758f059ef] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.246807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.247315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.248252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.249004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.249479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.249916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.267976 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef HTTP/1.1 Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '3101a61a-4422-4101-af1e-393758f059ef'} Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.269628 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance 3101a61a-4422-4101-af1e-393758f059ef could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-20364480-9493-4027-ae36-1dd55fd76443 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef" status: 404 len: 111 microversion: 2.1 time: 0.036552 Nov 02 13:30:39.274399 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3523/7589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:39 2022] GET /compute/v2.1/servers/3101a61a-4422-4101-af1e-393758f059ef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.281307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.281705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.288384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.288900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.289361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.290125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.290603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.291049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.307088 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b HTTP/1.1 Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'f1c285df-3729-4704-8ba6-865b2d62d55b'} Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:39.308521 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-60fda9d2-65c8-409e-a500-3042c0d5d172 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 404 len: 111 microversion: 2.1 time: 0.033393 Nov 02 13:30:39.313316 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4067/7590] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:30:39 2022] DELETE /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.320194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.321179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: f1c285df-3729-4704-8ba6-865b2d62d55b] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.329243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.329758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.330234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.330955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.331587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.333025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.359148 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b HTTP/1.1 Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'f1c285df-3729-4704-8ba6-865b2d62d55b'} Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.361247 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance f1c285df-3729-4704-8ba6-865b2d62d55b could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7042cd0f-df1d-45d0-8d84-fd6c08eabde8 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b" status: 404 len: 111 microversion: 2.1 time: 0.046947 Nov 02 13:30:39.370469 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3524/7591] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:39 2022] GET /compute/v2.1/servers/f1c285df-3729-4704-8ba6-865b2d62d55b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.374001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.374001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.380152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.380658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.381109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.381827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.382328 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.382765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.398502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 HTTP/1.1 Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'aac50158-8ef0-4537-8203-2b7c51ad49d0'} Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:39.400229 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c35c932-2e31-4cdf-b96d-8373e1cff49a tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 404 len: 111 microversion: 2.1 time: 0.033309 Nov 02 13:30:39.404651 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4068/7592] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:30:39 2022] DELETE /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.410757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.411384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] [instance: aac50158-8ef0-4537-8203-2b7c51ad49d0] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.417923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.418579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.419016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.420349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.420700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.421128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.441076 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] HTTP exception thrown: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Request method failure captured: Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 HTTP/1.1 Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYm7V23gmQttbhB8vGP7-jxGZaQApPswjc_WbkYcG6kd9bO7g8PMbdOIm-lLs1q97W-Do2rW3xjtZ5y1bbZm0ZxPN2OJqLftAvObudGs7z404wyrwvD4CKCZPOFb4xAOmPjStkyRj3fsD3vaYQEYAXEhclbnsmn91NIyiC-WadJtenw0 Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5345434f4a0144bf93bf64442bfe411c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 5345434f4a0144bf93bf64442bfe411c Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1303144969 Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: b990a688f9c44a5a8c2fae7818d46c5d Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServerActionsTestJSON-1303144969-project Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'aac50158-8ef0-4537-8203-2b7c51ad49d0'} Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:39.442685 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Returning 404 to user: Instance aac50158-8ef0-4537-8203-2b7c51ad49d0 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3ab68e28-a1bc-47a3-93b8-1ada0bed0497 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0" status: 404 len: 111 microversion: 2.1 time: 0.037463 Nov 02 13:30:39.449811 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3525/7593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:39 2022] GET /compute/v2.1/servers/aac50158-8ef0-4537-8203-2b7c51ad49d0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:39.454031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d70ba81f-0aaa-4b12-aa2b-0a4afacab3b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] Calling method '.version_select at 0x7f228c1a5790>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.480159 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d70ba81f-0aaa-4b12-aa2b-0a4afacab3b3 tempest-ServerActionsTestJSON-1303144969 tempest-ServerActionsTestJSON-1303144969-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783021381" status: 202 len: 0 microversion: 2.1 time: 0.030521 Nov 02 13:30:39.480775 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4069/7594] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Nov 2 13:30:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783021381 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:30:50.733144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=15 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:50.736228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=43 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:50.925424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1749198042", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "ea9659ad-7ebf-49e2-a8ed-c4c1202444ef"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:50.992109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] validate_networks() for [('ea9659ad-7ebf-49e2-a8ed-c4c1202444ef', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:30:51.535166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:30:51.535605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:30:51.536096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:30:51.536561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:30:51.536933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:30:51.547897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.548437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.548882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.549651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.550256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.550694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.570067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Getting quotas for project 60828e07036d4baaa421aa8a9ca0246b. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:51.577821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Getting quotas for user 6afc98fa99d84123a45dfdb55b2724be and project 60828e07036d4baaa421aa8a9ca0246b. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:51.593853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:30:51.596501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:30:51.649322 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [bd918f0e-d4d6-42cd-989f-c4b1685dcbcb] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:30:52.660498 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [bd918f0e-d4d6-42cd-989f-c4b1685dcbcb] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 38246. Nov 02 13:30:52.668831 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e8eea08e-c240-494f-a563-a8c56bbfd7a3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.949883 Nov 02 13:30:52.669751 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3526/7595] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:30:52.688025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe0f9868-04e6-45c8-9404-d693a4b2e176 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:52.690233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe0f9868-04e6-45c8-9404-d693a4b2e176 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:52.700271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:52.702075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:52.792636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe0f9868-04e6-45c8-9404-d693a4b2e176 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:52.803217 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe0f9868-04e6-45c8-9404-d693a4b2e176 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1217 microversion: 2.1 time: 0.123219 Nov 02 13:30:52.803802 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4070/7596] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:52 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:53.835820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f8168f0d-b8d5-480b-b3ad-e4ff57728791 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:53.836948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f8168f0d-b8d5-480b-b3ad-e4ff57728791 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:53.959506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f8168f0d-b8d5-480b-b3ad-e4ff57728791 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:53.975703 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f8168f0d-b8d5-480b-b3ad-e4ff57728791 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1217 microversion: 2.1 time: 0.148469 Nov 02 13:30:53.987105 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3527/7597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:53 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:55.010866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1663c238-8b9f-40d0-969a-06ab3ba79765 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:55.011546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1663c238-8b9f-40d0-969a-06ab3ba79765 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:55.079786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1663c238-8b9f-40d0-969a-06ab3ba79765 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:55.093281 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1663c238-8b9f-40d0-969a-06ab3ba79765 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1217 microversion: 2.1 time: 0.085901 Nov 02 13:30:55.094414 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4071/7598] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:55 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:56.132281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac76e4ba-2afc-41e9-904e-b8d0569ceacd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:56.132930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac76e4ba-2afc-41e9-904e-b8d0569ceacd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:56.137429 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:30:56.137569 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:30:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 (ip 10.222.0.45) !!! Nov 02 13:30:56.195239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac76e4ba-2afc-41e9-904e-b8d0569ceacd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:56.202828 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac76e4ba-2afc-41e9-904e-b8d0569ceacd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1217 microversion: 2.1 time: 0.074450 Nov 02 13:30:56.203420 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3528/7599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:56 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:57.227043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:57.227641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:57.237144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.237620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.238336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.239093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.239557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.239999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.320591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:57.348924 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-58666d1c-c13a-412b-a82f-64f9e6c42c73 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1277 microversion: 2.1 time: 0.126115 Nov 02 13:30:57.350270 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4072/7600] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:57 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:58.375463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:58.377300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:58.385188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.385901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.386371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:58.387283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.388262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.388887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:58.656616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:58.667301 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de536b4e-b546-4a85-8a7e-c63f2cde26aa tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1317 microversion: 2.1 time: 0.295906 Nov 02 13:30:58.668282 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3529/7601] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:58 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:58.890117 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-99198f62-7da0-4117-893c-02d55d18fe22 req-8c0d7daf-a6de-4c17-b939-52da0674efe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6086c158-d5a6-41a2-ab0b-01e36bc7a4f4", "tag": "b6510506-76d4-418a-8698-e7a050d7b8b3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:58.904225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-99198f62-7da0-4117-893c-02d55d18fe22 req-8c0d7daf-a6de-4c17-b939-52da0674efe3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.904733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-99198f62-7da0-4117-893c-02d55d18fe22 req-8c0d7daf-a6de-4c17-b939-52da0674efe3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.905201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-99198f62-7da0-4117-893c-02d55d18fe22 req-8c0d7daf-a6de-4c17-b939-52da0674efe3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:58.918020 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-99198f62-7da0-4117-893c-02d55d18fe22 req-8c0d7daf-a6de-4c17-b939-52da0674efe3 service nova] Creating event network-changed:b6510506-76d4-418a-8698-e7a050d7b8b3 for instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 on n-h2-855650-5 Nov 02 13:30:58.924180 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-99198f62-7da0-4117-893c-02d55d18fe22 req-8c0d7daf-a6de-4c17-b939-52da0674efe3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037973 Nov 02 13:30:58.924801 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4073/7602] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:30:59.696764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:59.697548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:59.704854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.705350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.705797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.706547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.707007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.707439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.839463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:59.847610 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7652671f-1880-4887-b226-798dd9c5b3a2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1317 microversion: 2.1 time: 0.156654 Nov 02 13:30:59.848203 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3530/7603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:59 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:00.873173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:00.873738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:00.880356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.880865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.881325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:00.882084 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.882561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.883006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:01.020713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:01.028681 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42d1d99d-12f4-46c7-9928-5075ef8a2ff5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1317 microversion: 2.1 time: 0.161443 Nov 02 13:31:01.029261 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4074/7604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:00 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:02.051472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:02.052089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:02.054853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:02.060525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.061014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.061457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.062225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.062681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.063111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.203183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:02.211213 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6d410caa-2c72-4381-85c1-fd159fed3957 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1317 microversion: 2.1 time: 0.163580 Nov 02 13:31:02.211803 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3531/7605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:02 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:03.236533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:03.237190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:03.243969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.244465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.244971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.245641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.246137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.246578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.387200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:03.396232 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9809a9a9-4298-4ff0-b14c-b6886f8529e3 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1317 microversion: 2.1 time: 0.163661 Nov 02 13:31:03.397058 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4075/7606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:03 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:04.420509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:04.421131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:04.428479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.428983 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.429431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.430179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.430641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.431075 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.566707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:04.574891 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-28bf0ff7-37ba-4687-8568-278e4f1f5f57 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1317 microversion: 2.1 time: 0.158817 Nov 02 13:31:04.575487 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3532/7607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:04 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:05.368364 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0d023907-cb07-4afe-9a63-7ef87595254b req-09fc38e3-5bb2-4762-8c0d-2dd8e982a50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6086c158-d5a6-41a2-ab0b-01e36bc7a4f4", "name": "network-vif-plugged", "status": "completed", "tag": "b6510506-76d4-418a-8698-e7a050d7b8b3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:05.376338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:05.384885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0d023907-cb07-4afe-9a63-7ef87595254b req-09fc38e3-5bb2-4762-8c0d-2dd8e982a50e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.385617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0d023907-cb07-4afe-9a63-7ef87595254b req-09fc38e3-5bb2-4762-8c0d-2dd8e982a50e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.386119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0d023907-cb07-4afe-9a63-7ef87595254b req-09fc38e3-5bb2-4762-8c0d-2dd8e982a50e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.401910 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0d023907-cb07-4afe-9a63-7ef87595254b req-09fc38e3-5bb2-4762-8c0d-2dd8e982a50e service nova] Creating event network-vif-plugged:b6510506-76d4-418a-8698-e7a050d7b8b3 for instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 on n-h2-855650-5 Nov 02 13:31:05.407158 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0d023907-cb07-4afe-9a63-7ef87595254b req-09fc38e3-5bb2-4762-8c0d-2dd8e982a50e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043112 Nov 02 13:31:05.407778 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4076/7608] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:05.596991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:05.597617 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:05.604646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.605207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.605815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.607335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.607845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.608352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.742877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:05.751573 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2aefc29-e2ee-4466-b44f-934e78055731 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1317 microversion: 2.1 time: 0.158499 Nov 02 13:31:05.752165 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3533/7609] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:05 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:06.775706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:06.776682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:06.785311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:06.785824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:06.786325 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.787121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:06.787598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:06.788116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.930424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:06.939177 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dac6a288-cdde-4baf-901a-ca3f727988d2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1317 microversion: 2.1 time: 0.168209 Nov 02 13:31:06.939669 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4077/7610] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:06 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:07.963189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:07.963922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:07.966418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=10 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:07.973632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.974166 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.974618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.975332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.975791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.976233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:08.109031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:08.116935 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-85a8de6d-713d-4e7b-a46e-9f5a96417381 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1506 microversion: 2.1 time: 0.157814 Nov 02 13:31:08.117742 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3534/7611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:07 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:08.181562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-170100401", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "ea9659ad-7ebf-49e2-a8ed-c4c1202444ef"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:08.237817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] validate_networks() for [('ea9659ad-7ebf-49e2-a8ed-c4c1202444ef', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:31:08.689815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:31:08.690482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:31:08.690919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:31:08.691355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:31:08.691801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:31:08.702309 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:08.702820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:08.703277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:08.704032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:08.704507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:08.704950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:08.721864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Getting quotas for project 60828e07036d4baaa421aa8a9ca0246b. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:31:08.727474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Getting quotas for user 6afc98fa99d84123a45dfdb55b2724be and project 60828e07036d4baaa421aa8a9ca0246b. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:31:08.740550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:31:08.743052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:31:08.794269 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46b458e8-2a91-4d54-87ee-4b37711f0cdb tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616167 Nov 02 13:31:08.795326 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4078/7612] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:31:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:31:08.807730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6c309754-8354-47bb-9640-d240c1d02225 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:08.808438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6c309754-8354-47bb-9640-d240c1d02225 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:08.865990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6c309754-8354-47bb-9640-d240c1d02225 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:08.874500 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6c309754-8354-47bb-9640-d240c1d02225 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1216 microversion: 2.1 time: 0.070975 Nov 02 13:31:08.875091 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3535/7613] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:08 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:09.898942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:09.900373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:09.907103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:09.907621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:09.908081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:09.908814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:09.909281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:09.909726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:09.984931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:09.995263 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5cf0f637-1b4f-4f6e-9f29-c9c82396ed74 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1276 microversion: 2.1 time: 0.102211 Nov 02 13:31:09.996219 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4079/7614] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:09 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:11.021109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:11.021919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:11.030539 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:11.031037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:11.031484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:11.032227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:11.032678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:11.033105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:11.274110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:11.283130 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8a8e3141-9824-47d2-8d75-2ba672d3c4bd tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1316 microversion: 2.1 time: 0.266103 Nov 02 13:31:11.283738 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3536/7615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:11 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:11.529294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-bed52db1-3d3a-45f8-8087-3c4a725bdafe req-b3747117-0953-4305-b18c-0ab181261de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fca19f1-d417-41ad-bd56-c08cde1d3712", "tag": "ad0f9bd7-8c02-4661-9cff-e503bb662092"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:11.542882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bed52db1-3d3a-45f8-8087-3c4a725bdafe req-b3747117-0953-4305-b18c-0ab181261de0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:11.543337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bed52db1-3d3a-45f8-8087-3c4a725bdafe req-b3747117-0953-4305-b18c-0ab181261de0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:11.544401 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-bed52db1-3d3a-45f8-8087-3c4a725bdafe req-b3747117-0953-4305-b18c-0ab181261de0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:11.556931 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-bed52db1-3d3a-45f8-8087-3c4a725bdafe req-b3747117-0953-4305-b18c-0ab181261de0 service nova] Creating event network-changed:ad0f9bd7-8c02-4661-9cff-e503bb662092 for instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 on n-h1-855650-5 Nov 02 13:31:11.563133 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-bed52db1-3d3a-45f8-8087-3c4a725bdafe req-b3747117-0953-4305-b18c-0ab181261de0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039878 Nov 02 13:31:11.564281 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4080/7616] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:12.308593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:12.310475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:12.320278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:12.321808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:12.322384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:12.323255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:12.323825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:12.324334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:12.498283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:12.506735 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-53314846-c6ea-4b00-ba91-088d2d6f038e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1316 microversion: 2.1 time: 0.203153 Nov 02 13:31:12.507293 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3537/7617] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:12 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:13.529492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:13.530246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:13.537416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:13.537932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:13.538508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:13.539123 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:13.539598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:13.540041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:13.675509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:13.683528 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46400181-6381-4ea4-a5ea-f83bb6492403 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1316 microversion: 2.1 time: 0.158284 Nov 02 13:31:13.684109 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4081/7618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:13 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:14.710098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:14.710716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:14.718254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.718746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.719194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:14.719894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.720345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.720771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:14.931994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:14.940352 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e77a79f7-600d-42fe-a1b0-4f4278396935 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1316 microversion: 2.1 time: 0.234118 Nov 02 13:31:14.941413 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3538/7619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:14 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:15.964728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:15.966018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:15.972888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:15.973390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:15.973846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:15.974703 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:15.975058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:15.975503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:16.113887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:16.122629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-936e7113-1cec-4e66-8785-c1b28100a8a5 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1316 microversion: 2.1 time: 0.161903 Nov 02 13:31:16.138239 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4082/7620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:15 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:17.147165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:17.147820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:17.155454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:17.155947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:17.156395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:17.157112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:17.157568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:17.158024 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:17.379433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:17.390386 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f53eccfc-9d27-4a9a-a9de-c89f3bc0d1ae tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1316 microversion: 2.1 time: 0.247401 Nov 02 13:31:17.391269 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3539/7621] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:17 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:18.013013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-67ade8bb-08d4-42ec-8266-bc2b2dd0c96e req-de7ebad3-090e-49cc-b382-d15220b6b72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fca19f1-d417-41ad-bd56-c08cde1d3712", "name": "network-vif-plugged", "status": "completed", "tag": "ad0f9bd7-8c02-4661-9cff-e503bb662092"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:18.024980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-67ade8bb-08d4-42ec-8266-bc2b2dd0c96e req-de7ebad3-090e-49cc-b382-d15220b6b72a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.025449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-67ade8bb-08d4-42ec-8266-bc2b2dd0c96e req-de7ebad3-090e-49cc-b382-d15220b6b72a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.025871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-67ade8bb-08d4-42ec-8266-bc2b2dd0c96e req-de7ebad3-090e-49cc-b382-d15220b6b72a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.038310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-67ade8bb-08d4-42ec-8266-bc2b2dd0c96e req-de7ebad3-090e-49cc-b382-d15220b6b72a service nova] Creating event network-vif-plugged:ad0f9bd7-8c02-4661-9cff-e503bb662092 for instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 on n-h1-855650-5 Nov 02 13:31:18.044677 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-67ade8bb-08d4-42ec-8266-bc2b2dd0c96e req-de7ebad3-090e-49cc-b382-d15220b6b72a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034454 Nov 02 13:31:18.045310 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4083/7622] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:18.414019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:18.414645 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:18.421721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.422242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.422689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.423427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.423890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.424327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.554583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:18.562493 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5bf25aec-f1a1-4e69-8178-a8c2c101d6ce tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1316 microversion: 2.1 time: 0.152406 Nov 02 13:31:18.563082 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3540/7623] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:18 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:19.587158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:19.587912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:19.589899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:19.591115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:19.598336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:19.598843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:19.599300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:19.600018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:19.600493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:19.600935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:19.747058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:19.756053 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83adc665-7971-47ea-a783-68f1a6c54f86 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1316 microversion: 2.1 time: 0.173169 Nov 02 13:31:19.756665 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4084/7624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:19 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:20.778951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:20.779549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:20.781428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:20.783047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:20.788666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:20.789152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:20.789585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:20.790319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:20.790768 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:20.791190 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:20.795116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=69 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:20.942352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:20.950568 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c2e6b949-9178-4f8d-b7cc-c7a1b719ddb7 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1504 microversion: 2.1 time: 0.175527 Nov 02 13:31:20.951167 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3541/7625] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:20 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:20.972717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:20.973270 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:20.980105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:20.980608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:20.981559 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:20.982369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:20.982842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:20.983284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:21.009701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:31:21.089313 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b9e6c86d-edb2-42b5-92f8-5d9d13e4f6c1 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 204 len: 0 microversion: 2.1 time: 0.119992 Nov 02 13:31:21.090131 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4085/7626] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:31:20 2022] DELETE /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:31:21.099246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:21.099868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:21.107214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:21.107708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:21.108138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:21.108863 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:21.109307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:21.109728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:21.244685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:21.252613 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dd2b4fd2-412a-45b7-817b-895391416474 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1510 microversion: 2.1 time: 0.157536 Nov 02 13:31:21.253198 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3542/7627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:21 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:22.277248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:22.277988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:22.284863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:22.285371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:22.285940 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:22.286572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:22.287039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:22.287473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:22.429661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:22.438475 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b94396e-615d-4083-93cf-57e131db368e tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1510 microversion: 2.1 time: 0.166152 Nov 02 13:31:22.439068 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4086/7628] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:22 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:23.227899 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-280b5929-b22a-4190-b33a-364613379776 req-f795ffd4-f4bc-4f1c-9770-bc11c1050b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fca19f1-d417-41ad-bd56-c08cde1d3712", "name": "network-vif-deleted", "tag": "ad0f9bd7-8c02-4661-9cff-e503bb662092"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:23.239803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-280b5929-b22a-4190-b33a-364613379776 req-f795ffd4-f4bc-4f1c-9770-bc11c1050b7a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.240471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-280b5929-b22a-4190-b33a-364613379776 req-f795ffd4-f4bc-4f1c-9770-bc11c1050b7a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.240918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-280b5929-b22a-4190-b33a-364613379776 req-f795ffd4-f4bc-4f1c-9770-bc11c1050b7a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:23.256423 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-280b5929-b22a-4190-b33a-364613379776 req-f795ffd4-f4bc-4f1c-9770-bc11c1050b7a service nova] Creating event network-vif-deleted:ad0f9bd7-8c02-4661-9cff-e503bb662092 for instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 on n-h1-855650-5 Nov 02 13:31:23.263689 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-280b5929-b22a-4190-b33a-364613379776 req-f795ffd4-f4bc-4f1c-9770-bc11c1050b7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040666 Nov 02 13:31:23.265183 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3543/7629] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:23.462943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:23.463664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:23.466628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:23.473008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.473525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.474030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:23.474761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.475232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.475678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:23.480749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:23.516429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.516975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.517409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:23.517871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lazy-loading 'fault' on Instance uuid 4fca19f1-d417-41ad-bd56-c08cde1d3712 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:31:23.558281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:23.566571 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-688f9edf-f708-4a60-8026-d02e57090f1f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 200 len: 1306 microversion: 2.1 time: 0.108137 Nov 02 13:31:23.567150 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4087/7630] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:23 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:24.592294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:24.592914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:24.599933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:24.600424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:24.600861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:24.601564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:24.602043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:24.602472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:24.616086 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] HTTP exception thrown: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Request method failure captured: Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 HTTP/1.1 Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnEKmiZ4fYqJiqadg5x10ErN1wFrNGC5jc2pKemn1ntwro_dQS_u24ERhvFAZkB2pxj1RKuSFl6Bj__T6fM6jaxuOo_fDa3GimOZKmXx2Wpz6jBxKvHeBc3kxGJnB6j1G-4dF-znBO_EPuqwdHDaRBuFI6o0bRFWHqhjA5QbzB8-rzk Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6afc98fa99d84123a45dfdb55b2724be Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '4fca19f1-d417-41ad-bd56-c08cde1d3712'} Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:24.617774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Returning 404 to user: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7aad23a8-6f99-48f4-8448-f9bea38a664d tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 404 len: 111 microversion: 2.1 time: 0.032101 Nov 02 13:31:24.622942 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3544/7631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:24 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:31:24.628750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:24.629459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:24.636823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:24.637873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:24.638358 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:24.639075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:24.639546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:24.639987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:24.783881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:24.791690 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3d18485-43b8-40b5-b428-0fa4b00ca263 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1506 microversion: 2.1 time: 0.167101 Nov 02 13:31:24.792268 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4088/7632] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:24 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:24.815643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e587d6a-700e-4a26-bae1-d0f385a8a91b tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:24.817888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1e587d6a-700e-4a26-bae1-d0f385a8a91b tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 8eceaf93-df45-4078-a177-c51590fcdef5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:24.824283 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1e587d6a-700e-4a26-bae1-d0f385a8a91b tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] HTTP exception thrown: Instance 8eceaf93-df45-4078-a177-c51590fcdef5 could not be found. Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e587d6a-700e-4a26-bae1-d0f385a8a91b tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Request method failure captured: Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/8eceaf93-df45-4078-a177-c51590fcdef5/action HTTP/1.1 Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 32 Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnEKmiZ4fYqJiqadg5x10ErN1wFrNGC5jc2pKemn1ntwro_dQS_u24ERhvFAZkB2pxj1RKuSFl6Bj__T6fM6jaxuOo_fDa3GimOZKmXx2Wpz6jBxKvHeBc3kxGJnB6j1G-4dF-znBO_EPuqwdHDaRBuFI6o0bRFWHqhjA5QbzB8-rzk Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6afc98fa99d84123a45dfdb55b2724be Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: {"resize": {"flavorRef": "452"}} Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 8eceaf93-df45-4078-a177-c51590fcdef5 could not be found. Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '8eceaf93-df45-4078-a177-c51590fcdef5', 'body': {'resize': {'flavorRef': '452'}}} Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eceaf93-df45-4078-a177-c51590fcdef5 could not be found. Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:24.826542 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eceaf93-df45-4078-a177-c51590fcdef5 could not be found. Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eceaf93-df45-4078-a177-c51590fcdef5 could not be found. Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1e587d6a-700e-4a26-bae1-d0f385a8a91b tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Returning 404 to user: Instance 8eceaf93-df45-4078-a177-c51590fcdef5 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1e587d6a-700e-4a26-bae1-d0f385a8a91b tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "POST /compute/v2.1/servers/8eceaf93-df45-4078-a177-c51590fcdef5/action" status: 404 len: 111 microversion: 2.1 time: 0.016562 Nov 02 13:31:24.830886 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3545/7633] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:31:24 2022] POST /compute/v2.1/servers/8eceaf93-df45-4078-a177-c51590fcdef5/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:24.836823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:24.837449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:24.843615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:24.844056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:24.844516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:24.845215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:24.845681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:24.846164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:24.991138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:25.000133 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-038c8e7e-fd52-423e-9a60-6149db4c6921 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1506 microversion: 2.1 time: 0.167186 Nov 02 13:31:25.000705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4089/7634] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:24 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:25.023715 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:25.024365 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.031505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.031998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.032449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.033154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.033639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.034104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.170195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:25.178102 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d38c5ceb-567a-4943-b81b-583416a64488 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1506 microversion: 2.1 time: 0.158311 Nov 02 13:31:25.178684 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3546/7635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:25 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:25.202944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "79cdc96d-5c5c-44e6-a7df-8356c189e6cb"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:25.205163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.212442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.212944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.213388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.214125 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.214679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.215177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.244535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:25.249892 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] HTTP exception thrown: Flavor 79cdc96d-5c5c-44e6-a7df-8356c189e6cb could not be found. Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Request method failure captured: Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4/action HTTP/1.1 Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 65 Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnEKmiZ4fYqJiqadg5x10ErN1wFrNGC5jc2pKemn1ntwro_dQS_u24ERhvFAZkB2pxj1RKuSFl6Bj__T6fM6jaxuOo_fDa3GimOZKmXx2Wpz6jBxKvHeBc3kxGJnB6j1G-4dF-znBO_EPuqwdHDaRBuFI6o0bRFWHqhjA5QbzB8-rzk Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6afc98fa99d84123a45dfdb55b2724be Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: {"resize": {"flavorRef": "79cdc96d-5c5c-44e6-a7df-8356c189e6cb"}} Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: exception: Flavor 79cdc96d-5c5c-44e6-a7df-8356c189e6cb could not be found. Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6086c158-d5a6-41a2-ab0b-01e36bc7a4f4', 'body': {'resize': {'flavorRef': '79cdc96d-5c5c-44e6-a7df-8356c189e6cb'}}} Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:25.259892 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 79cdc96d-5c5c-44e6-a7df-8356c189e6cb could not be found. Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 79cdc96d-5c5c-44e6-a7df-8356c189e6cb could not be found. Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 79cdc96d-5c5c-44e6-a7df-8356c189e6cb could not be found. Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Returning 400 to user: Flavor 79cdc96d-5c5c-44e6-a7df-8356c189e6cb could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15eaa565-baca-4a1f-a265-f291707a3b16 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "POST /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4/action" status: 400 len: 107 microversion: 2.1 time: 0.063298 Nov 02 13:31:25.265134 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4090/7636] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:31:25 2022] POST /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4/action => generated 107 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:31:25.270794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:25.271446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.277532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.278632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.279073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.279805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.280260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.280690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.426725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:25.435406 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9cba04ab-1292-477a-9a4c-23acfdfc87c2 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1506 microversion: 2.1 time: 0.168528 Nov 02 13:31:25.435993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3547/7637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:25 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:25.460406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:25.461190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.468164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.468674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.469130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.469847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.470349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.470791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.605771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:25.613630 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7efd805c-41d2-4b02-bae7-c2cf9806245f tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1506 microversion: 2.1 time: 0.157203 Nov 02 13:31:25.614235 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4091/7638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:25 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:25.636684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-688a87da-9863-4a58-b1d6-01d4e1d97498 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-688a87da-9863-4a58-b1d6-01d4e1d97498 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Request method failure captured: Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: request: POST /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4/action HTTP/1.1 Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 29 Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnEKmiZ4fYqJiqadg5x10ErN1wFrNGC5jc2pKemn1ntwro_dQS_u24ERhvFAZkB2pxj1RKuSFl6Bj__T6fM6jaxuOo_fDa3GimOZKmXx2Wpz6jBxKvHeBc3kxGJnB6j1G-4dF-znBO_EPuqwdHDaRBuFI6o0bRFWHqhjA5QbzB8-rzk Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6afc98fa99d84123a45dfdb55b2724be Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: {"resize": {"flavorRef": ""}} Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '6086c158-d5a6-41a2-ab0b-01e36bc7a4f4', 'body': {'resize': {'flavorRef': ''}}} Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi On instance['resize']: Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi '' Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.640749 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-688a87da-9863-4a58-b1d6-01d4e1d97498 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-688a87da-9863-4a58-b1d6-01d4e1d97498 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "POST /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4/action" status: 400 len: 113 microversion: 2.1 time: 0.009565 Nov 02 13:31:25.645425 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3548/7639] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:31:25 2022] POST /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:31:25.650886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:25.651510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.658445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.658939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.659387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.660096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.660541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.660973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.790560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:25.798370 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7ecffbd-eb59-4fd0-9e08-3e55e3a32c2c tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1506 microversion: 2.1 time: 0.151190 Nov 02 13:31:25.798976 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4092/7640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:25 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:25.826386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:25.826891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.834217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.834707 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.835150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.835848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.836305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.836734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.850317 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] HTTP exception thrown: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Request method failure captured: Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 HTTP/1.1 Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnEKmiZ4fYqJiqadg5x10ErN1wFrNGC5jc2pKemn1ntwro_dQS_u24ERhvFAZkB2pxj1RKuSFl6Bj__T6fM6jaxuOo_fDa3GimOZKmXx2Wpz6jBxKvHeBc3kxGJnB6j1G-4dF-znBO_EPuqwdHDaRBuFI6o0bRFWHqhjA5QbzB8-rzk Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 6afc98fa99d84123a45dfdb55b2724be Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '4fca19f1-d417-41ad-bd56-c08cde1d3712'} Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:25.851890 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Returning 404 to user: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-32525c14-444b-4666-ae78-75199a285c72 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 404 len: 111 microversion: 2.1 time: 0.032515 Nov 02 13:31:25.856595 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3549/7641] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:31:25 2022] DELETE /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:25.862522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:25.863151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 4fca19f1-d417-41ad-bd56-c08cde1d3712] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.870626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.871141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.872151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.873157 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.873551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.874016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.888687 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] HTTP exception thrown: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Request method failure captured: Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 HTTP/1.1 Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnEKmiZ4fYqJiqadg5x10ErN1wFrNGC5jc2pKemn1ntwro_dQS_u24ERhvFAZkB2pxj1RKuSFl6Bj__T6fM6jaxuOo_fDa3GimOZKmXx2Wpz6jBxKvHeBc3kxGJnB6j1G-4dF-znBO_EPuqwdHDaRBuFI6o0bRFWHqhjA5QbzB8-rzk Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6afc98fa99d84123a45dfdb55b2724be Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4fca19f1-d417-41ad-bd56-c08cde1d3712'} Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:25.890230 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Returning 404 to user: Instance 4fca19f1-d417-41ad-bd56-c08cde1d3712 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-76957096-d408-47bb-b1bc-357f7f47d9a0 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712" status: 404 len: 111 microversion: 2.1 time: 0.033491 Nov 02 13:31:25.898618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4093/7642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:25 2022] GET /compute/v2.1/servers/4fca19f1-d417-41ad-bd56-c08cde1d3712 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:25.901174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:25.901668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.908383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.908870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.909304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.910035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.910493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.910919 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.936498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:31:26.014976 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d1b22cf-d933-44e9-9b35-8f8791c363fc tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 204 len: 0 microversion: 2.1 time: 0.117391 Nov 02 13:31:26.015605 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3550/7643] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:31:25 2022] DELETE /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:31:26.024153 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:26.024833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:26.032097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:26.032601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:26.033063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:26.033777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:26.034284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:26.034725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:26.169294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:26.177154 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae51344c-0d41-4d5e-8916-23e4fccce764 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1512 microversion: 2.1 time: 0.156945 Nov 02 13:31:26.177729 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4094/7644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:26 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:27.201373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:27.202120 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:27.208692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:27.209187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:27.209633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:27.210370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:27.210829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:27.211262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:27.347724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:27.356995 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-178116b7-5f89-46ca-abfc-ef317192271a tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1512 microversion: 2.1 time: 0.160168 Nov 02 13:31:27.358028 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3551/7645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:27 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:28.058572 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7dfb49ad-3e27-4046-ad94-6cffe3d60962 req-59e7ae06-3f32-46fe-b159-b511a631d991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6086c158-d5a6-41a2-ab0b-01e36bc7a4f4", "name": "network-vif-deleted", "tag": "b6510506-76d4-418a-8698-e7a050d7b8b3"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:28.069871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7dfb49ad-3e27-4046-ad94-6cffe3d60962 req-59e7ae06-3f32-46fe-b159-b511a631d991 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:28.070513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7dfb49ad-3e27-4046-ad94-6cffe3d60962 req-59e7ae06-3f32-46fe-b159-b511a631d991 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:28.071024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7dfb49ad-3e27-4046-ad94-6cffe3d60962 req-59e7ae06-3f32-46fe-b159-b511a631d991 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:28.083865 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7dfb49ad-3e27-4046-ad94-6cffe3d60962 req-59e7ae06-3f32-46fe-b159-b511a631d991 service nova] Creating event network-vif-deleted:b6510506-76d4-418a-8698-e7a050d7b8b3 for instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 on n-h2-855650-5 Nov 02 13:31:28.089721 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7dfb49ad-3e27-4046-ad94-6cffe3d60962 req-59e7ae06-3f32-46fe-b159-b511a631d991 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034941 Nov 02 13:31:28.090935 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4095/7646] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:28.382994 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:28.383652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:28.390730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:28.391231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:28.391677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:28.392392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:28.392848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:28.393285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:28.425500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:28.426016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:28.426469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:28.426928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lazy-loading 'fault' on Instance uuid 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:31:28.470595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6afc98fa99d84123a45dfdb55b2724be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60828e07036d4baaa421aa8a9ca0246b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:28.478511 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-95b4faf5-c38a-4974-a609-28a8fddfa0a4 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 200 len: 1307 microversion: 2.1 time: 0.099437 Nov 02 13:31:28.479090 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3552/7647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:28 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:29.505096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:29.505721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] [instance: 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:29.512688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:29.513191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:29.513677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:29.514387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:29.514862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:29.515296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:29.530423 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] HTTP exception thrown: Instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 could not be found. Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Request method failure captured: Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 HTTP/1.1 Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnEKmiZ4fYqJiqadg5x10ErN1wFrNGC5jc2pKemn1ntwro_dQS_u24ERhvFAZkB2pxj1RKuSFl6Bj__T6fM6jaxuOo_fDa3GimOZKmXx2Wpz6jBxKvHeBc3kxGJnB6j1G-4dF-znBO_EPuqwdHDaRBuFI6o0bRFWHqhjA5QbzB8-rzk Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_60828e07036d4baaa421aa8a9ca0246b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 60828e07036d4baaa421aa8a9ca0246b Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1056400878 Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 6afc98fa99d84123a45dfdb55b2724be Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-ServersNegativeTestJSON-1056400878-project Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 could not be found. Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '6086c158-d5a6-41a2-ab0b-01e36bc7a4f4'} Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 could not be found. Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 could not be found. Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:29.532085 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 could not be found. Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] Returning 404 to user: Instance 6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3ec10231-5990-4764-bbe2-ab8248f7f166 tempest-ServersNegativeTestJSON-1056400878 tempest-ServersNegativeTestJSON-1056400878-project] 10.222.0.45 "GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4" status: 404 len: 111 microversion: 2.1 time: 0.034518 Nov 02 13:31:29.536820 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4096/7648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:29 2022] GET /compute/v2.1/servers/6086c158-d5a6-41a2-ab0b-01e36bc7a4f4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:03.667060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:03.668143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:03.865597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-31bad0f8-d8c0-4485-98af-a89d5de41f5c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: .version_select at 0x7f228d4dfe50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1416436826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvuZY/gwAHRBefrhhFDHgGyqgehx51hO9SmhHdqRWOQuTWblmNzrPqHD2VCvJrIOxJwgNfxKyRek4WqGHtWsP2cjDRrIm1ASGZwYGFHW6/RThc0wsCoJgz9L49L19wjxA=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:03.883350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-31bad0f8-d8c0-4485-98af-a89d5de41f5c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for project d1328b8f777e4cccb607e45f2799c346. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:03.889266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-31bad0f8-d8c0-4485-98af-a89d5de41f5c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for user 9caa083a1f984b02a9b9476c15260fb2 and project d1328b8f777e4cccb607e45f2799c346. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:03.921576 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-31bad0f8-d8c0-4485-98af-a89d5de41f5c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.260419 Nov 02 13:32:03.922758 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3553/7649] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:32:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:03.975090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1936758262", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1416436826", "networks": [{"uuid": "0ff2ec59-0e0e-49dc-ba35-b616c9718cf0"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:03.985466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=23 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:03.986302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=47 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:04.037545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] validate_networks() for [('0ff2ec59-0e0e-49dc-ba35-b616c9718cf0', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:32:04.428185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:32:04.428505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:32:04.429022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:32:04.429340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:32:04.429764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:32:04.439340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.439841 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.440290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.441033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.441497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.441937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.460515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for project d1328b8f777e4cccb607e45f2799c346. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:04.466766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for user 9caa083a1f984b02a9b9476c15260fb2 and project d1328b8f777e4cccb607e45f2799c346. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:04.479865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:32:04.482383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:32:04.537567 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a925499c-cbf7-49dd-902d-fad67dba5c5d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566592 Nov 02 13:32:04.538543 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4097/7650] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:32:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:32:04.549952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bafdb74f-f076-46b5-99e1-b369b40b78cb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:04.551421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bafdb74f-f076-46b5-99e1-b369b40b78cb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:04.632659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bafdb74f-f076-46b5-99e1-b369b40b78cb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:04.646957 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bafdb74f-f076-46b5-99e1-b369b40b78cb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1263 microversion: 2.1 time: 0.100561 Nov 02 13:32:04.647785 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3554/7651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:04 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1263 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:05.673154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:05.673803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:05.680340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:05.680990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:05.681678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:05.682377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:05.682908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:05.684483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:05.757109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:05.765801 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3720ea0-0487-4469-8d06-8e28edb92f4a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1315 microversion: 2.1 time: 0.098740 Nov 02 13:32:05.766753 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4098/7652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:05 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1315 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:06.791060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:06.792526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:06.802872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:06.803609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:06.804079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:06.804909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:06.805473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:06.808514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:07.330269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:07.345910 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eacbf1b7-216a-4446-8885-8f9c78d235c4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1363 microversion: 2.1 time: 0.558976 Nov 02 13:32:07.346596 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3555/7653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:06 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:07.676453 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7048a7a7-a6ff-47da-a29d-f29d0bf3a469 req-96ba1548-9f50-4ee6-972f-221c5987dae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "689ae11b-e142-4bc0-9b74-21792c2669fe", "tag": "167c5da7-fc34-4efe-a025-72a698d07880"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:07.689771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7048a7a7-a6ff-47da-a29d-f29d0bf3a469 req-96ba1548-9f50-4ee6-972f-221c5987dae3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:07.690784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7048a7a7-a6ff-47da-a29d-f29d0bf3a469 req-96ba1548-9f50-4ee6-972f-221c5987dae3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:07.691245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7048a7a7-a6ff-47da-a29d-f29d0bf3a469 req-96ba1548-9f50-4ee6-972f-221c5987dae3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:07.716632 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7048a7a7-a6ff-47da-a29d-f29d0bf3a469 req-96ba1548-9f50-4ee6-972f-221c5987dae3 service nova] Creating event network-changed:167c5da7-fc34-4efe-a025-72a698d07880 for instance 689ae11b-e142-4bc0-9b74-21792c2669fe on n-h2-855650-5 Nov 02 13:32:07.724894 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7048a7a7-a6ff-47da-a29d-f29d0bf3a469 req-96ba1548-9f50-4ee6-972f-221c5987dae3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053064 Nov 02 13:32:07.725517 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4099/7654] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:08.368928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:08.369556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:08.376554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:08.377047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:08.377497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:08.378234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:08.378697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:08.379130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:08.527676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:08.535847 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-afca5d11-ef32-4fea-931d-204b2e239731 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1363 microversion: 2.1 time: 0.170785 Nov 02 13:32:08.536541 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3556/7655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:08 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:09.561549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:09.562300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:09.569031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.569463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.569917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.570760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.571131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.571618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.706638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:09.715043 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fe22573-4212-4380-a7b4-bb45dc10b4b7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1363 microversion: 2.1 time: 0.158099 Nov 02 13:32:09.715622 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4100/7656] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:09 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:10.737844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:10.738406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:10.745924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:10.746457 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:10.746902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:10.747608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:10.748063 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:10.748494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:10.888260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:10.896546 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9716cdae-ef75-405f-aa8c-23ece7912a2a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1363 microversion: 2.1 time: 0.162650 Nov 02 13:32:10.897162 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3557/7657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:10 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:11.921097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:11.921719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:11.928860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:11.929375 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:11.929824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:11.930583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:11.931053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:11.931494 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:12.083065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:12.091209 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1ce4033-0ec2-4d6c-881e-65b755a73a36 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1363 microversion: 2.1 time: 0.174045 Nov 02 13:32:12.092126 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4101/7658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:11 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:13.114870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:13.115530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:13.123556 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.124058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.124507 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.125216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.125680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.126144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.273052 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:13.281691 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5e903aaa-2ec7-4c01-b384-c481116fc934 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1363 microversion: 2.1 time: 0.170697 Nov 02 13:32:13.282312 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3558/7659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:13 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:13.755990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e59d2880-be8d-4155-8444-7f08d226983f req-d5f05bf9-f77d-44be-8d38-b9b119b9f624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "689ae11b-e142-4bc0-9b74-21792c2669fe", "name": "network-vif-plugged", "status": "completed", "tag": "167c5da7-fc34-4efe-a025-72a698d07880"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:13.768268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e59d2880-be8d-4155-8444-7f08d226983f req-d5f05bf9-f77d-44be-8d38-b9b119b9f624 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.768767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e59d2880-be8d-4155-8444-7f08d226983f req-d5f05bf9-f77d-44be-8d38-b9b119b9f624 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.769231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e59d2880-be8d-4155-8444-7f08d226983f req-d5f05bf9-f77d-44be-8d38-b9b119b9f624 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.782118 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e59d2880-be8d-4155-8444-7f08d226983f req-d5f05bf9-f77d-44be-8d38-b9b119b9f624 service nova] Creating event network-vif-plugged:167c5da7-fc34-4efe-a025-72a698d07880 for instance 689ae11b-e142-4bc0-9b74-21792c2669fe on n-h2-855650-5 Nov 02 13:32:13.787161 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e59d2880-be8d-4155-8444-7f08d226983f req-d5f05bf9-f77d-44be-8d38-b9b119b9f624 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035032 Nov 02 13:32:13.787775 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4102/7660] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:14.306249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:14.306859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:14.314335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:14.314823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:14.315261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:14.315951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:14.316399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:14.316822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:14.456116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:14.463944 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b8fcfd8f-9e48-4c93-a6c8-b21011719ac1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1363 microversion: 2.1 time: 0.161727 Nov 02 13:32:14.464529 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3559/7661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:14 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:15.485002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:15.485749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:15.491124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:15.491845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:15.499727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.500231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.500691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.501400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.501870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.502349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.641386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:15.649444 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b66b57a-c9cb-47e3-96ea-d5ade1bd9068 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1555 microversion: 2.1 time: 0.165428 Nov 02 13:32:15.650122 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4103/7662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:15 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:15.672129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:15.672783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:15.674675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:15.681000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.681501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.681945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.682722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.683774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.684211 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.816445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:15.824551 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9574765f-7114-46bf-9369-63fb3e8bd0cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1555 microversion: 2.1 time: 0.156309 Nov 02 13:32:15.825133 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3560/7663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:15 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:17.459338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c4acd09-729a-4c1d-8858-5753718761ab"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:17.461739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:17.469228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:17.469737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:17.470741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.470945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:17.471419 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:17.471862 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.752288 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b6d4607-5d76-47ca-8f19-c965b9266f6e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296555 Nov 02 13:32:17.753078 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4104/7664] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:32:17 2022] POST /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:32:29.555615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:29.556139 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:29.558940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:29.559674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=36 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:29.565411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:29.565902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:29.566468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.567086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:29.567541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:29.567965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.652661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lazy-loading 'services' on Instance uuid 689ae11b-e142-4bc0-9b74-21792c2669fe {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:32:29.725265 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-99fb3901-9e7e-4775-8dc7-161b49cb6567 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments/1c4acd09-729a-4c1d-8858-5753718761ab" status: 202 len: 0 microversion: 2.1 time: 0.173771 Nov 02 13:32:29.725872 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3561/7665] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:32:29 2022] DELETE /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments/1c4acd09-729a-4c1d-8858-5753718761ab => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:29.733594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:29.734499 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:29.739496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:29.742116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:29.752867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:29.753366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:29.753838 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.754587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:29.755049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:29.755481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.787951 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-943b7476-36f8-4ca4-90bd-1a2a4ed4d37c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056381 Nov 02 13:32:29.788515 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4105/7666] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:29 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:30.802805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:30.805367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:30.811769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.812259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.812716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.816208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.816208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.816208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.849085 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9e69d3d5-69a5-46d3-b1ba-335ecb6c739d tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051577 Nov 02 13:32:30.849765 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3562/7667] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:30 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:31.862187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:31.864409 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:31.872321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:31.872827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:31.873287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:31.874045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:31.874525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:31.874968 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:31.909130 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92a22b74-6ca5-4d88-b6dd-b2edc2265bf8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051035 Nov 02 13:32:31.909739 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4106/7668] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:31 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:32.921298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:32.923564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:32.930782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:32.931268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:32.931705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:32.932402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:32.932850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:32.933275 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:32.965879 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-52875b81-3cc2-4181-94a5-f75723c93c84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048716 Nov 02 13:32:32.966487 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3563/7669] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:32 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:33.978853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:33.981694 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:33.988637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:33.989137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:33.989592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:33.990335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:33.990856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:33.991301 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.024296 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14385608-3258-46eb-ae5e-0ff26452ba73 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049566 Nov 02 13:32:34.024901 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4107/7670] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:33 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:35.037497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:35.039746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:35.047203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.047701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.048148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.048854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.049317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.049750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.081062 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9c659bb7-f4fe-42a1-b5fc-7959148a7aad tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047720 Nov 02 13:32:35.081639 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3564/7671] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:35 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:32:35.093041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:35.093585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:35.100516 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.101011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.101461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.102195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.102659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.103101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.178232 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] HTTP exception thrown: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe is not attached to volume 1c4acd09-729a-4c1d-8858-5753718761ab Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Request method failure captured: Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments/1c4acd09-729a-4c1d-8858-5753718761ab HTTP/1.1 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnFNI0UX2JJSHF-XcCrn6YLJ-j0FAP1hX2LkkvtaJJFsy_77QCKSx6-J4mYwfylwvcmJ4piyuCtVTVWZ5dQeUtqLS9cf_SAddmxcsn_5s1_aUqwVJdrA9iI280eMify8-rsVt_DbGbYsuaL7mC3NUgrRSlfFERKmpOlqQ5z6-z2pjx0 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 9caa083a1f984b02a9b9476c15260fb2 Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe is not attached to volume 1c4acd09-729a-4c1d-8858-5753718761ab Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': '689ae11b-e142-4bc0-9b74-21792c2669fe', 'id': '1c4acd09-729a-4c1d-8858-5753718761ab'} Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1c4acd09-729a-4c1d-8858-5753718761ab. Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe is not attached to volume 1c4acd09-729a-4c1d-8858-5753718761ab Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:35.188854 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:35.194213 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:35.194213 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:35.194213 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe is not attached to volume 1c4acd09-729a-4c1d-8858-5753718761ab Nov 02 13:32:35.194213 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:35.194213 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Returning 404 to user: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe is not attached to volume 1c4acd09-729a-4c1d-8858-5753718761ab {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:35.194213 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c7babab-4ce2-4826-a9c7-d825064a02df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments/1c4acd09-729a-4c1d-8858-5753718761ab" status: 404 len: 154 microversion: 2.1 time: 0.101414 Nov 02 13:32:35.194213 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4108/7672] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:32:35 2022] DELETE /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe/os-volume_attachments/1c4acd09-729a-4c1d-8858-5753718761ab => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:38.562602 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:38.563223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:38.571157 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.572332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.572332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.573900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.574420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.574855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.605468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:38.690902 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-59677fe9-c63d-4c66-8280-272b44314dc2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 204 len: 0 microversion: 2.1 time: 0.131929 Nov 02 13:32:38.695121 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3565/7673] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:32:38 2022] DELETE /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:38.702054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:38.702939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:38.711670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.712173 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.712627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.713331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.713793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.714250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.855336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:38.863792 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f10b2c8-92c6-4d58-8953-c50be716af7e tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1561 microversion: 2.1 time: 0.167007 Nov 02 13:32:38.864377 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4109/7674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:38 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:39.888596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:39.889300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:39.896552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:39.897046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:39.897494 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:39.898243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:39.898703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:39.899136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:40.039730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:40.047836 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7e11db1b-4191-4c12-b43a-fe1d53fcd8a8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1561 microversion: 2.1 time: 0.164194 Nov 02 13:32:40.048421 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3566/7675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:39 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:40.976145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-cc56d6b0-2786-49ce-aae9-3c75e9c1c7c8 req-4bb00f24-75c7-464d-91a1-b260fe4e6df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "689ae11b-e142-4bc0-9b74-21792c2669fe", "name": "network-vif-deleted", "tag": "167c5da7-fc34-4efe-a025-72a698d07880"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:40.989587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc56d6b0-2786-49ce-aae9-3c75e9c1c7c8 req-4bb00f24-75c7-464d-91a1-b260fe4e6df4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:40.990106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc56d6b0-2786-49ce-aae9-3c75e9c1c7c8 req-4bb00f24-75c7-464d-91a1-b260fe4e6df4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:40.990554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cc56d6b0-2786-49ce-aae9-3c75e9c1c7c8 req-4bb00f24-75c7-464d-91a1-b260fe4e6df4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:41.006457 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-cc56d6b0-2786-49ce-aae9-3c75e9c1c7c8 req-4bb00f24-75c7-464d-91a1-b260fe4e6df4 service nova] Creating event network-vif-deleted:167c5da7-fc34-4efe-a025-72a698d07880 for instance 689ae11b-e142-4bc0-9b74-21792c2669fe on n-h2-855650-5 Nov 02 13:32:41.013147 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-cc56d6b0-2786-49ce-aae9-3c75e9c1c7c8 req-4bb00f24-75c7-464d-91a1-b260fe4e6df4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040729 Nov 02 13:32:41.013766 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4110/7676] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:41.075212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:41.076636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:41.084317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:41.084821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:41.085470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:41.086628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:41.087279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:41.087726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:41.122886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:41.123397 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:41.123825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:41.124363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lazy-loading 'fault' on Instance uuid 689ae11b-e142-4bc0-9b74-21792c2669fe {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:32:41.169592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:41.178507 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ce47498f-00a2-4d71-82f3-bb86974c2b87 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 200 len: 1353 microversion: 2.1 time: 0.110111 Nov 02 13:32:41.178958 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3567/7677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:41 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 1353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:42.202909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:42.203693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 689ae11b-e142-4bc0-9b74-21792c2669fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:42.211225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.211732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.212198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.212920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.213883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.214362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.232119 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] HTTP exception thrown: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe could not be found. Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Request method failure captured: Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe HTTP/1.1 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnFNI0UX2JJSHF-XcCrn6YLJ-j0FAP1hX2LkkvtaJJFsy_77QCKSx6-J4mYwfylwvcmJ4piyuCtVTVWZ5dQeUtqLS9cf_SAddmxcsn_5s1_aUqwVJdrA9iI280eMify8-rsVt_DbGbYsuaL7mC3NUgrRSlfFERKmpOlqQ5z6-z2pjx0 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 9caa083a1f984b02a9b9476c15260fb2 Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe could not be found. Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '689ae11b-e142-4bc0-9b74-21792c2669fe'} Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe could not be found. Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe could not be found. Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:42.233839 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe could not be found. Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Returning 404 to user: Instance 689ae11b-e142-4bc0-9b74-21792c2669fe could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84ab0643-5230-4627-986c-613c7c6591a7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe" status: 404 len: 111 microversion: 2.1 time: 0.036786 Nov 02 13:32:42.238997 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4111/7678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:42 2022] GET /compute/v2.1/servers/689ae11b-e142-4bc0-9b74-21792c2669fe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:42.245389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-df60d468-66d7-450f-a6ef-80ce841bb973 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '.version_select at 0x7f228d4d7700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:42.269829 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-df60d468-66d7-450f-a6ef-80ce841bb973 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1416436826" status: 202 len: 0 microversion: 2.1 time: 0.027998 Nov 02 13:32:42.270493 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3568/7679] 10.222.0.45 () {58 vars in 1278 bytes} [Wed Nov 2 13:32:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1416436826 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:32:42.289037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46b81078-2a29-44f2-a516-89872dd617ed tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: .version_select at 0x7f228c11c940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-868355259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdm51Mw5Pl0yKhII2rMq1sWK/mc5mOVNmTcm3iYPiYgUyOaYo+FHtCMkH/Dhu17Ur2RiHcdEJGKuiq+n02cn/6Zgrkco4+4zrrvbYAU3w8OV2PgsjBVzorm/uO6PnPkqQ=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:42.306116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-46b81078-2a29-44f2-a516-89872dd617ed tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for project d1328b8f777e4cccb607e45f2799c346. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:42.311819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-46b81078-2a29-44f2-a516-89872dd617ed tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for user 9caa083a1f984b02a9b9476c15260fb2 and project d1328b8f777e4cccb607e45f2799c346. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:42.338951 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46b81078-2a29-44f2-a516-89872dd617ed tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.053343 Nov 02 13:32:42.339571 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4112/7680] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:32:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:32:42.393213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1149285020", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-868355259", "networks": [{"uuid": "0ff2ec59-0e0e-49dc-ba35-b616c9718cf0"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:42.450293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] validate_networks() for [('0ff2ec59-0e0e-49dc-ba35-b616c9718cf0', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:32:42.834305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:32:42.834734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:32:42.835215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:32:42.835632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:32:42.836047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:32:42.844959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.845441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.845881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.846644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.847106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.847530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.864824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for project d1328b8f777e4cccb607e45f2799c346. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:42.870851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for user 9caa083a1f984b02a9b9476c15260fb2 and project d1328b8f777e4cccb607e45f2799c346. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:42.883374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:32:42.886427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:32:42.936286 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f6e0c0b-59ea-4da6-86f8-89a7c58ff4af tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546679 Nov 02 13:32:42.937415 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3569/7681] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:32:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:32:42.950629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0350a181-9961-4377-a006-54dadf01e782 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:42.951341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0350a181-9961-4377-a006-54dadf01e782 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:43.011299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0350a181-9961-4377-a006-54dadf01e782 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:43.292017 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0350a181-9961-4377-a006-54dadf01e782 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1262 microversion: 2.1 time: 0.346312 Nov 02 13:32:43.292762 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4113/7682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:42 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1262 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:44.315952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:44.316615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:44.324477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.324989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.325434 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.326203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.326674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.327114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.414608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:44.422702 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-929b81da-f3a8-43d1-bf5d-32cff8f47ef0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1320 microversion: 2.1 time: 0.111609 Nov 02 13:32:44.423587 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3570/7683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:44 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1320 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:45.447771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:45.449250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:45.456279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.456789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.457253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.458005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.458488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.458933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.553722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1021cf0c-cac2-4110-bc84-ccb732809c45 req-fcae1ee0-9cba-4097-8d2b-9b419481aee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d7473e-9352-4125-8ed6-7535df7d4db1", "tag": "c895b398-af62-4687-ba99-fbd48b28f41f"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:45.567893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1021cf0c-cac2-4110-bc84-ccb732809c45 req-fcae1ee0-9cba-4097-8d2b-9b419481aee5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.568376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1021cf0c-cac2-4110-bc84-ccb732809c45 req-fcae1ee0-9cba-4097-8d2b-9b419481aee5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.568880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1021cf0c-cac2-4110-bc84-ccb732809c45 req-fcae1ee0-9cba-4097-8d2b-9b419481aee5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.582266 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1021cf0c-cac2-4110-bc84-ccb732809c45 req-fcae1ee0-9cba-4097-8d2b-9b419481aee5 service nova] Creating event network-changed:c895b398-af62-4687-ba99-fbd48b28f41f for instance 34d7473e-9352-4125-8ed6-7535df7d4db1 on n-h2-855650-5 Nov 02 13:32:45.589879 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1021cf0c-cac2-4110-bc84-ccb732809c45 req-fcae1ee0-9cba-4097-8d2b-9b419481aee5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040327 Nov 02 13:32:45.591003 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3571/7684] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:32:45.604296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:45.620841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df1648fc-e553-4942-9d4c-8ccfc53fb20c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1362 microversion: 2.1 time: 0.177189 Nov 02 13:32:45.622157 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4114/7685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:45 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:46.645471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:46.646125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:46.653914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:46.654433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:46.654882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:46.655591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:46.656050 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:46.656480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:46.793390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:46.802417 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b1a7091d-cbed-4bdf-a68e-7ec4dd5b7913 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1362 microversion: 2.1 time: 0.161241 Nov 02 13:32:46.803006 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3572/7686] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:46 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:47.826204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:47.826819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:47.833774 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:47.834396 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:47.834847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.835570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:47.836031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:47.836467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.976294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:47.985351 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-475c6802-d23a-460d-b3d6-fb560af602d2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1362 microversion: 2.1 time: 0.163460 Nov 02 13:32:47.986147 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4115/7687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:47 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:49.009081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:49.009705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:49.017436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:49.017930 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:49.018413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:49.019128 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:49.019591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:49.020026 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:49.151500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:49.159447 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-aaf7493e-e906-4ebc-9b07-74fc45329054 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1362 microversion: 2.1 time: 0.154306 Nov 02 13:32:49.160031 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3573/7688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:49 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:50.183263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:50.183878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:50.191110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:50.191624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:50.192100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:50.192832 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:50.193366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:50.193783 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:50.328389 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:50.343148 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-910405f9-1a91-437a-b151-2e271543399f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1362 microversion: 2.1 time: 0.163654 Nov 02 13:32:50.343747 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4116/7689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:50 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:51.367116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:51.367733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:51.374862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.375376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.375812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.376529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.376980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.377410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.520295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:51.528303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ac9ef8c5-ac57-410b-b35b-a74b8c709214 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1362 microversion: 2.1 time: 0.165452 Nov 02 13:32:51.528894 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3574/7690] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:51 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:51.991898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fc3b906a-1822-4350-b4c9-d808516a0542 req-8e9efd41-6164-4698-b50c-2b76ef191852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d7473e-9352-4125-8ed6-7535df7d4db1", "name": "network-vif-plugged", "status": "completed", "tag": "c895b398-af62-4687-ba99-fbd48b28f41f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:52.003661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc3b906a-1822-4350-b4c9-d808516a0542 req-8e9efd41-6164-4698-b50c-2b76ef191852 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.004169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc3b906a-1822-4350-b4c9-d808516a0542 req-8e9efd41-6164-4698-b50c-2b76ef191852 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.004621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fc3b906a-1822-4350-b4c9-d808516a0542 req-8e9efd41-6164-4698-b50c-2b76ef191852 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.025319 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fc3b906a-1822-4350-b4c9-d808516a0542 req-8e9efd41-6164-4698-b50c-2b76ef191852 service nova] Creating event network-vif-plugged:c895b398-af62-4687-ba99-fbd48b28f41f for instance 34d7473e-9352-4125-8ed6-7535df7d4db1 on n-h2-855650-5 Nov 02 13:32:52.031229 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fc3b906a-1822-4350-b4c9-d808516a0542 req-8e9efd41-6164-4698-b50c-2b76ef191852 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042903 Nov 02 13:32:52.032106 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4117/7691] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:52.552481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:52.553078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:52.559996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.560557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.560915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.561604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.562080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.562503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.697533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:52.706364 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fb9c0552-4b0f-4fee-b3a9-bd52c4cc1ba7 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1362 microversion: 2.1 time: 0.158144 Nov 02 13:32:52.706953 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3575/7692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:52 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:53.729226 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:53.733355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.734136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:53.741047 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.741540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.742022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.742729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.743190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.743623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.882137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:53.891086 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-eb4ab62e-9240-4795-a42e-7be03b56ff5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1554 microversion: 2.1 time: 0.164137 Nov 02 13:32:53.891716 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4118/7693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:53 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:53.914739 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.915361 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:53.917536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:53.918301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:53.925767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.926292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.926747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.927465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.927932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.928367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.062379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:54.070496 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ad5eb989-69f9-4370-b63c-1586d04699e2 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1554 microversion: 2.1 time: 0.159643 Nov 02 13:32:54.071080 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3576/7694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:53 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:55.597166 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cd04fea-f301-4c3d-925f-d47a894046e4"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:55.599604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:55.607005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:55.607429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:55.607889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:55.608621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:55.609089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:55.609532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:55.907162 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0d3ce96-41dc-47bf-b643-e3413bef49d6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314244 Nov 02 13:32:55.908399 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4119/7695] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:32:55 2022] POST /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:06.642562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.643090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:06.645438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:06.646262 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:06.651997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.652486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.652927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.653633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.654119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.654553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.740033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lazy-loading 'services' on Instance uuid 34d7473e-9352-4125-8ed6-7535df7d4db1 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:33:06.812368 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0bab9b4b-8b63-406b-8ec0-6a62c8750c5b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments/1cd04fea-f301-4c3d-925f-d47a894046e4" status: 202 len: 0 microversion: 2.1 time: 0.174303 Nov 02 13:33:06.813033 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3577/7696] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:33:06 2022] DELETE /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments/1cd04fea-f301-4c3d-925f-d47a894046e4 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:33:06.823681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.826467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:06.830495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:06.831522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:06.839687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.840201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.840659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.841412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.841879 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.842346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.876748 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0db608f3-d18d-430d-80d6-244144e0232f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057834 Nov 02 13:33:06.877248 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4120/7697] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:07.890990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:07.893935 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:07.902862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:07.903360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:07.903805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:07.904524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:07.904985 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:07.905418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:07.940060 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-187404be-9842-41f3-93fc-fe1d6c2d5232 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054284 Nov 02 13:33:07.940649 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3578/7698] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:07 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:08.953260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.955853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:08.963121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.963121 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.963529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.964279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.964855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.965303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.998820 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-246b45dd-3380-4f92-8f4b-e6fa58d55edb tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049681 Nov 02 13:33:08.999417 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4121/7699] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:10.013213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:10.015530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:10.022947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:10.023444 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:10.023896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:10.024616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:10.025078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:10.025514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:10.057317 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e6a66a1d-a920-4c70-94a9-bb050bd59d84 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048792 Nov 02 13:33:10.057802 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3579/7700] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:10 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:11.070836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:11.073426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:11.081448 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.081986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.082483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.083300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.083779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.084234 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.115697 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e3dccd59-e19c-4336-a486-d2778a2c0f75 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048989 Nov 02 13:33:11.116286 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4122/7701] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:11 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:12.128408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:12.130651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:12.137632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.138225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.138675 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.139382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.139852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.140288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.173814 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-50965624-ddeb-470e-ab8c-347145afebe0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048762 Nov 02 13:33:12.174434 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3580/7702] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:12 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:33:12.185451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:12.185992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:12.192923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.193428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.193896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.194642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.195112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.195558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.334975 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] HTTP exception thrown: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 is not attached to volume 1cd04fea-f301-4c3d-925f-d47a894046e4 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Request method failure captured: Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments/1cd04fea-f301-4c3d-925f-d47a894046e4 HTTP/1.1 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnFNI0UX2JJSHF-XcCrn6YLJ-j0FAP1hX2LkkvtaJJFsy_77QCKSx6-J4mYwfylwvcmJ4piyuCtVTVWZ5dQeUtqLS9cf_SAddmxcsn_5s1_aUqwVJdrA9iI280eMify8-rsVt_DbGbYsuaL7mC3NUgrRSlfFERKmpOlqQ5z6-z2pjx0 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 9caa083a1f984b02a9b9476c15260fb2 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 is not attached to volume 1cd04fea-f301-4c3d-925f-d47a894046e4 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': '34d7473e-9352-4125-8ed6-7535df7d4db1', 'id': '1cd04fea-f301-4c3d-925f-d47a894046e4'} Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1cd04fea-f301-4c3d-925f-d47a894046e4. Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 is not attached to volume 1cd04fea-f301-4c3d-925f-d47a894046e4 Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:12.336847 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:12.341741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:12.341741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:12.341741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 is not attached to volume 1cd04fea-f301-4c3d-925f-d47a894046e4 Nov 02 13:33:12.341741 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:12.341741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Returning 404 to user: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 is not attached to volume 1cd04fea-f301-4c3d-925f-d47a894046e4 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:12.341741 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1bcb3696-b24b-47c5-87cd-d1d6fdaefef5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments/1cd04fea-f301-4c3d-925f-d47a894046e4" status: 404 len: 154 microversion: 2.1 time: 0.157955 Nov 02 13:33:12.341741 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4123/7703] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:33:12 2022] DELETE /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1/os-volume_attachments/1cd04fea-f301-4c3d-925f-d47a894046e4 => generated 154 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:33:15.713164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:15.713742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:15.720889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.721388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.721837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.722582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.723045 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.723480 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.752174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:15.836430 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e13b1de4-adf1-4a18-8ee0-2e3599d19f8b tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 204 len: 0 microversion: 2.1 time: 0.127727 Nov 02 13:33:15.837199 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3581/7704] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:33:15 2022] DELETE /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:33:15.846408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:15.846958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:15.854646 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.855158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.855623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.856386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.856824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.857271 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.997623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:16.006257 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43030e52-1023-42ab-93be-d93a1f036801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1560 microversion: 2.1 time: 0.164285 Nov 02 13:33:16.006836 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4124/7705] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:15 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:17.030290 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:17.031018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:17.038730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:17.039212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:17.039652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:17.040343 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:17.040789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:17.041216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:17.176413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:17.184341 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5ae151e-798a-450c-963e-cfa2a3132076 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1560 microversion: 2.1 time: 0.158397 Nov 02 13:33:17.184921 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3582/7706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:17 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:18.123560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c6763387-4f17-4007-bbf1-966fa105d567 req-994f4f86-0363-4ef4-ab36-41420760339c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d7473e-9352-4125-8ed6-7535df7d4db1", "name": "network-vif-deleted", "tag": "c895b398-af62-4687-ba99-fbd48b28f41f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:18.134954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6763387-4f17-4007-bbf1-966fa105d567 req-994f4f86-0363-4ef4-ab36-41420760339c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.135454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6763387-4f17-4007-bbf1-966fa105d567 req-994f4f86-0363-4ef4-ab36-41420760339c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.135903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c6763387-4f17-4007-bbf1-966fa105d567 req-994f4f86-0363-4ef4-ab36-41420760339c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.149983 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c6763387-4f17-4007-bbf1-966fa105d567 req-994f4f86-0363-4ef4-ab36-41420760339c service nova] Creating event network-vif-deleted:c895b398-af62-4687-ba99-fbd48b28f41f for instance 34d7473e-9352-4125-8ed6-7535df7d4db1 on n-h2-855650-5 Nov 02 13:33:18.156634 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c6763387-4f17-4007-bbf1-966fa105d567 req-994f4f86-0363-4ef4-ab36-41420760339c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036597 Nov 02 13:33:18.158404 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4125/7707] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:18.209209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:18.210034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:18.217284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.218261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.218788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.219627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.220694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.221244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.289925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:18.298030 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8a2f3f7-7933-41dd-b94e-cf4408a419c8 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 200 len: 1347 microversion: 2.1 time: 0.092710 Nov 02 13:33:18.298937 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3583/7708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:18 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:19.323443 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:19.324154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 34d7473e-9352-4125-8ed6-7535df7d4db1] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:19.330688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:19.331186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:19.331641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:19.332366 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:19.332829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:19.333261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:19.350449 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] HTTP exception thrown: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 could not be found. Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Request method failure captured: Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 HTTP/1.1 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnFNI0UX2JJSHF-XcCrn6YLJ-j0FAP1hX2LkkvtaJJFsy_77QCKSx6-J4mYwfylwvcmJ4piyuCtVTVWZ5dQeUtqLS9cf_SAddmxcsn_5s1_aUqwVJdrA9iI280eMify8-rsVt_DbGbYsuaL7mC3NUgrRSlfFERKmpOlqQ5z6-z2pjx0 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 9caa083a1f984b02a9b9476c15260fb2 Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 could not be found. Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '34d7473e-9352-4125-8ed6-7535df7d4db1'} Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 could not be found. Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 could not be found. Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:19.352429 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 could not be found. Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Returning 404 to user: Instance 34d7473e-9352-4125-8ed6-7535df7d4db1 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b22984e7-5856-4872-ae0a-ae767059516c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1" status: 404 len: 111 microversion: 2.1 time: 0.036157 Nov 02 13:33:19.359331 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4126/7709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:19 2022] GET /compute/v2.1/servers/34d7473e-9352-4125-8ed6-7535df7d4db1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:33:19.364441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1ecff47c-420f-4708-8cd4-bbfa6464582f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '.version_select at 0x7f228d481700>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:19.384626 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1ecff47c-420f-4708-8cd4-bbfa6464582f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-868355259" status: 202 len: 0 microversion: 2.1 time: 0.024550 Nov 02 13:33:19.385213 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3584/7710] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 13:33:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-868355259 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:33:19.407784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99f3b27d-e082-4e7f-90fa-e63d198168c0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: .version_select at 0x7f228c0eaca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-927518923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfotcDw+gGhQWnxfBpn01JfrxqWLtVpdwRJUy5hiu6W01/x5iiMfQ6atEsmEPtv6EQXQuF8n/Q24wU8E4j5OqYk0ypjbQRRQrRL7Rr4lEz/hXw3Waj9zZZG1vrZzwsUFQ=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:19.423955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-99f3b27d-e082-4e7f-90fa-e63d198168c0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for project d1328b8f777e4cccb607e45f2799c346. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:33:19.429277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-99f3b27d-e082-4e7f-90fa-e63d198168c0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for user 9caa083a1f984b02a9b9476c15260fb2 and project d1328b8f777e4cccb607e45f2799c346. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:33:19.454133 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99f3b27d-e082-4e7f-90fa-e63d198168c0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.055125 Nov 02 13:33:19.454744 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4127/7711] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:33:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:19.505124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-36350049", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-927518923", "networks": [{"uuid": "0ff2ec59-0e0e-49dc-ba35-b616c9718cf0"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:19.563955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] validate_networks() for [('0ff2ec59-0e0e-49dc-ba35-b616c9718cf0', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:33:19.938758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:33:19.939189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:33:19.939671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:33:19.940089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:33:19.940506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:33:19.949898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:19.950502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:19.950981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:19.951880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:19.952455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:19.952939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:19.971287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for project d1328b8f777e4cccb607e45f2799c346. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:33:19.976673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Getting quotas for user 9caa083a1f984b02a9b9476c15260fb2 and project d1328b8f777e4cccb607e45f2799c346. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:33:19.989389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:33:19.991950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:33:20.043059 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-029a9831-f263-410e-8dd8-159619b69abf tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541834 Nov 02 13:33:20.044323 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3585/7712] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:33:20.055952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab6ca872-67f2-471d-a3c9-24b40d7cc71a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:20.056941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab6ca872-67f2-471d-a3c9-24b40d7cc71a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:20.113633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab6ca872-67f2-471d-a3c9-24b40d7cc71a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:20.122353 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab6ca872-67f2-471d-a3c9-24b40d7cc71a tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1260 microversion: 2.1 time: 0.070762 Nov 02 13:33:20.122946 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4128/7713] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:20 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1260 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:21.146051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:21.146737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:21.155476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:21.155975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:21.156421 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:21.157623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:21.158316 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:21.158810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:21.243912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:21.255271 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-beb7359b-9ce5-46e4-ba60-fbc79592c4df tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1320 microversion: 2.1 time: 0.113372 Nov 02 13:33:21.255876 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3586/7714] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:21 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1320 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:22.279497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:22.280138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:22.289112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:22.289635 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:22.290543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:22.291637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:22.292185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:22.292557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:22.439231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:22.448981 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6026f9ff-9edb-4498-93c2-1733243683fd tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.173002 Nov 02 13:33:22.449578 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4129/7715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:22 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:23.002177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6369a789-a034-44d5-a4b7-db36e0ad190c req-a23a8326-fc20-48b8-ae3c-716dab32328c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c36ed94-2f5f-49aa-8cd8-56f6cde373ea", "tag": "e329ff7c-eda8-4235-8899-2ca914cac42d"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:23.012673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6369a789-a034-44d5-a4b7-db36e0ad190c req-a23a8326-fc20-48b8-ae3c-716dab32328c service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:23.013235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6369a789-a034-44d5-a4b7-db36e0ad190c req-a23a8326-fc20-48b8-ae3c-716dab32328c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:23.013676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6369a789-a034-44d5-a4b7-db36e0ad190c req-a23a8326-fc20-48b8-ae3c-716dab32328c service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:23.025721 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6369a789-a034-44d5-a4b7-db36e0ad190c req-a23a8326-fc20-48b8-ae3c-716dab32328c service nova] Creating event network-changed:e329ff7c-eda8-4235-8899-2ca914cac42d for instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea on n-h2-855650-5 Nov 02 13:33:23.030992 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6369a789-a034-44d5-a4b7-db36e0ad190c req-a23a8326-fc20-48b8-ae3c-716dab32328c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032592 Nov 02 13:33:23.031619 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3587/7716] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:33:23.472606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:23.473507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:23.481192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:23.481890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:23.482561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:23.483137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:23.483649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:23.484221 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:23.627229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:23.635405 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae8ba8d0-c986-4f18-b61e-d3d57c351187 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.166677 Nov 02 13:33:23.636000 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4130/7717] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:23 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:24.659536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:24.660240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:24.667787 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:24.668281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:24.668722 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:24.669422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:24.669879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:24.670333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:24.803661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:24.811509 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66da2328-0079-4b94-9999-d83d31644dbc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.156486 Nov 02 13:33:24.812089 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3588/7718] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:24 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:25.838931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:25.839569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:25.847245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:25.847758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:25.848217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:25.848937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:25.849411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:25.849858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:25.989266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:25.997230 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0b6bb2e-a1c9-44a5-ba97-ae02114abad5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.162522 Nov 02 13:33:25.997817 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4131/7719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:25 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:27.020403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:27.021089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:27.028017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:27.028501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:27.028947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:27.029827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:27.030136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:27.030574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:27.162461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:27.170280 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6018bac6-d929-4523-a667-bb7d899c0ba0 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.153800 Nov 02 13:33:27.170852 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3589/7720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:27 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:28.194411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:28.195288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:28.202731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:28.203240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:28.203727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:28.204460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:28.204933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:28.205371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:28.347814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:28.355810 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6bb64286-02a1-4887-8dac-9fd327dfab25 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.165580 Nov 02 13:33:28.356390 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4132/7721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:28 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:29.383525 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:29.384615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:29.390979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:29.392087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:29.392527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:29.393235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:29.393694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:29.394146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:29.529125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:29.536805 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f810feaa-e584-420b-bfc7-08b188b6ff83 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.159781 Nov 02 13:33:29.537380 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3590/7722] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:29 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:30.247337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3e8e1cb0-789c-47ee-b772-d15320044f7c req-feaa7234-f829-4fe5-b679-c66bba5d57d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c36ed94-2f5f-49aa-8cd8-56f6cde373ea", "name": "network-vif-plugged", "status": "completed", "tag": "e329ff7c-eda8-4235-8899-2ca914cac42d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:30.253590 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:30.260397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3e8e1cb0-789c-47ee-b772-d15320044f7c req-feaa7234-f829-4fe5-b679-c66bba5d57d9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:30.260916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3e8e1cb0-789c-47ee-b772-d15320044f7c req-feaa7234-f829-4fe5-b679-c66bba5d57d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:30.261387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3e8e1cb0-789c-47ee-b772-d15320044f7c req-feaa7234-f829-4fe5-b679-c66bba5d57d9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:30.273665 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3e8e1cb0-789c-47ee-b772-d15320044f7c req-feaa7234-f829-4fe5-b679-c66bba5d57d9 service nova] Creating event network-vif-plugged:e329ff7c-eda8-4235-8899-2ca914cac42d for instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea on n-h2-855650-5 Nov 02 13:33:30.278707 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3e8e1cb0-789c-47ee-b772-d15320044f7c req-feaa7234-f829-4fe5-b679-c66bba5d57d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035595 Nov 02 13:33:30.279317 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4133/7723] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:30.560778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:30.561391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:30.563887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:30.564731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:30.571742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:30.572235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:30.572676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:30.573625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:30.574119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:30.574552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:30.709188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:30.717477 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ffab5bd8-cda7-403f-ac13-c5374227034f tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.160619 Nov 02 13:33:30.718072 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3591/7724] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:30 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:31.742602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:31.743248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:31.749830 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:31.750370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:31.750827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:31.751611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:31.752082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:31.752544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:31.895232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:31.905547 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94c09b42-33e2-4d60-85cd-c6e59d413eec tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1360 microversion: 2.1 time: 0.168030 Nov 02 13:33:31.906127 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4134/7725] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:31 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:32.930147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:32.930945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:32.938046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:32.938568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:32.939016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:32.939720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:32.940181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:32.940616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:33.076150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:33.084121 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-40db2f30-66be-4c3e-a4ed-ffb1333a2304 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1552 microversion: 2.1 time: 0.157966 Nov 02 13:33:33.084717 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3592/7726] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:32 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:33.107115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:33.107731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:33.115232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:33.115728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:33.116177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:33.116881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:33.117343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:33.117780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:33.257718 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:33.265996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9032484c-bb7e-4567-b7f5-0f93f0ad84b6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1552 microversion: 2.1 time: 0.162768 Nov 02 13:33:33.267069 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4135/7727] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:33 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:34.806529 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbb5901d-a776-4653-92e8-602d88c0fb7d"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:34.808982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:34.816576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:34.817070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:34.817514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:34.818231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:34.818687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:34.819114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:34.836831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:35.094047 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c6f4e756-cfbb-435f-b878-93991bf5e80c tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "POST /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291100 Nov 02 13:33:35.095860 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3593/7728] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:33:34 2022] POST /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:45.843131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:45.843765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:45.847239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:45.847942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=72 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:45.854522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:45.855046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:45.855509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:45.856249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:45.856731 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:45.857182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:45.948634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lazy-loading 'services' on Instance uuid 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:33:46.028186 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07cf994c-4e33-4b76-bee3-5e6363263f89 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments/fbb5901d-a776-4653-92e8-602d88c0fb7d" status: 202 len: 0 microversion: 2.1 time: 0.190204 Nov 02 13:33:46.028797 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4136/7729] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:33:45 2022] DELETE /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments/fbb5901d-a776-4653-92e8-602d88c0fb7d => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:33:46.039170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:46.041552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:46.044637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:46.045333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:46.051277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:46.051773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:46.052212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:46.052925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:46.053378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:46.053803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:46.090555 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1f6dd8ce-0479-43e7-a22c-cac1092619f4 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055676 Nov 02 13:33:46.091138 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3594/7730] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:46 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:47.105446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:47.107854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:47.115055 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:47.115544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:47.116025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:47.116725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:47.117254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:47.117640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:47.151613 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d220adf-4848-4a9a-8cd4-3377cd2fd0b5 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051396 Nov 02 13:33:47.152363 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4137/7731] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:47 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:48.164734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:48.166986 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:48.175004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.175504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.175961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.176682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.177141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.177579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.213427 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-85bfea8f-f139-491a-a370-3f8249aa0801 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052637 Nov 02 13:33:48.214394 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3595/7732] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:48 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:49.228744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:49.231045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:49.238776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.239282 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.239740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.240489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.240933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.241377 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.275376 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77f9dba9-1639-43ec-82c9-4bef4f308afc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052321 Nov 02 13:33:49.275962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4138/7733] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:49 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:50.289839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:50.292340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:50.299646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.300141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.300592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:50.301311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.301767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.302227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:50.342549 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2f4800bd-75f5-4016-977b-d20627e2f3f6 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056513 Nov 02 13:33:50.343211 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3596/7734] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:50 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:51.357937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:51.360605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:51.368659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:51.369554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:51.369816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:51.370408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:51.370887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:51.371338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:51.406201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-962dded1-2519-47fb-815a-0583bb6f1fc1 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052946 Nov 02 13:33:51.407870 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4139/7735] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:33:51 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:33:51.421798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:51.423267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:51.431433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:51.431922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:51.432358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:51.433269 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:51.433528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:51.433953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:51.521435 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] HTTP exception thrown: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea is not attached to volume fbb5901d-a776-4653-92e8-602d88c0fb7d Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Request method failure captured: Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments/fbb5901d-a776-4653-92e8-602d88c0fb7d HTTP/1.1 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnFNI0UX2JJSHF-XcCrn6YLJ-j0FAP1hX2LkkvtaJJFsy_77QCKSx6-J4mYwfylwvcmJ4piyuCtVTVWZ5dQeUtqLS9cf_SAddmxcsn_5s1_aUqwVJdrA9iI280eMify8-rsVt_DbGbYsuaL7mC3NUgrRSlfFERKmpOlqQ5z6-z2pjx0 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 9caa083a1f984b02a9b9476c15260fb2 Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea is not attached to volume fbb5901d-a776-4653-92e8-602d88c0fb7d Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': '0c36ed94-2f5f-49aa-8cd8-56f6cde373ea', 'id': 'fbb5901d-a776-4653-92e8-602d88c0fb7d'} Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fbb5901d-a776-4653-92e8-602d88c0fb7d. Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea is not attached to volume fbb5901d-a776-4653-92e8-602d88c0fb7d Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:51.523469 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:51.528533 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:51.528533 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:51.528533 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea is not attached to volume fbb5901d-a776-4653-92e8-602d88c0fb7d Nov 02 13:33:51.528533 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:51.528533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Returning 404 to user: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea is not attached to volume fbb5901d-a776-4653-92e8-602d88c0fb7d {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:51.529461 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7a15d707-cad6-47bb-b73c-845942ac4e12 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments/fbb5901d-a776-4653-92e8-602d88c0fb7d" status: 404 len: 154 microversion: 2.1 time: 0.111907 Nov 02 13:33:51.530489 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3597/7736] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:33:51 2022] DELETE /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea/os-volume_attachments/fbb5901d-a776-4653-92e8-602d88c0fb7d => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:33:55.022465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:55.023423 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:55.035413 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.035939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.036406 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.037151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.037627 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.038143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.072249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:55.176321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6bd111a0-61ef-4b09-8947-9a079c3d59cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 204 len: 0 microversion: 2.1 time: 0.161645 Nov 02 13:33:55.177554 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4140/7737] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:33:55 2022] DELETE /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:33:55.193839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:55.195142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:55.207497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.208152 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.208734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.209776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.210415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.210972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.388823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:55.397594 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7491f26b-efc0-43f3-b20b-f9fa39e6bc13 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1558 microversion: 2.1 time: 0.212807 Nov 02 13:33:55.398226 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3598/7738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:55 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:56.422077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:56.422794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:56.430799 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:56.431299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:56.431754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:56.432470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:56.432934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:56.433367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:56.578137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:56.587022 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-769c2150-26fc-4d90-a7c3-b9d7635b6626 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1558 microversion: 2.1 time: 0.169158 Nov 02 13:33:56.587617 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4141/7739] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:56 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:57.612136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:57.612859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:57.620385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:57.620884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:57.621327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:57.622087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:57.622544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:57.622975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:57.985009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a4e65db8-1890-4a59-96bf-856774b99b94 req-d2029bb9-a404-4cc5-b3d3-4f8e93e0d202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c36ed94-2f5f-49aa-8cd8-56f6cde373ea", "name": "network-vif-deleted", "tag": "e329ff7c-eda8-4235-8899-2ca914cac42d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:57.991304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caa083a1f984b02a9b9476c15260fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1328b8f777e4cccb607e45f2799c346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:58.008131 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6222f424-c7c6-4c19-94c1-0ede172161cc tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 200 len: 1558 microversion: 2.1 time: 0.400007 Nov 02 13:33:58.009708 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3599/7740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:57 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 1558 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:58.010552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4e65db8-1890-4a59-96bf-856774b99b94 req-d2029bb9-a404-4cc5-b3d3-4f8e93e0d202 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:58.011370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4e65db8-1890-4a59-96bf-856774b99b94 req-d2029bb9-a404-4cc5-b3d3-4f8e93e0d202 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:58.012115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a4e65db8-1890-4a59-96bf-856774b99b94 req-d2029bb9-a404-4cc5-b3d3-4f8e93e0d202 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:58.025257 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a4e65db8-1890-4a59-96bf-856774b99b94 req-d2029bb9-a404-4cc5-b3d3-4f8e93e0d202 service nova] Creating event network-vif-deleted:e329ff7c-eda8-4235-8899-2ca914cac42d for instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea on n-h2-855650-5 Nov 02 13:33:58.031070 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a4e65db8-1890-4a59-96bf-856774b99b94 req-d2029bb9-a404-4cc5-b3d3-4f8e93e0d202 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050527 Nov 02 13:33:58.032125 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4142/7741] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:59.036595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:59.037225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] [instance: 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:59.044484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:59.044988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:59.045431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:59.046204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:59.046663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:59.047093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:59.061935 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] HTTP exception thrown: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea could not be found. Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Request method failure captured: Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea HTTP/1.1 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnFNI0UX2JJSHF-XcCrn6YLJ-j0FAP1hX2LkkvtaJJFsy_77QCKSx6-J4mYwfylwvcmJ4piyuCtVTVWZ5dQeUtqLS9cf_SAddmxcsn_5s1_aUqwVJdrA9iI280eMify8-rsVt_DbGbYsuaL7mC3NUgrRSlfFERKmpOlqQ5z6-z2pjx0 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d1328b8f777e4cccb607e45f2799c346"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: d1328b8f777e4cccb607e45f2799c346 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-23737559 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 9caa083a1f984b02a9b9476c15260fb2 Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestEncryptedCinderVolumes-23737559-project Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea could not be found. Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '0c36ed94-2f5f-49aa-8cd8-56f6cde373ea'} Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea could not be found. Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea could not be found. Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:59.064085 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea could not be found. Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Returning 404 to user: Instance 0c36ed94-2f5f-49aa-8cd8-56f6cde373ea could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d31e3dbf-6fa2-4af4-a4ff-a060a5945a79 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea" status: 404 len: 111 microversion: 2.1 time: 0.034500 Nov 02 13:33:59.071969 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3600/7742] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:59 2022] GET /compute/v2.1/servers/0c36ed94-2f5f-49aa-8cd8-56f6cde373ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:33:59.085670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1139622-489f-41fc-abd3-be05cb36f217 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] Calling method '.version_select at 0x7f228c0ea9d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:59.113461 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1139622-489f-41fc-abd3-be05cb36f217 tempest-TestEncryptedCinderVolumes-23737559 tempest-TestEncryptedCinderVolumes-23737559-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-927518923" status: 202 len: 0 microversion: 2.1 time: 0.038093 Nov 02 13:33:59.114298 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4143/7743] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Nov 2 13:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-927518923 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:34:29.014221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7716785e-43ad-425c-92a0-0ba5dd8e9215 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'create', calling method: .version_select at 0x7f228e874670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1145864942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADBXBpTy1Z3ykbdbCQigC8m3JFttSvEz1FSRQLShoS0zZl58C5GpxxechLcS8wFFeElhc/MAV0e1jeRAmP3Y2Q+UfMqs0tTJv3aqHVZfwHxcTpbiXrA3o5QJCSoiOlsqw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:29.020038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=14 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:29.020705 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=38 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:29.034498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7716785e-43ad-425c-92a0-0ba5dd8e9215 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Getting quotas for project df1a80d52bdb4bbaba75dd59767f6166. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:29.040655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7716785e-43ad-425c-92a0-0ba5dd8e9215 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Getting quotas for user a8adf0a30cdb4034958b13bbde7b20ba and project df1a80d52bdb4bbaba75dd59767f6166. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:29.066373 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7716785e-43ad-425c-92a0-0ba5dd8e9215 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056223 Nov 02 13:34:29.067161 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3601/7744] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:34:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:29.115950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:29.116754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:29.122081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-878568545", "imageRef": "15b32928-b4fb-4660-bf48-7b43b113830d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1145864942", "networks": [{"uuid": "26526fcc-2226-4fe8-8bf6-1c0dc94020a4"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:29.176953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] validate_networks() for [('26526fcc-2226-4fe8-8bf6-1c0dc94020a4', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:34:29.565986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:34:29.566437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:34:29.566950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:34:29.567379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:34:29.567843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:34:29.577954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:29.578980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:29.579432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:29.580185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:29.580683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:29.581159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:29.599487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Getting quotas for project df1a80d52bdb4bbaba75dd59767f6166. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:29.604793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Getting quotas for user a8adf0a30cdb4034958b13bbde7b20ba and project df1a80d52bdb4bbaba75dd59767f6166. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:29.621677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:34:29.624189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b32928-b4fb-4660-bf48-7b43b113830d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:34:29.671103 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9feb8139-e58c-4768-bb28-7d8d3d4d76c4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557398 Nov 02 13:34:29.671763 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4144/7745] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:34:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:34:29.682809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b2d5fca0-f2b7-4efc-b0b4-e6e1c4f6252c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:29.683431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b2d5fca0-f2b7-4efc-b0b4-e6e1c4f6252c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:29.740979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b2d5fca0-f2b7-4efc-b0b4-e6e1c4f6252c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:29.752072 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b2d5fca0-f2b7-4efc-b0b4-e6e1c4f6252c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1258 microversion: 2.1 time: 0.073092 Nov 02 13:34:29.752889 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3602/7746] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:29 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:30.777548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:30.778265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:30.786187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:30.786705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:30.787167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:30.787895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:30.788567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:30.789015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:30.864695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:30.873151 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c3f8a44-1359-4a72-8959-7c223a6e5c85 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1318 microversion: 2.1 time: 0.100363 Nov 02 13:34:30.881405 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4145/7747] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:30 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:31.898932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:31.900326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:31.909040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:31.909753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:31.910522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:31.911414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:31.912041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:31.912796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:32.101334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:32.112309 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5f0688a-edf2-436c-950b-73b30f40e399 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.218168 Nov 02 13:34:32.113099 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3603/7748] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:31 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:33.136251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:33.137811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:33.145987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:33.146628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:33.147164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.147929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:33.148836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:33.149299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.291912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:33.304813 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-650557d4-c471-4b53-8aab-90dd5430405e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.168813 Nov 02 13:34:33.305633 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4146/7749] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:33 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:34.328414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:34.329240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:34.336643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:34.337150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:34.337605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:34.338384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:34.338964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:34.339293 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:34.490606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:34.498869 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-04fb96b8-06ce-42bc-96d6-e68874f6028a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.174546 Nov 02 13:34:34.499654 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3604/7750] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:34 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:35.523248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:35.523936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:35.530798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.531320 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.531865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.532593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.533067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.533509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.692247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:35.703495 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43f0bac0-74ed-4a75-8ba4-8532dbc2a57e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.184943 Nov 02 13:34:35.704547 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4147/7751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:35 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:36.728770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:36.729470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:36.736379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.736876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.737351 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.738140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.738607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.739044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.886204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:36.895062 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dcd0f1f5-7932-4024-978b-ef0965d0ee29 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.170252 Nov 02 13:34:36.895735 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3605/7752] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:36 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:37.920510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:37.921373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:37.931361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:37.931869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:37.932322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:37.933042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:37.933508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:37.933948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:38.083145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:38.091497 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-073d17d9-f927-44c2-b50f-fba3418b2d64 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.175285 Nov 02 13:34:38.092184 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4148/7753] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:37 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:39.115631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:39.116281 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:39.123308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:39.123797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:39.124243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:39.124942 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:39.125401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:39.125833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:39.260441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:39.268262 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-094096e3-b3a4-43a7-aaae-b3fe60b2c9e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.157090 Nov 02 13:34:39.268854 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3606/7754] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:39 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:40.292392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:40.293018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:40.295402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:40.296078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:40.302820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:40.303326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:40.303786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:40.304501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:40.304972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:40.305418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:40.440823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:40.448928 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6fb2c88-0ae6-4449-911a-cc9218c84088 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.160734 Nov 02 13:34:40.449777 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4149/7755] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:40 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:41.472261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:41.472864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:41.474844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:41.481171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:41.481669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:41.482154 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:41.482850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:41.483309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:41.483733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:41.613684 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:41.622096 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ba6db0e2-4e60-4222-a1f4-e7e4be87b6b3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.153708 Nov 02 13:34:41.622669 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3607/7756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:41 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:42.646843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:42.647414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:42.654405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:42.654919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:42.655380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:42.656094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:42.656565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:42.657010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:42.792348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:42.800131 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7aaebbcb-3e01-4d06-a481-76c224639cce tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.157385 Nov 02 13:34:42.800705 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4150/7757] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:42 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:43.826197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:43.826831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:43.834969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:43.835484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:43.835934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:43.836660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:43.837125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:43.837562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:44.089161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:44.097933 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-efb70112-1108-4517-a578-229ab22ab5f3 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.277192 Nov 02 13:34:44.098574 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3608/7758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:43 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:44.230387 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d9d3b35a-513f-48af-910d-64c6e41911c4 req-31f3fa0e-e05d-4bd3-a23a-0e209f6282fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4109c3ac-0ba6-4f8c-b462-35e8894fde04", "tag": "fc63e919-89a5-401d-ad35-faf322ad83e6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:44.243456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9d3b35a-513f-48af-910d-64c6e41911c4 req-31f3fa0e-e05d-4bd3-a23a-0e209f6282fe service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:44.243946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9d3b35a-513f-48af-910d-64c6e41911c4 req-31f3fa0e-e05d-4bd3-a23a-0e209f6282fe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:44.244920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d9d3b35a-513f-48af-910d-64c6e41911c4 req-31f3fa0e-e05d-4bd3-a23a-0e209f6282fe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:44.257552 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d9d3b35a-513f-48af-910d-64c6e41911c4 req-31f3fa0e-e05d-4bd3-a23a-0e209f6282fe service nova] Creating event network-changed:fc63e919-89a5-401d-ad35-faf322ad83e6 for instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 on n-h2-855650-5 Nov 02 13:34:44.263336 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d9d3b35a-513f-48af-910d-64c6e41911c4 req-31f3fa0e-e05d-4bd3-a23a-0e209f6282fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036610 Nov 02 13:34:44.264028 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4151/7759] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:45.122254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:45.122879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:45.130129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:45.131265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:45.131757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:45.132788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:45.133304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:45.133776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:45.263076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:45.271078 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8dcc6b57-7e90-4087-ade5-d6f1df36d5f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.152811 Nov 02 13:34:45.271679 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3609/7760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:45 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:46.295655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:46.296388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:46.302734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:46.303238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:46.303704 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:46.304425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:46.304902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:46.305350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:46.436275 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:46.444627 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fa7b9a55-64a5-4cf8-94f0-243a9e2d4277 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.154295 Nov 02 13:34:46.445210 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4152/7761] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:46 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:47.470409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:47.471425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:47.479894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:47.480527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:47.480977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:47.481687 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:47.482175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:47.482622 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:47.677340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:47.685388 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b680da7-87d4-4c11-9875-0844d0938757 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.220421 Nov 02 13:34:47.685988 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3610/7762] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:47 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:48.711789 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:48.712932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:48.721136 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:48.721640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:48.722142 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:48.722869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:48.723344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:48.723820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:48.869708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:48.877758 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b129b66-afbe-42c5-93cf-f3e3325a30f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.171588 Nov 02 13:34:48.878241 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4153/7763] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:48 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:49.900846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:49.901419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:49.908467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:49.908951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:49.909391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:49.910137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:49.910590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:49.911011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:50.044514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:50.052881 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-72dfe53e-771c-4d6d-a693-01c298192886 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.155449 Nov 02 13:34:50.053461 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3611/7764] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:49 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:50.698768 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7ca961cd-f3f9-427c-bd7f-d40785bcf813 req-95c1f6cf-f492-40b3-8e2d-4495ecc8c48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4109c3ac-0ba6-4f8c-b462-35e8894fde04", "name": "network-vif-plugged", "status": "completed", "tag": "fc63e919-89a5-401d-ad35-faf322ad83e6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:50.710469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7ca961cd-f3f9-427c-bd7f-d40785bcf813 req-95c1f6cf-f492-40b3-8e2d-4495ecc8c48f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:50.711052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7ca961cd-f3f9-427c-bd7f-d40785bcf813 req-95c1f6cf-f492-40b3-8e2d-4495ecc8c48f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:50.711524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7ca961cd-f3f9-427c-bd7f-d40785bcf813 req-95c1f6cf-f492-40b3-8e2d-4495ecc8c48f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:50.724084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7ca961cd-f3f9-427c-bd7f-d40785bcf813 req-95c1f6cf-f492-40b3-8e2d-4495ecc8c48f service nova] Creating event network-vif-plugged:fc63e919-89a5-401d-ad35-faf322ad83e6 for instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 on n-h2-855650-5 Nov 02 13:34:50.729242 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7ca961cd-f3f9-427c-bd7f-d40785bcf813 req-95c1f6cf-f492-40b3-8e2d-4495ecc8c48f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 Nov 02 13:34:50.729865 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4154/7765] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:51.076195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:51.076800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:51.084015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:51.084523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:51.084966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:51.085676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:51.086178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:51.086615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:51.225108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:51.233195 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fd68dd66-ed93-4b33-ac7f-f2f4bcf02dbb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.161190 Nov 02 13:34:51.233795 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3612/7766] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:51 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:52.260297 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:52.261079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:52.268012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:52.268523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:52.268983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:52.269722 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:52.270336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:52.270705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:52.414179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:52.422553 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-24487987-4e57-4800-a424-0ce71c4437f5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1358 microversion: 2.1 time: 0.168138 Nov 02 13:34:52.423159 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4155/7767] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:52 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:53.445824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:53.446521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:53.453542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.454074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.454516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.455229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.455686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.456116 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.589836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:53.597752 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb836375-c328-4fa1-bf88-20d4bc18e8c1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1548 microversion: 2.1 time: 0.156018 Nov 02 13:34:53.598362 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3613/7768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:53 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:53.620390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:53.621009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:53.627986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.628526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.628977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.629690 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.630248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.630689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.764701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:53.773589 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-803cc1ad-8ca6-49d5-a200-df2ca04cd37b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1548 microversion: 2.1 time: 0.157047 Nov 02 13:34:53.774212 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4156/7769] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:53 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:53.795706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:53.800493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:53.801164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Searching by: {'deleted': False, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:34:53.807085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.807565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.808001 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.808733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.809288 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.809604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.835760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:34:53.863062 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8dee3d8f-69ac-4f03-a5eb-5b0a07b52a3a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071038 Nov 02 13:34:53.863548 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3614/7770] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 13:34:53 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:53.877781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:53.878446 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:53.887904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.888427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.888953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.889692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.890204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.890651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:54.032631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:54.041381 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b28c4f0-3d8d-4535-b8a5-cdf0668b7ce0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1548 microversion: 2.1 time: 0.167576 Nov 02 13:34:54.041991 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4157/7771] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:53 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:55.622323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a360c993-2633-4f59-b74d-0f5680086eb6"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:55.624731 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:55.632524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:55.633020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:55.633466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:55.634228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:55.634671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:55.635098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:55.905121 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4a01c365-5209-4060-a611-57b912b843af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286638 Nov 02 13:34:55.912149 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3615/7772] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:34:55 2022] POST /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:08.986513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:08.987160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:08.990269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:08.991196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=72 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:08.997922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:08.998457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:08.998925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:08.999859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:09.000342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:09.000793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:09.133400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:09.141857 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b4e180a3-21d3-475b-a260-256a9e46444b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1594 microversion: 2.1 time: 0.159738 Nov 02 13:35:09.142465 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4158/7773] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:08 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:10.879021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:10.881358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:10.882436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:11.047422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-56e109a3-2416-4e97-b3e2-fb2cd7c068f9 req-7fbacb56-566c-4843-8daf-eea8676c4ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4109c3ac-0ba6-4f8c-b462-35e8894fde04", "tag": "fc63e919-89a5-401d-ad35-faf322ad83e6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:11.060644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-56e109a3-2416-4e97-b3e2-fb2cd7c068f9 req-7fbacb56-566c-4843-8daf-eea8676c4ee9 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:11.061242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-56e109a3-2416-4e97-b3e2-fb2cd7c068f9 req-7fbacb56-566c-4843-8daf-eea8676c4ee9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:11.061927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-56e109a3-2416-4e97-b3e2-fb2cd7c068f9 req-7fbacb56-566c-4843-8daf-eea8676c4ee9 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:11.078318 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-56e109a3-2416-4e97-b3e2-fb2cd7c068f9 req-7fbacb56-566c-4843-8daf-eea8676c4ee9 service nova] Creating event network-changed:fc63e919-89a5-401d-ad35-faf322ad83e6 for instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 on n-h2-855650-5 Nov 02 13:35:11.085166 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-56e109a3-2416-4e97-b3e2-fb2cd7c068f9 req-7fbacb56-566c-4843-8daf-eea8676c4ee9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207749 Nov 02 13:35:11.086113 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3616/7774] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:12.150319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1182599435"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:12.151634 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:12.160354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.161281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.161911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.163533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.164259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.164927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.328703 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.network.security_group_api [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Adding security group ecb47961-35a2-4a84-8768-a7f3f87bf7fb to port fc63e919-89a5-401d-ad35-faf322ad83e6 Nov 02 13:35:12.673805 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2125470b-a151-4cbd-92d2-0e0e75ec3ecd tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action" status: 202 len: 0 microversion: 2.1 time: 0.529265 Nov 02 13:35:12.675591 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4159/7775] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:35:12 2022] POST /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:35:12.690585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:12.691307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:12.719652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.722633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.723328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.724777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.726615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.727273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.794471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ede8a0d3-7efe-4289-b691-4f1e7408780d req-89845118-5f3d-4ba5-87c8-ee36b86b7f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4109c3ac-0ba6-4f8c-b462-35e8894fde04", "tag": "fc63e919-89a5-401d-ad35-faf322ad83e6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:12.806073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ede8a0d3-7efe-4289-b691-4f1e7408780d req-89845118-5f3d-4ba5-87c8-ee36b86b7f51 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.806808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ede8a0d3-7efe-4289-b691-4f1e7408780d req-89845118-5f3d-4ba5-87c8-ee36b86b7f51 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.807444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ede8a0d3-7efe-4289-b691-4f1e7408780d req-89845118-5f3d-4ba5-87c8-ee36b86b7f51 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.819647 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ede8a0d3-7efe-4289-b691-4f1e7408780d req-89845118-5f3d-4ba5-87c8-ee36b86b7f51 service nova] Creating event network-changed:fc63e919-89a5-401d-ad35-faf322ad83e6 for instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 on n-h2-855650-5 Nov 02 13:35:12.825240 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ede8a0d3-7efe-4289-b691-4f1e7408780d req-89845118-5f3d-4ba5-87c8-ee36b86b7f51 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131098 Nov 02 13:35:12.825925 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4160/7776] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:13.077187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:13.087126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-86f9a495-ada7-4fce-b768-1b5d0297b427 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1760 microversion: 2.1 time: 0.406651 Nov 02 13:35:13.088117 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3617/7777] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:12 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1760 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:41.723861 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2bebab1-6133-44ed-afdc-10bb19e356b1] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 13:37:41.724689 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:37:41.725277 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:41.726056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:41.727482 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:37:41.727698 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action (ip 10.222.0.45) !!! Nov 02 13:37:41.728837 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:37:41.728996 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action (ip 10.222.0.45) !!! Nov 02 13:37:41.729995 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:37:41.730709 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action (ip 10.222.0.45) !!! Nov 02 13:37:41.737822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:41.740782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:41.749925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.750550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.751008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:41.751728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.752218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.752649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:41.832397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82bee372-2023-4c3d-ab55-5dbe16a803af tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action" status: 202 len: 0 microversion: 2.1 time: 0.110318 Nov 02 13:37:41.833263 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4161/7778] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:37:41 2022] POST /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:37:41.839770 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a729f393-f18f-46ff-992e-9b20bef5c4cb] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:37:41.840697 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:41.841914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:41.843089 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:37:41.843089 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 (ip 10.222.0.45) !!! Nov 02 13:37:41.844877 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:37:41.845128 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 (ip 10.222.0.45) !!! Nov 02 13:37:41.851585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:41.852197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:41.864710 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.865215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.865789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:41.866483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.866996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.867381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:42.108643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:42.118316 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-245e12dd-0f8a-417a-9ef4-a3939fcebce8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1762 microversion: 2.1 time: 0.280639 Nov 02 13:37:42.119041 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3618/7779] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:41 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1762 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:43.147093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:43.147806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:43.156701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:43.157207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:43.157665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:43.158410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:43.158883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:43.159327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:43.164265 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2bebab1-6133-44ed-afdc-10bb19e356b1] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 39516. Nov 02 13:37:43.164994 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 39518. Nov 02 13:37:43.325982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:43.336379 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e6f0b68-7a45-45ad-9aa0-2187452bac82 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1767 microversion: 2.1 time: 0.195181 Nov 02 13:37:43.337580 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4162/7780] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:43 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1767 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:44.361764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:44.362417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:44.371229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:44.371721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:44.372172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:44.372890 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:44.373354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:44.373820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:44.380255 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] [a729f393-f18f-46ff-992e-9b20bef5c4cb] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 39524. Nov 02 13:37:44.531406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:44.540769 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64cbc51c-17d4-4af5-82c0-db070fc42ae9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1760 microversion: 2.1 time: 0.183694 Nov 02 13:37:44.542562 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3619/7781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:44 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1760 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:28.743802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:28.744854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:28.844773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1182599435"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:28.845336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:28.851509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:28.852015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:28.852471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:28.853188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:28.853662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:28.854144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.037734 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.network.security_group_api [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Removing security group ecb47961-35a2-4a84-8768-a7f3f87bf7fb from port fc63e919-89a5-401d-ad35-faf322ad83e6 Nov 02 13:39:29.349357 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-739a7a37-0909-45bf-aacc-55b804e5444d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action" status: 202 len: 0 microversion: 2.1 time: 0.607845 Nov 02 13:39:29.350024 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4163/7782] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:39:28 2022] POST /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:29.358422 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:29.359217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:29.360113 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:39:29.360306 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.45) !!! Nov 02 13:39:29.373690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-8cba6736-16d5-48db-9feb-5782e6784a3e req-5a203494-0e8e-4aae-802a-6e3f1e20264a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4109c3ac-0ba6-4f8c-b462-35e8894fde04", "tag": "fc63e919-89a5-401d-ad35-faf322ad83e6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:29.403856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8cba6736-16d5-48db-9feb-5782e6784a3e req-5a203494-0e8e-4aae-802a-6e3f1e20264a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:29.404142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8cba6736-16d5-48db-9feb-5782e6784a3e req-5a203494-0e8e-4aae-802a-6e3f1e20264a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:29.404564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-8cba6736-16d5-48db-9feb-5782e6784a3e req-5a203494-0e8e-4aae-802a-6e3f1e20264a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.428413 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-8cba6736-16d5-48db-9feb-5782e6784a3e req-5a203494-0e8e-4aae-802a-6e3f1e20264a service nova] Creating event network-changed:fc63e919-89a5-401d-ad35-faf322ad83e6 for instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 on n-h2-855650-5 Nov 02 13:39:29.446129 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-8cba6736-16d5-48db-9feb-5782e6784a3e req-5a203494-0e8e-4aae-802a-6e3f1e20264a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089868 Nov 02 13:39:29.449894 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3620/7783] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:30.612141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:30.612750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:30.618973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.619556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.620087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.620877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.621454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.622826 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.711974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lazy-loading 'services' on Instance uuid 4109c3ac-0ba6-4f8c-b462-35e8894fde04 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:30.789264 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1885d863-4b2b-42f6-a778-9538673130cf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments/a360c993-2633-4f59-b74d-0f5680086eb6" status: 202 len: 0 microversion: 2.1 time: 0.182044 Nov 02 13:39:30.789537 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4164/7784] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:39:30 2022] DELETE /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments/a360c993-2633-4f59-b74d-0f5680086eb6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:30.800690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:30.803082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:30.810571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.811115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.811582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.812383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.812886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.813306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.848815 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f0987083-8fc3-4fec-9ae2-a2f28260d64c tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053756 Nov 02 13:39:30.854079 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3621/7785] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:39:30 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:31.463127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-44306508-a7ae-48f3-bdea-e9af406dce0d req-7557cc34-0d68-4283-a25c-58da6aa874a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4109c3ac-0ba6-4f8c-b462-35e8894fde04", "tag": "fc63e919-89a5-401d-ad35-faf322ad83e6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:31.473715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-44306508-a7ae-48f3-bdea-e9af406dce0d req-7557cc34-0d68-4283-a25c-58da6aa874a0 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:31.474259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-44306508-a7ae-48f3-bdea-e9af406dce0d req-7557cc34-0d68-4283-a25c-58da6aa874a0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:31.474727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-44306508-a7ae-48f3-bdea-e9af406dce0d req-7557cc34-0d68-4283-a25c-58da6aa874a0 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:31.487081 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-44306508-a7ae-48f3-bdea-e9af406dce0d req-7557cc34-0d68-4283-a25c-58da6aa874a0 service nova] Creating event network-changed:fc63e919-89a5-401d-ad35-faf322ad83e6 for instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 on n-h2-855650-5 Nov 02 13:39:31.492419 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-44306508-a7ae-48f3-bdea-e9af406dce0d req-7557cc34-0d68-4283-a25c-58da6aa874a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034479 Nov 02 13:39:31.493406 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4165/7786] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:31.862902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:31.865682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:31.873719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:31.874249 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:31.874685 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:31.875404 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:31.875852 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:31.876277 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:31.913931 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-03f505d7-aaed-490a-a9f2-781c930d6234 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055621 Nov 02 13:39:31.914913 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3622/7787] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:39:31 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:32.927958 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:32.930351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:32.937917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:32.938372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:32.938842 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:32.939565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:32.940035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:32.940481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:32.975094 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90ada397-8168-455f-a978-528c2f233839 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051513 Nov 02 13:39:32.975690 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4166/7788] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:39:32 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:33.990550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:33.992669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:33.999104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:33.999594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:34.000038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.000742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:34.001228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:34.001606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.033999 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bb6ef786-fa91-4d4b-adfc-8a6dc8d73106 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048508 Nov 02 13:39:34.034986 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3623/7789] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:39:33 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:35.047659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:35.049914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:35.057556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:35.058131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:35.058592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:35.060051 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:35.060525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:35.060972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:35.094609 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2cdef969-fb59-42cd-a8c1-89b216cb315f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 Nov 02 13:39:35.095115 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4167/7790] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:39:35 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:36.107801 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:36.110086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:36.116944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:36.117436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:36.117883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:36.118618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:36.119100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:36.119532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:36.150143 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a2a92f15-b88f-4d4f-bf0d-41a8c648a9d5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046390 Nov 02 13:39:36.150726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3624/7791] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:39:36 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:39:36.161761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:36.162345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:36.169107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:36.169610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:36.170094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:36.170818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:36.171285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:36.171730 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:36.247692 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] HTTP exception thrown: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 is not attached to volume a360c993-2633-4f59-b74d-0f5680086eb6 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Request method failure captured: Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments/a360c993-2633-4f59-b74d-0f5680086eb6 HTTP/1.1 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnHViqH9Asr7AA8gsVv0xc5MUSFHq979k_lfERBY1aYvXNpr-ZH5f5_bM9b1ezfq6TxUoXtzIwlpKYVwhFvvBtBGnItHqfsI86oOtEZeC32dOF_JyEtRBoT43Vy1JlDNCzfer_Fse1JyMpXPO8g3ATclvXSqDE4Fg3ZTKL_iVMqzM8A Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: df1a80d52bdb4bbaba75dd59767f6166 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: df1a80d52bdb4bbaba75dd59767f6166 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestMinimumBasicScenario-382849423-project Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a8adf0a30cdb4034958b13bbde7b20ba Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestMinimumBasicScenario-382849423-project Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 is not attached to volume a360c993-2633-4f59-b74d-0f5680086eb6 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'server_id': '4109c3ac-0ba6-4f8c-b462-35e8894fde04', 'id': 'a360c993-2633-4f59-b74d-0f5680086eb6'} Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a360c993-2633-4f59-b74d-0f5680086eb6. Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 is not attached to volume a360c993-2633-4f59-b74d-0f5680086eb6 Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:36.249411 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:36.254066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:36.254066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:36.254066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 is not attached to volume a360c993-2633-4f59-b74d-0f5680086eb6 Nov 02 13:39:36.254066 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:36.254066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Returning 404 to user: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 is not attached to volume a360c993-2633-4f59-b74d-0f5680086eb6 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:36.254066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38e8c262-6c52-4b90-a989-3fb9a1b3ebec tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments/a360c993-2633-4f59-b74d-0f5680086eb6" status: 404 len: 154 microversion: 2.1 time: 0.093340 Nov 02 13:39:36.254066 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4168/7792] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:39:36 2022] DELETE /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04/os-volume_attachments/a360c993-2633-4f59-b74d-0f5680086eb6 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:39:39.511407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:39.511904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:39.519255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.519743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.520185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.520887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.521378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.521809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.550333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:39:39.632641 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-89314351-b578-4b5b-a756-534ec2cdd5ff tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 204 len: 0 microversion: 2.1 time: 0.124785 Nov 02 13:39:39.633575 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3625/7793] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:39:39 2022] DELETE /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:39:39.642160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:39.642912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:39.653685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.654330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.654866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.655691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.656440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.656802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.801339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:39.810243 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-482c4448-4122-4efa-b1d5-1204793b794d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1554 microversion: 2.1 time: 0.171502 Nov 02 13:39:39.810939 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4169/7794] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:39 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:40.834535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:40.835235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:40.842321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:40.842810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:40.843256 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:40.843991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:40.844445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:40.844884 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:40.982479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:40.990770 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-047b88c2-35a9-43ef-81a2-ddeaf8528bf8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1554 microversion: 2.1 time: 0.160595 Nov 02 13:39:40.991385 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3626/7795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:40 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:42.015685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:42.016449 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:42.023534 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:42.024054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:42.024521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:42.025250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:42.025725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:42.026202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:42.163714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:42.172180 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8c7c126-0e2f-4f64-96a7-cd0d39f92909 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 200 len: 1554 microversion: 2.1 time: 0.161130 Nov 02 13:39:42.172769 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4170/7796] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:42 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:42.301373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-b37ee953-116e-4c80-8b69-b184f4f45d1f req-a7804c46-4ffd-412c-b70a-424198f30713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4109c3ac-0ba6-4f8c-b462-35e8894fde04", "name": "network-vif-deleted", "tag": "fc63e919-89a5-401d-ad35-faf322ad83e6"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:42.314869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b37ee953-116e-4c80-8b69-b184f4f45d1f req-a7804c46-4ffd-412c-b70a-424198f30713 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:42.315345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b37ee953-116e-4c80-8b69-b184f4f45d1f req-a7804c46-4ffd-412c-b70a-424198f30713 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:42.315786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-b37ee953-116e-4c80-8b69-b184f4f45d1f req-a7804c46-4ffd-412c-b70a-424198f30713 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:42.329659 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-b37ee953-116e-4c80-8b69-b184f4f45d1f req-a7804c46-4ffd-412c-b70a-424198f30713 service nova] Creating event network-vif-deleted:fc63e919-89a5-401d-ad35-faf322ad83e6 for instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 on n-h2-855650-5 Nov 02 13:39:42.337456 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-b37ee953-116e-4c80-8b69-b184f4f45d1f req-a7804c46-4ffd-412c-b70a-424198f30713 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038946 Nov 02 13:39:42.338304 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3627/7797] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:43.197131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:43.197760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: 4109c3ac-0ba6-4f8c-b462-35e8894fde04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:43.204728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:43.205237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:43.205702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:43.206452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:43.206925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:43.207371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:43.221662 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] HTTP exception thrown: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 could not be found. Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Request method failure captured: Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 HTTP/1.1 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnHViqH9Asr7AA8gsVv0xc5MUSFHq979k_lfERBY1aYvXNpr-ZH5f5_bM9b1ezfq6TxUoXtzIwlpKYVwhFvvBtBGnItHqfsI86oOtEZeC32dOF_JyEtRBoT43Vy1JlDNCzfer_Fse1JyMpXPO8g3ATclvXSqDE4Fg3ZTKL_iVMqzM8A Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: df1a80d52bdb4bbaba75dd59767f6166 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: df1a80d52bdb4bbaba75dd59767f6166 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestMinimumBasicScenario-382849423-project Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: a8adf0a30cdb4034958b13bbde7b20ba Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestMinimumBasicScenario-382849423-project Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 could not be found. Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '4109c3ac-0ba6-4f8c-b462-35e8894fde04'} Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 could not be found. Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 could not be found. Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:43.223268 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 could not be found. Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Returning 404 to user: Instance 4109c3ac-0ba6-4f8c-b462-35e8894fde04 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-32d5b1a6-1874-46b6-9dbe-abd508ed4819 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04" status: 404 len: 111 microversion: 2.1 time: 0.031976 Nov 02 13:39:43.227721 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4171/7798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:43 2022] GET /compute/v2.1/servers/4109c3ac-0ba6-4f8c-b462-35e8894fde04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:39:43.234207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a8144243-8f3e-4b07-81f8-d824d83587ca tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '.version_select at 0x7f228d442ee0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:43.257739 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a8144243-8f3e-4b07-81f8-d824d83587ca tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1145864942" status: 202 len: 0 microversion: 2.1 time: 0.027709 Nov 02 13:39:43.258364 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3628/7799] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Nov 2 13:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1145864942 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:52.454098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf513c33-2ca3-465d-9142-4468b8aa4668 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'create', calling method: .version_select at 0x7f228c165790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-621588698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEUGCOgn/nGtoZrrp+/kQ170ej9xGzTxXs9e3hjGfSNxJkl+3TytVLOVuNekpNWnU9jkXIiqaaq4i7sJwbCnhTYWc8gLt4rqPhO0HcpO2uuF+c13Vd8eKkTsL1F9V44GA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:52.470933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-cf513c33-2ca3-465d-9142-4468b8aa4668 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Getting quotas for project df1a80d52bdb4bbaba75dd59767f6166. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:52.476974 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-cf513c33-2ca3-465d-9142-4468b8aa4668 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Getting quotas for user a8adf0a30cdb4034958b13bbde7b20ba and project df1a80d52bdb4bbaba75dd59767f6166. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:52.506516 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf513c33-2ca3-465d-9142-4468b8aa4668 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056457 Nov 02 13:39:52.508314 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4172/7800] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:39:52 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:52.554755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:52.559451 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1936885943", "imageRef": "14bb0f22-8a85-43a0-bf85-3a15e2cf40c9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-621588698", "networks": [{"uuid": "26526fcc-2226-4fe8-8bf6-1c0dc94020a4"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:52.614357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] validate_networks() for [('26526fcc-2226-4fe8-8bf6-1c0dc94020a4', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:39:52.848120 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a618658-f83a-4e1f-aba5-6ee48de50ace] AMQP server on 10.222.0.45:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 02 13:39:53.346358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:39:53.346780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:39:53.347306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:39:53.347702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:39:53.348147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:39:53.358741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.359145 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.359569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.360406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.360779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.361164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.378714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Getting quotas for project df1a80d52bdb4bbaba75dd59767f6166. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:53.384250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Getting quotas for user a8adf0a30cdb4034958b13bbde7b20ba and project df1a80d52bdb4bbaba75dd59767f6166. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:53.397883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:39:53.400394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='14bb0f22-8a85-43a0-bf85-3a15e2cf40c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:39:53.448888 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bda67af7-bb17-4baf-8bf2-919436672f5e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895910 Nov 02 13:39:53.450387 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3629/7801] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:39:53.458580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:53.463141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9e7fff2-ccbc-4999-b62f-8f0ae7bd8364 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:53.463788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9e7fff2-ccbc-4999-b62f-8f0ae7bd8364 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:53.522824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9e7fff2-ccbc-4999-b62f-8f0ae7bd8364 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:53.532892 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9e7fff2-ccbc-4999-b62f-8f0ae7bd8364 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1258 microversion: 2.1 time: 0.075103 Nov 02 13:39:53.533493 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4173/7802] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:53 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:54.557906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:54.558765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:54.566836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:54.567325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:54.567770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:54.568476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:54.568932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:54.569360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:54.575175 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a618658-f83a-4e1f-aba5-6ee48de50ace] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 39748. Nov 02 13:39:54.650672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:54.660557 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dccdbd47-d2cc-46f7-bc64-216bd32f26c7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1310 microversion: 2.1 time: 0.108113 Nov 02 13:39:54.661164 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3630/7803] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:54 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:55.686848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:55.688378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:55.700402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:55.701395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:55.702109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:55.703952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:55.704683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:55.705188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:55.904459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:55.914657 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d06bcf4c-4803-462f-8046-15fae5fbb462 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.232851 Nov 02 13:39:55.926805 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4174/7804] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:55 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:56.938924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:56.939552 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:56.947380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.948272 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.948756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.950284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.950753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.951187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:57.103893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:57.114405 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c0bba21d-38c4-45e7-b0f6-df7d68857d9f tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.179251 Nov 02 13:39:57.115993 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3631/7805] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:56 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:58.138775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:58.139720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:58.147970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.148521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.148960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.149691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.150209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.150659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.298359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:58.308963 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9fc0636-70cf-4681-b854-cafda172a404 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.173854 Nov 02 13:39:58.310665 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4175/7806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:58 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:59.334618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:59.335502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:59.344265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.344763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.345464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.346271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.346878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.347306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.535020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:59.543617 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5273f0d-b987-4e19-a3f9-be3f5077165d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.212816 Nov 02 13:39:59.544294 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3632/7807] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:59 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:00.568094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:00.568872 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:00.571849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:00.580428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:00.581260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:00.582030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:00.583218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:00.584034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:00.585073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:00.738947 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:00.748128 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-402d850e-7381-4206-8881-6b7c238e65f9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.183972 Nov 02 13:40:00.748753 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4176/7808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:00 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:01.772353 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:01.772989 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:01.775832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:01.783091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:01.783728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:01.784134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:01.784849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:01.785305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:01.785740 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:01.944137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:01.953661 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-27c74015-0fdd-4447-be27-0ae549d9a9b8 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.185209 Nov 02 13:40:01.954495 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3633/7809] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:01 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:02.978075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:02.978654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:02.985687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.986224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.986679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:02.987398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.987860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.988299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:03.129450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:03.137719 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4295db23-d524-4261-aa31-279f92081b7e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.163699 Nov 02 13:40:03.138357 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4177/7810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:02 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:04.160743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:04.161296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:04.163950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:04.164606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:04.170331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:04.170816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:04.171252 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:04.171946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:04.172396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:04.172820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:04.306274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:04.314596 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-995a7e3e-9869-4b4e-a257-7412028ec3b9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.157882 Nov 02 13:40:04.315181 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3634/7811] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:04 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:05.338214 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:05.339442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:05.341457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:05.347809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:05.348318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:05.348781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:05.349532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:05.350030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:05.350480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:05.484311 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:05.491981 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2fc187f9-f179-4a30-b6d0-550158c417d4 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.157814 Nov 02 13:40:05.492565 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4178/7812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:05 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:06.514306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:06.514936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:06.522056 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:06.522562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:06.523015 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:06.523730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:06.524204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:06.524629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:06.664551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:06.673044 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab25afbd-9ea5-4ae0-8f31-f3f2e1bf272b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.162815 Nov 02 13:40:06.673626 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3635/7813] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:06 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:07.695562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:07.696198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:07.699746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-68b30bb5-2368-4de5-be39-1ab4c26e5944 req-26e390b3-2b8d-4b65-a23a-bcf6924937fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc48f9c4-367a-4a1f-9c30-634bc4a77a2e", "tag": "01d6a8dc-47d8-45f1-ad0b-d94270fd6564"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:07.705185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:07.706031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:07.706725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:07.707754 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:07.708485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:07.709231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:07.712837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-68b30bb5-2368-4de5-be39-1ab4c26e5944 req-26e390b3-2b8d-4b65-a23a-bcf6924937fe service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:07.713506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-68b30bb5-2368-4de5-be39-1ab4c26e5944 req-26e390b3-2b8d-4b65-a23a-bcf6924937fe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:07.713995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-68b30bb5-2368-4de5-be39-1ab4c26e5944 req-26e390b3-2b8d-4b65-a23a-bcf6924937fe service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:07.726453 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-68b30bb5-2368-4de5-be39-1ab4c26e5944 req-26e390b3-2b8d-4b65-a23a-bcf6924937fe service nova] Creating event network-changed:01d6a8dc-47d8-45f1-ad0b-d94270fd6564 for instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e on n-h2-855650-5 Nov 02 13:40:07.731739 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-68b30bb5-2368-4de5-be39-1ab4c26e5944 req-26e390b3-2b8d-4b65-a23a-bcf6924937fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036325 Nov 02 13:40:07.733360 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3636/7814] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:07.853658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:07.862744 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7cc5f76-f9b1-4b1d-bfec-d5b87890c96a tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.171142 Nov 02 13:40:07.863262 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4179/7815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:07 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:08.888237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:08.889734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:08.897845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:08.898376 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:08.898827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:08.899535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:08.899996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:08.900426 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:09.037300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:09.047600 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e51d639-f95d-4d50-b7b1-d9dcb9e932e7 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.164685 Nov 02 13:40:09.048291 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3637/7816] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:08 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:10.071008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:10.071728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:10.078975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:10.079486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:10.079973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:10.080689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:10.081164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:10.081608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:10.214158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:10.222618 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b712ff94-fd4b-4ce4-9bab-16e896817b2e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.155731 Nov 02 13:40:10.223212 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4180/7817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:10 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:11.246415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:11.247055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:11.254809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:11.255309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:11.255760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:11.256471 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:11.256932 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:11.257389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:11.390066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:11.398915 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ca26596-55aa-4732-955e-dbb618ad66bf tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.156297 Nov 02 13:40:11.399555 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3638/7818] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:11 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:12.423894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:12.424465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:12.431724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:12.432225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:12.432682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:12.433408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:12.433881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:12.434349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:12.577784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:12.586115 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea9e2805-140f-4cef-9c7d-f11205d0e998 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.166192 Nov 02 13:40:12.596078 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4181/7819] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:12 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:13.608961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:13.609565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:13.616643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:13.617136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:13.617585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:13.618325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:13.618782 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:13.619215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:13.804036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:13.811994 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9640b0cb-c1b7-4ea6-b7dd-93f14aa121db tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.207008 Nov 02 13:40:13.812593 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3639/7820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:13 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:14.739524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3b0a3e34-66de-4dc4-a3c4-4ac8442a50fb req-a64cb7ec-4cd4-4800-b7c2-6199f99a524b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc48f9c4-367a-4a1f-9c30-634bc4a77a2e", "name": "network-vif-plugged", "status": "completed", "tag": "01d6a8dc-47d8-45f1-ad0b-d94270fd6564"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:14.749392 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3b0a3e34-66de-4dc4-a3c4-4ac8442a50fb req-a64cb7ec-4cd4-4800-b7c2-6199f99a524b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:14.755260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3b0a3e34-66de-4dc4-a3c4-4ac8442a50fb req-a64cb7ec-4cd4-4800-b7c2-6199f99a524b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:14.755916 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3b0a3e34-66de-4dc4-a3c4-4ac8442a50fb req-a64cb7ec-4cd4-4800-b7c2-6199f99a524b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:14.768412 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3b0a3e34-66de-4dc4-a3c4-4ac8442a50fb req-a64cb7ec-4cd4-4800-b7c2-6199f99a524b service nova] Creating event network-vif-plugged:01d6a8dc-47d8-45f1-ad0b-d94270fd6564 for instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e on n-h2-855650-5 Nov 02 13:40:14.773695 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3b0a3e34-66de-4dc4-a3c4-4ac8442a50fb req-a64cb7ec-4cd4-4800-b7c2-6199f99a524b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095762 Nov 02 13:40:14.774542 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4182/7821] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:14.835857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:14.836456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:14.843866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:14.844656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:14.845108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:14.846040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:14.846497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:14.847179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:15.042294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:15.050053 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-601f7a54-8b63-4729-a20a-53f59786d500 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.218202 Nov 02 13:40:15.050638 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3640/7822] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:14 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:16.076460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:16.077175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:16.084638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:16.085144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:16.085595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:16.086336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:16.086805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:16.087248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:16.222011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:16.229771 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c850b9ff-1ee9-44d3-a358-ca57f4fbce52 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1358 microversion: 2.1 time: 0.157996 Nov 02 13:40:16.230378 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4183/7823] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:16 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:17.254210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:17.254816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:17.261910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.262405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.262953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.263657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.264111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.265306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.399090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:17.407146 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6ba5f843-11d7-4298-bbef-ca375e8c54b1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1549 microversion: 2.1 time: 0.157276 Nov 02 13:40:17.407746 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3641/7824] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:17 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:17.429952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:17.430604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:17.438184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.438689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.439143 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.439848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.440313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.440751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.571006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:17.579354 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01a47176-67e7-46ab-a04a-0a904ea79bc5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1549 microversion: 2.1 time: 0.153245 Nov 02 13:40:17.579943 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4184/7825] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:17 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:17.601259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:17.606104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:17.606873 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Searching by: {'deleted': False, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166'} {{(pid=120723) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:40:17.612735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.613251 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.613696 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.614452 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.614927 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.615341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.639802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.multi_cell_list [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:40:17.666465 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6caa486d-3106-4171-9c87-4c061a4e7466 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069034 Nov 02 13:40:17.667057 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3642/7826] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Nov 2 13:40:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:17.679421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:17.680050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:17.686065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.686567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.687019 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.687723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.688190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.688630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.823680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:17.832788 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-255c58e2-98b5-4234-8c31-ea21f097ac15 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1549 microversion: 2.1 time: 0.157188 Nov 02 13:40:17.833378 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4185/7827] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:17 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:19.356135 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cf0ff1e-0918-496c-91cf-8b20f8904555"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:19.358586 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:19.366227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:19.366721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:19.367171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:19.367885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:19.368345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:19.368780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:19.638446 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9855d1dc-346f-4a55-b4f6-5cd004f3f829 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286191 Nov 02 13:40:19.639073 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3643/7828] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Nov 2 13:40:19 2022] POST /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:40:30.459833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:30.461908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:30.471867 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=19 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:30.473939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=68 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:30.482307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.482822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.483274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.484000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.484470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.484914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.616609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:30.625139 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dcbb20cc-d982-47dd-84e2-e8de4777904e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1595 microversion: 2.1 time: 0.177422 Nov 02 13:40:30.625727 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4186/7829] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:30 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1595 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:32.569608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:32.570419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=21 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:32.578856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:32.640634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-32cd489f-de95-4230-b594-ee3c085ac4b0 req-8942d02e-2754-46aa-aa5e-1094f8d07057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc48f9c4-367a-4a1f-9c30-634bc4a77a2e", "tag": "01d6a8dc-47d8-45f1-ad0b-d94270fd6564"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:32.655810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-32cd489f-de95-4230-b594-ee3c085ac4b0 req-8942d02e-2754-46aa-aa5e-1094f8d07057 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:32.656292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-32cd489f-de95-4230-b594-ee3c085ac4b0 req-8942d02e-2754-46aa-aa5e-1094f8d07057 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:32.656728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-32cd489f-de95-4230-b594-ee3c085ac4b0 req-8942d02e-2754-46aa-aa5e-1094f8d07057 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:32.669591 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-32cd489f-de95-4230-b594-ee3c085ac4b0 req-8942d02e-2754-46aa-aa5e-1094f8d07057 service nova] Creating event network-changed:01d6a8dc-47d8-45f1-ad0b-d94270fd6564 for instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e on n-h2-855650-5 Nov 02 13:40:32.675704 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-32cd489f-de95-4230-b594-ee3c085ac4b0 req-8942d02e-2754-46aa-aa5e-1094f8d07057 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108008 Nov 02 13:40:32.679690 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3644/7830] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:33.613009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-277072788"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:33.613640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:33.621288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:33.621798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:33.622283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:33.623066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:33.623487 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:33.623985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:33.771587 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.network.security_group_api [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Adding security group 5518a395-aa23-4b2b-bbc6-849cff9de5cc to port 01d6a8dc-47d8-45f1-ad0b-d94270fd6564 Nov 02 13:40:34.104142 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-29d97ac7-edf5-40c3-8f9a-1aa25368a22d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.495106 Nov 02 13:40:34.104775 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4187/7831] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:40:33 2022] POST /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:40:34.115460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:34.116428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:34.122779 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:34.124463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:34.125268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:34.126168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:34.127092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:34.127928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:34.302513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:34.311179 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-44dbb734-0555-44e2-809b-47a8a2139b07 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1760 microversion: 2.1 time: 0.201863 Nov 02 13:40:34.311865 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3645/7832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:34 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1760 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:34.691403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-1ad31909-e20e-4d0f-863a-a2f4028c2246 req-df6156cc-9664-4097-b233-42aaaeebe0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc48f9c4-367a-4a1f-9c30-634bc4a77a2e", "tag": "01d6a8dc-47d8-45f1-ad0b-d94270fd6564"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:34.700981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1ad31909-e20e-4d0f-863a-a2f4028c2246 req-df6156cc-9664-4097-b233-42aaaeebe0c7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:34.701489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1ad31909-e20e-4d0f-863a-a2f4028c2246 req-df6156cc-9664-4097-b233-42aaaeebe0c7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:34.701952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-1ad31909-e20e-4d0f-863a-a2f4028c2246 req-df6156cc-9664-4097-b233-42aaaeebe0c7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:34.714570 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-1ad31909-e20e-4d0f-863a-a2f4028c2246 req-df6156cc-9664-4097-b233-42aaaeebe0c7 service nova] Creating event network-changed:01d6a8dc-47d8-45f1-ad0b-d94270fd6564 for instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e on n-h2-855650-5 Nov 02 13:40:34.725073 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-1ad31909-e20e-4d0f-863a-a2f4028c2246 req-df6156cc-9664-4097-b233-42aaaeebe0c7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035028 Nov 02 13:40:34.727197 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4188/7833] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:32.817877 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:32.820246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:32.822398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:32.823229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:32.830321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:32.830815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:32.831258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:32.831970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:32.832540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:32.832858 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:32.913499 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-552133f8-2d6d-4191-acac-7802a3bec624 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.099739 Nov 02 13:41:32.914267 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3646/7834] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:41:32 2022] POST /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:32.924359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:32.925098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:32.927687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:32.928514 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:32.929793 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:41:32.930003 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e (ip 10.222.0.45) !!! Nov 02 13:41:32.946945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:32.947455 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:32.947914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:32.948638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:32.949112 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:32.949571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:33.106991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:33.124206 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd09ff90-6941-4b38-85a7-bcc0f4266fc0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1752 microversion: 2.1 time: 0.204740 Nov 02 13:41:33.124823 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4189/7835] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:32 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:34.153273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:34.154079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:34.161392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:34.161886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:34.162363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:34.163076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:34.163536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:34.163963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:34.316284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:34.325161 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c56168e-81ed-4f1d-b8f4-cb6849457ccb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.177736 Nov 02 13:41:34.325709 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3647/7836] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:34 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:35.348910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:35.349956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:35.358215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.358732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.359195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.359927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.360430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.360877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.517126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:35.525613 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f339c5b3-aa40-46cf-9da9-e5f4de626e94 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.180708 Nov 02 13:41:35.526232 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4190/7837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:35 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:36.550329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:36.550943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:36.559224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.559733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.560308 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.561194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.562174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.565338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.714619 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:36.723148 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08bd269d-14ad-4478-ab98-2a7b87b59aa9 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.176956 Nov 02 13:41:36.723766 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3648/7838] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:36 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:37.747865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.748520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:37.756981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.757279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.757747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.758507 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.758980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.759425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.941786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:37.950910 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4485e452-f925-45f4-8720-3b43a67454ee tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.207199 Nov 02 13:41:37.951531 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4191/7839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:38.978425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.979209 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:38.988225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.988726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.989176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.989917 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.990417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.990850 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:39.153860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:39.170270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3b823af5-7a18-48fa-a2d5-5efb31a0cd4d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.197742 Nov 02 13:41:39.171334 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3649/7840] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:38 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:40.195676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:40.196603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:40.204512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.205734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.206354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.207208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.207788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.208338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.387152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:40.396364 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e2539bef-b482-4885-af54-b0822d19f8fb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.205049 Nov 02 13:41:40.396972 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4192/7841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:40 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:41.421662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:41.422352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:41.429454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.429954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.430433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.431151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.431611 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.432040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.587876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:41.596527 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-552ee44f-fd29-4f00-bfa2-8a39c6195c04 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.178916 Nov 02 13:41:41.597121 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3650/7842] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:41 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:42.620240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:42.620914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:42.628426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:42.628942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:42.629397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:42.630165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:42.630733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:42.631062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:42.796615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:42.806277 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e762d8e6-419b-407c-a469-07ad47b36852 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.189828 Nov 02 13:41:42.807011 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4193/7843] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:42 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:43.832276 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:43.832891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:43.840177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.840693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.841119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.841836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.842333 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.842767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:44.008495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:44.017562 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-03a55b85-f916-4ed8-bec4-90b443d36235 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1757 microversion: 2.1 time: 0.189548 Nov 02 13:41:44.018207 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3651/7844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:43 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:45.042176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:45.042801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:45.050052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.050761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.051380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.052326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.052815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.053274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.202078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:45.210836 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-70b7712e-2d4c-4e16-b9c8-36281b1a45f0 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1760 microversion: 2.1 time: 0.172852 Nov 02 13:41:45.211657 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4194/7845] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:45 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:48.712370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:48.713044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:48.718568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-277072788"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:48.719113 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:48.727689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.728179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.728633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.729339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.729804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.730342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:49.163943 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.network.security_group_api [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Removing security group 5518a395-aa23-4b2b-bbc6-849cff9de5cc from port 01d6a8dc-47d8-45f1-ad0b-d94270fd6564 Nov 02 13:42:49.471337 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe34d12b-3864-4f15-a14d-406bc09face5 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "POST /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.761035 Nov 02 13:42:49.475236 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3652/7846] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:42:48 2022] POST /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:49.483479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:49.484863 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=36 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:49.571128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8bfe62df-289b-4872-8ff0-ffd1fb56376e req-754a3664-ea8e-4151-acbd-ece3d28bc0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc48f9c4-367a-4a1f-9c30-634bc4a77a2e", "tag": "01d6a8dc-47d8-45f1-ad0b-d94270fd6564"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:49.581874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bfe62df-289b-4872-8ff0-ffd1fb56376e req-754a3664-ea8e-4151-acbd-ece3d28bc0f3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:49.582816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bfe62df-289b-4872-8ff0-ffd1fb56376e req-754a3664-ea8e-4151-acbd-ece3d28bc0f3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:49.582954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bfe62df-289b-4872-8ff0-ffd1fb56376e req-754a3664-ea8e-4151-acbd-ece3d28bc0f3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:49.595268 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8bfe62df-289b-4872-8ff0-ffd1fb56376e req-754a3664-ea8e-4151-acbd-ece3d28bc0f3 service nova] Creating event network-changed:01d6a8dc-47d8-45f1-ad0b-d94270fd6564 for instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e on n-h2-855650-5 Nov 02 13:42:49.599003 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [req-8bfe62df-289b-4872-8ff0-ffd1fb56376e req-754a3664-ea8e-4151-acbd-ece3d28bc0f3 service nova] [a115c0b0-9ad2-4e89-af95-c1c83e96c142] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:42:50.527798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:50.528402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:50.534445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.534947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.535398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.536110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.536574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.537418 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.608749 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [req-8bfe62df-289b-4872-8ff0-ffd1fb56376e req-754a3664-ea8e-4151-acbd-ece3d28bc0f3 service nova] [a115c0b0-9ad2-4e89-af95-c1c83e96c142] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40000. Nov 02 13:42:50.612881 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8bfe62df-289b-4872-8ff0-ffd1fb56376e req-754a3664-ea8e-4151-acbd-ece3d28bc0f3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.137099 Nov 02 13:42:50.614228 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4195/7847] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:42:50.623115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lazy-loading 'services' on Instance uuid dc48f9c4-367a-4a1f-9c30-634bc4a77a2e {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:50.711947 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-beb7acae-652f-4daa-89a9-f8f325397585 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments/5cf0ff1e-0918-496c-91cf-8b20f8904555" status: 202 len: 0 microversion: 2.1 time: 0.188075 Nov 02 13:42:50.717027 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3653/7848] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:42:50 2022] DELETE /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments/5cf0ff1e-0918-496c-91cf-8b20f8904555 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:42:50.725228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:50.728680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:50.737654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.739171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.740654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.742041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.742732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.743394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.782558 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-368d22c8-f4c3-41d9-95b6-5a8bce5935df tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063585 Nov 02 13:42:50.784058 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4196/7849] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:42:50 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:51.797540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.800183 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:51.806665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.807156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.807594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.808332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.808783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.809201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.840597 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5dcd73df-a712-4154-87b7-d315e4c6b349 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048227 Nov 02 13:42:51.841158 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3654/7850] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:52.628486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-60b7e468-463d-48c3-ae69-abc7a16aec95 req-e7795125-4f1d-4d29-9753-282b33fedf28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc48f9c4-367a-4a1f-9c30-634bc4a77a2e", "tag": "01d6a8dc-47d8-45f1-ad0b-d94270fd6564"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:52.639628 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-60b7e468-463d-48c3-ae69-abc7a16aec95 req-e7795125-4f1d-4d29-9753-282b33fedf28 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.640132 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-60b7e468-463d-48c3-ae69-abc7a16aec95 req-e7795125-4f1d-4d29-9753-282b33fedf28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.640586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-60b7e468-463d-48c3-ae69-abc7a16aec95 req-e7795125-4f1d-4d29-9753-282b33fedf28 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.652313 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-60b7e468-463d-48c3-ae69-abc7a16aec95 req-e7795125-4f1d-4d29-9753-282b33fedf28 service nova] Creating event network-changed:01d6a8dc-47d8-45f1-ad0b-d94270fd6564 for instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e on n-h2-855650-5 Nov 02 13:42:52.657430 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-60b7e468-463d-48c3-ae69-abc7a16aec95 req-e7795125-4f1d-4d29-9753-282b33fedf28 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032721 Nov 02 13:42:52.658068 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4197/7851] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:52.853763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.856044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:52.864702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.865757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.866233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.867137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.867517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.868008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.904002 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe21f6cd-798d-49cd-851f-87ef5d20780e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054702 Nov 02 13:42:52.908789 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3655/7852] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:53.918533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.920913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:53.928317 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.928918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.929382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.930145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.930630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.931082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.964318 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d4a5f31b-a7af-4134-a951-74bf06bade19 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051712 Nov 02 13:42:53.965171 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4198/7853] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:42:54.977988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.980156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:54.987830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.988317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.988757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.989500 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.990627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.991057 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.025129 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1859e088-7723-46d2-ad45-58de1784274b tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051908 Nov 02 13:42:55.025731 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3656/7854] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:56.038378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:56.040637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:56.047691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.048198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.048661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.049403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.049856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.050334 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.083613 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-881a81b7-2290-4ef3-bad6-e463a8cbd881 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049227 Nov 02 13:42:56.084205 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4199/7855] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Nov 2 13:42:56 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:42:56.095655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:56.096222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:56.103315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.103978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.104549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.105396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.106082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.106658 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.184151 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] HTTP exception thrown: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e is not attached to volume 5cf0ff1e-0918-496c-91cf-8b20f8904555 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Request method failure captured: Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: request: DELETE /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments/5cf0ff1e-0918-496c-91cf-8b20f8904555 HTTP/1.1 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnHViqH9Asr7AA8gsVv0xc5MUSFHq979k_lfERBY1aYvXNpr-ZH5f5_bM9b1ezfq6TxUoXtzIwlpKYVwhFvvBtBGnItHqfsI86oOtEZeC32dOF_JyEtRBoT43Vy1JlDNCzfer_Fse1JyMpXPO8g3ATclvXSqDE4Fg3ZTKL_iVMqzM8A Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: df1a80d52bdb4bbaba75dd59767f6166 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: df1a80d52bdb4bbaba75dd59767f6166 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestMinimumBasicScenario-382849423-project Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a8adf0a30cdb4034958b13bbde7b20ba Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestMinimumBasicScenario-382849423-project Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e is not attached to volume 5cf0ff1e-0918-496c-91cf-8b20f8904555 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'server_id': 'dc48f9c4-367a-4a1f-9c30-634bc4a77a2e', 'id': '5cf0ff1e-0918-496c-91cf-8b20f8904555'} Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5cf0ff1e-0918-496c-91cf-8b20f8904555. Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e is not attached to volume 5cf0ff1e-0918-496c-91cf-8b20f8904555 Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:56.185774 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:56.190988 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:56.190988 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:56.190988 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e is not attached to volume 5cf0ff1e-0918-496c-91cf-8b20f8904555 Nov 02 13:42:56.190988 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:42:56.190988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Returning 404 to user: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e is not attached to volume 5cf0ff1e-0918-496c-91cf-8b20f8904555 {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:56.190988 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e9705032-3cef-4739-ab57-b852b0b8fb03 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments/5cf0ff1e-0918-496c-91cf-8b20f8904555" status: 404 len: 154 microversion: 2.1 time: 0.095640 Nov 02 13:42:56.190988 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3657/7856] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Nov 2 13:42:56 2022] DELETE /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e/os-volume_attachments/5cf0ff1e-0918-496c-91cf-8b20f8904555 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:59.452035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:59.452581 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:59.459683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.460176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.460633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.461350 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.461853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.462321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.488135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:42:59.571383 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39b86199-bbae-44d6-bece-236afe7d1df1 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 204 len: 0 microversion: 2.1 time: 0.122865 Nov 02 13:42:59.575253 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4200/7857] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:59 2022] DELETE /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:42:59.582098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:59.582880 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:59.591178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.591597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.592039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.592749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.593203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.593631 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.745470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:59.754316 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1c3df984-4543-4c2f-913e-acd930b35eeb tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1555 microversion: 2.1 time: 0.177015 Nov 02 13:42:59.754911 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3658/7858] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:59 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:00.779030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:00.779793 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:00.786763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.787294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.787804 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.788597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.789071 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.789519 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.927099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:00.935596 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86a51bb8-fcbc-4381-9c4d-78eb63dad20e tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1555 microversion: 2.1 time: 0.160934 Nov 02 13:43:00.936180 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4201/7859] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:00 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:01.961605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:01.962435 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:01.969693 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.970230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.970688 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.971415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.971914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.972345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.181347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8adf0a30cdb4034958b13bbde7b20ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a80d52bdb4bbaba75dd59767f6166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:02.189294 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9dad5eda-5b9f-4fcc-bd62-966fe5e71331 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 200 len: 1555 microversion: 2.1 time: 0.233524 Nov 02 13:43:02.189878 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3659/7860] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:01 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:02.415522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-edf1ddf3-4b1e-46d9-822c-219cbc1bb1fb req-368d9b9e-080f-426a-8799-4daebecd385a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc48f9c4-367a-4a1f-9c30-634bc4a77a2e", "name": "network-vif-deleted", "tag": "01d6a8dc-47d8-45f1-ad0b-d94270fd6564"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:02.426219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-edf1ddf3-4b1e-46d9-822c-219cbc1bb1fb req-368d9b9e-080f-426a-8799-4daebecd385a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.426639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-edf1ddf3-4b1e-46d9-822c-219cbc1bb1fb req-368d9b9e-080f-426a-8799-4daebecd385a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.427787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-edf1ddf3-4b1e-46d9-822c-219cbc1bb1fb req-368d9b9e-080f-426a-8799-4daebecd385a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.439731 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-edf1ddf3-4b1e-46d9-822c-219cbc1bb1fb req-368d9b9e-080f-426a-8799-4daebecd385a service nova] Creating event network-vif-deleted:01d6a8dc-47d8-45f1-ad0b-d94270fd6564 for instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e on n-h2-855650-5 Nov 02 13:43:02.445215 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-edf1ddf3-4b1e-46d9-822c-219cbc1bb1fb req-368d9b9e-080f-426a-8799-4daebecd385a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033945 Nov 02 13:43:02.445866 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4202/7861] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:03.214210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.214891 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [instance: dc48f9c4-367a-4a1f-9c30-634bc4a77a2e] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:03.221663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.222230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.222661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.223371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.223824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.224254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.238084 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] HTTP exception thrown: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e could not be found. Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Request method failure captured: Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e HTTP/1.1 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnHViqH9Asr7AA8gsVv0xc5MUSFHq979k_lfERBY1aYvXNpr-ZH5f5_bM9b1ezfq6TxUoXtzIwlpKYVwhFvvBtBGnItHqfsI86oOtEZeC32dOF_JyEtRBoT43Vy1JlDNCzfer_Fse1JyMpXPO8g3ATclvXSqDE4Fg3ZTKL_iVMqzM8A Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: df1a80d52bdb4bbaba75dd59767f6166 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_df1a80d52bdb4bbaba75dd59767f6166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: df1a80d52bdb4bbaba75dd59767f6166 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestMinimumBasicScenario-382849423 Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestMinimumBasicScenario-382849423-project Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: a8adf0a30cdb4034958b13bbde7b20ba Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestMinimumBasicScenario-382849423-project Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e could not be found. Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'dc48f9c4-367a-4a1f-9c30-634bc4a77a2e'} Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e could not be found. Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e could not be found. Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:03.239636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e could not be found. Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Returning 404 to user: Instance dc48f9c4-367a-4a1f-9c30-634bc4a77a2e could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eea8e03a-9e9b-48ad-961e-c2800a88d0c2 tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e" status: 404 len: 111 microversion: 2.1 time: 0.030843 Nov 02 13:43:03.244869 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3660/7862] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/servers/dc48f9c4-367a-4a1f-9c30-634bc4a77a2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:03.250779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d3e81817-d80f-4a62-ae6f-0c879ac8e47d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] Calling method '.version_select at 0x7f228c18aaf0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.255413 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d3e81817-d80f-4a62-ae6f-0c879ac8e47d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:43:04.263418 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [None req-d3e81817-d80f-4a62-ae6f-0c879ac8e47d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40052. Nov 02 13:43:04.283622 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d3e81817-d80f-4a62-ae6f-0c879ac8e47d tempest-TestMinimumBasicScenario-382849423 tempest-TestMinimumBasicScenario-382849423-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-621588698" status: 202 len: 0 microversion: 2.1 time: 1.037129 Nov 02 13:43:04.284233 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4203/7863] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Nov 2 13:43:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-621588698 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:43:14.016777 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:43:14.017456 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:43:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.45) !!! Nov 02 13:43:14.019082 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:43:14.019232 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:43:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.45) !!! Nov 02 13:43:14.020982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=18 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:14.022274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:14.198906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ab678b73-a789-4682-8404-560a353ff271 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: .version_select at 0x7f228d455280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-487431456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzH60+exxgP/wxuxqhT0AlQaxxQS5eDHcVK2xGYfPqzKLKAP3zazmjIWonUX06k9f8QGpTg3tiFswkjCTDGt/ptfYK9eARyAVls1aPoSZu60PGR/+j1bFzG3Mmz1jtgSw=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:14.216371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ab678b73-a789-4682-8404-560a353ff271 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:14.221749 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-ab678b73-a789-4682-8404-560a353ff271 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:14.250734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ab678b73-a789-4682-8404-560a353ff271 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.239615 Nov 02 13:43:14.251348 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3661/7864] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:43:14 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:20.453781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:20.456653 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:20.462159 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2041000915", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "be24c9ae-86ca-41ac-8c3c-a41ce681976d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-487431456", "security_groups": [{"name": "tempest-secgroup-smoke-1589379887"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:20.588291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] validate_networks() for [('be24c9ae-86ca-41ac-8c3c-a41ce681976d', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:21.058762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:21.059218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:21.059723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:21.060351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:21.060802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:21.070786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.071291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.071750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.072510 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.072987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.073438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.091405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:21.096814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:21.111105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:21.113460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:21.163210 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-505380e4-6a92-4017-9a7e-d77febb8781e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711370 Nov 02 13:43:21.164183 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4204/7865] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:43:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:43:21.178004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2dae2569-7387-42bc-802b-b6e1c346e60c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:21.178849 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2dae2569-7387-42bc-802b-b6e1c346e60c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:21.246936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2dae2569-7387-42bc-802b-b6e1c346e60c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:21.256660 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2dae2569-7387-42bc-802b-b6e1c346e60c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1266 microversion: 2.1 time: 0.084940 Nov 02 13:43:21.257679 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3662/7866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:21 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:22.282228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:22.283018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:22.291274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.291805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.292263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.293010 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.293482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.293929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.376120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:22.386164 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7e395780-01fb-44e6-91f7-5b2a64b89f42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1318 microversion: 2.1 time: 0.108494 Nov 02 13:43:22.386986 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4205/7867] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:22 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1318 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:23.410047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:23.410630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:23.420643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.421395 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.422078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.422840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.423513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.423950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.702923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:23.711610 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b5d4edaa-0447-4a60-84ee-402dd96407bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1392 microversion: 2.1 time: 0.305527 Nov 02 13:43:23.712199 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3663/7868] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:23 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1392 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:24.102894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-188bac89-4b67-4d18-939a-5acb7e94131f req-d51a1588-4767-448a-88e1-97b28c14bc18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90867e1d-eb79-4953-ace3-ae842f886b86", "tag": "ade4bdc2-089a-4a6b-add5-73c82507270b"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:24.115524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-188bac89-4b67-4d18-939a-5acb7e94131f req-d51a1588-4767-448a-88e1-97b28c14bc18 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.116061 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-188bac89-4b67-4d18-939a-5acb7e94131f req-d51a1588-4767-448a-88e1-97b28c14bc18 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.116528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-188bac89-4b67-4d18-939a-5acb7e94131f req-d51a1588-4767-448a-88e1-97b28c14bc18 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.128822 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-188bac89-4b67-4d18-939a-5acb7e94131f req-d51a1588-4767-448a-88e1-97b28c14bc18 service nova] Creating event network-changed:ade4bdc2-089a-4a6b-add5-73c82507270b for instance 90867e1d-eb79-4953-ace3-ae842f886b86 on n-h2-855650-5 Nov 02 13:43:24.134320 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-188bac89-4b67-4d18-939a-5acb7e94131f req-d51a1588-4767-448a-88e1-97b28c14bc18 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036012 Nov 02 13:43:24.135272 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4206/7869] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:24.735140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:24.735753 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:24.742427 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.742910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.743344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.744035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.744486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.744907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.900417 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:24.908636 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08bef76b-f170-4a24-910e-167716b0c0d3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1392 microversion: 2.1 time: 0.177678 Nov 02 13:43:24.909236 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3664/7870] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:24 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:25.933337 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:25.933995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:25.940272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.940773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.941229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.941941 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.942467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.943402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.093331 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:26.103991 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83b40c31-9c31-43c9-802e-1c449bf40f16 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1392 microversion: 2.1 time: 0.175789 Nov 02 13:43:26.104617 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4207/7871] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:25 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:27.127037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:27.127640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:27.135295 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.135957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.136410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.137111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.137592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.138038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.350664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.358635 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-14aa87ea-b613-43b1-aefc-66f6d64d2642 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1392 microversion: 2.1 time: 0.235500 Nov 02 13:43:27.359347 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3665/7872] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:27 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:28.386727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:28.387923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:28.400589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:28.401520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:28.402442 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:28.403753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:28.404663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:28.405562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:28.550481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:28.558531 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7c479621-9286-47e8-90d1-47e6e143c069 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1392 microversion: 2.1 time: 0.179895 Nov 02 13:43:28.559127 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4208/7873] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:28 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:29.582270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:29.582915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:29.589914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.590372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.590817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.591524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.591974 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.592400 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.733402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:29.742260 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f774c327-efa6-448f-99c0-e7c1308cb05e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1392 microversion: 2.1 time: 0.164116 Nov 02 13:43:29.742940 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3666/7874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:29 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:29.751195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d0c093ec-eea7-4612-847b-90c9e4d0efd1 req-108e474b-703b-424f-8ae8-29845fec18a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90867e1d-eb79-4953-ace3-ae842f886b86", "name": "network-vif-plugged", "status": "completed", "tag": "ade4bdc2-089a-4a6b-add5-73c82507270b"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:29.763746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0c093ec-eea7-4612-847b-90c9e4d0efd1 req-108e474b-703b-424f-8ae8-29845fec18a2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.764248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0c093ec-eea7-4612-847b-90c9e4d0efd1 req-108e474b-703b-424f-8ae8-29845fec18a2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.764697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0c093ec-eea7-4612-847b-90c9e4d0efd1 req-108e474b-703b-424f-8ae8-29845fec18a2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.777443 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d0c093ec-eea7-4612-847b-90c9e4d0efd1 req-108e474b-703b-424f-8ae8-29845fec18a2 service nova] Creating event network-vif-plugged:ade4bdc2-089a-4a6b-add5-73c82507270b for instance 90867e1d-eb79-4953-ace3-ae842f886b86 on n-h2-855650-5 Nov 02 13:43:29.782725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d0c093ec-eea7-4612-847b-90c9e4d0efd1 req-108e474b-703b-424f-8ae8-29845fec18a2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035477 Nov 02 13:43:29.783397 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4209/7875] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:30.766193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:30.766812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:30.773623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.774138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.774583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.775273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.775721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.776143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.918466 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:30.926466 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-bcb06af4-cc58-45e4-b51a-fe55802fa925 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1392 microversion: 2.1 time: 0.164106 Nov 02 13:43:30.927846 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3667/7876] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:30 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:31.948161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:31.949462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:31.954772 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.955515 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:31.964539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.965056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.965563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.966357 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.967029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.967478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:32.114262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:32.122963 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c75b2f96-cef5-4b02-8e01-5a2a232166f8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1564 microversion: 2.1 time: 0.176666 Nov 02 13:43:32.123589 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4210/7877] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:32.146906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:32.147758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:32.149428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:32.155726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:32.156219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:32.156666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:32.157371 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:32.157843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:32.158324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:32.297512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:32.305853 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-af3b8821-3b1c-48b7-a0bf-d604c3d438a3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1564 microversion: 2.1 time: 0.162930 Nov 02 13:43:32.306480 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3668/7878] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:32 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:34.240549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:34.241155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:34.241701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5d90b337-96a9-4e30-81ef-02a1316e15d9 req-4999a4ee-3032-4cda-84c7-f0a12b71cdae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90867e1d-eb79-4953-ace3-ae842f886b86", "tag": "ade4bdc2-089a-4a6b-add5-73c82507270b"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:34.248669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.249180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.249638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.250833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.251321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.251766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.253683 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5d90b337-96a9-4e30-81ef-02a1316e15d9 req-4999a4ee-3032-4cda-84c7-f0a12b71cdae service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.254304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5d90b337-96a9-4e30-81ef-02a1316e15d9 req-4999a4ee-3032-4cda-84c7-f0a12b71cdae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.254810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5d90b337-96a9-4e30-81ef-02a1316e15d9 req-4999a4ee-3032-4cda-84c7-f0a12b71cdae service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.268687 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5d90b337-96a9-4e30-81ef-02a1316e15d9 req-4999a4ee-3032-4cda-84c7-f0a12b71cdae service nova] Creating event network-changed:ade4bdc2-089a-4a6b-add5-73c82507270b for instance 90867e1d-eb79-4953-ace3-ae842f886b86 on n-h2-855650-5 Nov 02 13:43:34.275901 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5d90b337-96a9-4e30-81ef-02a1316e15d9 req-4999a4ee-3032-4cda-84c7-f0a12b71cdae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038680 Nov 02 13:43:34.276986 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3669/7879] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:34.403982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:34.412224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b6fad04-9850-4645-88d1-60f0f4afb3de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1564 microversion: 2.1 time: 0.176251 Nov 02 13:43:34.413187 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4211/7880] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:34 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:09.724403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:09.725179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=38 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:09.730133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:09.732490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:09.740651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.741191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.742158 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.742876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.743338 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.743776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.817196 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7018a4f7-40f9-4316-b6c1-d7991fd5a6ce tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action" status: 200 len: 24576 microversion: 2.1 time: 0.095408 Nov 02 13:44:09.817770 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3670/7881] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:09 2022] POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action => generated 24576 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:44:48.555813 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:48.556576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=36 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:48.560725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:48.561285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:48.568969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.569483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.569954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.570695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.571172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.571621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.640487 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96dcabea-7b1c-46ac-8a74-96c5e3d0b858 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action" status: 202 len: 0 microversion: 2.1 time: 0.086322 Nov 02 13:44:48.641573 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4212/7882] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:48 2022] POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:48.650626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.651327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:48.653921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:48.654690 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:48.662174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.662174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.662522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.663216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.663666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.664085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.812865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:48.821052 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fe2b6db4-00d1-406b-bce5-daeef95a52f4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1688 microversion: 2.1 time: 0.174909 Nov 02 13:44:48.821641 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3671/7883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:48 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:49.849078 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:49.849786 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:49.856096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.856594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.857048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:49.857764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.858252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.858689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.056474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:50.064893 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b3ce628-87e4-4fde-8605-43cd3a6489d8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1668 microversion: 2.1 time: 0.221922 Nov 02 13:44:50.065494 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4213/7884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:49 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:51.160499 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:51.162729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:51.170504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.170996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.171431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.172168 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.172625 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.173053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.243414 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4f25fd41-8eba-4341-87ac-1ed51eb7937e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action" status: 200 len: 32645 microversion: 2.1 time: 0.087288 Nov 02 13:44:51.244079 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3672/7885] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:51 2022] POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action => generated 32645 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:44:51.255972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:51.256598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:51.263720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.264227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.264808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.265424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.265899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.266425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.338502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-908b4f25-02d8-4d2f-9a2d-eded064867bc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action" status: 202 len: 0 microversion: 2.1 time: 0.086041 Nov 02 13:44:51.339004 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4214/7886] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:51 2022] POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:51.349594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:51.350379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:51.358991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.360071 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.360526 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.362085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.362563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.362998 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.519950 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:51.528035 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-adcc92ef-9d79-49bd-b336-8fb9c4d8fc9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1675 microversion: 2.1 time: 0.183698 Nov 02 13:44:51.528628 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3673/7887] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:51 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:52.554827 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:52.555553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:52.561808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.562368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.562834 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.563565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.564039 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.565050 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.703354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:52.712041 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea27621a-4962-4bd7-b225-fc14e6514f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1683 microversion: 2.1 time: 0.162411 Nov 02 13:44:52.712638 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4215/7888] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:52 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:52.810984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:52.813188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:52.821085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.821589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.822058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.822771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.823234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.823674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.888758 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a119070b-aabc-417b-8260-3bf5c1b80eea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action" status: 200 len: 38308 microversion: 2.1 time: 0.081652 Nov 02 13:44:52.889754 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3674/7889] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:52 2022] POST /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86/action => generated 38308 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:44:53.907376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:53.907939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:53.912487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-bf730e80-d2c8-4a2e-96b9-bb240e2d0924 req-302cf3f3-869b-4512-a489-883ccdc45e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90867e1d-eb79-4953-ace3-ae842f886b86", "tag": "ade4bdc2-089a-4a6b-add5-73c82507270b"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:53.916583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.917098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.917563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.918341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.918820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.919267 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.924108 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bf730e80-d2c8-4a2e-96b9-bb240e2d0924 req-302cf3f3-869b-4512-a489-883ccdc45e3d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.924600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bf730e80-d2c8-4a2e-96b9-bb240e2d0924 req-302cf3f3-869b-4512-a489-883ccdc45e3d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.925038 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-bf730e80-d2c8-4a2e-96b9-bb240e2d0924 req-302cf3f3-869b-4512-a489-883ccdc45e3d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.938283 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-bf730e80-d2c8-4a2e-96b9-bb240e2d0924 req-302cf3f3-869b-4512-a489-883ccdc45e3d service nova] Creating event network-changed:ade4bdc2-089a-4a6b-add5-73c82507270b for instance 90867e1d-eb79-4953-ace3-ae842f886b86 on n-h2-855650-5 Nov 02 13:44:53.944816 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-bf730e80-d2c8-4a2e-96b9-bb240e2d0924 req-302cf3f3-869b-4512-a489-883ccdc45e3d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037537 Nov 02 13:44:53.945990 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3675/7890] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:53.949126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:44:54.052003 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8af23795-9453-4be6-8bf1-c5282636f0fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 204 len: 0 microversion: 2.1 time: 0.147950 Nov 02 13:44:54.054054 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4216/7891] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:44:53 2022] DELETE /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:44:54.063352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:54.064364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:54.072714 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:54.073208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:54.073654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:54.074453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:54.074907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:54.075334 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:54.253218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:54.262496 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3327b0e8-0c37-4d5f-971f-78b2a1ece664 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1689 microversion: 2.1 time: 0.203558 Nov 02 13:44:54.263101 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3676/7892] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:54 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:55.288332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:55.289099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:55.296324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:55.296829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:55.297287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:55.298030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:55.298545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:55.298990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:55.445798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:55.454155 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9cc33b32-c6b7-4708-a376-3e17097295b7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1689 microversion: 2.1 time: 0.170693 Nov 02 13:44:55.455005 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4217/7893] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:55 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:56.479394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:56.479990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:56.486861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.487354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.488423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.489136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.489595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.490059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.634605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:56.642934 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-54a0ae3a-d012-46c2-b52d-6c10c16359de tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 200 len: 1570 microversion: 2.1 time: 0.167490 Nov 02 13:44:56.643611 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3677/7894] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:56 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:56.747767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-fb60699f-062e-4102-a890-3642331f7d15 req-bba5ae75-b1ec-44cf-bb7c-331c32abbd5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90867e1d-eb79-4953-ace3-ae842f886b86", "name": "network-vif-deleted", "tag": "ade4bdc2-089a-4a6b-add5-73c82507270b"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:56.758663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fb60699f-062e-4102-a890-3642331f7d15 req-bba5ae75-b1ec-44cf-bb7c-331c32abbd5a service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.759274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fb60699f-062e-4102-a890-3642331f7d15 req-bba5ae75-b1ec-44cf-bb7c-331c32abbd5a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.759800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-fb60699f-062e-4102-a890-3642331f7d15 req-bba5ae75-b1ec-44cf-bb7c-331c32abbd5a service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.772560 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-fb60699f-062e-4102-a890-3642331f7d15 req-bba5ae75-b1ec-44cf-bb7c-331c32abbd5a service nova] Creating event network-vif-deleted:ade4bdc2-089a-4a6b-add5-73c82507270b for instance 90867e1d-eb79-4953-ace3-ae842f886b86 on n-h2-855650-5 Nov 02 13:44:56.778114 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-fb60699f-062e-4102-a890-3642331f7d15 req-bba5ae75-b1ec-44cf-bb7c-331c32abbd5a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034133 Nov 02 13:44:56.779005 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4218/7895] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:57.667498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:57.668070 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 90867e1d-eb79-4953-ace3-ae842f886b86] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:57.675744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.676236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.676676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.677372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.677825 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.678278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.693175 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] HTTP exception thrown: Instance 90867e1d-eb79-4953-ace3-ae842f886b86 could not be found. Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Request method failure captured: Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 HTTP/1.1 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnPx4EFsBnbqTTmYNA2b279hrz_QSLXb2Ap33NXVkmTN_imatYBnwdoBsi2sTcAHqbBSps6n5W7XN3xrMHtONr-OCrP98Ms6cPB6ulL_eGKrj3XFTLFG-aaV-EzAaUiOpxkLJjQP0AuOPuhI8_xX5UpzLDOaTAHbGq9dXAsMGa7O5wQ Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 17d93319feb94e59bd2e47c2d91f45ef Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 90867e1d-eb79-4953-ace3-ae842f886b86 could not be found. Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '90867e1d-eb79-4953-ace3-ae842f886b86'} Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90867e1d-eb79-4953-ace3-ae842f886b86 could not be found. Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90867e1d-eb79-4953-ace3-ae842f886b86 could not be found. Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:44:57.694886 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90867e1d-eb79-4953-ace3-ae842f886b86 could not be found. Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Returning 404 to user: Instance 90867e1d-eb79-4953-ace3-ae842f886b86 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7c10397a-10d7-43b1-9a99-cd5ac1244b11 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86" status: 404 len: 111 microversion: 2.1 time: 0.033019 Nov 02 13:44:57.700225 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3678/7896] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:57 2022] GET /compute/v2.1/servers/90867e1d-eb79-4953-ace3-ae842f886b86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:01.174460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8699a5fc-f0a1-41f3-8940-1ea39c61e0ba tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '.version_select at 0x7f228dacdb80>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:01.199116 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8699a5fc-f0a1-41f3-8940-1ea39c61e0ba tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-487431456" status: 202 len: 0 microversion: 2.1 time: 0.031014 Nov 02 13:45:01.199961 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4219/7897] 10.222.0.45 () {58 vars in 1281 bytes} [Wed Nov 2 13:45:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-487431456 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:45:01.224732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3e6204b0-f5d9-47a2-8e77-534f0d717900 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: .version_select at 0x7f228d3f70d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1228287091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzGtIQCTLHw4QcBBvw0GC1QtXPFY8/7cqFnb/9zCFDK0y/tOt5r9v8r0j4qoB7qP7HDOUaVeXcyQs/nH+D6OdxaTGFuLfRQ9KjflHIeNLX1wnm25LXnLrjzlQ61vyAppA=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:01.245255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-3e6204b0-f5d9-47a2-8e77-534f0d717900 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:01.250758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-3e6204b0-f5d9-47a2-8e77-534f0d717900 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:01.275571 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3e6204b0-f5d9-47a2-8e77-534f0d717900 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054782 Nov 02 13:45:01.276169 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3679/7898] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:45:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:07.052715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1507603317", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "426d21f7-32d7-4f1d-908c-c4c7b95710da"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1228287091", "security_groups": [{"name": "tempest-secgroup-smoke-1153730721"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:07.062571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:07.172489 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] validate_networks() for [('426d21f7-32d7-4f1d-908c-c4c7b95710da', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:45:07.621843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:45:07.622160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:45:07.622661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:45:07.623093 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:45:07.623726 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:45:07.634274 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:07.634840 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:07.635305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:07.636080 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:07.636550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:07.637191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:07.660346 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:07.666713 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:07.680971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:45:07.683587 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:45:07.762333 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dca81b29-f7ea-468c-8d1e-f6d1ce87653d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713607 Nov 02 13:45:07.763021 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4220/7899] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:45:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:45:07.776441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-834af207-f0c0-443a-8c55-8d990497e6d7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:07.778373 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-834af207-f0c0-443a-8c55-8d990497e6d7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:07.781473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=36 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:07.856407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-834af207-f0c0-443a-8c55-8d990497e6d7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:07.866769 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-834af207-f0c0-443a-8c55-8d990497e6d7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1267 microversion: 2.1 time: 0.095386 Nov 02 13:45:07.867793 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3680/7900] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:07 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:08.894882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:08.895520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:08.903807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:08.904600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:08.905260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:08.906239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:08.906895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:08.907526 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:08.995601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:09.007826 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c4dcd80-8369-489c-896e-26ab69415903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1319 microversion: 2.1 time: 0.117521 Nov 02 13:45:09.010457 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4221/7901] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:08 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1319 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:10.032931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:10.034179 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:10.045074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:10.046093 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:10.047066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:10.048142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:10.049191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:10.049912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:10.211101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:10.219460 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-8b43f51e-80bf-4481-a890-dc466eb75aa8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1393 microversion: 2.1 time: 0.190355 Nov 02 13:45:10.221233 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3681/7902] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:10 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1393 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:10.814980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e9fec942-8ca2-4c77-b939-ea4be8d0baf4 req-56b27bee-0d3f-4841-b657-7e1ba9e95af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26284cd5-d71a-43ea-846f-52c8e7a79f57", "tag": "8273b17e-486b-4973-a323-28b1afc9bc57"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:10.831796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e9fec942-8ca2-4c77-b939-ea4be8d0baf4 req-56b27bee-0d3f-4841-b657-7e1ba9e95af1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:10.832467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e9fec942-8ca2-4c77-b939-ea4be8d0baf4 req-56b27bee-0d3f-4841-b657-7e1ba9e95af1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:10.833038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e9fec942-8ca2-4c77-b939-ea4be8d0baf4 req-56b27bee-0d3f-4841-b657-7e1ba9e95af1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:10.846058 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e9fec942-8ca2-4c77-b939-ea4be8d0baf4 req-56b27bee-0d3f-4841-b657-7e1ba9e95af1 service nova] Creating event network-changed:8273b17e-486b-4973-a323-28b1afc9bc57 for instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 on n-h2-855650-5 Nov 02 13:45:10.851834 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e9fec942-8ca2-4c77-b939-ea4be8d0baf4 req-56b27bee-0d3f-4841-b657-7e1ba9e95af1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041936 Nov 02 13:45:10.853013 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4222/7903] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:11.244980 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:11.245589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:11.252562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:11.253096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:11.253537 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:11.254271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:11.254778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:11.255147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:11.399389 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:11.409532 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6809f1a1-c521-47c9-8417-d48e4a66ae3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1393 microversion: 2.1 time: 0.168340 Nov 02 13:45:11.410197 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3682/7904] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:11 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:12.434217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:12.434959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:12.441235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:12.441734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:12.442215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:12.442927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:12.443399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:12.443836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:12.579182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:12.587841 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c59500f-b0c2-4592-937c-48a8f8bbd338 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1393 microversion: 2.1 time: 0.158820 Nov 02 13:45:12.588427 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4223/7905] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:12 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:13.612878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:13.614336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:13.622239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:13.622819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:13.623266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:13.624036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:13.624584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:13.625019 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:13.767871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:13.776728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f38d792c-d018-4809-85fb-f3084812da59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1393 microversion: 2.1 time: 0.168540 Nov 02 13:45:13.777690 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3683/7906] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:13 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:14.801939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:14.802785 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:14.808963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.809488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.809954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.810711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.811383 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.811844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.953904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:14.963069 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5513bfc4-b092-4d65-ab2c-207f59920fd9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1393 microversion: 2.1 time: 0.166487 Nov 02 13:45:14.963878 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4224/7907] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:14 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:15.985401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:15.986053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:15.992698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.993184 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.993627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:15.994370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.994830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.995258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:16.191982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:16.199939 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2385d373-96fd-41cd-81af-dfa7c6dbc673 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1393 microversion: 2.1 time: 0.218574 Nov 02 13:45:16.200544 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3684/7908] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:15 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1393 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:16.273314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-159b561f-3583-4c70-be95-d80a72b0985c req-b32496d5-c83b-4a02-86f6-75bc8a1c4c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26284cd5-d71a-43ea-846f-52c8e7a79f57", "name": "network-vif-plugged", "status": "completed", "tag": "8273b17e-486b-4973-a323-28b1afc9bc57"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:16.283235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-159b561f-3583-4c70-be95-d80a72b0985c req-b32496d5-c83b-4a02-86f6-75bc8a1c4c14 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:16.283790 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-159b561f-3583-4c70-be95-d80a72b0985c req-b32496d5-c83b-4a02-86f6-75bc8a1c4c14 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:16.284752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-159b561f-3583-4c70-be95-d80a72b0985c req-b32496d5-c83b-4a02-86f6-75bc8a1c4c14 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:16.296317 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-159b561f-3583-4c70-be95-d80a72b0985c req-b32496d5-c83b-4a02-86f6-75bc8a1c4c14 service nova] Creating event network-vif-plugged:8273b17e-486b-4973-a323-28b1afc9bc57 for instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 on n-h2-855650-5 Nov 02 13:45:16.301573 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-159b561f-3583-4c70-be95-d80a72b0985c req-b32496d5-c83b-4a02-86f6-75bc8a1c4c14 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097278 Nov 02 13:45:16.302237 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4225/7909] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:45:17.224600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:17.225149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:17.232062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:17.232559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:17.233008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:17.233721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:17.234213 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:17.234653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:17.368925 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:17.377340 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d374a76a-4160-4dd5-849f-3d7cc5451730 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1393 microversion: 2.1 time: 0.157290 Nov 02 13:45:17.378512 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3685/7910] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:17 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:18.402912 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.403771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:18.407972 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:18.408655 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:18.414378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.414891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.415370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.416103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.416607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.417020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.553845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:18.561849 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-333b7306-780f-4093-bc6f-bfff3fbdcb82 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1566 microversion: 2.1 time: 0.163548 Nov 02 13:45:18.562462 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4226/7911] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:18.584960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.585565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:18.587472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:18.593521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.594037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.594481 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.595182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.595640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.596066 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.733440 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:18.741286 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-57734665-4969-4a53-adf5-1eb6d64167c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1566 microversion: 2.1 time: 0.161158 Nov 02 13:45:18.741871 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3686/7912] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:20.648695 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:20.649410 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:20.652194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:20.658549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-84932006-8e9b-4acf-8b64-685bc315b4d3 req-613e8e3e-0318-41f9-9027-c92a4c83e284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26284cd5-d71a-43ea-846f-52c8e7a79f57", "tag": "8273b17e-486b-4973-a323-28b1afc9bc57"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:20.664758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:20.670444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.670965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.671430 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.672167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.672639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.673087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.683022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-84932006-8e9b-4acf-8b64-685bc315b4d3 req-613e8e3e-0318-41f9-9027-c92a4c83e284 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.683549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-84932006-8e9b-4acf-8b64-685bc315b4d3 req-613e8e3e-0318-41f9-9027-c92a4c83e284 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.683991 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-84932006-8e9b-4acf-8b64-685bc315b4d3 req-613e8e3e-0318-41f9-9027-c92a4c83e284 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.697441 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-84932006-8e9b-4acf-8b64-685bc315b4d3 req-613e8e3e-0318-41f9-9027-c92a4c83e284 service nova] Creating event network-changed:8273b17e-486b-4973-a323-28b1afc9bc57 for instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 on n-h2-855650-5 Nov 02 13:45:20.703604 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-84932006-8e9b-4acf-8b64-685bc315b4d3 req-613e8e3e-0318-41f9-9027-c92a4c83e284 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048541 Nov 02 13:45:20.704704 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3687/7913] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:20.933582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:20.942950 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fa2932b-6581-4b77-9414-daffb1257f26 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1566 microversion: 2.1 time: 0.298397 Nov 02 13:45:20.943756 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4227/7914] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:20 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1566 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:58.274490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:58.279493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:58.285107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:58.286711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=38 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:58.294317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:58.294822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:58.295273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:58.295996 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:58.296460 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:58.296894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:58.378230 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9087a9fb-ec6c-4290-96aa-a0bbcd8cac77 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57/action" status: 200 len: 24566 microversion: 2.1 time: 0.113311 Nov 02 13:45:58.378953 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3688/7915] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:45:58 2022] POST /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57/action => generated 24566 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:46:37.198582 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:37.199248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=36 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:37.203882 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:37.206450 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:37.213839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.214373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.214839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.215561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.216045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.216517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.298062 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7902fbcb-90d5-47df-a46c-18e0d11e3371 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57/action" status: 202 len: 0 microversion: 2.1 time: 0.101267 Nov 02 13:46:37.298736 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4228/7916] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:46:37 2022] POST /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:46:37.308047 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:37.308746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:37.311287 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:37.312255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:37.313087 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:46:37.313303 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:46:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 (ip 10.222.0.45) !!! Nov 02 13:46:37.323000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.323493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.323933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.324633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.325083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.325514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.496010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:37.505220 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fa2c7d23-b44c-499a-94eb-84374cf9f6a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1677 microversion: 2.1 time: 0.201398 Nov 02 13:46:37.505837 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3689/7917] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:37 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:38.531498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:38.532220 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:38.539027 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.539529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.539991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.540708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.541185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.541631 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.679739 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:38.687643 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4813748-39f6-4ea5-8e9a-5ffd23008c96 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.161591 Nov 02 13:46:38.688225 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4229/7918] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:38 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:39.713141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:39.713733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:39.720803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:39.721300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:39.721751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:39.722491 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:39.722957 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:39.723391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:39.861000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:39.870431 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c3d08bf2-0c2f-4d61-9732-4a7fdd058b92 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.161290 Nov 02 13:46:39.871029 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3690/7919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:39 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:40.893595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:40.894266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:40.901247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:40.901755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:40.902252 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:40.902963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:40.903441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:40.903889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.037287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:41.045216 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48dde404-756f-44a1-b8ed-f9a472e5ad69 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.155597 Nov 02 13:46:41.045798 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4230/7920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:40 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:42.069409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:42.070044 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:42.076833 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.077313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.077751 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.078465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.079029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.079354 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.214512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:42.223024 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7f7595ff-a5bc-4569-9bb1-2915e7fada44 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.157985 Nov 02 13:46:42.223619 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3691/7921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:42 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:43.246756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:43.247445 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:43.254187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.254700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.255170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.255886 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.256361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.256811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.392021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:43.400453 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-428269f4-6282-4cd1-8f1c-24b8bd1346cd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.158049 Nov 02 13:46:43.401043 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4231/7922] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:43 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:44.423594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:44.424198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:44.432177 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.432671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.433129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.433838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.434328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.434759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.569493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:44.577497 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea22f528-09b7-4e10-adcb-25dc5f58b200 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.158021 Nov 02 13:46:44.578099 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3692/7923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:44 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:45.601537 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:45.602135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:45.609003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:45.609512 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:45.609989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:45.610711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:45.611189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:45.611644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:45.749707 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:45.757605 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-41e6720e-02a6-4442-b5d0-432e44665bf0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.160155 Nov 02 13:46:45.758224 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4232/7924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:45 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:46.781561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:46.782349 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:46.789778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.790291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.790734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.792053 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.792509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.792940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.931087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:46.938976 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c986c2d3-69f9-41a4-8219-855b40028f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.161441 Nov 02 13:46:46.939546 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3693/7925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:46 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:47.963171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:47.963810 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:47.971596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.972108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.972574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:47.973303 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.973781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.974269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.110349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:48.118315 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de3fab4b-ac81-4546-be3b-6ab34bf603a4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1682 microversion: 2.1 time: 0.159142 Nov 02 13:46:48.118902 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4233/7926] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:47 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:49.142513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:49.143125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:49.150215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.150712 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.151163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.151864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.152381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.152818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.295517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:49.303387 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7dd669c2-4203-4f10-a5c1-341309e2f4a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1685 microversion: 2.1 time: 0.164959 Nov 02 13:46:49.303977 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3694/7927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:49 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:25.548422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:25.550750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:25.553097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:25.553999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:25.559814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.560878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.561380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.562169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.562651 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.563101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.647310 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a78b4bd2-442d-4bd5-8ad7-d44d959c6fc8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57/action" status: 200 len: 69109 microversion: 2.1 time: 0.103380 Nov 02 13:47:25.647897 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4234/7928] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:47:25 2022] POST /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57/action => generated 69109 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:47:49.236248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-09d02b8f-e8f0-4681-8521-3566249efafd req-50d42a4b-e94e-4fee-b5fc-ed4e2f56e6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26284cd5-d71a-43ea-846f-52c8e7a79f57", "tag": "8273b17e-486b-4973-a323-28b1afc9bc57"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:49.238453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:49.239313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=36 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:49.244716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:49.244952 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:49.245522 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:49.245700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:49.253864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-09d02b8f-e8f0-4681-8521-3566249efafd req-50d42a4b-e94e-4fee-b5fc-ed4e2f56e6cb service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.255555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-09d02b8f-e8f0-4681-8521-3566249efafd req-50d42a4b-e94e-4fee-b5fc-ed4e2f56e6cb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.256048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-09d02b8f-e8f0-4681-8521-3566249efafd req-50d42a4b-e94e-4fee-b5fc-ed4e2f56e6cb service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.262639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.262639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.262639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.262639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.262639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.262639 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.273472 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-09d02b8f-e8f0-4681-8521-3566249efafd req-50d42a4b-e94e-4fee-b5fc-ed4e2f56e6cb service nova] Creating event network-changed:8273b17e-486b-4973-a323-28b1afc9bc57 for instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 on n-h2-855650-5 Nov 02 13:47:49.280606 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-09d02b8f-e8f0-4681-8521-3566249efafd req-50d42a4b-e94e-4fee-b5fc-ed4e2f56e6cb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048782 Nov 02 13:47:49.281568 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4235/7929] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:49.289017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:47:49.387720 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-84eb45bf-df7a-4fe8-b83e-fd0fba69eb42 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 204 len: 0 microversion: 2.1 time: 0.157974 Nov 02 13:47:49.388776 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3695/7930] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:47:49 2022] DELETE /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:47:49.400563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:49.401503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:49.410242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.410908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.411417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.412228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.412773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.413299 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.556885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:49.565270 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-604d50b8-330e-438a-8f57-1e18df9d7b3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1691 microversion: 2.1 time: 0.172014 Nov 02 13:47:49.565937 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4236/7931] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:49 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:50.590555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:50.591410 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:50.598588 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:50.599083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:50.599528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:50.600232 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:50.600691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:50.601127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:50.749008 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:50.757159 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08a66631-d77f-48c2-b498-c08b814f788a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1691 microversion: 2.1 time: 0.170837 Nov 02 13:47:50.757726 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3696/7932] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:50 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:51.780828 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:51.781604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:51.790188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.790881 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.791349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.792324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.792878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.793650 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.935339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:51.943763 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15aa09a9-0d21-4e75-9884-1737ba91e161 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 200 len: 1572 microversion: 2.1 time: 0.166888 Nov 02 13:47:51.944557 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4237/7933] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:51 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:52.122936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-7baa7482-04c1-413f-bb3b-231401e96856 req-a444ee5e-ed96-48c3-82f2-7767674b3df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26284cd5-d71a-43ea-846f-52c8e7a79f57", "name": "network-vif-deleted", "tag": "8273b17e-486b-4973-a323-28b1afc9bc57"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:52.136719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7baa7482-04c1-413f-bb3b-231401e96856 req-a444ee5e-ed96-48c3-82f2-7767674b3df8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.137565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7baa7482-04c1-413f-bb3b-231401e96856 req-a444ee5e-ed96-48c3-82f2-7767674b3df8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.138672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-7baa7482-04c1-413f-bb3b-231401e96856 req-a444ee5e-ed96-48c3-82f2-7767674b3df8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.160836 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-7baa7482-04c1-413f-bb3b-231401e96856 req-a444ee5e-ed96-48c3-82f2-7767674b3df8 service nova] Creating event network-vif-deleted:8273b17e-486b-4973-a323-28b1afc9bc57 for instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 on n-h2-855650-5 Nov 02 13:47:52.167557 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-7baa7482-04c1-413f-bb3b-231401e96856 req-a444ee5e-ed96-48c3-82f2-7767674b3df8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108180 Nov 02 13:47:52.168371 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3697/7934] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:52.969821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:52.970497 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 26284cd5-d71a-43ea-846f-52c8e7a79f57] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:52.977554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.978097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.978561 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.979296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.980018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.980247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.995648 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] HTTP exception thrown: Instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 could not be found. Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Request method failure captured: Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 HTTP/1.1 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnPx4EFsBnbqTTmYNA2b279hrz_QSLXb2Ap33NXVkmTN_imatYBnwdoBsi2sTcAHqbBSps6n5W7XN3xrMHtONr-OCrP98Ms6cPB6ulL_eGKrj3XFTLFG-aaV-EzAaUiOpxkLJjQP0AuOPuhI8_xX5UpzLDOaTAHbGq9dXAsMGa7O5wQ Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 17d93319feb94e59bd2e47c2d91f45ef Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 could not be found. Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '26284cd5-d71a-43ea-846f-52c8e7a79f57'} Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 could not be found. Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 could not be found. Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:47:52.997363 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 could not be found. Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Returning 404 to user: Instance 26284cd5-d71a-43ea-846f-52c8e7a79f57 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e6ecdb63-989f-439c-9b23-ce65f283ed9a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57" status: 404 len: 111 microversion: 2.1 time: 0.033718 Nov 02 13:47:53.003083 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4238/7935] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:52 2022] GET /compute/v2.1/servers/26284cd5-d71a-43ea-846f-52c8e7a79f57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:56.598997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d019488a-44cf-4c05-93b8-835b02ad8e08 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '.version_select at 0x7f228d32e550>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:56.603597 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d019488a-44cf-4c05-93b8-835b02ad8e08 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [58f6817e-0e64-4d70-86fd-4ecc655506dc] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:47:57.611904 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [None req-d019488a-44cf-4c05-93b8-835b02ad8e08 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [58f6817e-0e64-4d70-86fd-4ecc655506dc] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40584. Nov 02 13:47:57.633028 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d019488a-44cf-4c05-93b8-835b02ad8e08 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1228287091" status: 202 len: 0 microversion: 2.1 time: 1.038396 Nov 02 13:47:57.633614 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3698/7936] 10.222.0.45 () {58 vars in 1284 bytes} [Wed Nov 2 13:47:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1228287091 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:47:57.662994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-967928ec-ba9c-47aa-867b-d94d94fe6514 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: .version_select at 0x7f228dbcba60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-341147848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Ra8A+zOrGv7mFGzODcHsfivItL0d8jD8WXkn1chvm4Q/JDmUozxIR5XQz64lFYYPBu6b2OMNV/9DDBHAD/GFSex/YDNw8peAKU62yt5X88KclINW5/23wUFKo+UA4mw=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:57.680508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-967928ec-ba9c-47aa-867b-d94d94fe6514 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:57.685700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-967928ec-ba9c-47aa-867b-d94d94fe6514 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:57.700528 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [None req-967928ec-ba9c-47aa-867b-d94d94fe6514 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:47:58.708068 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [None req-967928ec-ba9c-47aa-867b-d94d94fe6514 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40588. Nov 02 13:47:58.722813 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-967928ec-ba9c-47aa-867b-d94d94fe6514 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.063935 Nov 02 13:47:58.723690 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4239/7937] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:47:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:04.533717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:04.538864 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-296177176", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "ab8776a9-b3d7-46cf-9e3c-093233a1c58b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-341147848", "security_groups": [{"name": "tempest-secgroup-smoke-912216099"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:04.670944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] validate_networks() for [('ab8776a9-b3d7-46cf-9e3c-093233a1c58b', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:48:05.158522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:48:05.158946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:48:05.159534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:48:05.159959 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:48:05.160366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:48:05.169375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:05.169878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:05.170319 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:05.171597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:05.172292 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:05.172729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:05.190283 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:48:05.195928 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:48:05.209984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:48:05.212848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:48:05.349868 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7ad35f99-6c01-4927-ad40-a02b15071944 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.817815 Nov 02 13:48:05.357074 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3699/7938] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:48:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:48:05.361773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=16 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:05.365614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf59cd86-34db-480c-8471-54b27d818893 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:05.366553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bf59cd86-34db-480c-8471-54b27d818893 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:05.431556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bf59cd86-34db-480c-8471-54b27d818893 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:05.443161 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bf59cd86-34db-480c-8471-54b27d818893 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1265 microversion: 2.1 time: 0.084029 Nov 02 13:48:05.443804 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4240/7939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:05 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:06.469773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:06.470540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:06.477716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:06.478259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:06.478931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:06.479641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:06.480096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:06.480523 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:06.602278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:06.610509 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-fccebd51-56da-45c9-af9a-0690c902fca2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1325 microversion: 2.1 time: 0.145441 Nov 02 13:48:06.611658 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3700/7940] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:06 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1325 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:07.637160 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:07.637733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:07.645543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:07.646110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:07.646571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:07.647457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:07.647935 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:07.648381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:07.811992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:07.821004 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ed0732a-3f82-4d88-bb62-fdc370db7a21 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1390 microversion: 2.1 time: 0.188061 Nov 02 13:48:07.821895 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4241/7941] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:07 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:08.485419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-938a401e-b6d2-4ba6-ad96-e47fa3ae5065 req-334e9c72-ea65-4a86-8839-1901dbad3046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0999a0d-a425-4713-af38-2882910d4d04", "tag": "11326013-8cc6-4e92-82f5-3a0ab59a8ed9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:08.496550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-938a401e-b6d2-4ba6-ad96-e47fa3ae5065 req-334e9c72-ea65-4a86-8839-1901dbad3046 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:08.497248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-938a401e-b6d2-4ba6-ad96-e47fa3ae5065 req-334e9c72-ea65-4a86-8839-1901dbad3046 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:08.497767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-938a401e-b6d2-4ba6-ad96-e47fa3ae5065 req-334e9c72-ea65-4a86-8839-1901dbad3046 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:08.510249 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-938a401e-b6d2-4ba6-ad96-e47fa3ae5065 req-334e9c72-ea65-4a86-8839-1901dbad3046 service nova] Creating event network-changed:11326013-8cc6-4e92-82f5-3a0ab59a8ed9 for instance c0999a0d-a425-4713-af38-2882910d4d04 on n-h2-855650-5 Nov 02 13:48:08.515517 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-938a401e-b6d2-4ba6-ad96-e47fa3ae5065 req-334e9c72-ea65-4a86-8839-1901dbad3046 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034450 Nov 02 13:48:08.516387 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3701/7942] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:08.846324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:08.847082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:08.855065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:08.855618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:08.856116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:08.856897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:08.857425 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:08.858500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:09.006030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:09.015201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1534ced0-9775-43f0-9f4d-3fce36e6ef0b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1390 microversion: 2.1 time: 0.173387 Nov 02 13:48:09.015988 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4242/7943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:08 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:10.040769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:10.041490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:10.049220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:10.049716 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:10.050207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:10.050921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:10.051381 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:10.051896 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:10.195652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:10.203544 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2e4cadcf-7cfb-474e-b528-0fa96b5b3f51 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1390 microversion: 2.1 time: 0.167659 Nov 02 13:48:10.204139 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3702/7944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:10 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:11.238967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:11.239595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:11.247335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:11.247846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:11.248306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:11.249035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:11.249509 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:11.249951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:11.406187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:11.416833 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9871dace-3a29-4fbf-b990-eab7067a4030 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1390 microversion: 2.1 time: 0.193584 Nov 02 13:48:11.418014 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4243/7945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:11 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1390 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:12.441997 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:12.442655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:12.449894 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:12.450437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:12.450878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:12.452220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:12.452682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:12.453112 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:12.863654 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:12.872852 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6266070c-3bd7-47de-b880-03d60fe153a6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1390 microversion: 2.1 time: 0.435130 Nov 02 13:48:12.874024 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3703/7946] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:12 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1390 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:13.945182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:13.945818 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:13.952794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.953288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.953742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.954484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.954949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.955388 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.097895 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:14.106023 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d5812576-1e15-4481-ad90-ccfb47311a76 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1390 microversion: 2.1 time: 0.213549 Nov 02 13:48:14.106627 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4244/7947] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:13 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1390 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:15.046003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-9b581d03-fcb1-4c3b-8ab6-4754610c01da req-89ba04ca-3f58-4ab5-b5ce-d01eab1eeea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0999a0d-a425-4713-af38-2882910d4d04", "name": "network-vif-plugged", "status": "completed", "tag": "11326013-8cc6-4e92-82f5-3a0ab59a8ed9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:15.056430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9b581d03-fcb1-4c3b-8ab6-4754610c01da req-89ba04ca-3f58-4ab5-b5ce-d01eab1eeea3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.056915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9b581d03-fcb1-4c3b-8ab6-4754610c01da req-89ba04ca-3f58-4ab5-b5ce-d01eab1eeea3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.057606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-9b581d03-fcb1-4c3b-8ab6-4754610c01da req-89ba04ca-3f58-4ab5-b5ce-d01eab1eeea3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.072126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-9b581d03-fcb1-4c3b-8ab6-4754610c01da req-89ba04ca-3f58-4ab5-b5ce-d01eab1eeea3 service nova] Creating event network-vif-plugged:11326013-8cc6-4e92-82f5-3a0ab59a8ed9 for instance c0999a0d-a425-4713-af38-2882910d4d04 on n-h2-855650-5 Nov 02 13:48:15.079107 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-9b581d03-fcb1-4c3b-8ab6-4754610c01da req-89ba04ca-3f58-4ab5-b5ce-d01eab1eeea3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037414 Nov 02 13:48:15.079634 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3704/7948] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:15.130347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:15.130973 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:15.140268 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.140784 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.141243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.142011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.142488 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.142955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.285482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:15.293602 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b366be2-04ac-49e0-8aa2-4a4fd617ff93 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1390 microversion: 2.1 time: 0.167345 Nov 02 13:48:15.294233 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4245/7949] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:15 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:16.317323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:16.318094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:16.320043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:16.320733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:16.328144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.328646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.329097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.329816 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.330310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.330764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.472191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:16.479977 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f2d99da5-a4c8-41ee-bb4f-964e30c755c6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1390 microversion: 2.1 time: 0.166852 Nov 02 13:48:16.480540 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3705/7950] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:16 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:17.503391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:17.504131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:17.505980 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:17.512462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.512977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.513436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.514189 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.514676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.515128 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.653414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:17.661795 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-391348b4-055e-406a-886c-4349554944fe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1562 microversion: 2.1 time: 0.162942 Nov 02 13:48:17.662409 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4246/7951] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:17 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:17.684640 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:17.685263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:17.692758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.693260 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.693704 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.694442 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.694904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.695341 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.833541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:17.841493 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a46804e4-7d14-4315-a312-bec915afdae7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1562 microversion: 2.1 time: 0.160731 Nov 02 13:48:17.842371 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3706/7952] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:17 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:19.506521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:19.507104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:19.510177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:19.518889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.519412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.519871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.521001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.521558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.522113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.571090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-521c0ab2-019c-412e-91e9-9e2f8623ffb1 req-398618b3-9cb0-46e5-9b9a-a4a975c2b487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0999a0d-a425-4713-af38-2882910d4d04", "tag": "11326013-8cc6-4e92-82f5-3a0ab59a8ed9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:19.576111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:19.583914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-521c0ab2-019c-412e-91e9-9e2f8623ffb1 req-398618b3-9cb0-46e5-9b9a-a4a975c2b487 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.584744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-521c0ab2-019c-412e-91e9-9e2f8623ffb1 req-398618b3-9cb0-46e5-9b9a-a4a975c2b487 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.585140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-521c0ab2-019c-412e-91e9-9e2f8623ffb1 req-398618b3-9cb0-46e5-9b9a-a4a975c2b487 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.599595 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-521c0ab2-019c-412e-91e9-9e2f8623ffb1 req-398618b3-9cb0-46e5-9b9a-a4a975c2b487 service nova] Creating event network-changed:11326013-8cc6-4e92-82f5-3a0ab59a8ed9 for instance c0999a0d-a425-4713-af38-2882910d4d04 on n-h2-855650-5 Nov 02 13:48:19.606416 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-521c0ab2-019c-412e-91e9-9e2f8623ffb1 req-398618b3-9cb0-46e5-9b9a-a4a975c2b487 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101514 Nov 02 13:48:19.607637 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3707/7953] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:48:19.677399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:19.685437 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-69d80067-6739-4fd3-b89e-7769189cf49a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1562 microversion: 2.1 time: 0.183370 Nov 02 13:48:19.686051 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4247/7954] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:19 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:52.997624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=38 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:53.003106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:53.006078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:53.013122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.013618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.014133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.014868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.015344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.015781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.088492 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c9b934d1-0bc1-4ad9-8fae-89a5b53ed22c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action" status: 200 len: 24568 microversion: 2.1 time: 0.092951 Nov 02 13:48:53.089379 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3708/7955] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:48:52 2022] POST /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action => generated 24568 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:49:31.807782 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:49:31.808466 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:49:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action (ip 10.222.0.45) !!! Nov 02 13:49:31.810082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:31.810856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=42 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:31.815747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:31.819045 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:31.829637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.830183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.830641 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.831380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.832100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.832543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.937889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.945663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Old instance type m1.heat2, new instance type m1.heat {{(pid=120722) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:49:31.953444 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:31.953936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:31.954479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:31.954911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:31.955381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:32.036128 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-875cd26b-f348-4c5a-893e-24ac7352e4f7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action" status: 202 len: 0 microversion: 2.1 time: 0.230325 Nov 02 13:49:32.037081 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4248/7956] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:49:31 2022] POST /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:49:32.047971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:32.049386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:32.057031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:32.058212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:32.061206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.062173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.062883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.063922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.064637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.065317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.244965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.258971 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-00ab0a6f-fee0-4f77-9c3c-048f7787fa6a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1689 microversion: 2.1 time: 0.216428 Nov 02 13:49:32.259743 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3709/7957] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:32 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:33.289645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.290353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.297116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.297701 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.298148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.298887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.299373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.299821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.465235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.475285 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7d8e6c98-d509-4f2a-a41a-2919397374c1 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1689 microversion: 2.1 time: 0.191595 Nov 02 13:49:33.476246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4249/7958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:34.503778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:34.505085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:34.514680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.515285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.515746 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.516486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.516953 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.517386 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.704483 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.714493 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-760b40d0-5da3-4f67-8cef-ba143f69a2fd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1689 microversion: 2.1 time: 0.217364 Nov 02 13:49:34.715088 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3710/7959] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:34 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:35.754154 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:35.754797 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.761876 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.762421 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.762883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.763612 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.764089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.764536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.906709 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.915342 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea3df6e4-a2e3-4c80-87af-90742eeb100a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.165446 Nov 02 13:49:35.915922 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4250/7960] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:35 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:36.939862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:36.940506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:36.947663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.948159 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.948600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.949298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.949754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.950225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.088558 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.096573 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3979ffa6-118b-427f-8abd-22a83d0ca322 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.160712 Nov 02 13:49:37.097167 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3711/7961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:36 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:38.121683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.122381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.129408 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.129911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.130963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.131681 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.132155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.132604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.269567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.277583 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2d3016f0-e0ce-4147-bd3b-4a0f7a4d7051 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.160268 Nov 02 13:49:38.278190 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4251/7962] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:38 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:39.300810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.301433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.308469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.308960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.309403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.310140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.310604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.311035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.453236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:39.458286 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d48915ba-47dc-466b-82d6-84291551408b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.161175 Nov 02 13:49:39.459365 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3712/7963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:39 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:40.482602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:40.483253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:40.490822 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.491321 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.491775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.492503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.493030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.493414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.636441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.644997 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a536eb4b-52e1-40bc-80d1-0c70c493131e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.166242 Nov 02 13:49:40.645627 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4252/7964] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:40 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:41.669641 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.670253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.677732 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.678255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.678711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.679430 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.679895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.680332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.814097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.822165 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ffa6421-b9bd-41bb-bc1b-fbe856eb87dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.156522 Nov 02 13:49:41.822814 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3713/7965] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:41 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:42.847108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.847735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.854955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.855452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.855902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.856605 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.857096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.857533 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.997129 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.005083 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0fc56f5-b99e-4c5f-8f8c-0aeae85580d6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.161857 Nov 02 13:49:43.006096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4253/7966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:42 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:44.029380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:44.030138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:44.037608 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.038138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.038587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.039309 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.039770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.040207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.194425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:44.202616 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2722a708-971a-4237-84b2-8ec6b1287712 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.177163 Nov 02 13:49:44.203207 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3714/7967] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:44 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:45.230197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:45.230823 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:45.237523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.238073 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.238539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.239893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.240385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.240835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.380742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:45.388779 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bf5cd226-01d8-4ddb-a008-f5de9aee360c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.163061 Nov 02 13:49:45.389367 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4254/7968] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:45 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:46.412229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:46.412840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:46.419448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.419948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.420407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.421151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.421621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.422155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.564406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.572911 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e775a86b-acce-4d19-805a-4c73047843d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.164740 Nov 02 13:49:46.573504 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3715/7969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:46 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:47.597870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:47.599012 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:47.606683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.607192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.607649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.608372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.608843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.609285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.761998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.770542 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-27eb21ab-9759-41f3-b3c2-162ccddda268 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.176625 Nov 02 13:49:47.771151 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4255/7970] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:47 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:48.793571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:48.794222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.802100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.802592 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.803031 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.803733 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.804191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.804618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.944241 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.953107 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b4a3791-dfa5-4f9a-89fb-89ce339110aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.163475 Nov 02 13:49:48.954063 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3716/7971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:48 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:49.977737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.978418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.985792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.986343 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.986811 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.987607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.988119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.988573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.178933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.187404 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7cfdc7c-06d3-4f13-a241-5815cac85f78 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.214224 Nov 02 13:49:50.188091 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4256/7972] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:51.211571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:51.212194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:51.219306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.219800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.220250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.220968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.221433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.221879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.370433 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.378763 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-85bb1c3a-6ca3-47fb-8752-acf760105c59 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1694 microversion: 2.1 time: 0.171105 Nov 02 13:49:51.379349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3717/7973] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:51 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:52.402552 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.403182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.410545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.411648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.412120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.412859 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.413493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.414403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.547464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-a39b4911-1d95-4596-bcb4-45a8ea451fe6 req-c09328d3-1e08-4791-9328-7603e26ad8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0999a0d-a425-4713-af38-2882910d4d04", "name": "network-vif-unplugged", "status": "completed", "tag": "11326013-8cc6-4e92-82f5-3a0ab59a8ed9"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:52.559648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a39b4911-1d95-4596-bcb4-45a8ea451fe6 req-c09328d3-1e08-4791-9328-7603e26ad8c4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.560300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a39b4911-1d95-4596-bcb4-45a8ea451fe6 req-c09328d3-1e08-4791-9328-7603e26ad8c4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.560754 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-a39b4911-1d95-4596-bcb4-45a8ea451fe6 req-c09328d3-1e08-4791-9328-7603e26ad8c4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.577929 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-a39b4911-1d95-4596-bcb4-45a8ea451fe6 req-c09328d3-1e08-4791-9328-7603e26ad8c4 service nova] Creating event network-vif-unplugged:11326013-8cc6-4e92-82f5-3a0ab59a8ed9 for instance c0999a0d-a425-4713-af38-2882910d4d04 on n-h1-855650-5 Nov 02 13:49:52.584637 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.585869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [req-a39b4911-1d95-4596-bcb4-45a8ea451fe6 req-c09328d3-1e08-4791-9328-7603e26ad8c4 service nova] Instance c0999a0d-a425-4713-af38-2882910d4d04 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:49:52.593845 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df68fb4a-c979-44af-8c8b-fa9a2afe2777 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1693 microversion: 2.1 time: 0.195040 Nov 02 13:49:52.603583 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-a39b4911-1d95-4596-bcb4-45a8ea451fe6 req-c09328d3-1e08-4791-9328-7603e26ad8c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060848 Nov 02 13:49:52.604467 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3718/7975] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:52.604870 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4257/7975] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1693 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:53.619446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:53.620257 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:53.628284 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.628785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.629447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.630785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.631330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.631700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.776809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.784861 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9afa62e3-5b9d-4b8f-9778-78f4b2bcf196 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1693 microversion: 2.1 time: 0.169839 Nov 02 13:49:53.785440 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3719/7976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:53 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:54.640557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0999a0d-a425-4713-af38-2882910d4d04", "tag": "11326013-8cc6-4e92-82f5-3a0ab59a8ed9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:54.651397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.651900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.652353 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.664637 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] Creating event network-changed:11326013-8cc6-4e92-82f5-3a0ab59a8ed9 for instance c0999a0d-a425-4713-af38-2882910d4d04 on n-h1-855650-5 Nov 02 13:49:54.670327 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] Instance c0999a0d-a425-4713-af38-2882910d4d04 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855650-5', 'n-h2-855650-5'} {{(pid=120722) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:49:54.675270 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] [a115c0b0-9ad2-4e89-af95-c1c83e96c142] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:49:54.809212 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:54.809838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:54.816616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.817162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.818181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.818905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.819378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.819817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.964350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:54.973136 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9fa3128-ade3-407c-b4b4-97ede3f67dde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1691 microversion: 2.1 time: 0.168081 Nov 02 13:49:54.974270 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3720/7977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:54 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:55.683377 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] [a115c0b0-9ad2-4e89-af95-c1c83e96c142] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40800. Nov 02 13:49:55.691796 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-942499f4-3406-48d7-a85f-9d824351d97d req-892c1867-47a7-4c9a-8e49-2ab110c43ec7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.054983 Nov 02 13:49:55.692701 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4258/7978] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:55.998250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:55.999133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:56.006591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.007296 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.007515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.008219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.008668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.009300 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.303114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.311087 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-003ef823-2017-466e-a947-a4d43819680c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1691 microversion: 2.1 time: 0.316789 Nov 02 13:49:56.312536 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3721/7979] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:55 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1691 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:57.337771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:57.338538 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:57.345868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.346294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.346751 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.347477 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.347948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.348505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.491458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.500835 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acc0c81a-9130-462e-907e-a7ddfcfe6375 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1688 microversion: 2.1 time: 0.169075 Nov 02 13:49:57.501418 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4259/7980] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:57 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:57.523770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:57.524317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:57.532074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.532571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.533017 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.533728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.534216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.534651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.599838 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-94923ffb-ae73-486b-afaa-0dbe07286dc0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action" status: 204 len: 0 microversion: 2.1 time: 0.079803 Nov 02 13:49:57.600666 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3722/7981] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:49:57 2022] POST /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:57.611677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:57.613137 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:57.623969 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.624715 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.625359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.626285 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.626970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.627541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.789868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.798011 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a4027830-bad3-4f14-9c72-4fbca6107821 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1688 microversion: 2.1 time: 0.192149 Nov 02 13:49:57.798583 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4260/7982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:57 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:57.821866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:57.822784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:57.829542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.830007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.830463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.831176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.831881 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.832331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.061780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:58.070325 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dc8d5c16-59c5-4847-b153-5252001ae940 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1688 microversion: 2.1 time: 0.253664 Nov 02 13:49:58.071174 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3723/7983] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:57 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:59.068382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f301f073-44d1-4f87-ab58-5fa3d5f457a0 req-a79f1dd0-4262-4c63-81a4-096a67e5239b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0999a0d-a425-4713-af38-2882910d4d04", "name": "network-vif-plugged", "status": "completed", "tag": "11326013-8cc6-4e92-82f5-3a0ab59a8ed9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.078613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f301f073-44d1-4f87-ab58-5fa3d5f457a0 req-a79f1dd0-4262-4c63-81a4-096a67e5239b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.079158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f301f073-44d1-4f87-ab58-5fa3d5f457a0 req-a79f1dd0-4262-4c63-81a4-096a67e5239b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.079717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f301f073-44d1-4f87-ab58-5fa3d5f457a0 req-a79f1dd0-4262-4c63-81a4-096a67e5239b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.095224 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f301f073-44d1-4f87-ab58-5fa3d5f457a0 req-a79f1dd0-4262-4c63-81a4-096a67e5239b service nova] Creating event network-vif-plugged:11326013-8cc6-4e92-82f5-3a0ab59a8ed9 for instance c0999a0d-a425-4713-af38-2882910d4d04 on n-h1-855650-5 Nov 02 13:49:59.099329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:59.100800 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:59.101515 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f301f073-44d1-4f87-ab58-5fa3d5f457a0 req-a79f1dd0-4262-4c63-81a4-096a67e5239b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038410 Nov 02 13:49:59.102777 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4261/7984] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:59.109255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.110083 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.110908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.112068 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.112742 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.113185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.253490 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.255860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:59.263001 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a09eb9ea-69bc-4c7f-9e3e-cf2c038ac31b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1680 microversion: 2.1 time: 0.171320 Nov 02 13:49:59.263598 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3724/7985] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:59 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:31.490281 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:31.492616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:31.494899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=32 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:31.495555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:31.502963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.503462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.503938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.504624 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.505585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.506040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.579960 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b643372-2543-457c-a940-3f0efc14b261 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action" status: 200 len: 24580 microversion: 2.1 time: 0.094045 Nov 02 13:50:31.580649 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4262/7986] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:50:31 2022] POST /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04/action => generated 24580 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:50:55.505079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:55.506911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:55.507591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d0102aaa-1acf-4ea6-a3a7-6d64bc430a76 req-ac672aa3-1855-47ed-be7f-1ed879c229ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0999a0d-a425-4713-af38-2882910d4d04", "tag": "11326013-8cc6-4e92-82f5-3a0ab59a8ed9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:55.511554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=32 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:55.515923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:55.516686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:55.517161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:55.517931 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:55.518438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:55.518883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:55.524433 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:55.527192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:55.532106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0102aaa-1acf-4ea6-a3a7-6d64bc430a76 req-ac672aa3-1855-47ed-be7f-1ed879c229ec service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:55.533428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0102aaa-1acf-4ea6-a3a7-6d64bc430a76 req-ac672aa3-1855-47ed-be7f-1ed879c229ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:55.534588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0102aaa-1acf-4ea6-a3a7-6d64bc430a76 req-ac672aa3-1855-47ed-be7f-1ed879c229ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:55.556254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:55.560740 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d0102aaa-1acf-4ea6-a3a7-6d64bc430a76 req-ac672aa3-1855-47ed-be7f-1ed879c229ec service nova] Creating event network-changed:11326013-8cc6-4e92-82f5-3a0ab59a8ed9 for instance c0999a0d-a425-4713-af38-2882910d4d04 on n-h1-855650-5 Nov 02 13:50:55.570837 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d0102aaa-1acf-4ea6-a3a7-6d64bc430a76 req-ac672aa3-1855-47ed-be7f-1ed879c229ec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070813 Nov 02 13:50:55.572117 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4263/7987] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:55.654285 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dd146aba-261f-42aa-80ab-23bb41b7d32c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 204 len: 0 microversion: 2.1 time: 0.154761 Nov 02 13:50:55.655510 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3725/7988] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:50:55 2022] DELETE /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:55.665025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:55.665747 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:55.672345 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:55.672855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:55.673348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:55.674066 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:55.674540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:55.674977 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:55.831728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:55.840945 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-78dfc522-8d54-448e-8e0f-cf3d60317575 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1686 microversion: 2.1 time: 0.180628 Nov 02 13:50:55.841543 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4264/7989] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:55 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:56.881827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:56.882577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:56.889939 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:56.890473 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:56.890923 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:56.891652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:56.892111 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:56.892543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:57.113065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:57.121691 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d40dcca3-d251-467f-a2de-5484e8fecfea tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1686 microversion: 2.1 time: 0.244595 Nov 02 13:50:57.122308 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3726/7990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:56 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1686 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:57.749457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-32e3abf5-4679-48a5-a263-200e514ef2e9 req-c1195467-358d-4f00-a45d-6b12f07abf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0999a0d-a425-4713-af38-2882910d4d04", "name": "network-vif-deleted", "tag": "11326013-8cc6-4e92-82f5-3a0ab59a8ed9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:57.762677 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32e3abf5-4679-48a5-a263-200e514ef2e9 req-c1195467-358d-4f00-a45d-6b12f07abf4b service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:57.763182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32e3abf5-4679-48a5-a263-200e514ef2e9 req-c1195467-358d-4f00-a45d-6b12f07abf4b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:57.763633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-32e3abf5-4679-48a5-a263-200e514ef2e9 req-c1195467-358d-4f00-a45d-6b12f07abf4b service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:57.776736 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-32e3abf5-4679-48a5-a263-200e514ef2e9 req-c1195467-358d-4f00-a45d-6b12f07abf4b service nova] Creating event network-vif-deleted:11326013-8cc6-4e92-82f5-3a0ab59a8ed9 for instance c0999a0d-a425-4713-af38-2882910d4d04 on n-h1-855650-5 Nov 02 13:50:57.782843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-32e3abf5-4679-48a5-a263-200e514ef2e9 req-c1195467-358d-4f00-a45d-6b12f07abf4b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037353 Nov 02 13:50:57.783630 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4265/7991] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:50:58.146804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:58.148096 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:58.155582 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:58.156090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:58.156542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:58.157270 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:58.157783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:58.158247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:58.194854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:58.195273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:58.195725 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:58.196195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lazy-loading 'fault' on Instance uuid c0999a0d-a425-4713-af38-2882910d4d04 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:58.246840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:58.256670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0ca1b90e-f240-40c0-b87f-13b006b2467c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 200 len: 1355 microversion: 2.1 time: 0.113863 Nov 02 13:50:58.257257 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3727/7992] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:58 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 1355 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:59.281501 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:59.282253 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: c0999a0d-a425-4713-af38-2882910d4d04] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:59.289062 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:59.289571 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:59.290058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:59.290780 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:59.291262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:59.291716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:59.306066 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] HTTP exception thrown: Instance c0999a0d-a425-4713-af38-2882910d4d04 could not be found. Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Request method failure captured: Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 HTTP/1.1 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnPx4EFsBnbqTTmYNA2b279hrz_QSLXb2Ap33NXVkmTN_imatYBnwdoBsi2sTcAHqbBSps6n5W7XN3xrMHtONr-OCrP98Ms6cPB6ulL_eGKrj3XFTLFG-aaV-EzAaUiOpxkLJjQP0AuOPuhI8_xX5UpzLDOaTAHbGq9dXAsMGa7O5wQ Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 17d93319feb94e59bd2e47c2d91f45ef Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance c0999a0d-a425-4713-af38-2882910d4d04 could not be found. Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': 'c0999a0d-a425-4713-af38-2882910d4d04'} Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0999a0d-a425-4713-af38-2882910d4d04 could not be found. Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0999a0d-a425-4713-af38-2882910d4d04 could not be found. Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:50:59.307762 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0999a0d-a425-4713-af38-2882910d4d04 could not be found. Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Returning 404 to user: Instance c0999a0d-a425-4713-af38-2882910d4d04 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-878ffb6c-9c59-48b7-99c0-d254f3315794 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04" status: 404 len: 111 microversion: 2.1 time: 0.032958 Nov 02 13:50:59.313216 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4266/7993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:59 2022] GET /compute/v2.1/servers/c0999a0d-a425-4713-af38-2882910d4d04 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:03.014846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-11fc4c27-0d6d-4921-9aa1-7b8b98e31595 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '.version_select at 0x7f228d4419d0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:03.041354 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-11fc4c27-0d6d-4921-9aa1-7b8b98e31595 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-341147848" status: 202 len: 0 microversion: 2.1 time: 0.030448 Nov 02 13:51:03.041958 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3728/7994] 10.222.0.45 () {58 vars in 1281 bytes} [Wed Nov 2 13:51:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-341147848 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:03.072116 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d5774e52-2da0-470e-9830-4c5a06b6c446 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: .version_select at 0x7f228e6901f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1520588772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIogMjTz5zlXUWLIIVCGMqrGPInjhyvi04OYuDKOkpf6nik0r9LYXU0IvThZMuDhkZkuQoSgk0j5qoaFPUZNiFXdzyayvO30A4TrIrIHd8twwelIWB/+0mvC2+5pJxcnEA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:03.091342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-d5774e52-2da0-470e-9830-4c5a06b6c446 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:03.096997 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-d5774e52-2da0-470e-9830-4c5a06b6c446 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:03.112492 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d5774e52-2da0-470e-9830-4c5a06b6c446 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:51:04.120765 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5774e52-2da0-470e-9830-4c5a06b6c446 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40874. Nov 02 13:51:04.135570 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d5774e52-2da0-470e-9830-4c5a06b6c446 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.067802 Nov 02 13:51:04.136192 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4267/7995] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:51:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:10.316795 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:10.321303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-912025369", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "b1a35ba3-603f-491a-acd7-2087f4863d91"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1520588772", "security_groups": [{"name": "tempest-secgroup-smoke-720409650"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:10.462839 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] validate_networks() for [('b1a35ba3-603f-491a-acd7-2087f4863d91', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:51:10.899043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:10.899589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:10.900148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:10.900660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:10.901178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:10.910824 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.912178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.912579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.913331 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.913798 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.914261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.935744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:10.941900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:10.956206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:10.959411 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:11.015284 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3d603a4f-6ce1-409c-b819-154e62df9aaf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.700059 Nov 02 13:51:11.016288 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3729/7996] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:51:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:51:11.025583 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:11.031683 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfc202b1-9c25-4825-ae30-409aa19409a5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:11.032619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfc202b1-9c25-4825-ae30-409aa19409a5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:11.092623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cfc202b1-9c25-4825-ae30-409aa19409a5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:11.102001 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfc202b1-9c25-4825-ae30-409aa19409a5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1266 microversion: 2.1 time: 0.077996 Nov 02 13:51:11.115101 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4268/7997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:11 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:12.126007 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:12.132149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:12.140793 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.141303 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.141759 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.142501 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.143167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.143786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.284775 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:12.295569 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b862a11-f0f7-4fe7-b29a-486bc099aaa6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1318 microversion: 2.1 time: 0.173478 Nov 02 13:51:12.322447 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3730/7998] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:12 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:13.338113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:13.339658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:13.358642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.359836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.360723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.361860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.362606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.363230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.561231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:13.571593 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82a0e0f8-dada-42ba-a113-8dba79366ec2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1391 microversion: 2.1 time: 0.247721 Nov 02 13:51:13.588370 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4269/7999] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:13 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:14.033250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-f7764a5b-1f14-43b8-a6df-2a68663457c4 req-1607c146-91ee-437c-b9d0-6a883017971d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b8786b-d929-4bdd-ae7a-f680c0fedbb4", "tag": "e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:14.046629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f7764a5b-1f14-43b8-a6df-2a68663457c4 req-1607c146-91ee-437c-b9d0-6a883017971d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:14.047132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f7764a5b-1f14-43b8-a6df-2a68663457c4 req-1607c146-91ee-437c-b9d0-6a883017971d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:14.047583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-f7764a5b-1f14-43b8-a6df-2a68663457c4 req-1607c146-91ee-437c-b9d0-6a883017971d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.059145 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-f7764a5b-1f14-43b8-a6df-2a68663457c4 req-1607c146-91ee-437c-b9d0-6a883017971d service nova] Creating event network-changed:e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba for instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 on n-h2-855650-5 Nov 02 13:51:14.064345 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-f7764a5b-1f14-43b8-a6df-2a68663457c4 req-1607c146-91ee-437c-b9d0-6a883017971d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034975 Nov 02 13:51:14.065280 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3731/8000] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:14.595609 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:14.596175 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:14.603249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:14.603764 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:14.604238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.604959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:14.605441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:14.605890 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.743854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:14.751800 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-810e445a-a978-4b8b-bc46-3e019cba67d5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1391 microversion: 2.1 time: 0.160220 Nov 02 13:51:14.752386 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4270/8001] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:14 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:15.776504 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:15.777220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:15.784205 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.784709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.785200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.785952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.786461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.786900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.924637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:15.933609 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5e38ef9-2da7-4536-81b2-8845a2837c9e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1391 microversion: 2.1 time: 0.161346 Nov 02 13:51:15.934334 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3732/8002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:15 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:16.960398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:16.961002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:16.968777 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:16.969295 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:16.969845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:16.970520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:16.971120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:16.971802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:17.115945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:17.123987 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7515aed-598f-4fa9-85d3-2e33e6d2631a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1391 microversion: 2.1 time: 0.168739 Nov 02 13:51:17.124690 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4271/8003] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:16 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:18.148167 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:18.148741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:18.155709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.156206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.156659 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.157380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.157845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.158315 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.294219 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:18.302612 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-40de967c-e941-4c99-abde-a7dc0f28b7b4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1391 microversion: 2.1 time: 0.159172 Nov 02 13:51:18.303201 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3733/8004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:18 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:19.326617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:19.327288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:19.335795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.336307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.336759 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.337949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.337949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.338424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.482402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:19.495549 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb25fc4a-b6f1-44d6-8699-eb41c5b811bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1391 microversion: 2.1 time: 0.172850 Nov 02 13:51:19.496330 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4272/8005] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:19 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:20.107905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-71481a99-e0ae-4af1-8cd9-17d0f49e0f34 req-cc739174-e653-48a6-9778-62e38dcf1185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b8786b-d929-4bdd-ae7a-f680c0fedbb4", "name": "network-vif-plugged", "status": "completed", "tag": "e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:20.118872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-71481a99-e0ae-4af1-8cd9-17d0f49e0f34 req-cc739174-e653-48a6-9778-62e38dcf1185 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.119370 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-71481a99-e0ae-4af1-8cd9-17d0f49e0f34 req-cc739174-e653-48a6-9778-62e38dcf1185 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.119818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-71481a99-e0ae-4af1-8cd9-17d0f49e0f34 req-cc739174-e653-48a6-9778-62e38dcf1185 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.132338 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-71481a99-e0ae-4af1-8cd9-17d0f49e0f34 req-cc739174-e653-48a6-9778-62e38dcf1185 service nova] Creating event network-vif-plugged:e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba for instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 on n-h2-855650-5 Nov 02 13:51:20.137391 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-71481a99-e0ae-4af1-8cd9-17d0f49e0f34 req-cc739174-e653-48a6-9778-62e38dcf1185 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089202 Nov 02 13:51:20.138033 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3734/8006] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:20.519150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:20.519805 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:20.527508 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.528022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.528483 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.529209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.529737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.530174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.666819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:20.674739 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7da481c5-b124-4960-9582-68f32f3bdbde tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1391 microversion: 2.1 time: 0.159709 Nov 02 13:51:20.675535 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4273/8007] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:20 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:21.697054 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:21.698285 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:21.704607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:21.705337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:21.713913 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.714446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.714901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.715635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.716103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.716545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.855726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:21.863750 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-66ea0c46-f1fe-47a3-8b41-8364eaea90ab tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1563 microversion: 2.1 time: 0.168111 Nov 02 13:51:21.864992 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3735/8008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:21 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:21.887308 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:21.888042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:21.889943 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:21.896857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.897359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.897815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.898548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.899020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.899454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.040765 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:22.048817 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f51ad438-c2eb-4d2b-a75c-55c7f05c619e tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1563 microversion: 2.1 time: 0.165395 Nov 02 13:51:22.049400 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4274/8009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:21 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:23.675872 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:23.681591 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-644c8913-26b8-4d99-802b-602087ca8a47 req-f074e6e3-e18e-4384-8431-c9ea5b697be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b8786b-d929-4bdd-ae7a-f680c0fedbb4", "tag": "e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:23.688521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:23.696119 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:23.697076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:23.697413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:23.697944 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-644c8913-26b8-4d99-802b-602087ca8a47 req-f074e6e3-e18e-4384-8431-c9ea5b697be8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:23.698481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-644c8913-26b8-4d99-802b-602087ca8a47 req-f074e6e3-e18e-4384-8431-c9ea5b697be8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:23.698676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:23.698932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-644c8913-26b8-4d99-802b-602087ca8a47 req-f074e6e3-e18e-4384-8431-c9ea5b697be8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:23.699197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:23.699656 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:23.713435 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-644c8913-26b8-4d99-802b-602087ca8a47 req-f074e6e3-e18e-4384-8431-c9ea5b697be8 service nova] Creating event network-changed:e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba for instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 on n-h2-855650-5 Nov 02 13:51:23.721181 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-644c8913-26b8-4d99-802b-602087ca8a47 req-f074e6e3-e18e-4384-8431-c9ea5b697be8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041742 Nov 02 13:51:23.722224 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4275/8010] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:23.943629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:23.951966 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c776d79b-183e-4f21-8a8e-6acf99250fbf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1563 microversion: 2.1 time: 0.279979 Nov 02 13:51:23.952939 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3736/8011] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:23 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1563 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:57.292384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:57.293611 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=38 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:57.297995 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:57.300290 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:57.308259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.308767 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.309224 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.309949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.310452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.310893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.383788 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4ca3a06c-b36d-47a4-8ab1-7cec9563759d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action" status: 200 len: 24569 microversion: 2.1 time: 0.093327 Nov 02 13:51:57.384707 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4276/8012] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:51:57 2022] POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action => generated 24569 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:52:36.454061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:36.454717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=36 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:36.460940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63806fe2-a08f-4229-9578-2724179bc7c0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:36.468830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63806fe2-a08f-4229-9578-2724179bc7c0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.469322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63806fe2-a08f-4229-9578-2724179bc7c0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.469765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63806fe2-a08f-4229-9578-2724179bc7c0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.497728 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63806fe2-a08f-4229-9578-2724179bc7c0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Going to try to stop instance {{(pid=120723) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:52:36.545656 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63806fe2-a08f-4229-9578-2724179bc7c0 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action" status: 202 len: 0 microversion: 2.1 time: 0.093425 Nov 02 13:52:36.546377 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3737/8013] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:36 2022] POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:36.557279 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:36.558172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:36.560776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:36.561586 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:36.568756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.569207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.569665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.571072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.571072 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.571378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.729463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:36.738506 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85a56c72-39c9-4d22-a4cb-3347796c0cb7 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.185789 Nov 02 13:52:36.739064 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4277/8014] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:36 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:37.766151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:37.766902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:37.774000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.774509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.774965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.775860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.776155 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.776601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.947420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:37.961407 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b33dc9e5-e59c-413c-9f4c-f7c9a9cdb903 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.200396 Nov 02 13:52:37.962668 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3738/8015] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:37 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:38.988592 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:38.989209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:38.997371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:38.997371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:38.997809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:38.998719 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:38.999229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:38.999680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.154664 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:39.163838 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-df0d0f87-103d-4a33-8d82-5b15a96a58aa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.179539 Nov 02 13:52:39.164429 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4278/8016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:38 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:40.187487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:40.188091 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:40.195465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.196010 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.196502 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.197326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.197713 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.198186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.356254 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:40.365081 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a40986b4-ad97-4805-a374-ad7ad1008390 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.181479 Nov 02 13:52:40.366599 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3739/8017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:40 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:41.390197 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:41.390839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:41.399492 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.400028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.400745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.401902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.402513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.403021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.561987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:41.571664 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-963bc446-bed3-42ee-9c28-e61e6f5d9d28 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.186154 Nov 02 13:52:41.572377 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4279/8018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:41 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:42.607265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:42.607924 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:42.615618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.616062 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.616475 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.617206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.617674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.618142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.762479 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:42.772396 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be9253ac-7c87-4e07-9efe-99cb0c4af462 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.169269 Nov 02 13:52:42.772985 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3740/8019] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:42 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:43.797161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:43.797809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:43.805186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.805736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.806578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.807355 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.808098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.808800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.972473 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:43.980930 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8df75563-0478-4530-9fe8-e689325d4c6d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.187800 Nov 02 13:52:43.981554 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4280/8020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:43 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:45.008593 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:45.009672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:45.017661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.018695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.019150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.019855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.020312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.020737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.162509 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:45.170376 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48dbde0a-4e9e-4b12-99b5-32971fd7d48f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.168544 Nov 02 13:52:45.170952 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3741/8021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:45 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:46.194394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:46.195035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:46.202043 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:46.202549 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:46.203016 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:46.203740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:46.204212 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:46.204656 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:46.344195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:46.352374 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be732ffb-c58e-4b07-b149-30e2fc379d15 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1692 microversion: 2.1 time: 0.162454 Nov 02 13:52:46.352962 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4281/8022] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:46 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:47.377140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:47.378279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:47.385268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.385756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.386236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.386937 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.387385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.387808 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.534623 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:47.545333 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-af1bacfe-de7a-4d63-96b8-8ea6b4dce63d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1669 microversion: 2.1 time: 0.172098 Nov 02 13:52:47.546067 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3742/8023] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:47 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:48.646691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:48.648897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:48.656262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.656798 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.657256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.658089 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.658594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.659095 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.723219 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4264564-7934-4a71-8b93-a6b3f11c34c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action" status: 200 len: 38375 microversion: 2.1 time: 0.080422 Nov 02 13:52:48.723874 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4282/8024] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:48 2022] POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action => generated 38375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:52:48.735958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4ef15362-9976-4cda-b36f-092c39d5f3da tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:48.742962 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ef15362-9976-4cda-b36f-092c39d5f3da tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.743453 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ef15362-9976-4cda-b36f-092c39d5f3da tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.743892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4ef15362-9976-4cda-b36f-092c39d5f3da tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.766703 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4ef15362-9976-4cda-b36f-092c39d5f3da tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Going to try to start instance {{(pid=120723) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:52:48.809317 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4ef15362-9976-4cda-b36f-092c39d5f3da tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action" status: 202 len: 0 microversion: 2.1 time: 0.077115 Nov 02 13:52:48.809927 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3743/8025] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:48 2022] POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:48.819120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:48.819981 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:48.827140 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.827626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.828127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.828816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.829292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.829738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.977237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:48.985370 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5636afc6-8493-4ce5-8e6f-c22e6fdc09b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1678 microversion: 2.1 time: 0.170590 Nov 02 13:52:48.985996 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4283/8026] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:48 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:50.012199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:50.012993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:50.021613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:50.022468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:50.022977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.023941 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:50.024405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:50.024843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.170185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:50.178006 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c8eda4f5-bc61-4eae-9795-51ef2b37398f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1678 microversion: 2.1 time: 0.171695 Nov 02 13:52:50.178581 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3744/8027] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:50 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:51.201367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:51.202020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:51.212874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:51.213391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:51.213853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:51.214607 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:51.215086 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:51.215563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:51.353238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:51.362420 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66797bef-6477-4e95-bfda-ad7e95df3182 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1682 microversion: 2.1 time: 0.164319 Nov 02 13:52:51.362957 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4284/8028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:51 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:23.591239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=16 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:23.591993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:23.826837 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:23.829204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:23.836228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.836723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.837170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.837879 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.838378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.838818 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.915629 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7a3145a4-93b7-4b59-9490-1cd47dafca32 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action" status: 200 len: 62934 microversion: 2.1 time: 0.329161 Nov 02 13:53:23.916283 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3745/8029] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:53:23 2022] POST /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4/action => generated 62934 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:53:41.065193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:41.073367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:41.074065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:41.077587 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 13:53:41.078674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:41.083999 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:53:41.084174 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:53:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 (ip 10.222.0.45) !!! Nov 02 13:53:41.085613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=16 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:41.086900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=46 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:41.095513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:41.096178 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:41.096836 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:41.097871 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:41.098541 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:41.098988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:41.134180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:41.152503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-2c79eb9b-9afc-439f-9990-a6692cfc3e4c req-5ad048c6-ee81-4604-9eac-f063692e3cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b8786b-d929-4bdd-ae7a-f680c0fedbb4", "tag": "e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:41.164311 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2c79eb9b-9afc-439f-9990-a6692cfc3e4c req-5ad048c6-ee81-4604-9eac-f063692e3cf3 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:41.164862 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2c79eb9b-9afc-439f-9990-a6692cfc3e4c req-5ad048c6-ee81-4604-9eac-f063692e3cf3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:41.165439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-2c79eb9b-9afc-439f-9990-a6692cfc3e4c req-5ad048c6-ee81-4604-9eac-f063692e3cf3 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:41.177730 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-2c79eb9b-9afc-439f-9990-a6692cfc3e4c req-5ad048c6-ee81-4604-9eac-f063692e3cf3 service nova] Creating event network-changed:e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba for instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 on n-h2-855650-5 Nov 02 13:53:41.183639 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-2c79eb9b-9afc-439f-9990-a6692cfc3e4c req-5ad048c6-ee81-4604-9eac-f063692e3cf3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115696 Nov 02 13:53:41.184587 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3746/8030] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:41.232920 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-30f77ed8-ccf8-4ba3-bf3a-d454884eced5 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 204 len: 0 microversion: 2.1 time: 0.171263 Nov 02 13:53:41.234075 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4285/8031] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:41 2022] DELETE /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:41.246314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:41.247051 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:41.253691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:41.254903 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:41.255358 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:41.256087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:41.256550 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:41.256988 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:41.400546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:41.408630 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-79671ac1-4b26-435e-9a96-691d6c3fc19d tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1688 microversion: 2.1 time: 0.168811 Nov 02 13:53:41.409218 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3747/8032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:41 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:42.436959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:42.437680 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:42.445495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:42.446036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:42.446502 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:42.447216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:42.447689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:42.448133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:42.592773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:42.600703 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-65233225-ea2d-4bd4-8a2e-43559f53eace tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1688 microversion: 2.1 time: 0.168006 Nov 02 13:53:42.601393 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4286/8033] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:42 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:43.625263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:43.625953 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:43.639601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:43.639957 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:43.640466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:43.641150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:43.641697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:43.642236 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:43.676804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-4b4cd48f-5572-4c36-9829-d34ba54c8678 req-73de0b50-16bc-4b26-813f-f2c102bb5c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b8786b-d929-4bdd-ae7a-f680c0fedbb4", "name": "network-vif-deleted", "tag": "e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:43.689416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4b4cd48f-5572-4c36-9829-d34ba54c8678 req-73de0b50-16bc-4b26-813f-f2c102bb5c30 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:43.691982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4b4cd48f-5572-4c36-9829-d34ba54c8678 req-73de0b50-16bc-4b26-813f-f2c102bb5c30 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:43.692823 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-4b4cd48f-5572-4c36-9829-d34ba54c8678 req-73de0b50-16bc-4b26-813f-f2c102bb5c30 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:43.705505 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-4b4cd48f-5572-4c36-9829-d34ba54c8678 req-73de0b50-16bc-4b26-813f-f2c102bb5c30 service nova] Creating event network-vif-deleted:e2b56505-1dc1-4ea9-9b8c-0d8cc532b9ba for instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 on n-h2-855650-5 Nov 02 13:53:43.712616 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-4b4cd48f-5572-4c36-9829-d34ba54c8678 req-73de0b50-16bc-4b26-813f-f2c102bb5c30 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104137 Nov 02 13:53:43.713239 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3748/8034] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:43.727873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:43.736128 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bccd40a0-4031-43a3-b5c6-b95a02049b2f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 200 len: 1351 microversion: 2.1 time: 0.114912 Nov 02 13:53:43.736734 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4287/8035] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:43 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:44.760970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:44.761601 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: a6b8786b-d929-4bdd-ae7a-f680c0fedbb4] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:44.768259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:44.768757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:44.769217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:44.770467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:44.770933 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:44.771369 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:44.785864 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] HTTP exception thrown: Instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 could not be found. Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Request method failure captured: Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 HTTP/1.1 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnPx4EFsBnbqTTmYNA2b279hrz_QSLXb2Ap33NXVkmTN_imatYBnwdoBsi2sTcAHqbBSps6n5W7XN3xrMHtONr-OCrP98Ms6cPB6ulL_eGKrj3XFTLFG-aaV-EzAaUiOpxkLJjQP0AuOPuhI8_xX5UpzLDOaTAHbGq9dXAsMGa7O5wQ Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 17d93319feb94e59bd2e47c2d91f45ef Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 could not be found. Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': 'a6b8786b-d929-4bdd-ae7a-f680c0fedbb4'} Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 could not be found. Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 could not be found. Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:53:44.787571 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 could not be found. Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Returning 404 to user: Instance a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a210fc88-e729-44b3-b5a5-1c7f12f307d9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4" status: 404 len: 111 microversion: 2.1 time: 0.033399 Nov 02 13:53:44.792778 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3749/8036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:44 2022] GET /compute/v2.1/servers/a6b8786b-d929-4bdd-ae7a-f680c0fedbb4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:48.208606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fadc936-92c6-4a4c-82ee-deafb31135bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '.version_select at 0x7f228e904d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:48.245493 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fadc936-92c6-4a4c-82ee-deafb31135bf tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1520588772" status: 202 len: 0 microversion: 2.1 time: 0.041609 Nov 02 13:53:48.246130 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4288/8037] 10.222.0.45 () {58 vars in 1284 bytes} [Wed Nov 2 13:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1520588772 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:48.280307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a4e21d2c-71aa-4777-bb8d-87f799396088 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: .version_select at 0x7f228e182040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-393740775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBVA+jQEij4M1TuRBiZkKD7TbjqfsiOMVf0NbKTS7fZatiYUYBaQ7XbsySzHgaP7y5Q0AngzwBFXWQyWo9KanUcfbINgM2WWZgGFHuEvg8esGww6I+Q5pNSUk9mNlWzbA=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:48.298677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a4e21d2c-71aa-4777-bb8d-87f799396088 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:53:48.304069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-a4e21d2c-71aa-4777-bb8d-87f799396088 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:53:48.328768 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a4e21d2c-71aa-4777-bb8d-87f799396088 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052567 Nov 02 13:53:48.329705 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3750/8038] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:53:48 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:54.440352 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:54.448380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1639666336", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "networks": [{"uuid": "546d02a2-076c-4e93-9f05-5dfd6c727094"}], "key_name": "tempest-TestNetworkAdvancedServerOps-393740775", "security_groups": [{"name": "tempest-secgroup-smoke-581335392"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:54.579672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] validate_networks() for [('546d02a2-076c-4e93-9f05-5dfd6c727094', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:53:54.989003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:53:54.989527 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:53:54.990141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:53:54.990675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:53:54.991188 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:53:55.000773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:55.001372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:55.001839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:55.002636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:55.003135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:55.004111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:55.024899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:53:55.030721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Getting quotas for user 17d93319feb94e59bd2e47c2d91f45ef and project 73ca49bb72c54442817d3c22f8d639e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:53:55.051371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:53:55.053820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:53:55.107321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab9c4868-665a-4639-8487-0980c4a3cd54 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.669275 Nov 02 13:53:55.108279 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4289/8039] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:53:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:53:55.120392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-37b5e409-c486-470f-ac4f-12247e6c7e3b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:55.121012 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-37b5e409-c486-470f-ac4f-12247e6c7e3b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:55.124222 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=12 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:55.190041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-37b5e409-c486-470f-ac4f-12247e6c7e3b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:55.199464 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-37b5e409-c486-470f-ac4f-12247e6c7e3b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1266 microversion: 2.1 time: 0.083222 Nov 02 13:53:55.200387 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3751/8040] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:55 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:56.232291 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:56.233520 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:56.243967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:56.244484 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:56.244942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:56.245667 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:56.246167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:56.246629 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:56.315545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:56.324799 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e16e5ac0-fe05-497f-baa9-0c2594a71c3a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1318 microversion: 2.1 time: 0.098003 Nov 02 13:53:56.325803 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4290/8041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:56 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:57.349414 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:57.350150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:57.359013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:57.359516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:57.359970 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:57.360692 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:57.361151 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:57.361745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:57.583706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:57.593579 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d5c93de2-0819-485b-974d-dea2760f3f02 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1391 microversion: 2.1 time: 0.248096 Nov 02 13:53:57.610487 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3752/8042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:57 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:58.390756 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a1845b5c-2760-4eb9-9e81-5b224ffa9334 req-68d93aa6-3957-4021-87a3-c9637e52219d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "418b4030-331b-4e30-a725-7f877b5cd588", "tag": "9faaa314-0b1c-4524-9489-46f6a3a09599"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:58.404574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a1845b5c-2760-4eb9-9e81-5b224ffa9334 req-68d93aa6-3957-4021-87a3-c9637e52219d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:58.405085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a1845b5c-2760-4eb9-9e81-5b224ffa9334 req-68d93aa6-3957-4021-87a3-c9637e52219d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:58.405543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a1845b5c-2760-4eb9-9e81-5b224ffa9334 req-68d93aa6-3957-4021-87a3-c9637e52219d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:58.421281 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a1845b5c-2760-4eb9-9e81-5b224ffa9334 req-68d93aa6-3957-4021-87a3-c9637e52219d service nova] Creating event network-changed:9faaa314-0b1c-4524-9489-46f6a3a09599 for instance 418b4030-331b-4e30-a725-7f877b5cd588 on n-h2-855650-5 Nov 02 13:53:58.427775 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a1845b5c-2760-4eb9-9e81-5b224ffa9334 req-68d93aa6-3957-4021-87a3-c9637e52219d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041965 Nov 02 13:53:58.428917 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4291/8043] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:58.624760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:58.625489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:58.633366 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:58.633870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:58.634356 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:58.635074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:58.635541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:58.635979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:58.773322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:58.781667 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-874ea55a-2796-4518-ab07-4c8d9f3757e4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1391 microversion: 2.1 time: 0.160887 Nov 02 13:53:58.782303 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3753/8044] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:58 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:59.805528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:59.806265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:59.813674 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:59.814202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:59.814654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:59.815500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:59.816048 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:59.816575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:59.958915 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:59.970375 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-54d6013d-068f-434d-a955-172e859954c2 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1391 microversion: 2.1 time: 0.168966 Nov 02 13:53:59.971010 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4292/8045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:59 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:00.995196 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:00.996140 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:01.003336 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:01.003857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:01.004301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:01.005013 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:01.005470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:01.005912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:01.145886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:01.153979 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f1e0ae6d-2c5d-4a9e-aa1a-538b72f19861 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1391 microversion: 2.1 time: 0.162996 Nov 02 13:54:01.154569 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3754/8046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:00 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:02.178441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:02.178994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:02.186068 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:02.186579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:02.187041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:02.187761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:02.188232 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:02.188697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:02.325247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:02.333691 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d317d31e-74cf-4843-9bec-ac6a178102b6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1391 microversion: 2.1 time: 0.159492 Nov 02 13:54:02.334310 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4293/8047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:02 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:03.356993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:03.357621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:03.364745 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:03.365243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:03.365694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:03.366449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:03.366907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:03.367339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:03.510271 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:03.518476 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-546660e3-23bc-4470-9dc2-49c87de6fe5c tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1391 microversion: 2.1 time: 0.165531 Nov 02 13:54:03.519239 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3755/8048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:03 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:04.541521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:04.542283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:04.549195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.549748 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.550261 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.550985 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.551459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.551910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.695633 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.705576 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e4d3ede-9bcf-4081-a7f7-36fb8d82f767 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1391 microversion: 2.1 time: 0.167779 Nov 02 13:54:04.706233 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4294/8049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:04 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:04.819084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-39b2e262-cd54-4454-abed-852cbd620d49 req-3b5d21db-c7fe-47b2-8959-05b0289bfb27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "418b4030-331b-4e30-a725-7f877b5cd588", "name": "network-vif-plugged", "status": "completed", "tag": "9faaa314-0b1c-4524-9489-46f6a3a09599"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:04.830963 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-39b2e262-cd54-4454-abed-852cbd620d49 req-3b5d21db-c7fe-47b2-8959-05b0289bfb27 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.832073 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-39b2e262-cd54-4454-abed-852cbd620d49 req-3b5d21db-c7fe-47b2-8959-05b0289bfb27 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.832972 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-39b2e262-cd54-4454-abed-852cbd620d49 req-3b5d21db-c7fe-47b2-8959-05b0289bfb27 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.845032 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-39b2e262-cd54-4454-abed-852cbd620d49 req-3b5d21db-c7fe-47b2-8959-05b0289bfb27 service nova] Creating event network-vif-plugged:9faaa314-0b1c-4524-9489-46f6a3a09599 for instance 418b4030-331b-4e30-a725-7f877b5cd588 on n-h2-855650-5 Nov 02 13:54:04.850483 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-39b2e262-cd54-4454-abed-852cbd620d49 req-3b5d21db-c7fe-47b2-8959-05b0289bfb27 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036822 Nov 02 13:54:04.851328 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3756/8050] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:05.730412 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:05.731058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:05.733020 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:05.733698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:05.740806 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:05.741310 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:05.741760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:05.742493 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:05.742966 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:05.743405 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:05.881511 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:05.890025 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba3719e3-d41a-4a1d-bd18-827097a9c761 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1391 microversion: 2.1 time: 0.163450 Nov 02 13:54:05.890620 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4295/8051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:05 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:54:06.911633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:06.916719 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:06.917465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:06.924392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:06.924898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:06.925918 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:06.926664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:06.927131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:06.927573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:07.062702 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:07.070832 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b709386c-8fd1-4a69-a3ea-4df85646ac49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1564 microversion: 2.1 time: 0.160211 Nov 02 13:54:07.071431 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3757/8052] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:06 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:07.093760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:07.094427 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:07.101908 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:07.102461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:07.102924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:07.103657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:07.104134 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:07.104588 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:07.237218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:07.245069 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9652a64a-78db-446a-9a31-b8c011af6594 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1564 microversion: 2.1 time: 0.155427 Nov 02 13:54:07.245651 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4296/8053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:07 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:08.864836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:08.866214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:08.868259 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6cb7e49e-9541-4660-8d1f-fde8c4a6f87e req-ba055eaa-42f9-4aa4-b74c-b01870745c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "418b4030-331b-4e30-a725-7f877b5cd588", "tag": "9faaa314-0b1c-4524-9489-46f6a3a09599"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:08.873571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:08.874118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:08.874599 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:08.875564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:08.876115 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:08.876476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:08.880496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6cb7e49e-9541-4660-8d1f-fde8c4a6f87e req-ba055eaa-42f9-4aa4-b74c-b01870745c89 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:08.881191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6cb7e49e-9541-4660-8d1f-fde8c4a6f87e req-ba055eaa-42f9-4aa4-b74c-b01870745c89 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:08.881917 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6cb7e49e-9541-4660-8d1f-fde8c4a6f87e req-ba055eaa-42f9-4aa4-b74c-b01870745c89 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:08.897629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6cb7e49e-9541-4660-8d1f-fde8c4a6f87e req-ba055eaa-42f9-4aa4-b74c-b01870745c89 service nova] Creating event network-changed:9faaa314-0b1c-4524-9489-46f6a3a09599 for instance 418b4030-331b-4e30-a725-7f877b5cd588 on n-h2-855650-5 Nov 02 13:54:08.902725 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6cb7e49e-9541-4660-8d1f-fde8c4a6f87e req-ba055eaa-42f9-4aa4-b74c-b01870745c89 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038904 Nov 02 13:54:08.903577 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4297/8054] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:09.035498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:09.046074 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-975c9cd0-a9f2-440f-9817-d2bfe288c8b3 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1564 microversion: 2.1 time: 0.185222 Nov 02 13:54:09.047117 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3758/8055] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:08 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:42.341194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:42.342097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=42 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:42.346700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:42.349042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:42.356642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:42.357187 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:42.357632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:42.358548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:42.358866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:42.359316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:42.433458 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad8e2702-a87c-4327-b2c7-1b196750c7a8 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action" status: 200 len: 24565 microversion: 2.1 time: 0.094208 Nov 02 13:54:42.434151 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4298/8056] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:54:42 2022] POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action => generated 24565 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:12.832745 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:55:12.833455 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action (ip 10.222.0.45) !!! Nov 02 13:55:12.833922 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:12.834958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=38 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:12.838955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:12.839497 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:12.848131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.848621 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.849064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.849771 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.850264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.850701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.876803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lazy-loading 'flavor' on Instance uuid 418b4030-331b-4e30-a725-7f877b5cd588 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:55:12.947782 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f7c05928-7799-449d-b3c1-6285d44b9db9 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action" status: 202 len: 0 microversion: 2.1 time: 0.117018 Nov 02 13:55:12.948333 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3759/8057] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:55:12 2022] POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:12.958313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:12.959150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:12.966029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:12.966854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:12.969782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.970374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.970856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.971998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.972602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.973041 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:13.166945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:13.175533 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-843d3cbb-1740-4d09-b591-b4b8ae8d3cfe tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1690 microversion: 2.1 time: 0.222396 Nov 02 13:55:13.176108 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4299/8058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:12 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:14.202701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:14.203313 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:14.209791 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.210329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.210780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.211485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.211944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.212378 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.349893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:14.358511 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-de6a8742-7093-4fa7-9497-7385ac82fe74 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1690 microversion: 2.1 time: 0.161312 Nov 02 13:55:14.359098 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3760/8059] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:14 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:15.381942 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:15.382603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:15.389737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:15.390215 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:15.390684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:15.391424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:15.391884 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:15.392336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:15.527858 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:15.535839 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4cee652e-9611-4be0-89ea-858be87e2c62 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1673 microversion: 2.1 time: 0.157820 Nov 02 13:55:15.536422 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4300/8060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:15 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:16.634886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:16.637532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:16.644280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.644778 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.645230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.645943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.646428 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.646920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.711205 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e3834b9c-51c1-4996-9aac-6f812685f315 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action" status: 200 len: 37414 microversion: 2.1 time: 0.080182 Nov 02 13:55:16.711890 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3761/8061] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:55:16 2022] POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action => generated 37414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:16.726535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:16.727120 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:16.734090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.734594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.735042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.735779 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.736248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.736684 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.804422 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b4e2a62-4fd9-4896-9d56-3cbff38f2d9b tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action" status: 202 len: 0 microversion: 2.1 time: 0.081721 Nov 02 13:55:16.805079 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4301/8062] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:55:16 2022] POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:16.814618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:16.815325 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:16.822596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.823101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.824088 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.824820 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.825282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.825718 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.970087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:16.978244 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5aca66e7-ef55-4794-9e88-aeb0a7686ec6 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1679 microversion: 2.1 time: 0.167997 Nov 02 13:55:16.978824 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3762/8063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:16 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:18.003146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:18.003866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:18.011990 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:18.012418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:18.012883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:18.013615 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:18.014122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:18.014577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:18.159931 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:18.168532 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-029cbbe3-6fb8-4268-b1f0-15d6eca18607 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1679 microversion: 2.1 time: 0.169748 Nov 02 13:55:18.169115 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4302/8064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:17 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:19.192635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:19.193248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:19.200259 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.200734 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.201181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.201888 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.202384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.202867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.341210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:19.349571 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-830b4e53-f646-49c9-b974-27257a15ca49 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1682 microversion: 2.1 time: 0.160823 Nov 02 13:55:19.350188 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3763/8065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:19 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:19.453464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:19.455714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:19.463063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.463475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.463930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.465335 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.465993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.466372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.532898 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18ce73f6-9d71-4507-9097-0acc22aabb0a tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action" status: 200 len: 37414 microversion: 2.1 time: 0.083194 Nov 02 13:55:19.533577 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4303/8066] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:55:19 2022] POST /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588/action => generated 37414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:20.562197 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:20.562840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:20.564675 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-ee49ccea-9254-4a4a-b65a-3ca185550121 req-f269c239-5971-408b-91a6-635a01565b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "418b4030-331b-4e30-a725-7f877b5cd588", "tag": "9faaa314-0b1c-4524-9489-46f6a3a09599"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:20.571456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.571955 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.572660 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.573415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.574079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.574522 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.577177 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ee49ccea-9254-4a4a-b65a-3ca185550121 req-f269c239-5971-408b-91a6-635a01565b13 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.577678 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ee49ccea-9254-4a4a-b65a-3ca185550121 req-f269c239-5971-408b-91a6-635a01565b13 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.578158 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-ee49ccea-9254-4a4a-b65a-3ca185550121 req-f269c239-5971-408b-91a6-635a01565b13 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.590838 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-ee49ccea-9254-4a4a-b65a-3ca185550121 req-f269c239-5971-408b-91a6-635a01565b13 service nova] Creating event network-changed:9faaa314-0b1c-4524-9489-46f6a3a09599 for instance 418b4030-331b-4e30-a725-7f877b5cd588 on n-h2-855650-5 Nov 02 13:55:20.597028 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-ee49ccea-9254-4a4a-b65a-3ca185550121 req-f269c239-5971-408b-91a6-635a01565b13 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036655 Nov 02 13:55:20.598922 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4304/8067] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:20.605956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:55:20.702050 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-513ed731-b989-41ac-b4c7-fdbdddb307fa tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 204 len: 0 microversion: 2.1 time: 0.143735 Nov 02 13:55:20.702977 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3764/8068] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 13:55:20 2022] DELETE /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:20.713557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:20.714382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:20.721102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.721869 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.722550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.723458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.724106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.724750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:21.205662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:21.214393 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-041dd32b-e3a6-45aa-a0c5-c2439a1296dc tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1688 microversion: 2.1 time: 0.505958 Nov 02 13:55:21.214988 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4305/8069] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:20 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1688 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:22.240505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:22.241220 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:22.248773 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:22.249273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:22.249729 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:22.250477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:22.250943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:22.251380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:22.394199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:22.402501 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0f8ba43b-8298-40d0-91ed-0a1850f6dfec tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1688 microversion: 2.1 time: 0.166311 Nov 02 13:55:22.403211 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3765/8070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:22 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:23.150155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a1035164-872e-494c-a574-e4854e9663f5 req-6d00be70-6cd3-466a-bae4-ead7070ac434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "418b4030-331b-4e30-a725-7f877b5cd588", "name": "network-vif-deleted", "tag": "9faaa314-0b1c-4524-9489-46f6a3a09599"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:23.163700 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a1035164-872e-494c-a574-e4854e9663f5 req-6d00be70-6cd3-466a-bae4-ead7070ac434 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.164897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a1035164-872e-494c-a574-e4854e9663f5 req-6d00be70-6cd3-466a-bae4-ead7070ac434 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.165618 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a1035164-872e-494c-a574-e4854e9663f5 req-6d00be70-6cd3-466a-bae4-ead7070ac434 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.179124 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a1035164-872e-494c-a574-e4854e9663f5 req-6d00be70-6cd3-466a-bae4-ead7070ac434 service nova] Creating event network-vif-deleted:9faaa314-0b1c-4524-9489-46f6a3a09599 for instance 418b4030-331b-4e30-a725-7f877b5cd588 on n-h2-855650-5 Nov 02 13:55:23.185671 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a1035164-872e-494c-a574-e4854e9663f5 req-6d00be70-6cd3-466a-bae4-ead7070ac434 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039238 Nov 02 13:55:23.186328 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4306/8071] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:23.427448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:23.428078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:23.436175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.436676 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.437129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.437846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.438350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.438788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.472893 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.473547 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.474020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.474493 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lazy-loading 'fault' on Instance uuid 418b4030-331b-4e30-a725-7f877b5cd588 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:55:23.518595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d93319feb94e59bd2e47c2d91f45ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca49bb72c54442817d3c22f8d639e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:23.527578 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63529602-4193-4b1a-b15a-7555cb20eebd tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 200 len: 1356 microversion: 2.1 time: 0.104138 Nov 02 13:55:23.528344 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3766/8072] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:23 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:24.552693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:24.553415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] [instance: 418b4030-331b-4e30-a725-7f877b5cd588] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:24.560625 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.561200 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.561614 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.562367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.562846 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.563293 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.577401 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] HTTP exception thrown: Instance 418b4030-331b-4e30-a725-7f877b5cd588 could not be found. Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Request method failure captured: Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 HTTP/1.1 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnPx4EFsBnbqTTmYNA2b279hrz_QSLXb2Ap33NXVkmTN_imatYBnwdoBsi2sTcAHqbBSps6n5W7XN3xrMHtONr-OCrP98Ms6cPB6ulL_eGKrj3XFTLFG-aaV-EzAaUiOpxkLJjQP0AuOPuhI8_xX5UpzLDOaTAHbGq9dXAsMGa7O5wQ Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_73ca49bb72c54442817d3c22f8d639e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 73ca49bb72c54442817d3c22f8d639e3 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-755359152 Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 17d93319feb94e59bd2e47c2d91f45ef Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestNetworkAdvancedServerOps-755359152-project Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 418b4030-331b-4e30-a725-7f877b5cd588 could not be found. Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '418b4030-331b-4e30-a725-7f877b5cd588'} Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 418b4030-331b-4e30-a725-7f877b5cd588 could not be found. Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 418b4030-331b-4e30-a725-7f877b5cd588 could not be found. Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:55:24.579119 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 418b4030-331b-4e30-a725-7f877b5cd588 could not be found. Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Returning 404 to user: Instance 418b4030-331b-4e30-a725-7f877b5cd588 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-447258c0-4b78-4db1-923e-9abbe4d9cec4 tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588" status: 404 len: 111 microversion: 2.1 time: 0.032233 Nov 02 13:55:24.585272 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4307/8073] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:24 2022] GET /compute/v2.1/servers/418b4030-331b-4e30-a725-7f877b5cd588 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:28.024571 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-237f9b1d-ae6a-418e-b5d3-bca6fb6a909f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] Calling method '.version_select at 0x7f228f3083a0>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:28.046321 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-237f9b1d-ae6a-418e-b5d3-bca6fb6a909f tempest-TestNetworkAdvancedServerOps-755359152 tempest-TestNetworkAdvancedServerOps-755359152-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-393740775" status: 202 len: 0 microversion: 2.1 time: 0.025713 Nov 02 13:55:28.046925 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3767/8074] 10.222.0.45 () {58 vars in 1281 bytes} [Wed Nov 2 13:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-393740775 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:39.579469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=18 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:39.580229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:39.763210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca826dcf-5a55-4bfc-8269-2f8f412bb99a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Action: 'create', calling method: .version_select at 0x7f228f2824c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1198583709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1rLVN7u5fxdYZcjQ5Fb1r4e3rXFqfzOxfxzxbvlFfu9jglLRkmKnHGK0w4ubbJrGe9UVGkiIPYXF1iLSMS1K0kBKG8aZ5tT/wpOAQyFDwJz6lolQBRyB1HhxIDVdQ59w=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:39.785557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ca826dcf-5a55-4bfc-8269-2f8f412bb99a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Getting quotas for project ba3f85be054944c5be60b00e887abebd. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:39.793229 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-ca826dcf-5a55-4bfc-8269-2f8f412bb99a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Getting quotas for user 8f19fd2cda964d6d8cda9580f4e0bb5e and project ba3f85be054944c5be60b00e887abebd. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:39.827712 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca826dcf-5a55-4bfc-8269-2f8f412bb99a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.254488 Nov 02 13:55:39.828361 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4308/8075] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 13:55:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:40.986958 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:40.989840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:40.996033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-659292537", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1198583709", "security_groups": [{"name": "tempest-secgroup-smoke-1443432129"}], "networks": [{"uuid": "685a3cab-3c22-454c-a999-61c2ad38e949"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:41.119278 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] validate_networks() for [('685a3cab-3c22-454c-a999-61c2ad38e949', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:55:41.664865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:55:41.665870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:55:41.666748 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:55:41.667171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:55:41.667596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:55:41.677153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:41.677633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:41.678203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:41.680409 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:41.680906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:41.681385 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:41.703615 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Getting quotas for project ba3f85be054944c5be60b00e887abebd. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:41.709799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Getting quotas for user 8f19fd2cda964d6d8cda9580f4e0bb5e and project ba3f85be054944c5be60b00e887abebd. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:41.723736 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:55:41.726136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:55:41.777012 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-dd038829-9dbe-40c1-8f88-c58eb4373338 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.793580 Nov 02 13:55:41.777837 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3768/8076] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 13:55:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:55:41.791500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-277d02da-05c1-4e00-b16c-bf5f22f5fe18 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:41.792186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-277d02da-05c1-4e00-b16c-bf5f22f5fe18 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:41.850910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-277d02da-05c1-4e00-b16c-bf5f22f5fe18 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:41.858537 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-277d02da-05c1-4e00-b16c-bf5f22f5fe18 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1246 microversion: 2.1 time: 0.071795 Nov 02 13:55:41.859135 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4309/8077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:41 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:42.882627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:42.883540 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:42.892454 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:42.893236 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:42.893821 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:42.894776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:42.895965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:42.896477 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:42.969585 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:42.978337 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f351867e-7021-46ca-8dd2-838aac1aaf11 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1242 microversion: 2.1 time: 0.099808 Nov 02 13:55:42.995935 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3769/8078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:42 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:44.008706 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:44.009356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:44.017705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:44.018255 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:44.018740 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:44.019480 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:44.020336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:44.020481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:44.120720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:44.130203 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67ebd438-b435-4d6c-95b8-4d54eddd0ddd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1304 microversion: 2.1 time: 0.126300 Nov 02 13:55:44.131107 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4310/8079] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:44 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:45.086441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d4ded5db-36af-4aab-b898-9c91afc006b0 req-0e04ee6f-f0b0-4181-a10b-94e53db8296d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5", "tag": "4b6e99e9-ba36-4834-8f2d-fed3971b2538"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:45.102874 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4ded5db-36af-4aab-b898-9c91afc006b0 req-0e04ee6f-f0b0-4181-a10b-94e53db8296d service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:45.103961 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4ded5db-36af-4aab-b898-9c91afc006b0 req-0e04ee6f-f0b0-4181-a10b-94e53db8296d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:45.105632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d4ded5db-36af-4aab-b898-9c91afc006b0 req-0e04ee6f-f0b0-4181-a10b-94e53db8296d service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:45.119537 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-d4ded5db-36af-4aab-b898-9c91afc006b0 req-0e04ee6f-f0b0-4181-a10b-94e53db8296d service nova] Creating event network-changed:4b6e99e9-ba36-4834-8f2d-fed3971b2538 for instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 on n-h2-855650-5 Nov 02 13:55:45.125396 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d4ded5db-36af-4aab-b898-9c91afc006b0 req-0e04ee6f-f0b0-4181-a10b-94e53db8296d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044280 Nov 02 13:55:45.126775 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3770/8080] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:55:45.155422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:45.156106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:45.163729 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:45.164361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:45.164752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:45.165490 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:45.165992 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:45.166658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:45.399013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:45.407089 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a8a4171-c6ac-4660-9a0c-e380e6bbb3c7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1372 microversion: 2.1 time: 0.256426 Nov 02 13:55:45.407841 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4311/8081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:45 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:46.431898 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:46.432595 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:46.438895 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:46.439382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:46.439830 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:46.440528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:46.440982 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:46.441408 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:46.577519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:46.585851 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a4299fe0-33de-4f21-afb5-6cf11a1a3974 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1372 microversion: 2.1 time: 0.159028 Nov 02 13:55:46.586470 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3771/8082] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:46 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:47.610312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:47.610950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:47.618183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:47.618727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:47.619186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:47.620347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:47.620347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:47.620807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:47.757471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:47.765358 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b4e5698b-6f7f-48a9-b032-e95b80b0ed15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1372 microversion: 2.1 time: 0.159051 Nov 02 13:55:47.765977 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4312/8083] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:47 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:48.788889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:48.789516 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:48.796794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.797350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.797809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.798562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.799030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.799468 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.939878 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:48.947802 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c5bf9ca8-87d1-4572-b7f7-29a9af17a31a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1372 microversion: 2.1 time: 0.162911 Nov 02 13:55:48.948899 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3772/8084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:48 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:49.972948 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:49.973776 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:49.981249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:49.981755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:49.982260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:49.983248 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:49.983467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:49.983866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:50.130771 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:50.140192 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05799aad-a6e9-45ca-b7a3-130a9064160b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1372 microversion: 2.1 time: 0.171265 Nov 02 13:55:50.140810 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4313/8085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:49 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:51.163420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:51.164076 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:51.171580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.172078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.172533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.173235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.173695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.174181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.309822 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:51.317625 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36d59423-e713-465d-84db-4fc4f1ed1501 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1372 microversion: 2.1 time: 0.158233 Nov 02 13:55:51.318246 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3773/8086] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:51 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:51.497550 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-554c917b-058d-48b0-bc72-d6987d57720d req-0d43c35b-9ed1-4cce-8539-838dbe035116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5", "name": "network-vif-plugged", "status": "completed", "tag": "4b6e99e9-ba36-4834-8f2d-fed3971b2538"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:51.507996 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-554c917b-058d-48b0-bc72-d6987d57720d req-0d43c35b-9ed1-4cce-8539-838dbe035116 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.508491 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-554c917b-058d-48b0-bc72-d6987d57720d req-0d43c35b-9ed1-4cce-8539-838dbe035116 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.509164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-554c917b-058d-48b0-bc72-d6987d57720d req-0d43c35b-9ed1-4cce-8539-838dbe035116 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.521101 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-554c917b-058d-48b0-bc72-d6987d57720d req-0d43c35b-9ed1-4cce-8539-838dbe035116 service nova] Creating event network-vif-plugged:4b6e99e9-ba36-4834-8f2d-fed3971b2538 for instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 on n-h2-855650-5 Nov 02 13:55:51.527150 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-554c917b-058d-48b0-bc72-d6987d57720d req-0d43c35b-9ed1-4cce-8539-838dbe035116 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032809 Nov 02 13:55:51.527751 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4314/8087] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:52.341648 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:52.342306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:52.344394 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:52.345090 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:52.352439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:52.352943 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:52.353391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:52.354144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:52.355163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:52.355642 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:52.500783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:52.508616 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5ce29e21-4cf8-4dce-92e9-fba1e9651c2e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1372 microversion: 2.1 time: 0.171064 Nov 02 13:55:52.509203 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3774/8088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:52 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:53.528640 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:53.533937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:53.534685 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:53.541330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:53.541870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:53.542351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:53.543065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:53.543540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:53.543979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:53.682196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:53.690660 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e724bcc7-1836-4064-bf81-9b7a5c1b71d0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1555 microversion: 2.1 time: 0.162980 Nov 02 13:55:53.691255 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4315/8089] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:53 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:53.714216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:53.714804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:53.721869 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:53.722407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:53.722851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:53.723562 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:53.724025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:53.724462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:53.864265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:53.872910 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e90aeecf-cf77-4a91-bdb9-d6be6815c83e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1555 microversion: 2.1 time: 0.162960 Nov 02 13:55:53.873668 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3775/8090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:53 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:55.594584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-2ca4ad08-dfbf-4b79-8fcf-67d1b2a4706e req-0e24ab30-727a-44c5-89c2-943ae51eae54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5", "tag": "4b6e99e9-ba36-4834-8f2d-fed3971b2538"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:55.606616 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2ca4ad08-dfbf-4b79-8fcf-67d1b2a4706e req-0e24ab30-727a-44c5-89c2-943ae51eae54 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.607216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2ca4ad08-dfbf-4b79-8fcf-67d1b2a4706e req-0e24ab30-727a-44c5-89c2-943ae51eae54 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.607670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-2ca4ad08-dfbf-4b79-8fcf-67d1b2a4706e req-0e24ab30-727a-44c5-89c2-943ae51eae54 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.619238 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-2ca4ad08-dfbf-4b79-8fcf-67d1b2a4706e req-0e24ab30-727a-44c5-89c2-943ae51eae54 service nova] Creating event network-changed:4b6e99e9-ba36-4834-8f2d-fed3971b2538 for instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 on n-h2-855650-5 Nov 02 13:55:55.625047 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-2ca4ad08-dfbf-4b79-8fcf-67d1b2a4706e req-0e24ab30-727a-44c5-89c2-943ae51eae54 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034318 Nov 02 13:55:55.625883 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4316/8091] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:21.785395 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a618658-f83a-4e1f-aba5-6ee48de50ace] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:58:21.786629 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a729f393-f18f-46ff-992e-9b20bef5c4cb] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:58:21.787207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:21.787966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=40 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:21.789481 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:58:21.789687 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:58:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5/action (ip 10.222.0.45) !!! Nov 02 13:58:21.792388 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:58:21.792559 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 13:58:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5/action (ip 10.222.0.45) !!! Nov 02 13:58:21.803587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:21.804133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:21.813141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:21.813805 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:21.814110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:21.814831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:21.815294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:21.815723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:21.842909 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lazy-loading 'flavor' on Instance uuid 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:58:22.161186 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2dc54759-a24c-488d-b2c9-5dc578ef7212 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "POST /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5/action" status: 202 len: 0 microversion: 2.1 time: 0.377423 Nov 02 13:58:22.161880 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3776/8092] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:21 2022] POST /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:58:22.169035 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:58:22.169879 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2bebab1-6133-44ed-afdc-10bb19e356b1] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:58:22.170535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:22.171470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=34 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:22.172410 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:58:22.172605 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 (ip 10.222.0.45) !!! Nov 02 13:58:22.173915 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:58:22.174072 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 (ip 10.222.0.45) !!! Nov 02 13:58:22.175208 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:58:22.175362 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 13:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 (ip 10.222.0.45) !!! Nov 02 13:58:22.182462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:22.183904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:22.196741 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:22.197242 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:22.197702 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:22.198545 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:22.198986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:22.199438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:22.337829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:22.346463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c18007fd-b67c-4e85-b48e-f6e791f5886c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.179709 Nov 02 13:58:22.347060 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4317/8093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:22 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:23.373902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:23.374629 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:23.385084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:23.385569 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:23.386030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:23.387528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:23.387979 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:23.388403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:23.389613 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a618658-f83a-4e1f-aba5-6ee48de50ace] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41512. Nov 02 13:58:23.392895 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] [a729f393-f18f-46ff-992e-9b20bef5c4cb] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41514. Nov 02 13:58:23.527584 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:23.535478 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7498ee5a-3e89-45c4-bd4c-c4891c93535a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.168157 Nov 02 13:58:23.536060 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3777/8094] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:23 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:24.560316 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:24.560951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:24.575866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.576369 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.576853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.577621 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.578145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.578585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.582079 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2bebab1-6133-44ed-afdc-10bb19e356b1] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41522. Nov 02 13:58:24.589528 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41520. Nov 02 13:58:24.722601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:24.730586 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a3efb98f-ccb1-4abe-9d30-4c4a88cf7e3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.174773 Nov 02 13:58:24.731166 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4318/8095] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:24 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:25.755897 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:25.756549 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:25.763580 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:25.764078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:25.764532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:25.765243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:25.765709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:25.766182 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:25.909305 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:25.917436 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-24583d0f-0213-49a3-b637-8e86f062bc57 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.165572 Nov 02 13:58:25.918062 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3778/8096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:25 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:26.942517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:26.943046 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:26.950225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.951380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.951380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.952565 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.953040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.953521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:27.095312 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:27.103236 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-67765f34-0632-4ff7-a196-3e2e6dd7be45 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.164850 Nov 02 13:58:27.103817 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4319/8097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:26 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:28.127092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:28.127668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:28.134596 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.135084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.135534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.136234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.136694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.137125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.273708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:28.282126 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-427a415c-157e-4d1e-8420-e651f20e16e3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.159730 Nov 02 13:58:28.282706 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3779/8098] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:28 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:29.306569 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:29.307207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:29.314219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:29.314763 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:29.315183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:29.315896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:29.316371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:29.316809 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:29.457642 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:29.467502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5dc44a5-47dc-49c2-8bcb-b4e06473efac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.164966 Nov 02 13:58:29.468105 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4320/8099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:29 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:30.491737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:30.492362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:30.499969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:30.500533 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:30.501018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:30.503248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:30.503248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:30.503248 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:30.642618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:30.650973 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b2c68c84-2d69-4844-a849-589842a51609 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.163138 Nov 02 13:58:30.651631 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3780/8100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:30 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:31.675837 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:31.676397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:31.683381 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:31.683889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:31.684342 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:31.685589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:31.686087 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:31.686577 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:31.825773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:31.833856 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d3d55da-9a81-4bd9-b25b-6ab43c3e7604 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.162161 Nov 02 13:58:31.834475 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4321/8101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:31 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:32.857789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:32.858424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:32.865524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.866060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.866517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.867235 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.867695 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.868132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:33.006255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:33.014271 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e17de9c0-5f19-4655-b596-ae41b683e8d1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.160499 Nov 02 13:58:33.014857 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3781/8102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:32 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:34.039354 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:34.040292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:34.052181 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:34.052687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:34.053145 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:34.053880 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:34.054373 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:34.054817 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:34.197926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:34.206209 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff402702-04da-477f-8e10-e6d509cdf3f1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1701 microversion: 2.1 time: 0.171375 Nov 02 13:58:34.206797 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4322/8103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:34 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1701 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:35.231668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:35.232362 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:35.239412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:35.239920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:35.240392 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:35.241109 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:35.241565 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:35.242014 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:35.379185 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:35.387617 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4da89989-c75d-4e3e-a4a8-31a6bbc5a6bb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1701 microversion: 2.1 time: 0.160846 Nov 02 13:58:35.388257 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3782/8104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:35 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:36.406139 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8e233248-5c12-457e-b910-eabd5ee514b4 req-fad11dd3-c01c-421a-8d80-e33438cb66e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5", "name": "network-vif-plugged", "status": "completed", "tag": "4b6e99e9-ba36-4834-8f2d-fed3971b2538"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:36.412200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:36.413018 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:36.417230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8e233248-5c12-457e-b910-eabd5ee514b4 req-fad11dd3-c01c-421a-8d80-e33438cb66e5 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.417230 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8e233248-5c12-457e-b910-eabd5ee514b4 req-fad11dd3-c01c-421a-8d80-e33438cb66e5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.417645 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8e233248-5c12-457e-b910-eabd5ee514b4 req-fad11dd3-c01c-421a-8d80-e33438cb66e5 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.421253 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.421755 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.422230 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.422951 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.423589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.424030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.430243 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8e233248-5c12-457e-b910-eabd5ee514b4 req-fad11dd3-c01c-421a-8d80-e33438cb66e5 service nova] Creating event network-vif-plugged:4b6e99e9-ba36-4834-8f2d-fed3971b2538 for instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 on n-h2-855650-5 Nov 02 13:58:36.437028 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8e233248-5c12-457e-b910-eabd5ee514b4 req-fad11dd3-c01c-421a-8d80-e33438cb66e5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101885 Nov 02 13:58:36.437790 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4323/8105] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:36.566698 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:36.574659 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b31539a6-8b3f-42e7-ac97-dc6fb65875f8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1701 microversion: 2.1 time: 0.166923 Nov 02 13:58:36.576630 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3783/8106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:36 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1701 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:37.601574 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:37.602227 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:37.609167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.609668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.610162 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.610874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.611336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.611775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.751359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:37.759341 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77e6700f-9aac-46a4-874b-49137c313902 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1701 microversion: 2.1 time: 0.162943 Nov 02 13:58:37.759935 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4324/8107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:37 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:38.783321 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:38.783964 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:38.791136 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.791620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.792059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.792760 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.793217 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.793777 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.949216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:38.958733 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f5c0dd42-5c7b-48f8-9b09-6712860c56c5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.179391 Nov 02 13:58:38.959304 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3784/8108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:38 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:39.988934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:39.996887 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:40.016687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:40.017258 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:40.018096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:40.019529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:40.020235 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:40.020994 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:40.176199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:40.192597 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5c3d7af-3bfb-4902-bc50-064d6538d266 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.211757 Nov 02 13:58:40.193496 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4325/8109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:39 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:41.218174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:41.219634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:41.227320 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.228156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.228887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.229682 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.230437 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.230952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.409094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:41.420809 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4fe54d69-0512-419d-a149-f2d495da8451 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.206894 Nov 02 13:58:41.422135 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3785/8110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:41 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:42.447866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:42.449179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:42.458877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.459394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.460118 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.461124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.462099 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.462630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.638219 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:42.647197 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a38dea5-a3f7-41cd-99d6-75be54d9e7d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.204094 Nov 02 13:58:42.665384 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4326/8111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:42 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:43.673127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:43.674443 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:43.684005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.684512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.685250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.686449 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.686726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.687335 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.853282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:43.864858 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-751f953c-2e11-46e3-8797-75f33b004205 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.196015 Nov 02 13:58:43.883272 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3786/8112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:43 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:44.895038 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:44.895791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:44.904174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:44.904708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:44.905182 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:44.905939 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:44.906452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:44.906909 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:45.086288 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:45.095711 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a8d19ca6-8302-4508-844d-40faa9bbe976 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.208081 Nov 02 13:58:45.098052 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4327/8113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:44 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:46.124563 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:46.125204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:46.136944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.141030 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.141809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.143628 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.144806 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.145797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.326375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:46.335322 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-46b763d7-5edc-4e06-bf52-59b84e069822 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.217934 Nov 02 13:58:46.347005 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3787/8114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:46 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:47.364891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:47.366815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:47.374896 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.375705 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.376380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.377110 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.377954 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.378585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.533391 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:47.542455 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-76646d2d-37cd-4824-bdf2-4c1a5beb54ef tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.181432 Nov 02 13:58:47.543594 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4328/8115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:47 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:48.569900 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:48.570671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:48.578033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.578661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.579124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:48.579866 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.580337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.580857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:48.732788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:48.742229 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f8199734-bafd-4b4a-8691-1bdf4d375ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1696 microversion: 2.1 time: 0.177327 Nov 02 13:58:48.742833 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3788/8116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:48 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:49.767138 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:49.767802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:49.775441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:49.775950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:49.776418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:49.777284 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:49.777761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:49.778098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.030296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:50.038772 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fbe487be-2c15-4ffd-a331-57001a9161ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1678 microversion: 2.1 time: 0.276021 Nov 02 13:58:50.039613 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4329/8117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:49 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:51.063127 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:51.063845 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:51.071282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:51.071815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:51.072239 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:51.072966 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:51.073431 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:51.073870 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:51.211039 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:51.219853 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f451d8bf-9f6e-4334-942f-143331d40e16 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1678 microversion: 2.1 time: 0.160776 Nov 02 13:58:51.220440 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3789/8118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:51 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:52.243035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:52.243657 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:52.246472 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=27 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:52.252716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:52.253218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:52.253671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:52.254404 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:52.254874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:52.255302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:52.258167 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=75 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:52.416111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:52.425375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-41e1ced5-4372-43d5-889c-3e370768b49d req-fa3de3f2-3f37-4635-a62e-1e7e8ae1dc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b6e99e9-ba36-4834-8f2d-fed3971b2538"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:52.436041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=29 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:52.440425 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e547af9f-aeb0-4009-848c-eeba3a8e1498 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1681 microversion: 2.1 time: 0.201137 Nov 02 13:58:52.441037 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4330/8119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:52 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:52.446210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-41e1ced5-4372-43d5-889c-3e370768b49d req-fa3de3f2-3f37-4635-a62e-1e7e8ae1dc95 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:52.446936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-41e1ced5-4372-43d5-889c-3e370768b49d req-fa3de3f2-3f37-4635-a62e-1e7e8ae1dc95 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:52.447575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-41e1ced5-4372-43d5-889c-3e370768b49d req-fa3de3f2-3f37-4635-a62e-1e7e8ae1dc95 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:52.456069 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:52.464733 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:52.465164 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.compute.server_external_events [req-41e1ced5-4372-43d5-889c-3e370768b49d req-fa3de3f2-3f37-4635-a62e-1e7e8ae1dc95 service nova] Unable to find a host for instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5. Dropping event network-vif-unplugged {{(pid=120723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 13:58:52.465339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:52.467004 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-41e1ced5-4372-43d5-889c-3e370768b49d req-fa3de3f2-3f37-4635-a62e-1e7e8ae1dc95 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047050 Nov 02 13:58:52.468504 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3790/8120] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 13:58:52.472697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:52.473210 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:52.473668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:52.474429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:52.474950 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:52.475390 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:52.562432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 13:58:52.632321 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e304821a-cad2-4b81-8108-1cca3b3650d2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "POST /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5/action" status: 202 len: 0 microversion: 2.1 time: 0.171809 Nov 02 13:58:52.632932 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4331/8121] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:52 2022] POST /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:58:52.641635 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:52.642382 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:52.649944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:52.650470 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:52.650914 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:52.651633 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:52.652105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:52.652543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:52.797110 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:52.805670 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b1f5491d-df76-4683-a3f5-c4d238361c79 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1629 microversion: 2.1 time: 0.168089 Nov 02 13:58:52.806202 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3791/8122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:52 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1629 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:53.842416 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:53.843127 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:53.849800 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:53.850347 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:53.850807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:53.851542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:53.852018 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:53.852465 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:54.007119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:54.017268 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99ae1962-06a1-4d80-a7f7-a10e48cec9db tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1629 microversion: 2.1 time: 0.180422 Nov 02 13:58:54.017988 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4332/8123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:53 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1629 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:55.042486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:55.043188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:55.050147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:55.050661 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:55.051114 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:55.051838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:55.052302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:55.052737 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:55.198079 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:55.206872 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0fec67a9-0db1-417e-92c1-e978dafa2ad2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1629 microversion: 2.1 time: 0.168741 Nov 02 13:58:55.207738 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3792/8124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:55 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1629 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:56.232322 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:56.232955 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:56.239287 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:56.239791 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:56.240251 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:56.240967 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:56.241440 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:56.241891 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:56.384505 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:56.392990 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b3b96d6-4207-4281-9dcc-4617a28c44a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1629 microversion: 2.1 time: 0.165018 Nov 02 13:58:56.393572 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4333/8125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:56 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1629 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:57.417921 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:57.418848 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:57.425538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:57.426060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:57.426514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:57.427214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:57.427668 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:57.428095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:57.575573 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:57.586281 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-42736b06-db33-4a1b-8a41-5916aa4e7dc8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1629 microversion: 2.1 time: 0.172245 Nov 02 13:58:57.586882 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3793/8126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:57 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1629 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:58.611415 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:58.612237 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:58.623417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:58.623930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:58.624385 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:58.625174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:58.625566 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:58.627782 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:58.796603 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:58.804597 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89a42e18-6625-4b3f-b71b-7bc9f296b2e4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.197203 Nov 02 13:58:58.805194 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4334/8127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:58 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:59.829405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:59.830124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:59.838099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:59.838653 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:59.839312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:59.839945 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:59.840616 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:59.841094 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:00.008814 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:00.016894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f4f146f8-4862-4f99-9d1a-ff9bca9191ce tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.192056 Nov 02 13:59:00.017484 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3794/8128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:59 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:01.041171 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:01.041946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:01.049467 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:01.049993 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:01.050458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:01.051180 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:01.051648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:01.052090 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:01.204025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:01.214731 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ee14cdd-ea27-4d91-97f7-144e14ccf785 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.177457 Nov 02 13:59:01.215233 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4335/8129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:01 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:02.238620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:02.240383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:02.249572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.250632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.251406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:02.252536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.253317 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.254099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:02.412561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:02.422383 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a9ddf6eb-148a-4f7b-bdd5-85c40d6925ba tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.187513 Nov 02 13:59:02.423007 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3795/8130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:02 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:03.447807 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:03.448458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:03.456394 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:03.456902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:03.457360 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:03.458135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:03.458606 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:03.459053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:03.613998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:03.625679 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-171afb18-4b72-4286-ad8f-31c2f47d8306 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.181759 Nov 02 13:59:03.626322 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4336/8131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:03 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:04.651860 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:04.654441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:04.664138 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:04.664644 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:04.665092 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:04.665812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:04.666348 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:04.666781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:04.812544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:04.820575 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7df8c8fa-d300-440a-bc2c-f956b985ab81 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.175134 Nov 02 13:59:04.821156 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3796/8132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:04 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:05.845649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:05.847190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:05.855207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.856604 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.857280 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:05.858114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.858579 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.859170 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:06.012240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:06.020791 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-81567789-27b8-494b-ad3c-9be54c8fda38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.180035 Nov 02 13:59:06.022027 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4337/8133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:05 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:07.045643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:07.046339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:07.053215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:07.053709 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:07.054206 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:07.054912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:07.055367 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:07.055796 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:07.197329 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:07.205303 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6bef34a9-6935-4be7-91da-34d3ac6443b5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.164430 Nov 02 13:59:07.205897 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3797/8134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:07 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:08.229831 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:08.230556 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:08.238035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:08.238554 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:08.239009 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:08.239736 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:08.240207 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:08.240648 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:08.381124 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:08.389927 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-42e03d27-559a-47f9-a075-c1b3610bee7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.164110 Nov 02 13:59:08.390548 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4338/8135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:08 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:09.414146 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:09.414804 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:09.421689 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:09.422223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:09.422673 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:09.423384 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:09.423844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:09.424280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:09.565960 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:09.574764 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a204520f-ba52-4b58-bd40-cf8afcd29ffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.164597 Nov 02 13:59:09.575349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3798/8136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:09 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:10.598899 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:10.599596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:10.606857 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:10.607370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:10.607848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:10.608548 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:10.609021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:10.609471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:10.747456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:10.755390 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cae9a858-29ba-4cc2-900e-5b354b715d3b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.160656 Nov 02 13:59:10.755980 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4339/8137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:10 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:11.780551 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:11.781208 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:11.788364 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.788865 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.789383 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.790141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.790607 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.791080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.932809 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:11.942991 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-83911379-7ca7-46c7-a012-21977b8f2bf2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.166755 Nov 02 13:59:11.943607 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3799/8138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:11 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:12.968737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:12.969365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:12.976500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:12.977005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:12.978049 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:12.978199 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:12.978663 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:12.979104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:13.114103 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:13.121794 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ada28e7-dc74-4bb8-ba83-560f8a35df25 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.157046 Nov 02 13:59:13.122931 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4340/8139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:12 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:14.146756 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.147416 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:14.154441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.154936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.155456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.156103 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.156876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.157023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.301095 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:14.310763 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36d9d0a3-efea-4ca3-bc7d-fcd1b290e220 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.167922 Nov 02 13:59:14.316650 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3800/8140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:15.335821 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:15.336461 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:15.343898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.344439 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.344897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.345626 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.346130 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.346580 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.484965 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:15.493124 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6713ad91-1373-4032-bfb7-c3524763b9aa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.161215 Nov 02 13:59:15.493723 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4341/8141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:15 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:16.517441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:16.518107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:16.524307 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-af755811-85c7-4895-9438-f25eb76e772b req-b46950bc-9292-454b-bedb-0da9a0ed0ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5", "name": "network-vif-plugged", "status": "completed", "tag": "4b6e99e9-ba36-4834-8f2d-fed3971b2538"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:16.537074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.537506 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.538203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.538992 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.539390 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.539539 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-af755811-85c7-4895-9438-f25eb76e772b req-b46950bc-9292-454b-bedb-0da9a0ed0ef2 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.539828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.539949 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-af755811-85c7-4895-9438-f25eb76e772b req-b46950bc-9292-454b-bedb-0da9a0ed0ef2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.540414 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-af755811-85c7-4895-9438-f25eb76e772b req-b46950bc-9292-454b-bedb-0da9a0ed0ef2 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.553797 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-af755811-85c7-4895-9438-f25eb76e772b req-b46950bc-9292-454b-bedb-0da9a0ed0ef2 service nova] Creating event network-vif-plugged:4b6e99e9-ba36-4834-8f2d-fed3971b2538 for instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 on n-h2-855650-5 Nov 02 13:59:16.560084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-af755811-85c7-4895-9438-f25eb76e772b req-b46950bc-9292-454b-bedb-0da9a0ed0ef2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039328 Nov 02 13:59:16.561855 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4342/8142] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:16.692086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:16.700632 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-00d9c6a7-713c-4701-9b0c-47fa3fb280a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.187694 Nov 02 13:59:16.701572 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3801/8143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:16 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:17.726801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:17.727460 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:17.734500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.735007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.735486 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.736201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.736672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.737115 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.877781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:17.886024 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01ade336-38de-4a79-a304-c4676238f139 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1687 microversion: 2.1 time: 0.164677 Nov 02 13:59:17.886626 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4343/8144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:17 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:18.910101 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:18.910674 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:18.917738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:18.918280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:18.918735 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:18.919445 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:18.919912 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:18.920347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:19.059084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:19.067270 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9f6ad638-d016-4a6a-aa9c-8e3de7be8f0e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1674 microversion: 2.1 time: 0.161705 Nov 02 13:59:19.067863 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3802/8145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:18 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:05.418485 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:05.419451 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:05.420817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=25 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:05.421567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=73 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:05.422809 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:01:05.423550 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 14:01:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.45) !!! Nov 02 14:01:05.426005 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:05.426960 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:05.434801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:05.435661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:05.436190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:05.436986 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:05.438204 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:05.438721 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:05.472910 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:01:05.524846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-5a787d65-6086-4ef5-ac17-990332fc1c0a req-afc1279e-0bdf-4514-ab05-01c9168c0771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5", "tag": "4b6e99e9-ba36-4834-8f2d-fed3971b2538"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:05.535589 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5a787d65-6086-4ef5-ac17-990332fc1c0a req-afc1279e-0bdf-4514-ab05-01c9168c0771 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:05.536085 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5a787d65-6086-4ef5-ac17-990332fc1c0a req-afc1279e-0bdf-4514-ab05-01c9168c0771 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:05.536534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-5a787d65-6086-4ef5-ac17-990332fc1c0a req-afc1279e-0bdf-4514-ab05-01c9168c0771 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:05.550290 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-5a787d65-6086-4ef5-ac17-990332fc1c0a req-afc1279e-0bdf-4514-ab05-01c9168c0771 service nova] Creating event network-changed:4b6e99e9-ba36-4834-8f2d-fed3971b2538 for instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 on n-h2-855650-5 Nov 02 14:01:05.557212 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-5a787d65-6086-4ef5-ac17-990332fc1c0a req-afc1279e-0bdf-4514-ab05-01c9168c0771 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138506 Nov 02 14:01:05.558185 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3803/8146] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:05.559384 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-09bdf888-eac3-4cdf-be8b-74d6e7f1b8ae tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 204 len: 0 microversion: 2.1 time: 0.143000 Nov 02 14:01:05.561800 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4344/8147] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 14:01:05 2022] DELETE /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:01:05.571469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:05.572188 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:05.579194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:05.579694 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:05.580170 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:05.580882 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:05.581345 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:05.581776 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:05.731153 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:05.740586 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d2119b19-d9ff-42a6-938c-1e130c2051cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.173891 Nov 02 14:01:05.741268 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3804/8148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:05 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:06.767620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:06.768341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:06.775744 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:06.776250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:06.776708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:06.777422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:06.777892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:06.778395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:07.025262 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:07.033497 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4045215-0062-4c39-adc8-5b16eb54226d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1680 microversion: 2.1 time: 0.270802 Nov 02 14:01:07.034112 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4345/8149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:06 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:01:08.057307 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:08.057916 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:08.065534 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:08.066067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:08.066527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:08.067265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:08.067708 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:08.068144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:08.143485 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:08.154493 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ebabe5c3-0b5b-4428-8aaa-5ab9bbdd0cf7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 200 len: 1493 microversion: 2.1 time: 0.101225 Nov 02 14:01:08.155114 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3805/8150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:08 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 1493 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:08.192865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9a668d19-ad02-414b-9799-fbf7d1a9bdf4 req-3cf433b9-3f2d-4f6b-9d36-8be38f8abda1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5", "name": "network-vif-deleted", "tag": "4b6e99e9-ba36-4834-8f2d-fed3971b2538"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:08.204033 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9a668d19-ad02-414b-9799-fbf7d1a9bdf4 req-3cf433b9-3f2d-4f6b-9d36-8be38f8abda1 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:08.204535 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9a668d19-ad02-414b-9799-fbf7d1a9bdf4 req-3cf433b9-3f2d-4f6b-9d36-8be38f8abda1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:08.204989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9a668d19-ad02-414b-9799-fbf7d1a9bdf4 req-3cf433b9-3f2d-4f6b-9d36-8be38f8abda1 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:08.221097 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9a668d19-ad02-414b-9799-fbf7d1a9bdf4 req-3cf433b9-3f2d-4f6b-9d36-8be38f8abda1 service nova] Creating event network-vif-deleted:4b6e99e9-ba36-4834-8f2d-fed3971b2538 for instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 on n-h2-855650-5 Nov 02 14:01:08.226302 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9a668d19-ad02-414b-9799-fbf7d1a9bdf4 req-3cf433b9-3f2d-4f6b-9d36-8be38f8abda1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Nov 02 14:01:08.226928 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4346/8151] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:09.183650 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:09.184488 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:09.191229 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:09.191721 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:09.192163 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:09.192868 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:09.193398 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:09.193826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:09.207904 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] HTTP exception thrown: Instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 could not be found. Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Request method failure captured: Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 HTTP/1.1 Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnbW1TEDFuTBRp3MCY8T_Tqc1BCTnhfFJWfInKkFGYa3-7OOgYGmMaOIyeif_dab7hoHXDnHj7sgC7NuuI4r1Utz0mARt4cBiGcH3WiKtL_7Vqc8YgoH3QnDFCvivbWZmIA5WlLZIRU8uXRBSJiB7j341287i2VoA_qin7nILP_g7aY Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ba3f85be054944c5be60b00e887abebd Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestShelveInstance-1813034927 Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba3f85be054944c5be60b00e887abebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba3f85be054944c5be60b00e887abebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba3f85be054944c5be60b00e887abebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba3f85be054944c5be60b00e887abebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestShelveInstance-1813034927 Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ba3f85be054944c5be60b00e887abebd Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestShelveInstance-1813034927 Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestShelveInstance-1813034927-project Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 8f19fd2cda964d6d8cda9580f4e0bb5e Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestShelveInstance-1813034927-project Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 could not be found. Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5'} Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 could not be found. Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 could not be found. Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:09.209620 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 could not be found. Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Returning 404 to user: Instance 1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08331833-b0ae-4a4e-b06b-c4635d202966 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5" status: 404 len: 111 microversion: 2.1 time: 0.031485 Nov 02 14:01:09.215817 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3806/8152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:09 2022] GET /compute/v2.1/servers/1f6fb98c-1eef-42c2-aac4-2d6e8b912fc5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:01:09.374594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b297bfd9-4554-4989-b5a2-33fccf11b3d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '.version_select at 0x7f2292ad6b80>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:09.399453 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b297bfd9-4554-4989-b5a2-33fccf11b3d4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1198583709" status: 202 len: 0 microversion: 2.1 time: 0.029674 Nov 02 14:01:09.400048 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4347/8153] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Nov 2 14:01:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1198583709 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:01:09.426887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-113e5e62-152f-4da6-ab3e-40a157ac0a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Action: 'create', calling method: .version_select at 0x7f228e8c2700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1452049972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3M+v4lDH15DqUv+2/rO5TLTxT4WN0BjjOf8UQaSEFUoIA0inV+Nw6hjzOw12+LhUZXo5roiIfpKU6lFhbt+zgVedjyBstOdxXqlHrdjPaTkaIss2LqTQihqDSwrWXm8Q=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:09.442234 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-113e5e62-152f-4da6-ab3e-40a157ac0a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Getting quotas for project ba3f85be054944c5be60b00e887abebd. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:01:09.447439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-113e5e62-152f-4da6-ab3e-40a157ac0a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Getting quotas for user 8f19fd2cda964d6d8cda9580f4e0bb5e and project ba3f85be054944c5be60b00e887abebd. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:01:09.474908 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-113e5e62-152f-4da6-ab3e-40a157ac0a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.051967 Nov 02 14:01:09.475541 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3807/8154] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 14:01:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:01:26.723988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:26.724749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:26.729249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-332628136", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1452049972", "security_groups": [{"name": "tempest-secgroup-smoke-425200771"}], "networks": [{"uuid": "685a3cab-3c22-454c-a999-61c2ad38e949"}], "block_device_mapping_v2": [{"uuid": "1c31a4c8-e767-422c-9b7e-73488ac9391e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:26.846752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] validate_networks() for [('685a3cab-3c22-454c-a999-61c2ad38e949', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:01:27.216892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:01:27.217326 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:01:27.217812 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:01:27.218256 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:01:27.218714 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:01:27.227936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:27.228429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:27.228877 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:27.229620 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:27.230109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:27.230573 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:27.248570 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Getting quotas for project ba3f85be054944c5be60b00e887abebd. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:01:27.254378 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Getting quotas for user 8f19fd2cda964d6d8cda9580f4e0bb5e and project ba3f85be054944c5be60b00e887abebd. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:01:27.311922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:01:27.314860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c31a4c8-e767-422c-9b7e-73488ac9391e',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:01:27.446813 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [e380d269-6430-4951-a5b9-df26694167b0] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:01:28.454710 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [e380d269-6430-4951-a5b9-df26694167b0] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41992. Nov 02 14:01:28.459121 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-535cff65-5185-453a-8430-ebc683824807 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.737052 Nov 02 14:01:28.459787 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4348/8155] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 14:01:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:01:28.469867 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=16 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:28.471098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:28.471861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:28.478258 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-58356ed2-c224-4440-88cf-b2a57b21da15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:28.478886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-58356ed2-c224-4440-88cf-b2a57b21da15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:28.543237 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-58356ed2-c224-4440-88cf-b2a57b21da15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:28.550987 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-58356ed2-c224-4440-88cf-b2a57b21da15 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1088 microversion: 2.1 time: 0.083561 Nov 02 14:01:28.551567 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3808/8156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:28 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:29.573894 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:29.574608 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:29.581193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:29.581711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:29.582198 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:29.583155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:29.583630 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:29.584082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:29.667692 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:29.676058 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fadc23b3-c729-4d59-843b-f34912623040 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1194 microversion: 2.1 time: 0.107119 Nov 02 14:01:29.677010 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4349/8157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:29 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:30.700512 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:30.701147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:30.708388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:30.708892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:30.709342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:30.710225 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:30.710706 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:30.711147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:30.854223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:30.864114 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-48ce8d51-462f-484c-b532-cab1ca5e28ac tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1271 microversion: 2.1 time: 0.167681 Nov 02 14:01:30.865166 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3809/8158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:30 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:31.159254 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8415fa0c-9def-4ad9-91dd-956ec747ade0 req-2716f686-ab2e-4f1b-a55b-ec911fbe8a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626932b9-d51d-49bc-bc6e-d07a22fba1b8", "tag": "f6a87aae-c996-4529-9af4-bd3015b1d013"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:31.175083 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8415fa0c-9def-4ad9-91dd-956ec747ade0 req-2716f686-ab2e-4f1b-a55b-ec911fbe8a46 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:31.175662 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8415fa0c-9def-4ad9-91dd-956ec747ade0 req-2716f686-ab2e-4f1b-a55b-ec911fbe8a46 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:31.176356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8415fa0c-9def-4ad9-91dd-956ec747ade0 req-2716f686-ab2e-4f1b-a55b-ec911fbe8a46 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:31.190239 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8415fa0c-9def-4ad9-91dd-956ec747ade0 req-2716f686-ab2e-4f1b-a55b-ec911fbe8a46 service nova] Creating event network-changed:f6a87aae-c996-4529-9af4-bd3015b1d013 for instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 on n-h1-855650-5 Nov 02 14:01:31.196801 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8415fa0c-9def-4ad9-91dd-956ec747ade0 req-2716f686-ab2e-4f1b-a55b-ec911fbe8a46 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042022 Nov 02 14:01:31.198096 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4350/8159] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:31.889990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:31.890681 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:31.897572 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:31.898098 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:31.898545 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:31.899264 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:31.899726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:31.900161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:32.045245 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:32.055564 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-330a500b-4891-49aa-a02d-863b76ef4982 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1271 microversion: 2.1 time: 0.171236 Nov 02 14:01:32.056823 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3810/8160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:31 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:33.080593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:33.081368 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:33.088100 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:33.088870 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:33.089333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:33.090114 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:33.090593 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:33.091040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:33.227962 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:33.236618 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b2d10d12-43f7-48e9-ba06-6fc6d0037d0f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1271 microversion: 2.1 time: 0.161722 Nov 02 14:01:33.237210 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4351/8161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:33 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:34.260405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:34.261131 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:34.269165 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:34.269665 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:34.270149 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:34.270871 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:34.271377 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:34.271815 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:34.413527 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:34.421772 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5d2b202e-7c93-432a-8e6c-51de772e8133 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1271 microversion: 2.1 time: 0.165226 Nov 02 14:01:34.422415 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3811/8162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:34 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:35.444844 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:35.445478 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:35.452927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:35.454021 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:35.454481 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:35.455195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:35.455661 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:35.456104 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:35.590007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:35.598403 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f15432c6-cd97-4e4f-8f08-53dd8809813a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.157452 Nov 02 14:01:35.598982 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4352/8163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:35 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:36.622853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:36.623474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:36.631106 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:36.631606 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:36.632046 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:36.632846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:36.633306 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:36.633785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:36.768513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:36.776407 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9b8f8c58-b2a7-473c-bbc9-5e5b863c9bc2 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.157609 Nov 02 14:01:36.777002 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3812/8164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:36 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:01:37.799454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:37.800081 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:37.802903 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:37.803576 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:37.810318 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:37.810819 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:37.811269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:37.811971 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:37.812437 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:37.812889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:37.950292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:37.958951 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0186b87b-a436-4505-8f78-0c44a277a428 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.163496 Nov 02 14:01:37.959543 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4353/8165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:37 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:38.982310 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:38.982940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:38.987375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:38.991590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:38.992087 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:38.992536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:38.993244 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:38.993711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:38.994172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:39.132016 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:39.139874 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b5e5de5d-fd1e-4735-aa79-07dda5341dbb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.161651 Nov 02 14:01:39.140461 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3813/8166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:38 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:40.163075 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:40.163936 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:40.170796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:40.171294 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:40.171742 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:40.173003 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:40.173466 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:40.173900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:40.312983 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:40.320934 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b9cfb51-c998-4097-ac5c-0cff05d02f69 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.161984 Nov 02 14:01:40.321523 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4354/8167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:40 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:41.344892 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:41.345508 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:41.352463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:41.353004 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:41.353447 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:41.354178 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:41.354638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:41.355065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:41.488699 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:41.496558 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-b06b7641-38a5-4911-925d-461ad92aa62b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.156376 Nov 02 14:01:41.497140 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3814/8168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:41 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:42.519929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:42.520564 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:42.527506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:42.528011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:42.528475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:42.529184 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:42.529659 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:42.530144 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:42.668283 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:42.676201 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2955c256-987f-4712-8b9f-5f4809de50c3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.160784 Nov 02 14:01:42.676789 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4355/8169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:42 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:43.699794 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:43.700391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:43.707476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:43.707975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:43.708424 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:43.709133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:43.709597 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:43.710059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:43.842887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:43.850741 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-475ce229-a277-4f13-9b40-60d9523a1b2c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.155004 Nov 02 14:01:43.851352 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3815/8170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:43 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:44.874438 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:44.875686 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:44.882750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:44.883263 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:44.883769 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:44.884447 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:44.884920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:44.885361 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:45.032723 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:45.040638 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ff1e741-1cef-4e6b-90ef-9dcf58234086 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.170157 Nov 02 14:01:45.041246 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4356/8171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:44 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:46.063298 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:46.063905 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:46.070840 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:46.071326 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:46.071769 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:46.072456 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:46.072946 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:46.073340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:46.213041 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:46.221122 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea2f0b88-8c1d-45e8-b5d8-bfb05a291191 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.161739 Nov 02 14:01:46.225345 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3816/8172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:46 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:01:46.333365 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f67b60bf-6cdb-46b5-9d8a-dc3deddc2fb2 req-c3ea02b4-5ab1-47af-a633-bc737ea1b71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626932b9-d51d-49bc-bc6e-d07a22fba1b8", "name": "network-vif-plugged", "status": "completed", "tag": "f6a87aae-c996-4529-9af4-bd3015b1d013"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:46.345687 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f67b60bf-6cdb-46b5-9d8a-dc3deddc2fb2 req-c3ea02b4-5ab1-47af-a633-bc737ea1b71e service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:46.346523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f67b60bf-6cdb-46b5-9d8a-dc3deddc2fb2 req-c3ea02b4-5ab1-47af-a633-bc737ea1b71e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:46.346982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f67b60bf-6cdb-46b5-9d8a-dc3deddc2fb2 req-c3ea02b4-5ab1-47af-a633-bc737ea1b71e service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:46.358514 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f67b60bf-6cdb-46b5-9d8a-dc3deddc2fb2 req-c3ea02b4-5ab1-47af-a633-bc737ea1b71e service nova] Creating event network-vif-plugged:f6a87aae-c996-4529-9af4-bd3015b1d013 for instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 on n-h1-855650-5 Nov 02 14:01:46.364108 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f67b60bf-6cdb-46b5-9d8a-dc3deddc2fb2 req-c3ea02b4-5ab1-47af-a633-bc737ea1b71e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034560 Nov 02 14:01:46.364712 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4357/8173] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:47.244876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:47.245489 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:47.252530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:47.253023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:47.253469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:47.254280 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:47.254743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:47.255176 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:47.388401 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:47.397172 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9cabc9f2-5748-4ab8-baa5-44b782fc9fd5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1259 microversion: 2.1 time: 0.156267 Nov 02 14:01:47.397795 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3817/8174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:47 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:48.422126 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:48.422860 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:48.429037 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:48.429531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:48.429999 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:48.430697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:48.431163 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:48.431594 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:48.564179 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:48.572082 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3b9c47c-d78c-4c4f-885d-913b837502a6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1442 microversion: 2.1 time: 0.155653 Nov 02 14:01:48.572673 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4358/8175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:48 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:48.594978 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:48.595531 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:48.602406 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:48.602904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:48.603352 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:48.604061 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:48.604542 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:48.604969 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:48.744228 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:48.752173 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-01b14669-f8d2-4414-ad5c-3b321eb22488 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1442 microversion: 2.1 time: 0.161617 Nov 02 14:01:48.752769 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3818/8176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:48 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:50.398854 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7900e4ab-0cd3-4714-abf0-b03b73787b85 req-3c1133b7-2470-4296-a8c5-f45630c5e563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626932b9-d51d-49bc-bc6e-d07a22fba1b8", "tag": "f6a87aae-c996-4529-9af4-bd3015b1d013"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:50.410174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7900e4ab-0cd3-4714-abf0-b03b73787b85 req-3c1133b7-2470-4296-a8c5-f45630c5e563 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:50.410654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7900e4ab-0cd3-4714-abf0-b03b73787b85 req-3c1133b7-2470-4296-a8c5-f45630c5e563 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:50.411105 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7900e4ab-0cd3-4714-abf0-b03b73787b85 req-3c1133b7-2470-4296-a8c5-f45630c5e563 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:50.422481 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7900e4ab-0cd3-4714-abf0-b03b73787b85 req-3c1133b7-2470-4296-a8c5-f45630c5e563 service nova] Creating event network-changed:f6a87aae-c996-4529-9af4-bd3015b1d013 for instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 on n-h1-855650-5 Nov 02 14:01:50.427848 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7900e4ab-0cd3-4714-abf0-b03b73787b85 req-3c1133b7-2470-4296-a8c5-f45630c5e563 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032561 Nov 02 14:01:50.428471 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4359/8177] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:45.560196 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a729f393-f18f-46ff-992e-9b20bef5c4cb] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:03:45.561495 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a618658-f83a-4e1f-aba5-6ee48de50ace] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:03:45.562100 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=24 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:45.562857 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=60 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:45.563951 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:03:45.564148 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 14:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8/action (ip 10.222.0.45) !!! Nov 02 14:03:45.566459 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:03:45.566635 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 14:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8/action (ip 10.222.0.45) !!! Nov 02 14:03:45.585097 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:45.585669 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:45.592600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.593000 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.593436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.594175 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.594634 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.595058 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.620162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lazy-loading 'flavor' on Instance uuid 626932b9-d51d-49bc-bc6e-d07a22fba1b8 {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:03:45.698498 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b0e1cd3-b38d-4e96-98d3-80c3d01d051f tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "POST /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8/action" status: 202 len: 0 microversion: 2.1 time: 0.140014 Nov 02 14:03:45.699104 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3819/8178] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:45 2022] POST /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:03:45.705683 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2bebab1-6133-44ed-afdc-10bb19e356b1] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:03:45.706562 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:03:45.707172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:45.707929 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=56 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:45.709358 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:03:45.709611 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 14:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 (ip 10.222.0.45) !!! Nov 02 14:03:45.715260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:45.715989 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:45.725893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.726464 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.726922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.727644 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.728119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.728563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.868097 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.876084 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-983b748a-31a2-4b36-8276-f99f19101d26 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.172209 Nov 02 14:03:45.876689 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4360/8179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:45 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:46.903078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:46.903790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:46.913065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.913561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.914033 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.914743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.915207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.915638 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.916864 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a618658-f83a-4e1f-aba5-6ee48de50ace] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42094. Nov 02 14:03:46.921006 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] [a729f393-f18f-46ff-992e-9b20bef5c4cb] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42092. Nov 02 14:03:47.125548 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.133394 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9553da2b-aaa4-4ee2-b477-7244f9ec4f3a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.237070 Nov 02 14:03:47.133998 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3820/8180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:46 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:48.157223 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:48.157852 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:48.173007 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:48.173517 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:48.174001 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:48.174724 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:48.175196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:48.175638 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:48.180442 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2bebab1-6133-44ed-afdc-10bb19e356b1] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42104. Nov 02 14:03:48.181433 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42106. Nov 02 14:03:48.311617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:48.319600 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9bd3c027-5ac4-4031-a5a8-b5569528941c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.166386 Nov 02 14:03:48.320208 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4361/8181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:48 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:49.343082 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:49.343738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:49.350781 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:49.351174 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:49.351624 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:49.352324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:49.352784 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:49.353221 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:49.488132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:49.496222 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-071db12d-0d89-4bac-b98b-1d6e2f72646e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.157423 Nov 02 14:03:49.496811 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3821/8182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:49 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:50.519036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:50.519668 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:50.527596 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:50.528102 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:50.528893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.529557 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:50.530052 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:50.530500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.664752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.672716 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46815854-6223-4dc5-a235-b9939b8723e5 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.157669 Nov 02 14:03:50.673300 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4362/8183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:50 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:51.696121 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:51.696691 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:51.703636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:51.704125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:51.704576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:51.705279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:51.705743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:51.706207 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:51.839011 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:51.847468 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-7496fd72-c143-407a-89ff-3c99c2ed38cb tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.155396 Nov 02 14:03:51.848052 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3822/8184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:51 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:52.872698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:52.873371 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:52.880524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:52.881025 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:52.881476 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:52.882717 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:52.883183 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:52.883623 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:53.015015 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:53.023316 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1b07f7d-0fd0-4871-beb2-f318fabd0590 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.154044 Nov 02 14:03:53.023891 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4363/8185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:52 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:54.046844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:54.047495 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:54.054515 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:54.054975 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:54.055419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:54.056162 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:54.056630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:54.057059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:54.194247 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:54.202912 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2ffdbe38-2d1a-4fb2-8cf5-80d2858d0b42 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.159962 Nov 02 14:03:54.203601 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3823/8186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:54 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:55.228195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:55.228794 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:55.235824 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:55.236330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:55.236788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:55.237544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:55.238042 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:55.238513 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:55.379815 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:55.388262 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-405c1b2f-8609-4cac-a5af-f1c84f2d2a38 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.164978 Nov 02 14:03:55.388856 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4364/8187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:55 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:56.412396 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:56.413037 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:56.420666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:56.421161 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:56.421609 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:56.422344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:56.422831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:56.423267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:56.565530 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:56.573728 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-439a39fb-9823-4850-a0be-b20ab0a29c58 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.165261 Nov 02 14:03:56.574349 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3824/8188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:56 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:57.598356 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:57.598926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:57.606376 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:57.606911 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:57.607441 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:57.608164 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:57.608636 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:57.609076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:57.742523 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:57.750762 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86026dc8-c54e-4580-ba04-567f764c469d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.156642 Nov 02 14:03:57.751341 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4365/8189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:57 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:58.774910 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:58.775543 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:58.782462 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:58.782952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:58.783399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:58.784099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:58.784561 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:58.784993 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:58.935711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:58.948765 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e82573bb-764e-48ab-89a9-dac9feadd72c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.177420 Nov 02 14:03:58.949753 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3825/8190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:58 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:59.976802 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:59.977462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:59.984218 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:59.984735 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:59.985196 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:59.985924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:59.986431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:59.986878 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:00.126639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:00.135252 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d8a764d8-44cf-4620-8661-b9c69ca5a8c6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1568 microversion: 2.1 time: 0.162496 Nov 02 14:04:00.135848 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4366/8191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:59 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:00.158043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:00.158677 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:00.166086 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:00.166579 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:00.167020 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:00.167741 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:00.168198 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:00.168627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:00.268886 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120723) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 14:04:00.339264 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-982dad38-2b30-4aee-8360-bd10410a8167 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "POST /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8/action" status: 202 len: 0 microversion: 2.1 time: 0.184654 Nov 02 14:04:00.339695 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3826/8192] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:00 2022] POST /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:04:00.347914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:00.348529 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:00.355348 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:00.355848 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:00.356319 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:00.357006 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:00.357469 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:00.357900 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:00.530711 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:00.538629 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6ac82820-e76d-4732-a702-ee1df5052a70 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1516 microversion: 2.1 time: 0.194646 Nov 02 14:04:00.539211 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4367/8193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:00 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:00.836663 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-d0806e5b-de7e-470a-88dd-cf8838019933 req-82310612-4dbf-4609-8c37-746a805a14bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626932b9-d51d-49bc-bc6e-d07a22fba1b8", "name": "network-vif-unplugged", "status": "completed", "tag": "f6a87aae-c996-4529-9af4-bd3015b1d013"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:00.846842 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d0806e5b-de7e-470a-88dd-cf8838019933 req-82310612-4dbf-4609-8c37-746a805a14bf service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:00.847337 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d0806e5b-de7e-470a-88dd-cf8838019933 req-82310612-4dbf-4609-8c37-746a805a14bf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:00.847780 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-d0806e5b-de7e-470a-88dd-cf8838019933 req-82310612-4dbf-4609-8c37-746a805a14bf service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:00.860318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.compute.server_external_events [req-d0806e5b-de7e-470a-88dd-cf8838019933 req-82310612-4dbf-4609-8c37-746a805a14bf service nova] Unable to find a host for instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8. Dropping event network-vif-unplugged {{(pid=120723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 14:04:00.861228 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-d0806e5b-de7e-470a-88dd-cf8838019933 req-82310612-4dbf-4609-8c37-746a805a14bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080851 Nov 02 14:04:00.862371 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3827/8194] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 14:04:01.562913 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:01.563732 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:01.571553 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:01.572131 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:01.572649 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:01.573597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:01.574017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:01.574457 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:01.712532 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:01.720847 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db545f03-d67e-4ace-bf2b-7da32649a1e1 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1516 microversion: 2.1 time: 0.161940 Nov 02 14:04:01.721505 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4368/8195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:01 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:02.745744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:02.746324 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:02.753099 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:02.753587 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:02.754048 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:02.754744 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:02.755193 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:02.755618 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:02.894148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:02.903300 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ad8443fd-5a20-4f44-9ef9-26d0c32723f0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1516 microversion: 2.1 time: 0.162158 Nov 02 14:04:02.903896 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3828/8196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:02 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:03.928341 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:03.929617 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:03.937023 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:03.937540 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:03.938028 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:03.938758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:03.939233 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:03.939682 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:04.069584 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:04.077561 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ecd761f4-8b71-4a7e-894b-bb96c4da5849 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1516 microversion: 2.1 time: 0.153142 Nov 02 14:04:04.078186 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4369/8197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:03 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:05.102553 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:05.103301 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:05.110420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.110911 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.111357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.112060 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.112517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.112956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.251049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.259532 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-938ebcfa-05e3-4242-b1fa-15452d4a05fe tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1518 microversion: 2.1 time: 0.161022 Nov 02 14:04:05.260117 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3829/8198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:05 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:06.283691 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:06.284286 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:06.291209 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.291737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.292190 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.292889 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.293359 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.293795 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.432399 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.440463 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f329a89-7c7b-417b-bf6a-9ec5b2189adc tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1518 microversion: 2.1 time: 0.160683 Nov 02 14:04:06.441052 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4370/8199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:06 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:07.465372 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:07.466137 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:07.473240 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.473747 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.474227 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.474947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.476133 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.476577 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.616680 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:07.625635 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5591c0b1-4359-411f-8385-66adbbb472e0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1518 microversion: 2.1 time: 0.164385 Nov 02 14:04:07.626271 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3830/8200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:07 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:08.648984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:08.649536 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:08.656982 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.657495 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.657951 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:08.658801 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.659168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.659613 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:08.793330 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:08.801449 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c94faa9-ce87-482b-b013-6d02fb82c647 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1518 microversion: 2.1 time: 0.156502 Nov 02 14:04:08.802081 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4371/8201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:08 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:09.824990 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:09.825603 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:09.833282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:09.833786 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:09.834265 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:09.835790 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:09.836266 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:09.836757 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:09.984173 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:09.993737 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-be98f88f-50aa-406c-bb42-0a2212bbdc2a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1518 microversion: 2.1 time: 0.172828 Nov 02 14:04:09.994641 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3831/8202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:09 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:11.019113 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:11.019945 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:11.026902 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.027403 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.027853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.028575 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.029040 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.029506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.262302 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:11.270211 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b53c1dea-b9c9-4300-addd-b504cd2511b4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.255305 Nov 02 14:04:11.270805 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4372/8203] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:11 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:11.487407 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-05bc4375-cc6a-43ac-8b31-1cef279edb46 req-e40798e4-404e-4409-aaf2-802642283ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626932b9-d51d-49bc-bc6e-d07a22fba1b8", "tag": "f6a87aae-c996-4529-9af4-bd3015b1d013"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:11.499261 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-05bc4375-cc6a-43ac-8b31-1cef279edb46 req-e40798e4-404e-4409-aaf2-802642283ef7 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.499889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-05bc4375-cc6a-43ac-8b31-1cef279edb46 req-e40798e4-404e-4409-aaf2-802642283ef7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.500583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-05bc4375-cc6a-43ac-8b31-1cef279edb46 req-e40798e4-404e-4409-aaf2-802642283ef7 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.515319 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-05bc4375-cc6a-43ac-8b31-1cef279edb46 req-e40798e4-404e-4409-aaf2-802642283ef7 service nova] Creating event network-changed:f6a87aae-c996-4529-9af4-bd3015b1d013 for instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 on n-h2-855650-5 Nov 02 14:04:11.521999 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-05bc4375-cc6a-43ac-8b31-1cef279edb46 req-e40798e4-404e-4409-aaf2-802642283ef7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038959 Nov 02 14:04:11.523513 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3832/8204] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:12.293462 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:12.294374 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:12.301496 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:12.302202 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:12.302766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:12.304474 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:12.305195 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:12.305853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:12.451459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:12.459562 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8d407bac-b799-4999-93bd-5df976f7f03a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.170068 Nov 02 14:04:12.460253 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4373/8205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:12 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:13.484952 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:13.485802 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:13.492906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:13.493399 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:13.493853 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:13.494666 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:13.495129 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:13.495567 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:13.638836 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:13.642419 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:13.648428 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d7afab0f-7db2-4b42-9b24-36bb2cbed1e6 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.168632 Nov 02 14:04:13.649022 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3833/8206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:13 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:14.672946 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:14.673524 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:14.680922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:14.681418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:14.681875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:14.682601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:14.683069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:14.683506 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:14.816002 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:14.823880 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2bddd2e0-ca4a-4947-8f11-b35bb2ae3227 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.155064 Nov 02 14:04:14.824455 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4374/8207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:14 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:15.847876 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:15.848498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:15.851223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:15.858022 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:15.858521 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:15.858971 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:15.859678 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:15.860142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:15.860578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:15.996034 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:16.004002 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a5a23511-ffad-4286-8715-38897aa560b3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.160841 Nov 02 14:04:16.004581 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3834/8208] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:15 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:17.028338 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:17.028970 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:17.031699 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=31 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:17.037407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:17.037914 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:17.038398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:17.039106 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:17.039578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:17.040022 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:17.042639 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=91 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:17.175008 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:17.183301 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c23fed62-aa34-4724-8e0b-5d1d65bbc0e8 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.158908 Nov 02 14:04:17.183880 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4375/8209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:17 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:18.207652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:18.208339 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:18.214557 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:18.215322 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:18.215770 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:18.216472 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:18.216936 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:18.217374 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:18.349379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:18.357925 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-90dcda8a-92d4-4e44-b4d8-42195e7ebb4c tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.154554 Nov 02 14:04:18.358538 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3835/8210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:18 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:19.382397 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:19.383035 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:19.389169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:19.389671 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:19.390155 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:19.390866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:19.391333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:19.391773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:19.526654 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:19.534542 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8ae17e0e-bbbd-4f86-8db7-fe19244e7d2d tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.156410 Nov 02 14:04:19.535117 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4376/8211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:19 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:20.558043 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:20.558767 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:20.565600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:20.566141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:20.566594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:20.567947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:20.568415 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:20.568854 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:20.705413 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:20.714470 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2af61432-bca9-4c6f-b117-dd2a35ef2ec3 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.160379 Nov 02 14:04:20.715316 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3836/8212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:20 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:21.738601 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:21.739161 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:21.746108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:21.746610 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:21.747064 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:21.747766 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:21.748240 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:21.748679 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:21.885257 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:21.893434 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-145aed02-6a86-497f-8fe3-a1c5930ec47b tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.158803 Nov 02 14:04:21.894059 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4377/8213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:21 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:21.979605 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-37658995-b125-474a-8949-de2e7ef19ef0 req-4d472f11-9ebb-4447-9ae2-03f1cee87785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626932b9-d51d-49bc-bc6e-d07a22fba1b8", "name": "network-vif-plugged", "status": "completed", "tag": "f6a87aae-c996-4529-9af4-bd3015b1d013"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:21.990646 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-37658995-b125-474a-8949-de2e7ef19ef0 req-4d472f11-9ebb-4447-9ae2-03f1cee87785 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:21.991130 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-37658995-b125-474a-8949-de2e7ef19ef0 req-4d472f11-9ebb-4447-9ae2-03f1cee87785 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:21.991564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-37658995-b125-474a-8949-de2e7ef19ef0 req-4d472f11-9ebb-4447-9ae2-03f1cee87785 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:22.003080 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-37658995-b125-474a-8949-de2e7ef19ef0 req-4d472f11-9ebb-4447-9ae2-03f1cee87785 service nova] Creating event network-vif-plugged:f6a87aae-c996-4529-9af4-bd3015b1d013 for instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 on n-h2-855650-5 Nov 02 14:04:22.008624 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-37658995-b125-474a-8949-de2e7ef19ef0 req-4d472f11-9ebb-4447-9ae2-03f1cee87785 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032838 Nov 02 14:04:22.009215 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3837/8214] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:22.918300 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:22.918938 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:22.925984 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:22.926498 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:22.926959 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:22.927676 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:22.928150 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:22.928597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:23.059770 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:23.067937 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1eb7fce8-f6fb-4c9d-b243-42c5efce37cd tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1574 microversion: 2.1 time: 0.154080 Nov 02 14:04:23.068519 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4378/8215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:22 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:24.094243 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:24.095105 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:24.101546 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:24.102065 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:24.102519 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:24.103242 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:24.103700 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:24.104126 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:24.238614 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:24.247202 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-61a64928-eeb9-420d-9797-89f75363aef0 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1561 microversion: 2.1 time: 0.159247 Nov 02 14:04:24.247804 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3838/8216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:24 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:40.620168 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=7 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:40.621400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=23 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:40.623051 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:05:40.623212 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 14:05:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 (ip 10.222.0.45) !!! Nov 02 14:05:40.625712 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:05:40.625850 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 14:05:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 (ip 10.222.0.45) !!! Nov 02 14:05:40.626576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-e6961e1a-2dc0-4f50-bf78-765189fa5f1d req-fb5c310f-a2d2-40f3-ab9f-6db041634b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626932b9-d51d-49bc-bc6e-d07a22fba1b8", "tag": "f6a87aae-c996-4529-9af4-bd3015b1d013"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:40.633626 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=9 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:40.634602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:40.634855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=26 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:40.635246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:40.642423 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e6961e1a-2dc0-4f50-bf78-765189fa5f1d req-fb5c310f-a2d2-40f3-ab9f-6db041634b8f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.643274 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e6961e1a-2dc0-4f50-bf78-765189fa5f1d req-fb5c310f-a2d2-40f3-ab9f-6db041634b8f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.643956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-e6961e1a-2dc0-4f50-bf78-765189fa5f1d req-fb5c310f-a2d2-40f3-ab9f-6db041634b8f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.649244 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.649753 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.650231 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.650956 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.651429 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.651868 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.657734 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-e6961e1a-2dc0-4f50-bf78-765189fa5f1d req-fb5c310f-a2d2-40f3-ab9f-6db041634b8f service nova] Creating event network-changed:f6a87aae-c996-4529-9af4-bd3015b1d013 for instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 on n-h2-855650-5 Nov 02 14:05:40.663927 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-e6961e1a-2dc0-4f50-bf78-765189fa5f1d req-fb5c310f-a2d2-40f3-ab9f-6db041634b8f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043520 Nov 02 14:05:40.665235 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3839/8217] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:40.683395 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:05:40.775356 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab0ca461-83c5-4d55-832a-904c1a8e24a9 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "DELETE /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 204 len: 0 microversion: 2.1 time: 0.157035 Nov 02 14:05:40.779725 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4379/8218] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 14:05:40 2022] DELETE /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:05:40.785743 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:40.786662 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:40.793726 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.794279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.794724 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.795643 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.796439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.796885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.948059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:40.956565 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-871a3871-c066-4ad2-9c76-b0aa65ecc305 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.175395 Nov 02 14:05:40.957242 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3840/8219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:40 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:41.982264 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:41.982991 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:41.990076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:41.990589 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:41.991053 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:41.991773 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:41.992246 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:41.992688 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:42.127546 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:42.136122 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22f0f9d1-b7c4-4b0f-9ab3-7dfee5193fa7 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1567 microversion: 2.1 time: 0.158980 Nov 02 14:05:42.136887 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4380/8220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:41 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:43.083420 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-16b6a3f2-add4-4848-820e-793c440ad9ad req-7abbd089-7b76-4ad1-a614-178ba0aadda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626932b9-d51d-49bc-bc6e-d07a22fba1b8", "name": "network-vif-deleted", "tag": "f6a87aae-c996-4529-9af4-bd3015b1d013"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:43.097463 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-16b6a3f2-add4-4848-820e-793c440ad9ad req-7abbd089-7b76-4ad1-a614-178ba0aadda4 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:43.098347 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-16b6a3f2-add4-4848-820e-793c440ad9ad req-7abbd089-7b76-4ad1-a614-178ba0aadda4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:43.098803 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-16b6a3f2-add4-4848-820e-793c440ad9ad req-7abbd089-7b76-4ad1-a614-178ba0aadda4 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:43.112712 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-16b6a3f2-add4-4848-820e-793c440ad9ad req-7abbd089-7b76-4ad1-a614-178ba0aadda4 service nova] Creating event network-vif-deleted:f6a87aae-c996-4529-9af4-bd3015b1d013 for instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 on n-h2-855650-5 Nov 02 14:05:43.118878 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-16b6a3f2-add4-4848-820e-793c440ad9ad req-7abbd089-7b76-4ad1-a614-178ba0aadda4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039257 Nov 02 14:05:43.120050 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3841/8221] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:43.160069 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:43.160697 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:43.168269 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:43.168778 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:43.169245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:43.169988 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:43.170459 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:43.170904 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:43.236141 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:43.245029 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0709424-1caa-41cb-b977-5ea9ac49e97e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1219 microversion: 2.1 time: 0.088805 Nov 02 14:05:43.245618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4381/8222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:43 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:44.269583 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:44.270323 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:44.276883 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:44.277380 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:44.277831 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:44.278576 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:44.279040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:44.279474 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:44.345467 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:44.354123 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0cdc14e8-9b34-4035-aa4c-a67cda8830c4 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1219 microversion: 2.1 time: 0.089757 Nov 02 14:05:44.354736 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3842/8223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:44 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:45.378426 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:45.379109 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:45.386749 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:45.387260 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:45.387738 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:45.388452 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:45.388922 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:45.389367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:45.462835 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:45.472843 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d67dca39-aa33-4b74-9a51-08212526136e tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1219 microversion: 2.1 time: 0.098296 Nov 02 14:05:45.473449 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4382/8224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:45 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:46.496885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:46.497535 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:46.504439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.504920 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.505360 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.506143 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.506541 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.506968 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.570465 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:46.578802 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-9d671f17-644d-4c6c-ba94-ac5e68ab9d7a tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1219 microversion: 2.1 time: 0.085884 Nov 02 14:05:46.579390 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3843/8225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:46 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:47.603816 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:47.604551 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:47.611898 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:47.612411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:47.612873 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:47.613597 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:47.614094 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:47.614543 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:47.647417 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:47.647920 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:47.648380 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:47.648843 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lazy-loading 'fault' on Instance uuid 626932b9-d51d-49bc-bc6e-d07a22fba1b8 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:05:47.693208 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f19fd2cda964d6d8cda9580f4e0bb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f85be054944c5be60b00e887abebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:47.701278 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2212f900-3667-4a38-b726-fd1b385a6d76 tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 200 len: 1224 microversion: 2.1 time: 0.102026 Nov 02 14:05:47.701905 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4383/8226] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:47 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:48.725318 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:48.726036 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] [instance: 626932b9-d51d-49bc-bc6e-d07a22fba1b8] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:48.732887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:48.733513 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:48.733984 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:48.734720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:48.735191 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:48.735630 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:48.750936 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] HTTP exception thrown: Instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 could not be found. Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Request method failure captured: Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 HTTP/1.1 Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnbW1TEDFuTBRp3MCY8T_Tqc1BCTnhfFJWfInKkFGYa3-7OOgYGmMaOIyeif_dab7hoHXDnHj7sgC7NuuI4r1Utz0mARt4cBiGcH3WiKtL_7Vqc8YgoH3QnDFCvivbWZmIA5WlLZIRU8uXRBSJiB7j341287i2VoA_qin7nILP_g7aY Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: ba3f85be054944c5be60b00e887abebd Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestShelveInstance-1813034927 Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba3f85be054944c5be60b00e887abebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba3f85be054944c5be60b00e887abebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba3f85be054944c5be60b00e887abebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba3f85be054944c5be60b00e887abebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestShelveInstance-1813034927 Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: ba3f85be054944c5be60b00e887abebd Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestShelveInstance-1813034927 Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestShelveInstance-1813034927-project Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 8f19fd2cda964d6d8cda9580f4e0bb5e Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestShelveInstance-1813034927-project Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 could not be found. Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '626932b9-d51d-49bc-bc6e-d07a22fba1b8'} Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 could not be found. Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 could not be found. Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:48.752636 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 could not be found. Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Returning 404 to user: Instance 626932b9-d51d-49bc-bc6e-d07a22fba1b8 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6a5f5d64-ec9b-40e7-beaf-700f1ac77cda tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8" status: 404 len: 111 microversion: 2.1 time: 0.033175 Nov 02 14:05:48.762505 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3844/8227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:48 2022] GET /compute/v2.1/servers/626932b9-d51d-49bc-bc6e-d07a22fba1b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:05:48.928933 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0922ad62-7e56-4261-aa21-a06debf6cffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] Calling method '.version_select at 0x7f228ec78ee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:48.955234 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0922ad62-7e56-4261-aa21-a06debf6cffa tempest-TestShelveInstance-1813034927 tempest-TestShelveInstance-1813034927-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1452049972" status: 202 len: 0 microversion: 2.1 time: 0.032339 Nov 02 14:05:48.956145 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4384/8228] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Nov 2 14:05:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1452049972 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:06:07.249672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=14 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:07.250559 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=24 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:07.454081 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-2312dca4-4feb-49bf-b354-659717077833 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Action: 'create', calling method: .version_select at 0x7f228e1708b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2047377629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8co5f29kUUbwHigipoRGKd5rHefw1P/RzQuzSy0MSwUHTeRCUNFqr+X8I++qpvWSgVk4iUi6i9brHwy4EqvxGhzoXIBEj/pYdyE6AwTvxMVg9AFv1NBOcDpFBX/8c6CA=="}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:07.470438 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-2312dca4-4feb-49bf-b354-659717077833 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Getting quotas for project 6061653e33774f62bb7f11777e502a0d. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:07.477118 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-2312dca4-4feb-49bf-b354-659717077833 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Getting quotas for user 5f40c90debe348a28625fec7f7c195db and project 6061653e33774f62bb7f11777e502a0d. Resources: {'key_pairs'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:07.511081 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-2312dca4-4feb-49bf-b354-659717077833 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.267034 Nov 02 14:06:07.512004 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3845/8229] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Nov 2 14:06:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:08.570085 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:08.570930 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:08.575278 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1798308606", "imageRef": "5a18a9e9-495a-4970-9f7b-124577e0709a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2047377629", "security_groups": [{"name": "tempest-secgroup-smoke-502274924"}], "networks": [{"uuid": "cd582e5d-eb4e-4758-86f4-aef63eef673e"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:08.819602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] validate_networks() for [('cd582e5d-eb4e-4758-86f4-aef63eef673e', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:06:09.331063 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:09.331750 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:09.332458 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:09.333074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:09.333542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:09.343600 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:09.344108 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:09.344578 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:09.345332 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:09.345864 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:09.346531 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:09.364147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Getting quotas for project 6061653e33774f62bb7f11777e502a0d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:09.370135 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.quota [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Getting quotas for user 5f40c90debe348a28625fec7f7c195db and project 6061653e33774f62bb7f11777e502a0d. Resources: {'instances', 'ram', 'cores'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:09.383845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:09.386313 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a18a9e9-495a-4970-9f7b-124577e0709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:09.436013 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4b5a45d7-b66c-4aec-80af-1eea3b1a8650 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.868304 Nov 02 14:06:09.436673 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4385/8230] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 14:06:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:06:09.448764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-65ad5c32-4b99-46f0-aa91-aff8671c4c45 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:09.449544 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-65ad5c32-4b99-46f0-aa91-aff8671c4c45 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:09.507738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-65ad5c32-4b99-46f0-aa91-aff8671c4c45 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:09.514893 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-65ad5c32-4b99-46f0-aa91-aff8671c4c45 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1249 microversion: 2.1 time: 0.070863 Nov 02 14:06:09.515816 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3846/8231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:09 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:10.540367 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:10.540987 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:10.547191 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.547698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.548165 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.548925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.549402 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.549851 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.622471 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:10.634031 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a2007886-9557-4687-bc1f-72cccf4969b4 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1301 microversion: 2.1 time: 0.098866 Nov 02 14:06:10.635090 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4386/8232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:10 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:11.659255 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:11.665195 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:11.680487 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:11.681002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:11.681455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:11.683672 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:11.684555 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:11.687267 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:11.971279 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:11.987741 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3bd8e7cf-c1b7-40f4-8022-d9575fd360b6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.332732 Nov 02 14:06:11.989247 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3847/8233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:11 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:12.667875 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-be0d0b14-ed77-4bbb-a87e-c338ef247b8f req-e7b13363-58ce-49a5-a1c5-5ef599dee6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ed47f5-cc6d-4c18-b866-c50bcaf644b3", "tag": "1623c5f0-f6cc-424b-9cdb-bb427df2a152"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:12.679111 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be0d0b14-ed77-4bbb-a87e-c338ef247b8f req-e7b13363-58ce-49a5-a1c5-5ef599dee6ac service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.679925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be0d0b14-ed77-4bbb-a87e-c338ef247b8f req-e7b13363-58ce-49a5-a1c5-5ef599dee6ac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.680563 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-be0d0b14-ed77-4bbb-a87e-c338ef247b8f req-e7b13363-58ce-49a5-a1c5-5ef599dee6ac service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.702101 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-be0d0b14-ed77-4bbb-a87e-c338ef247b8f req-e7b13363-58ce-49a5-a1c5-5ef599dee6ac service nova] Creating event network-changed:1623c5f0-f6cc-424b-9cdb-bb427df2a152 for instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 on n-h2-855650-5 Nov 02 14:06:12.711450 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-be0d0b14-ed77-4bbb-a87e-c338ef247b8f req-e7b13363-58ce-49a5-a1c5-5ef599dee6ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128652 Nov 02 14:06:12.712087 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4387/8234] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:13.012448 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:13.013080 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:13.020441 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.021233 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.022402 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.023263 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.023940 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.024461 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.163078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:13.170974 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-3da91c96-4f74-4be6-9bcd-1d1d731c0b62 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.162477 Nov 02 14:06:13.171562 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3848/8235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:13 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:14.195362 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:14.195998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:14.202296 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:14.202803 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:14.203265 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:14.204004 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:14.204479 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:14.204924 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:14.339585 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:14.347861 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7654aa6e-823c-4299-9daf-35430cccc76a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.157700 Nov 02 14:06:14.348445 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4388/8236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:14 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:15.372223 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:15.372846 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:15.379711 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:15.380210 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:15.380657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:15.381363 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:15.381828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:15.382294 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:15.523819 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:15.531859 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-e92e3d2c-86ea-4157-ba23-a50893ff6da5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.163544 Nov 02 14:06:15.532450 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3849/8237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:15 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:16.554839 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:16.555463 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:16.562324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:16.562820 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:16.563266 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.563963 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:16.564424 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:16.564856 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.704728 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:16.713620 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a155f20-36f1-4298-8a99-d348d6728900 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.162547 Nov 02 14:06:16.714381 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4389/8238] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:16 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:17.736981 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:17.737528 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:17.744828 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.745327 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.745810 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.746554 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.747025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.747458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.881906 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:17.889953 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c57fe0e3-47e4-4d4b-ae1e-e590a8fc7ea0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.156986 Nov 02 14:06:17.890561 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3850/8239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:17 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:18.914708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:18.915292 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:18.921698 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.922247 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.922708 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.923693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.924174 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.924619 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:19.057333 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:19.065415 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb9f2bb9-4a4d-4d12-8809-a1e86996a633 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.155076 Nov 02 14:06:19.066017 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4390/8240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:18 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:20.089204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:20.089832 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:20.092799 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:20.098268 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.098764 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.099214 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.100484 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.100944 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.101375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.238021 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:20.245894 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91b9aaca-2138-401e-99f3-508490e8bbdd tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.160613 Nov 02 14:06:20.246570 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3851/8241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:20 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:20.521013 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-561f0e56-4953-42be-a8fa-86f259bddf28 req-81cafe77-578f-4ee7-86af-361a971c735f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ed47f5-cc6d-4c18-b866-c50bcaf644b3", "name": "network-vif-plugged", "status": "completed", "tag": "1623c5f0-f6cc-424b-9cdb-bb427df2a152"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:20.526598 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:20.527306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:20.534829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-561f0e56-4953-42be-a8fa-86f259bddf28 req-81cafe77-578f-4ee7-86af-361a971c735f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.535336 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-561f0e56-4953-42be-a8fa-86f259bddf28 req-81cafe77-578f-4ee7-86af-361a971c735f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.535792 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-561f0e56-4953-42be-a8fa-86f259bddf28 req-81cafe77-578f-4ee7-86af-361a971c735f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.547490 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-561f0e56-4953-42be-a8fa-86f259bddf28 req-81cafe77-578f-4ee7-86af-361a971c735f service nova] Creating event network-vif-plugged:1623c5f0-f6cc-424b-9cdb-bb427df2a152 for instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 on n-h2-855650-5 Nov 02 14:06:20.553093 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-561f0e56-4953-42be-a8fa-86f259bddf28 req-81cafe77-578f-4ee7-86af-361a971c735f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035715 Nov 02 14:06:20.553710 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4391/8242] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:21.268574 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:21.269203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:21.276194 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.276686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.277132 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.277835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.278330 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.278765 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.410040 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:21.418549 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-822c8ff1-33d4-4d5d-a46c-885c646f60f0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1374 microversion: 2.1 time: 0.153924 Nov 02 14:06:21.419136 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3852/8243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:21 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:22.443386 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:22.444096 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:22.450418 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.450919 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.451372 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.452074 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.452542 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.452979 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.586689 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:22.594856 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7463f481-6a5c-4e34-a8ba-b1a789dd2bd7 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1559 microversion: 2.1 time: 0.156593 Nov 02 14:06:22.595377 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4392/8244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:22 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:22.616915 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:22.617604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:22.624517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.625002 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.625439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.626171 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.626627 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.627055 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.763049 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:22.770986 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0daec2ae-4153-4c4a-b5a9-c8712ffa626b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1559 microversion: 2.1 time: 0.158010 Nov 02 14:06:22.771568 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3853/8245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:22 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:24.770558 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-35c2275f-ba04-47fa-affb-aee417826ff5 req-aa2c2a2a-ab7a-4f98-b8b8-de6c63a5efed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ed47f5-cc6d-4c18-b866-c50bcaf644b3", "tag": "1623c5f0-f6cc-424b-9cdb-bb427df2a152"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:24.780482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-35c2275f-ba04-47fa-affb-aee417826ff5 req-aa2c2a2a-ab7a-4f98-b8b8-de6c63a5efed service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.780975 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-35c2275f-ba04-47fa-affb-aee417826ff5 req-aa2c2a2a-ab7a-4f98-b8b8-de6c63a5efed service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.781422 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-35c2275f-ba04-47fa-affb-aee417826ff5 req-aa2c2a2a-ab7a-4f98-b8b8-de6c63a5efed service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.794538 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-35c2275f-ba04-47fa-affb-aee417826ff5 req-aa2c2a2a-ab7a-4f98-b8b8-de6c63a5efed service nova] Creating event network-changed:1623c5f0-f6cc-424b-9cdb-bb427df2a152 for instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 on n-h2-855650-5 Nov 02 14:06:24.800163 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-35c2275f-ba04-47fa-affb-aee417826ff5 req-aa2c2a2a-ab7a-4f98-b8b8-de6c63a5efed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088505 Nov 02 14:06:24.800883 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4393/8246] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:50.956447 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a729f393-f18f-46ff-992e-9b20bef5c4cb] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:08:50.957320 n-d-855650-5 devstack@n-api.service[120723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a618658-f83a-4e1f-aba5-6ee48de50ace] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:08:50.958181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:50.958947 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=42 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:50.960238 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:08:50.960387 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 14:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3/action (ip 10.222.0.45) !!! Nov 02 14:08:50.961532 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:08:50.961650 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 14:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3/action (ip 10.222.0.45) !!! Nov 02 14:08:50.962701 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:08:50.962824 n-d-855650-5 devstack@n-api.service[120723]: Wed Nov 2 14:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3/action (ip 10.222.0.45) !!! Nov 02 14:08:50.968478 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1107060566"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:50.970783 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:50.986077 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:50.986564 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:50.987003 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:50.987701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:50.988156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:50.988581 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:51.329096 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5398aa16-ccfa-4017-a2f4-e6be87cf5906 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "POST /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3/action" status: 202 len: 0 microversion: 2.1 time: 0.374110 Nov 02 14:08:51.329685 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3854/8247] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 14:08:50 2022] POST /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 02 14:08:59.334104 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:08:59.335273 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2bebab1-6133-44ed-afdc-10bb19e356b1] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:08:59.336032 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:59.336998 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=38 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:59.338161 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:08:59.338315 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 14:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.45) !!! Nov 02 14:08:59.340102 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:08:59.340102 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 14:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.45) !!! Nov 02 14:08:59.341884 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:08:59.341884 n-d-855650-5 devstack@n-api.service[120722]: Wed Nov 2 14:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.45) !!! Nov 02 14:08:59.350379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7e816610-1efe-4929-92cc-d5cb547ad104 req-108a37ef-f820-4d14-820a-c56a92a1b305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ed47f5-cc6d-4c18-b866-c50bcaf644b3", "name": "network-vif-plugged", "status": "completed", "tag": "1623c5f0-f6cc-424b-9cdb-bb427df2a152"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:59.369775 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7e816610-1efe-4929-92cc-d5cb547ad104 req-108a37ef-f820-4d14-820a-c56a92a1b305 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:59.370314 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7e816610-1efe-4929-92cc-d5cb547ad104 req-108a37ef-f820-4d14-820a-c56a92a1b305 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:59.370761 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7e816610-1efe-4929-92cc-d5cb547ad104 req-108a37ef-f820-4d14-820a-c56a92a1b305 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:59.383727 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7e816610-1efe-4929-92cc-d5cb547ad104 req-108a37ef-f820-4d14-820a-c56a92a1b305 service nova] Creating event network-vif-plugged:1623c5f0-f6cc-424b-9cdb-bb427df2a152 for instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 on n-h2-855650-5 Nov 02 14:08:59.391211 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7e816610-1efe-4929-92cc-d5cb547ad104 req-108a37ef-f820-4d14-820a-c56a92a1b305 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059214 Nov 02 14:08:59.391916 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4394/8248] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:10.021186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:10.021977 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:10.027084 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-892251034", "imageRef": "e5ba88cd-f4cb-40bd-b798-c4e140e138c4", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2047377629", "security_groups": [{"name": "tempest-secgroup-smoke-502274924"}], "networks": [{"uuid": "cd582e5d-eb4e-4758-86f4-aef63eef673e"}]}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:10.055725 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] [a729f393-f18f-46ff-992e-9b20bef5c4cb] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42704. Nov 02 14:09:10.056441 n-d-855650-5 devstack@n-api.service[120723]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a618658-f83a-4e1f-aba5-6ee48de50ace] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42706. Nov 02 14:09:10.146379 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.network.neutron [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] validate_networks() for [('cd582e5d-eb4e-4758-86f4-aef63eef673e', None, None, None, None, None)] {{(pid=120723) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:09:10.582590 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Flavor limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:09:10.583025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Image limits 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:09:10.583514 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Flavor pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:09:10.583934 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Image pref 0:0:0 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:09:10.584357 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.virt.hardware [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:09:10.593613 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:10.594125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:10.594568 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:10.595302 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:10.595761 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:10.596187 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:10.612887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Getting quotas for project 6061653e33774f62bb7f11777e502a0d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:09:10.618766 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.quota [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Getting quotas for user 5f40c90debe348a28625fec7f7c195db and project 6061653e33774f62bb7f11777e502a0d. Resources: {'instances', 'ram', 'cores'} {{(pid=120723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:09:10.631200 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Going to run 1 instances... {{(pid=120723) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:09:10.634439 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5ba88cd-f4cb-40bd-b798-c4e140e138c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:09:10.683287 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c87a394a-04c4-4c99-b4c1-247eb75b3d77 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.664192 Nov 02 14:09:10.683947 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3855/8249] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Nov 2 14:09:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:09:10.696918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6c17b335-800e-476e-9104-716112d8a24c tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:10.697734 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c17b335-800e-476e-9104-716112d8a24c tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:10.701883 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:10.702595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:10.719830 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [bba6959d-459a-4664-88e6-7a153141c4e2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42726. Nov 02 14:09:10.721989 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2bebab1-6133-44ed-afdc-10bb19e356b1] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 42728. Nov 02 14:09:10.775238 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-6c17b335-800e-476e-9104-716112d8a24c tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:10.783106 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6c17b335-800e-476e-9104-716112d8a24c tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1248 microversion: 2.1 time: 0.091381 Nov 02 14:09:10.783677 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4395/8250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:10 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:09:11.806855 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f5b23f8f-e354-4f11-8eb4-fcf865171f12 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:11.807469 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f5b23f8f-e354-4f11-8eb4-fcf865171f12 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:11.874125 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f5b23f8f-e354-4f11-8eb4-fcf865171f12 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:11.884510 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f5b23f8f-e354-4f11-8eb4-fcf865171f12 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1248 microversion: 2.1 time: 0.082237 Nov 02 14:09:11.896531 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3856/8251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:11 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:12.908436 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec6ba900-f9f1-4bff-9af3-70bba1c41598 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:12.909076 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec6ba900-f9f1-4bff-9af3-70bba1c41598 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:12.964273 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec6ba900-f9f1-4bff-9af3-70bba1c41598 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:12.971692 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec6ba900-f9f1-4bff-9af3-70bba1c41598 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1248 microversion: 2.1 time: 0.067159 Nov 02 14:09:12.972428 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4396/8252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:12 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:13.403156 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-189dbadf-25ee-47d8-a06c-bbc98390a917 req-641f7d28-62b9-4083-b3fc-16881d7ad628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ed47f5-cc6d-4c18-b866-c50bcaf644b3", "name": "network-vif-unplugged", "status": "completed", "tag": "1623c5f0-f6cc-424b-9cdb-bb427df2a152"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:13.414107 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-189dbadf-25ee-47d8-a06c-bbc98390a917 req-641f7d28-62b9-4083-b3fc-16881d7ad628 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:13.414758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-189dbadf-25ee-47d8-a06c-bbc98390a917 req-641f7d28-62b9-4083-b3fc-16881d7ad628 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:13.415201 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-189dbadf-25ee-47d8-a06c-bbc98390a917 req-641f7d28-62b9-4083-b3fc-16881d7ad628 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:13.425935 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-189dbadf-25ee-47d8-a06c-bbc98390a917 req-641f7d28-62b9-4083-b3fc-16881d7ad628 service nova] Creating event network-vif-unplugged:1623c5f0-f6cc-424b-9cdb-bb427df2a152 for instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 on n-h2-855650-5 Nov 02 14:09:13.431338 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-189dbadf-25ee-47d8-a06c-bbc98390a917 req-641f7d28-62b9-4083-b3fc-16881d7ad628 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092134 Nov 02 14:09:13.432023 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3857/8253] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:13.995351 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-494d4ea5-081a-4703-898c-51a072012af9 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:13.995897 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-494d4ea5-081a-4703-898c-51a072012af9 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:14.049305 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-494d4ea5-081a-4703-898c-51a072012af9 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:14.057462 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-494d4ea5-081a-4703-898c-51a072012af9 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1248 microversion: 2.1 time: 0.066542 Nov 02 14:09:14.057887 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4397/8254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:13 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:15.082025 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:15.082738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:15.089202 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:15.089701 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:15.090181 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:15.090887 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:15.091350 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:15.091785 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:15.156064 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:15.163875 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0629356e-c38a-4ddc-9fee-93ac35ffb528 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1252 microversion: 2.1 time: 0.087100 Nov 02 14:09:15.164446 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3858/8255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:15 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1252 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:16.187152 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:16.187787 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:16.196243 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:16.196829 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:16.197518 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:16.198344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:16.198934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:16.199454 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:16.284752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:16.297549 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d0364f90-7370-4224-9fb9-74ae8b8941b5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1306 microversion: 2.1 time: 0.114007 Nov 02 14:09:16.299606 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4398/8256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:16 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:17.326859 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:17.328122 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:17.336686 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:17.337218 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:17.337652 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:17.338405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:17.339029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:17.339297 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:17.481359 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:17.489297 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0fa14c46-2255-4720-8cae-a9cdc62fe6c2 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.166467 Nov 02 14:09:17.489873 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3859/8257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:17 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:18.513370 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:18.514029 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:18.520833 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:18.521568 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:18.522228 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:18.523710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:18.524339 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:18.524937 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:18.671814 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:18.680063 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e29b1c1d-10a1-4884-b5f3-7ffc8725b967 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.170554 Nov 02 14:09:18.680840 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4399/8258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:18 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:19.705594 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:19.706340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:19.714450 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:19.714948 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:19.715393 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:19.716104 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:19.716570 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:19.717005 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:19.867246 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:19.876148 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d0e5b7e2-791d-450b-adb6-a540a32725d3 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.174913 Nov 02 14:09:19.876754 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3860/8259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:19 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:20.902193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:20.902746 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:20.909201 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:20.909716 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:20.914468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:20.915245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:20.915737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:20.916185 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:21.068475 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:21.077022 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f69ee58-a985-4020-b67c-333235845c68 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.179945 Nov 02 14:09:21.077618 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4400/8260] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:20 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:22.100664 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:22.101856 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:22.105412 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:22.106723 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:22.112446 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:22.112954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:22.113405 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:22.114172 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:22.114636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:22.115189 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:22.278023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:22.286217 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-a271742e-9ac4-41ec-8757-a519a51b83dc tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.189298 Nov 02 14:09:22.287021 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3861/8261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:22 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:23.311000 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:23.311866 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:23.319079 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:23.319720 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:23.320670 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:23.321400 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:23.322034 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:23.322344 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:23.464752 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:23.473133 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-13fe72a6-4767-44be-96e4-6219b095d959 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.166511 Nov 02 14:09:23.473921 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4401/8262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:23 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:24.496517 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:24.497072 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:24.503965 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:24.504455 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:24.504902 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:24.505604 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:24.506089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:24.506807 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:24.637575 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:24.645355 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-064335dc-62b9-4360-b088-85a396cd5ab0 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.152804 Nov 02 14:09:24.645934 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3862/8263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:24 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:25.669737 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:25.670411 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:25.672363 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:25.679306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:25.679825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:25.680468 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:25.681192 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:25.681669 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:25.682147 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:26.218379 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:26.226686 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b9c8605-117c-4cdf-a5c3-9a7fa6c913db tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.560504 Nov 02 14:09:26.227296 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4402/8264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:25 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:26.752511 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-6bbd517a-c0ad-4310-86c5-933590599da2 req-cfd8eb7c-6334-4e5c-a210-3626268c199f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2762b4bc-b2ca-438b-8fae-824f8c1f6e1a", "tag": "a124f214-1307-4922-ab2d-8c4df93be12a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:26.769169 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6bbd517a-c0ad-4310-86c5-933590599da2 req-cfd8eb7c-6334-4e5c-a210-3626268c199f service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:26.769907 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6bbd517a-c0ad-4310-86c5-933590599da2 req-cfd8eb7c-6334-4e5c-a210-3626268c199f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:26.770524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-6bbd517a-c0ad-4310-86c5-933590599da2 req-cfd8eb7c-6334-4e5c-a210-3626268c199f service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:26.784307 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-6bbd517a-c0ad-4310-86c5-933590599da2 req-cfd8eb7c-6334-4e5c-a210-3626268c199f service nova] Creating event network-changed:a124f214-1307-4922-ab2d-8c4df93be12a for instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a on n-h1-855650-5 Nov 02 14:09:26.789862 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-6bbd517a-c0ad-4310-86c5-933590599da2 req-cfd8eb7c-6334-4e5c-a210-3626268c199f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042561 Nov 02 14:09:26.790853 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3863/8265] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:27.250272 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:27.250825 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:27.258567 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:27.259065 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:27.259525 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:27.260239 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:27.260712 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:27.261151 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:27.396119 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:27.403873 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5108c341-8754-493a-a5b3-69eee0eb8287 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.157710 Nov 02 14:09:27.404456 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4403/8266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:27 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:28.437286 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:28.440667 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:28.462342 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:28.462861 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:28.464304 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:28.465124 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:28.467464 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:28.468224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:28.613238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:28.621500 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f76e69c0-74de-45f9-93c3-a502431a292e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.194564 Nov 02 14:09:28.622098 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3864/8267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:28 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:29.644788 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:29.645544 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:29.652503 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:29.653017 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:29.653470 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:29.654225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:29.654693 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:29.655122 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:29.802133 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:29.810502 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c74bbd6d-0028-4333-9609-5c9a8f376e3e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.169702 Nov 02 14:09:29.811084 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4404/8268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:29 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:30.833671 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:30.834291 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:30.841231 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:30.841720 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:30.842192 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:30.843144 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:30.843600 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:30.844029 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:30.982788 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:30.990587 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-eded1417-a6fd-4c51-9ffa-b5470baf7c51 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.160728 Nov 02 14:09:30.991661 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3865/8269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:30 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:32.014250 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:32.014892 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:32.021923 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:32.023056 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:32.023528 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:32.024245 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:32.024725 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:32.025169 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:32.170225 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:32.178818 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b4ca65f2-97e6-422e-bddf-fefdf5c2d817 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.168457 Nov 02 14:09:32.180066 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4405/8270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:32 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:32.375186 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1d1c098d-0eeb-4b0e-87b3-6140a20f3659 req-80725a18-c9fd-45a3-8795-c2d731de9115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2762b4bc-b2ca-438b-8fae-824f8c1f6e1a", "name": "network-vif-plugged", "status": "completed", "tag": "a124f214-1307-4922-ab2d-8c4df93be12a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:32.387789 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1d1c098d-0eeb-4b0e-87b3-6140a20f3659 req-80725a18-c9fd-45a3-8795-c2d731de9115 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:32.388282 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1d1c098d-0eeb-4b0e-87b3-6140a20f3659 req-80725a18-c9fd-45a3-8795-c2d731de9115 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:32.388717 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1d1c098d-0eeb-4b0e-87b3-6140a20f3659 req-80725a18-c9fd-45a3-8795-c2d731de9115 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:32.400266 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1d1c098d-0eeb-4b0e-87b3-6140a20f3659 req-80725a18-c9fd-45a3-8795-c2d731de9115 service nova] Creating event network-vif-plugged:a124f214-1307-4922-ab2d-8c4df93be12a for instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a on n-h1-855650-5 Nov 02 14:09:32.405601 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1d1c098d-0eeb-4b0e-87b3-6140a20f3659 req-80725a18-c9fd-45a3-8795-c2d731de9115 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034184 Nov 02 14:09:32.406204 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3866/8271] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:33.203148 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:33.203781 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:33.211249 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.211755 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.212216 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:33.212926 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.213398 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.213845 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:33.345382 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:33.353903 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3282dcc3-b24f-4039-83cc-326d1b947f7a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1373 microversion: 2.1 time: 0.154771 Nov 02 14:09:33.354513 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4406/8272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:33 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:34.378458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:34.379203 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:34.385632 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:34.386199 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:34.386655 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:34.387368 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:34.387835 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:34.388273 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:34.527637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:34.535567 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ccea006c-27f5-499e-8e39-6eb36795d85e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1558 microversion: 2.1 time: 0.162281 Nov 02 14:09:34.536148 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3867/8273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:34 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:34.558431 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:34.559067 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:34.565885 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:34.566428 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:34.566888 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:34.567602 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:34.568077 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:34.568521 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:34.704011 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:34.712397 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c51c8c4e-8293-4e99-81c0-999c58d6c5d5 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1558 microversion: 2.1 time: 0.157829 Nov 02 14:09:34.712976 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4407/8274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:34 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:36.308391 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-aca6c170-190b-4231-aa7a-2a74a92aff73 req-17c159ce-44e9-4e7a-bc85-55f9c961bb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2762b4bc-b2ca-438b-8fae-824f8c1f6e1a", "tag": "a124f214-1307-4922-ab2d-8c4df93be12a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:36.318885 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aca6c170-190b-4231-aa7a-2a74a92aff73 req-17c159ce-44e9-4e7a-bc85-55f9c961bb43 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:36.319524 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aca6c170-190b-4231-aa7a-2a74a92aff73 req-17c159ce-44e9-4e7a-bc85-55f9c961bb43 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:36.319956 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aca6c170-190b-4231-aa7a-2a74a92aff73 req-17c159ce-44e9-4e7a-bc85-55f9c961bb43 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:36.335550 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-aca6c170-190b-4231-aa7a-2a74a92aff73 req-17c159ce-44e9-4e7a-bc85-55f9c961bb43 service nova] Creating event network-changed:a124f214-1307-4922-ab2d-8c4df93be12a for instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a on n-h1-855650-5 Nov 02 14:09:36.341123 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-aca6c170-190b-4231-aa7a-2a74a92aff73 req-17c159ce-44e9-4e7a-bc85-55f9c961bb43 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036456 Nov 02 14:09:36.342110 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3868/8275] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:38.728054 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=34 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:38.728745 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=60 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:38.788172 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1318201931"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:38.790665 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:38.796710 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:38.797206 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:38.797658 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:38.798393 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:38.798865 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:38.799306 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:39.052647 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-263dc4f1-0dce-41bd-af3e-b7676e55a6be tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "POST /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.326516 Nov 02 14:11:39.053313 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4408/8276] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Nov 2 14:11:38 2022] POST /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 14:11:45.000904 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:45.001738 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=58 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:45.006841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-aa0c313f-72ef-40f1-8110-c4ff2ab5c193 req-c76699ae-308f-4dec-9ca6-f295913f9764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2762b4bc-b2ca-438b-8fae-824f8c1f6e1a", "name": "network-vif-plugged", "status": "completed", "tag": "a124f214-1307-4922-ab2d-8c4df93be12a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:45.018730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aa0c313f-72ef-40f1-8110-c4ff2ab5c193 req-c76699ae-308f-4dec-9ca6-f295913f9764 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:45.019224 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aa0c313f-72ef-40f1-8110-c4ff2ab5c193 req-c76699ae-308f-4dec-9ca6-f295913f9764 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:45.019844 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-aa0c313f-72ef-40f1-8110-c4ff2ab5c193 req-c76699ae-308f-4dec-9ca6-f295913f9764 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:45.032882 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-aa0c313f-72ef-40f1-8110-c4ff2ab5c193 req-c76699ae-308f-4dec-9ca6-f295913f9764 service nova] Creating event network-vif-plugged:a124f214-1307-4922-ab2d-8c4df93be12a for instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a on n-h1-855650-5 Nov 02 14:11:45.038635 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-aa0c313f-72ef-40f1-8110-c4ff2ab5c193 req-c76699ae-308f-4dec-9ca6-f295913f9764 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039792 Nov 02 14:11:45.039301 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3869/8277] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:57.811829 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:57.812500 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:57.812874 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:57.813032 n-d-855650-5 devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=2 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:57.816918 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:57.817758 n-d-855650-5 devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:57.822146 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.822727 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.823194 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:57.823925 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.824560 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.825024 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:57.856082 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:11:57.873826 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [req-1bfd69cd-36be-4f51-b0c3-244e23c533ad req-24b1d9e2-53bc-4ff8-af04-40a6939e2824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2762b4bc-b2ca-438b-8fae-824f8c1f6e1a", "tag": "a124f214-1307-4922-ab2d-8c4df93be12a"}]} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:57.884250 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1bfd69cd-36be-4f51-b0c3-244e23c533ad req-24b1d9e2-53bc-4ff8-af04-40a6939e2824 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.885089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1bfd69cd-36be-4f51-b0c3-244e23c533ad req-24b1d9e2-53bc-4ff8-af04-40a6939e2824 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.886150 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [req-1bfd69cd-36be-4f51-b0c3-244e23c533ad req-24b1d9e2-53bc-4ff8-af04-40a6939e2824 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:57.900253 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.compute.server_external_events [req-1bfd69cd-36be-4f51-b0c3-244e23c533ad req-24b1d9e2-53bc-4ff8-af04-40a6939e2824 service nova] Creating event network-changed:a124f214-1307-4922-ab2d-8c4df93be12a for instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a on n-h1-855650-5 Nov 02 14:11:57.906683 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [req-1bfd69cd-36be-4f51-b0c3-244e23c533ad req-24b1d9e2-53bc-4ff8-af04-40a6939e2824 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096923 Nov 02 14:11:57.907685 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3870/8278] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:57.941875 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1656a6e7-4c4c-44e3-9f7e-0635c9447599 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 204 len: 0 microversion: 2.1 time: 0.134093 Nov 02 14:11:57.942412 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4409/8279] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 14:11:57 2022] DELETE /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:57.954591 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:57.955657 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:57.965812 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.966889 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.967344 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:57.968067 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.968532 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.969238 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.107059 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:58.115394 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-858123bc-6815-4376-aa04-21889f5b414e tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1682 microversion: 2.1 time: 0.166358 Nov 02 14:11:58.115986 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3871/8280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:57 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:59.006101 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-05cbbadd-06ff-4d2f-aef2-48d4d3d74d7e req-08a3755b-10ba-43f7-8e39-b4d5724ea5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2762b4bc-b2ca-438b-8fae-824f8c1f6e1a", "name": "network-vif-unplugged", "status": "completed", "tag": "a124f214-1307-4922-ab2d-8c4df93be12a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:59.018562 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-05cbbadd-06ff-4d2f-aef2-48d4d3d74d7e req-08a3755b-10ba-43f7-8e39-b4d5724ea5a8 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:59.019340 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-05cbbadd-06ff-4d2f-aef2-48d4d3d74d7e req-08a3755b-10ba-43f7-8e39-b4d5724ea5a8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:59.020031 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-05cbbadd-06ff-4d2f-aef2-48d4d3d74d7e req-08a3755b-10ba-43f7-8e39-b4d5724ea5a8 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:59.033730 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-05cbbadd-06ff-4d2f-aef2-48d4d3d74d7e req-08a3755b-10ba-43f7-8e39-b4d5724ea5a8 service nova] Creating event network-vif-unplugged:a124f214-1307-4922-ab2d-8c4df93be12a for instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a on n-h1-855650-5 Nov 02 14:11:59.039153 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-05cbbadd-06ff-4d2f-aef2-48d4d3d74d7e req-08a3755b-10ba-43f7-8e39-b4d5724ea5a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037205 Nov 02 14:11:59.040112 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4410/8281] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:11:59.139843 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:59.140486 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:59.147403 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:59.147908 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:59.148328 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:59.149023 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:59.149476 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:59.149901 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:59.289089 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:59.297953 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-408307f7-be7e-43e9-a831-e62b8f233d4a tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1682 microversion: 2.1 time: 0.161973 Nov 02 14:11:59.298569 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3872/8282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:59 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:00.275927 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-df81956c-6b1d-4056-817f-144c0b60e2eb req-2e1be287-7fc7-44f4-b04f-6751f802f8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2762b4bc-b2ca-438b-8fae-824f8c1f6e1a", "name": "network-vif-deleted", "tag": "a124f214-1307-4922-ab2d-8c4df93be12a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:00.285808 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-df81956c-6b1d-4056-817f-144c0b60e2eb req-2e1be287-7fc7-44f4-b04f-6751f802f8ec service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.286349 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-df81956c-6b1d-4056-817f-144c0b60e2eb req-2e1be287-7fc7-44f4-b04f-6751f802f8ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.286796 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-df81956c-6b1d-4056-817f-144c0b60e2eb req-2e1be287-7fc7-44f4-b04f-6751f802f8ec service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.299243 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-df81956c-6b1d-4056-817f-144c0b60e2eb req-2e1be287-7fc7-44f4-b04f-6751f802f8ec service nova] Creating event network-vif-deleted:a124f214-1307-4922-ab2d-8c4df93be12a for instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a on n-h1-855650-5 Nov 02 14:12:00.305152 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-df81956c-6b1d-4056-817f-144c0b60e2eb req-2e1be287-7fc7-44f4-b04f-6751f802f8ec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086172 Nov 02 14:12:00.305835 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4411/8283] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:00.320841 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:00.321458 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:00.328827 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.329332 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.329797 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.330536 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.331134 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.331578 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.365792 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.366312 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.366750 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.367204 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.objects.instance [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lazy-loading 'fault' on Instance uuid 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a {{(pid=120723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:12:00.409388 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:00.417637 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0b7ff049-0bf4-4687-9ed1-ebd57a5fcb25 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 200 len: 1338 microversion: 2.1 time: 0.100815 Nov 02 14:12:00.418232 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3873/8284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:00 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:01.441849 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:01.442595 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:01.449632 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:01.450176 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:01.451217 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:01.451932 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:01.452407 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:01.452855 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:01.466197 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] HTTP exception thrown: Instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a could not be found. Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Request method failure captured: Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a HTTP/1.1 Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: Accept: application/json Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: Accept-Encoding: identity Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: Connection: close Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: Content-Length: 0 Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: Content-Type: application/json Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: Host: 10.222.0.45 Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: Openstack-System-Scope: None Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjYnlJkYOZ2hvD4wQnbhtdBrfVNz9ovnaVdQg2QP0kzQ_zhZJZTpDq8qs1h9DjxxknYvcVwKJ0RFu1kK34i_yoHks1OwYK5NpuH4c7OcQvHFniMXtbPIJwQLNVk9rSN4kBOHAV2SOMXbxE8VgEyhFgnZad4PaMtCJgqDu5Eo5sMChKuOo Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Id: None Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Domain-Name: None Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Identity-Status: Confirmed Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Is-Admin-Project: True Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Id: default Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Domain-Name: Default Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Id: 6061653e33774f62bb7f11777e502a0d Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Project-Name: tempest-TestSnapshotPattern-37670165 Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Role: member,reader Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Roles: member,reader Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6061653e33774f62bb7f11777e502a0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6061653e33774f62bb7f11777e502a0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6061653e33774f62bb7f11777e502a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6061653e33774f62bb7f11777e502a0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant: tempest-TestSnapshotPattern-37670165 Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Id: 6061653e33774f62bb7f11777e502a0d Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestSnapshotPattern-37670165 Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-User: tempest-TestSnapshotPattern-37670165-project Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Id: default Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-User-Domain-Name: Default Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-User-Id: 5f40c90debe348a28625fec7f7c195db Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: X-User-Name: tempest-TestSnapshotPattern-37670165-project Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: method: > Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: exception: Instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a could not be found. Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: action_args: {'id': '2762b4bc-b2ca-438b-8fae-824f8c1f6e1a'} Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a could not be found. Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a could not be found. Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:01.467853 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a could not be found. Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Returning 404 to user: Instance 2762b4bc-b2ca-438b-8fae-824f8c1f6e1a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11294d9c-3897-40a5-abdf-96dbed5e087b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a" status: 404 len: 111 microversion: 2.1 time: 0.032058 Nov 02 14:12:01.472098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4412/8285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:01 2022] GET /compute/v2.1/servers/2762b4bc-b2ca-438b-8fae-824f8c1f6e1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:02.797436 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:02.797954 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:02.799847 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-93e4c2d6-ccee-4c23-ac1d-7d1b91bb3431 req-ce2687e9-b783-48c4-9edf-c2e9984e1b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ed47f5-cc6d-4c18-b866-c50bcaf644b3", "tag": "1623c5f0-f6cc-424b-9cdb-bb427df2a152"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:02.805074 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:02.805651 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:02.806215 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:02.806995 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:02.807538 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:02.808035 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:02.811432 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-93e4c2d6-ccee-4c23-ac1d-7d1b91bb3431 req-ce2687e9-b783-48c4-9edf-c2e9984e1b33 service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:02.811934 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-93e4c2d6-ccee-4c23-ac1d-7d1b91bb3431 req-ce2687e9-b783-48c4-9edf-c2e9984e1b33 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:02.812384 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-93e4c2d6-ccee-4c23-ac1d-7d1b91bb3431 req-ce2687e9-b783-48c4-9edf-c2e9984e1b33 service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:02.823204 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-93e4c2d6-ccee-4c23-ac1d-7d1b91bb3431 req-ce2687e9-b783-48c4-9edf-c2e9984e1b33 service nova] Creating event network-changed:1623c5f0-f6cc-424b-9cdb-bb427df2a152 for instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 on n-h2-855650-5 Nov 02 14:12:02.828943 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-93e4c2d6-ccee-4c23-ac1d-7d1b91bb3431 req-ce2687e9-b783-48c4-9edf-c2e9984e1b33 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032718 Nov 02 14:12:02.830009 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4413/8286] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:12:02.837838 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Going to try to terminate instance {{(pid=120723) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:12:02.937342 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-64985c62-4402-47ee-8cf6-5dbb643cdfc6 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "DELETE /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 204 len: 0 microversion: 2.1 time: 0.143326 Nov 02 14:12:02.938600 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3874/8287] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Nov 2 14:12:02 2022] DELETE /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:02.949058 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:02.949893 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:02.957456 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:02.958030 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:02.958672 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:02.959555 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:02.960036 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:02.960482 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:03.099324 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.policy [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:03.108303 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bdd343f4-111a-4b6c-8d28-e3b798ff942d tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1684 microversion: 2.1 time: 0.164131 Nov 02 14:12:03.109098 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4414/8288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:02 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:04.133503 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:04.134340 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:04.141314 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:04.141851 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:04.142730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:04.143498 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:04.144147 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:04.144730 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:04.370425 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.policy [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f40c90debe348a28625fec7f7c195db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6061653e33774f62bb7f11777e502a0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120723) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:04.379054 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-98e12907-3535-426a-90f8-c57f0acd8784 tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 200 len: 1565 microversion: 2.1 time: 0.250498 Nov 02 14:12:04.379769 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3875/8289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:04 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 1565 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:04.846760 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3b29e16d-2ff5-4af8-a4b8-8d395abf7a6d req-268aec63-a7d0-453a-96b7-cd352f7df9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ed47f5-cc6d-4c18-b866-c50bcaf644b3", "name": "network-vif-deleted", "tag": "1623c5f0-f6cc-424b-9cdb-bb427df2a152"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:04.857186 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3b29e16d-2ff5-4af8-a4b8-8d395abf7a6d req-268aec63-a7d0-453a-96b7-cd352f7df9fd service nova] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:04.858107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3b29e16d-2ff5-4af8-a4b8-8d395abf7a6d req-268aec63-a7d0-453a-96b7-cd352f7df9fd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:04.858107 n-d-855650-5 devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3b29e16d-2ff5-4af8-a4b8-8d395abf7a6d req-268aec63-a7d0-453a-96b7-cd352f7df9fd service nova] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:04.869279 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3b29e16d-2ff5-4af8-a4b8-8d395abf7a6d req-268aec63-a7d0-453a-96b7-cd352f7df9fd service nova] Creating event network-vif-deleted:1623c5f0-f6cc-424b-9cdb-bb427df2a152 for instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 on n-h2-855650-5 Nov 02 14:12:04.873996 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3b29e16d-2ff5-4af8-a4b8-8d395abf7a6d req-268aec63-a7d0-453a-96b7-cd352f7df9fd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031267 Nov 02 14:12:04.874600 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4415/8290] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:12:05.403758 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:05.404375 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.compute.api [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [instance: 41ed47f5-cc6d-4c18-b866-c50bcaf644b3] Fetching instance by UUID {{(pid=120723) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:05.411148 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.411637 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.412078 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:05.412763 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Acquiring lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.413216 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.413636 n-d-855650-5 devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Lock "65f1d099-06e8-4a99-9e09-ba8e4a1a8185" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:05.427490 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] HTTP exception thrown: Instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 could not be found. Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Request method failure captured: Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: request: GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 HTTP/1.1 Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: Accept: application/json Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: Accept-Encoding: identity Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: Connection: close Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: Content-Length: 0 Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: Content-Type: application/json Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: Host: 10.222.0.45 Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: Openstack-System-Scope: None Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Auth-Token: gAAAAABjYnlJkYOZ2hvD4wQnbhtdBrfVNz9ovnaVdQg2QP0kzQ_zhZJZTpDq8qs1h9DjxxknYvcVwKJ0RFu1kK34i_yoHks1OwYK5NpuH4c7OcQvHFniMXtbPIJwQLNVk9rSN4kBOHAV2SOMXbxE8VgEyhFgnZad4PaMtCJgqDu5Eo5sMChKuOo Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Id: None Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Domain-Name: None Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Identity-Status: Confirmed Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Is-Admin-Project: True Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Id: default Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Domain-Name: Default Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Id: 6061653e33774f62bb7f11777e502a0d Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Project-Name: tempest-TestSnapshotPattern-37670165 Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Role: member,reader Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Roles: member,reader Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6061653e33774f62bb7f11777e502a0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6061653e33774f62bb7f11777e502a0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6061653e33774f62bb7f11777e502a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6061653e33774f62bb7f11777e502a0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant: tempest-TestSnapshotPattern-37670165 Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Id: 6061653e33774f62bb7f11777e502a0d Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-Tenant-Name: tempest-TestSnapshotPattern-37670165 Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-User: tempest-TestSnapshotPattern-37670165-project Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Id: default Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-User-Domain-Name: Default Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-User-Id: 5f40c90debe348a28625fec7f7c195db Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: X-User-Name: tempest-TestSnapshotPattern-37670165-project Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: method: > Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: exception: Instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 could not be found. Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: action_args: {'id': '41ed47f5-cc6d-4c18-b866-c50bcaf644b3'} Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 could not be found. Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 could not be found. Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:05.429141 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 could not be found. Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Returning 404 to user: Instance 41ed47f5-cc6d-4c18-b866-c50bcaf644b3 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-1c92e95f-8a7a-47de-a2bd-abcd0f935fde tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3" status: 404 len: 111 microversion: 2.1 time: 0.030739 Nov 02 14:12:05.433142 n-d-855650-5 devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3876/8291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:05 2022] GET /compute/v2.1/servers/41ed47f5-cc6d-4c18-b866-c50bcaf644b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:05.593193 n-d-855650-5 devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a0491f5e-082c-4cae-8ff6-7ae1d1c3e75b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] Calling method '.version_select at 0x7f228d9bee50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:05.597781 n-d-855650-5 devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a0491f5e-082c-4cae-8ff6-7ae1d1c3e75b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:12:06.605239 n-d-855650-5 devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [None req-a0491f5e-082c-4cae-8ff6-7ae1d1c3e75b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] [36f97ff6-3c49-4721-91c1-b13870b548cf] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43150. Nov 02 14:12:06.627195 n-d-855650-5 devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a0491f5e-082c-4cae-8ff6-7ae1d1c3e75b tempest-TestSnapshotPattern-37670165 tempest-TestSnapshotPattern-37670165-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2047377629" status: 202 len: 0 microversion: 2.1 time: 1.038855 Nov 02 14:12:06.627831 n-d-855650-5 devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4416/8292] 10.222.0.45 () {58 vars in 1257 bytes} [Wed Nov 2 14:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2047377629 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)